Skip to main content
SpringerLink
Log in

A Proof of Concept Integrated Multi-systems Approach for Large Scale Tactile Feedback in VR

  • Conference paper
  • First Online:
Augmented Reality, Virtual Reality, and Computer Graphics (AVR 2019)

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 11613))

Abstract

It is well understood that multi-sensory stimulation can be used to enhance immersion in virtual environments such as Virtual Reality (VR) and Augmented Reality (AR). State of the art VR technologies have enhanced visual stimulation in aspects such as pixel density in recent years, whilst the area of haptics has remained less developed. The Ultrahaptics Evaluation Kit is a relatively new technology that consists of a \(16\times 16\) array of ultrasound transducers used to create ultrasound haptic sensations. We have developed a proof of concept large scale haptic system by integrating this device with an HTC VIVE, Leap Motion and Rethink Robotics’ Baxter Robot to provide ultrasound haptic feedback in a volume greater than 1.5 m\(^3\) for VR users. The system was evaluated through a user study with 19 participants. The study focused on users’ assessments of the location of the haptics produced by the system. The results of the study offer a means of validating the system, as well as providing comparisons in accuracy for a haptic perception task vs a visual perception task. There have been opportunities recognised for improving accuracy of the system. However, the system has been deemed suitable in creating haptic feedback for low fidelity models within large volumes in VR.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 59.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 79.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Blake, J., Gurocak, H.B.: Haptic glove with mr brakes for virtual reality. IEEE/ASME Trans. Mechatron. 14(5), 606–615 (2009). https://doi.org/10.1109/TMECH.2008.2010934

    Article  Google Scholar 

  2. Brice, D., Devine, S., Rafferty, K.: A novel force feedback haptics system with applications in phobia treatment (2017)

    Google Scholar 

  3. Carter, T., Seah, S., Long, B., Drinkwater, B., Subramanian, S.: Ultrahaptics: multi-point mid-air haptic feedback for touch surfaces. In: UIST 2013 Proceedings of the 26th Annual ACM Symposium on User Interface Software and Technology, UIST 2013. Association for Computing Machinery (ACM), October 2013. https://doi.org/10.1145/2501988.2502018

  4. Corbett-Davies, S., Dünser, A., Clark, A.: Interactive AR exposure therapy. In: Proceedings of the 13th International Conference of the NZ Chapter of the ACM’s Special Interest Group on Human-Computer Interaction, CHINZ 2012, p. 98. ACM, New York (2012). https://doi.org/10.1145/2379256.2379282

  5. Covarrubias, M., Bordegoni, M.: Immersive VR for natural interaction with a haptic interface for shape rendering. In: 2015 IEEE 1st International Forum on Research and Technologies for Society and Industry Leveraging a Better Tomorrow (RTSI), pp. 82–89, September 2015. https://doi.org/10.1109/RTSI.2015.7325075

  6. Cremer, S., Mastromoro, L., Popa, D.O.: On the performance of the Baxter research robot. In: 2016 IEEE International Symposium on Assembly and Manufacturing (ISAM), pp. 106–111, August 2016. https://doi.org/10.1109/ISAM.2016.7750722

  7. Dexmo: Dexmo (2008). http://www.dextarobotics.com/. Accessed 14 Feb 2018

  8. Dunbar, B., et al.: Augmenting human spatial navigation via sensory substitution. In: 2017 IEEE MIT Undergraduate Research Technology Conference (URTC), pp. 1–4, November 2017. https://doi.org/10.1109/URTC.2017.8284172

  9. Garage, W.: MoveIt (2008). http://moveit.ros.org/. Accessed 14 Feb 2018

  10. Geomagic: Phantom Omni (2011). http://www.geomagic.com/en/products/phantom-omni/overview. Accessed 14 Feb 2018

  11. Guo, J., Guo, S.: A haptic interface design for a VR-based unskilled doctor training system in vascular interventional surgery. In: 2014 IEEE International Conference on Mechatronics and Automation, pp. 1259–1263, August 2014. https://doi.org/10.1109/ICMA.2014.6885880

  12. Han, P.H., et al.: OoEs: playing in the immersive game with augmented haptics. In: ACM SIGGRAPH 2016 VR Village, SIGGRAPH 2016, p. 15:1. ACM, New York (2016). https://doi.org/10.1145/2929490.2929895

  13. Hoshi, T., Takahashi, M., Iwamoto, T., Shinoda, H.: Noncontact tactile display based on radiation pressure of airborne ultrasound. IEEE Trans. Haptics 3(3), 155–165 (2010). https://doi.org/10.1109/TOH.2010.4

    Article  Google Scholar 

  14. HTC: HTC Vive (2011). https://www.vive.com/uk/. Accessed 14 Feb 2018

  15. Iwamoto, T., Tatezono, M., Shinoda, H.: Non-contact method for producing tactile sensation using airborne ultrasound. In: Ferre, M. (ed.) EuroHaptics 2008. LNCS, vol. 5024, pp. 504–513. Springer, Heidelberg (2008). https://doi.org/10.1007/978-3-540-69057-3_64

    Chapter  Google Scholar 

  16. de Jesus Oliveira, V.A., Brayda, L., Nedel, L., Maciel, A.: Experiencing guidance in 3D spaces with a vibrotactile head-mounted display. In: 2017 IEEE Virtual Reality (VR), pp. 453–454, March 2017. https://doi.org/10.1109/VR.2017.7892375

  17. Knopp, S., Lorenz, M., Pelliccia, L., Klimant, P.: Using industrial robots as haptic devices for VR-training. In: 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), pp. 607–608, March 2018. https://doi.org/10.1109/VR.2018.8446614

  18. Long, B., Seah, S.A., Carter, T., Subramanian, S.: Rendering volumetric haptic shapes in mid-air using ultrasound. ACM Trans. Graph. 33(6), 181:1–181:10 (2014). https://doi.org/10.1145/2661229.2661257

    Article  Google Scholar 

  19. Ma, Z., Ben-Tzvi, P.: RML glove–an exoskeleton glove mechanism with haptics feedback. IEEE/ASME Trans. Mechatron. 20(2), 641–652 (2015). https://doi.org/10.1109/TMECH.2014.2305842

    Article  Google Scholar 

  20. Martínez, J., García, A., Oliver, M., Molina, J.P., González, P.: Identifying virtual 3D geometric shapes with a vibrotactile glove. IEEE Comput. Graph. Appl. 36(1), 42–51 (2016). https://doi.org/10.1109/MCG.2014.81

    Article  Google Scholar 

  21. Motion, L.: Leap Motion (2008). https://www.leapmotion.com/. Accessed 12 June 2018

  22. Neupert, C., Matich, S., Scherping, N., Kupnik, M., Werthschützky, R., Hatzfeld, C.: Pseudo-haptic feedback in teleoperation. IEEE Trans. Haptics 9(3), 397–408 (2016). https://doi.org/10.1109/TOH.2016.2557331

    Article  Google Scholar 

  23. Peng, W., Xiao, N., Guo, S., Wang, Y.: A novel force feedback interventional surgery robotic system. In: 2015 IEEE International Conference on Mechatronics and Automation (ICMA), pp. 709–714, August 2015. https://doi.org/10.1109/ICMA.2015.7237572

  24. de Ribaupierre, S., Eagleson, R.: Editorial: challenges for the usability of AR and VR for clinical neurosurgical procedures. Healthc. Technol. Lett. 4(5), 151–151 (2017). https://doi.org/10.1049/htl.2017.0077

    Article  Google Scholar 

  25. Rethink Robotics: Baxter specifications (2008). http://www.rethinkrobotics.com/baxter/tech-specs/. Accessed 14 Feb 2018

  26. Sodhi, R., Poupyrev, I., Glisson, M., Israr, A.: AIREAL: interactive tactile experiences in free air. ACM Trans. Graph. 32(4), 134:1–134:10 (2013). https://doi.org/10.1145/2461912.2462007

    Article  Google Scholar 

  27. Strickland, D., Hodges, L., North, M., Weghorst, S.: Overcoming phobias by virtual exposure. Commun. ACM 40(8), 34–39 (1997). https://doi.org/10.1145/257874.257881

    Article  Google Scholar 

  28. Suzuki, Y., Kobayashi, M.: Air jet driven force feedback in virtual reality. IEEE Comput. Graph. Appl. 25(1), 44–47 (2005). https://doi.org/10.1109/MCG.2005.1

    Article  Google Scholar 

  29. Thanh, V.D.H., Pui, O., Constable, M.: Room VR: A VR therapy game for children who fear the dark. In: SIGGRAPH Asia 2017 Posters, SA 2017, pp. 52:1–52:2. ACM, New York (2017). https://doi.org/10.1145/3145690.3145734

  30. Tsai, W.L.: Personal basketball coach: tactic training through wireless virtual reality. In: Proceedings of the 2018 ACM on International Conference on Multimedia Retrieval, ICMR 2018, pp. 481–484. ACM, New York (2018). https://doi.org/10.1145/3206025.3206084

  31. Ultrahaptics: Ultrahaptics technical white paper. Technical report, Bristo, l United Kingdom (2018)

    Google Scholar 

  32. van Wyk, E., de Villiers, R.: Virtual reality training applications for the mining industry. In: Proceedings of the 6th International Conference on Computer Graphics, Virtual Reality, Visualisation and Interaction in Africa, AFRIGRAPH 2009, pp. 53–63. ACM, New York (2009). https://doi.org/10.1145/1503454.1503465

Download references

Author information

Authors and Affiliations

  1. Queen’s University Belfast, Belfast, UK

    Daniel Brice, Thomas McRoberts & Karen Rafferty

Authors
  1. Daniel Brice
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Thomas McRoberts
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Karen Rafferty
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding authors

Correspondence to Daniel Brice , Thomas McRoberts or Karen Rafferty .

Editor information

Editors and Affiliations

  1. University of Salento, Lecce, Italy

    Lucio Tommaso De Paolis

  2. University of Paris-Sud, Orsay, France

    Patrick Bourdot

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Brice, D., McRoberts, T., Rafferty, K. (2019). A Proof of Concept Integrated Multi-systems Approach for Large Scale Tactile Feedback in VR. In: De Paolis, L., Bourdot, P. (eds) Augmented Reality, Virtual Reality, and Computer Graphics. AVR 2019. Lecture Notes in Computer Science(), vol 11613. Springer, Cham. https://doi.org/10.1007/978-3-030-25965-5_10

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-25965-5_10

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-25964-8

  • Online ISBN: 978-3-030-25965-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation