Skip to main content

Virtual Reality Assembly of Physical Parts: The Impact of Interaction Interface Techniques on Usability and Performance

  • Conference paper
  • First Online:
Virtual, Augmented and Mixed Reality: Applications in Education, Aviation and Industry (HCII 2022)

Abstract

In the last few years there has been increased interest in Virtual Reality technology application in the professional context. The technology is used in industry for training. There are several reported successful pilot applications in the industrial training of assembly of physical parts. However, our understanding of how interaction techniques affect performance on these tasks is still limited. In this research, we study the usability of three common hand-based interaction methods: controllers, camera-based hand tracking, and dataglove interaction in the virtual assembly of physical parts. We investigate how performance on the task is affected by the interaction method. We measure the usability, task time, task accuracy, and interaction errors in a study with 12 participants (n = 12) - with and without prior Virtual Reality experience. The results show that users rate the usability of controllers higher than camera based tracking, while datagloves are rated lower than camera tracked solutions. Users also complete the task faster, and with fewer interaction errors when using a controller, than when using a camera-tracking solution, or dataglove. However users execute actions more precisely when using a dataglove. Participants gender does not play a significant rule on the reported usability or task performance. However, as participants experience with Virtual Reality increases they can become less precise at executing actions with the controller, and more precise with the dataglove. The results of this study can help to design systems for the Virtual Reality assembly of physical parts, and to make decisions on which interaction method is suitable based on which aspects of the system are most important.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 69.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 89.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    https://bit.ly/3urrmEY.

References

  1. Argelaguet, F., Hoyet, L., Trico, M., Lécuyer, A.: The role of interaction in virtual embodiment: effects of the virtual hand representation. In: 2016 IEEE Virtual Reality (VR), pp. 3–10. IEEE (2016)

    Google Scholar 

  2. Audi AG: With virtual reality into the electric era: Audi makes technicians worldwide fit for the e-tron | audi mediacenter (2019). https://www.audi-mediacenter.com/en/press-releases/with-virtual-reality-into-the-electric-era-audi-makes-technicians-worldwide-fit-for-the-e-tron-11658

  3. Bailey, S.K., Johnson, C.I., Schroeder, B.L., Marraffino, M.D.: Using virtual reality for training maintenance procedures. In: Proceedings of the Interservice/Industry Training, Simulation and Education Conference (2017)

    Google Scholar 

  4. Berg, L.P., Vance, J.M.: Industry use of virtual reality in product design and manufacturing: a survey. Virtual Reality 21(1), 1–17 (2016). https://doi.org/10.1007/s10055-016-0293-9

    Article  Google Scholar 

  5. EPIC: Beyond the manual: VR training on aircraft maintenance (2019). https://www.unrealengine.com/en-US/spotlights/beyond-the-manual-vr-training-on-aircraft-maintenance?sessionInvalidated=true

  6. Fahmi, F., Tanjung, K., Nainggolan, F., Siregar, B., Mubarakah, N., Zarlis, M.: Comparison study of user experience between virtual reality controllers, leap motion controllers, and senso glove for anatomy learning systems in a virtual reality environment, vol. 851, p. 12024. IOP Publishing (2020)

    Google Scholar 

  7. Figueiredo, L., Rodrigues, E., Teixeira, J., Teichrieb, V.: A comparative evaluation of direct hand and wand interactions on consumer devices. Comput. Graph. 77, 108–121 (2018). https://doi.org/10.1016/j.cag.2018.10.006

    Article  Google Scholar 

  8. Gusai, E., Bassano, C., Solari, F., Chessa, M.: Interaction in an immersive collaborative virtual reality environment: a comparison between leap motion and HTC controllers. In: Battiato, S., Farinella, G.M., Leo, M., Gallo, G. (eds.) ICIAP 2017. LNCS, vol. 10590, pp. 290–300. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-70742-6_27

    Chapter  Google Scholar 

  9. Kalkan, Ö.K., Karabulut, Ş, Höke, G.: Effect of virtual reality-based training on complex industrial assembly task performance. Arab. J. Sci. Eng. 46(12), 12697–12708 (2021). https://doi.org/10.1007/s13369-021-06138-w

    Article  Google Scholar 

  10. Ko, A.J., LaToza, T.D., Burnett, M.M.: A practical guide to controlled experiments of software engineering tools with human participants. Empir. Softw. Eng. 20(1), 110–141 (2013). https://doi.org/10.1007/s10664-013-9279-3

    Article  Google Scholar 

  11. Lewis, J.R.: Psychometric evaluation of the post-study system usability questionnaire: the PSSUQ (1992)

    Google Scholar 

  12. Lewis, J.R.: IBM computer usability satisfaction questionnaires: psychometric evaluation and instructions for use. Int. J. Hum.-Comput. Interact. 7(1), 57–78 (1995)

    Article  Google Scholar 

  13. Lougiakis, C., Katifori, A., Roussou, M., Ioannidis, I.P.: Effects of virtual hand representation on interaction and embodiment in HMD-based virtual environments using controllers. In: 2020 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), pp. 510–518. IEEE (2020)

    Google Scholar 

  14. Navarro, D., Sundstedt, V.: Evaluating player performance and experience in virtual reality game interactions using the HTC Vive controller and leap motion sensor, pp. 103–110. SciTePress (2019). HTC Vive is more reliable than Leap Motion. \(<\)br/\(>\)Reduced performance when using Leap Motion

    Google Scholar 

  15. Plechatá, A., Sahula, V., Fayette, D., Fajnerová, I.: Age-related differences with immersive and non-immersive virtual reality in memory assessment. Front. Psychol. 10 (2019). https://doi.org/10.3389/fpsyg.2019.01330

  16. Seymour, N.E., et al.: Virtual reality training improves operating room performance: results of a randomized, double-blinded study. Ann. Surg. 236(4), 458 (2002)

    Google Scholar 

  17. Taillade, M., et al.: Executive and memory correlates of age-related differences in wayfinding performances using a virtual reality application. Aging Neuropsychol. Cogn. 20(3), 298–319 (2013). https://doi.org/10.1080/13825585.2012.706247. pMID 22901081

  18. Tanjung, K., Nainggolan, F., Siregar, B., Panjaitan, S., Fahmi, F.: The use of virtual reality controllers and comparison between vive, leap motion and senso gloves applied in the anatomy learning system. J. Phys.: Conf. Ser. 1542, 12026 (2020). https://doi.org/10.1088/1742-6596/1542/1/012026

  19. Zimmermann, P.: Virtual reality aided design. A survey of the use of VR in automotive industry. In: Talaba, D., Amditis, A. (eds.) Product Engineering, pp. 277–296. Springer, Dordrecht (2008). https://doi.org/10.1007/978-1-4020-8200-9_13

    Chapter  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Ketoma Vix Kemanji .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2022 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Vix Kemanji, K., Mpwadina, R., Meixner, G. (2022). Virtual Reality Assembly of Physical Parts: The Impact of Interaction Interface Techniques on Usability and Performance. In: Chen, J.Y.C., Fragomeni, G. (eds) Virtual, Augmented and Mixed Reality: Applications in Education, Aviation and Industry. HCII 2022. Lecture Notes in Computer Science, vol 13318. Springer, Cham. https://doi.org/10.1007/978-3-031-06015-1_24

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-06015-1_24

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-06014-4

  • Online ISBN: 978-3-031-06015-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics