Abstract
Virtual reality technologies offer several intuitive and natural interactions that can be used to enhance and increase awareness during the different phases of the product design, such as the virtual prototyping or the project reviews. In this work, we focus on the benefits of virtual reality environments for assembly retrieval applications, which usually are employed to reuse existing CAD models by operating minor modifications. The retrieval system adopted to evaluate the different similarity among CAD assemblies is able to detect three different similarity criteria (i.e. shape, joint and position) at different levels (globally and locally). Considering the complexity of assembly models, conveying these different types of information simultaneously is quite difficult, especially through the traditional desktop systems. Hence, this paper presents a system for the visualization and the inspection of the results returned by a retrieval system with the aim of easing the analysis especially when the retrieved objects to analyze are complex. The proposed tool exploits the 3D space to represent and communicate the different types of similarity and gestures as well as voice commands to interact in the VR environment. Finally, the usability of the system has been tested over a sample of interviewers, who used the system and the different functionalities provided and then expressed their judgment filling out a questionnaire. The results indicate that user are able to interpret the different similarity criteria and that the gestures help acting in a natural manner.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Abraham, L., Urru, A., Normani, N., Wilk, M., Walsh, M., O’Flynn, B.: Hand tracking and gesture recognition using lensless smart sensors. Sensors 18(9), 2834 (2018)
Abulrub, A.H.G., Attridge, A.N., Williams, M.A.: Virtual reality in engineering education: the future of creative learning. In: 2011 IEEE Global Engineering Education Conference (EDUCON), pp. 751–757. IEEE (2011)
Argelaguet, F., Andujar, C.: A survey of 3D object selection techniques for virtual environments. Comput. Graph. 37(3), 121–136 (2013)
Bachmann, D., Weichert, F., Rinkenauer, G.: Review of three-dimensional human-computer interaction with focus on the leap motion controller. Sensors 18(7), 2194 (2018)
Beattie, N., Horan, B., McKenzie, S.: Taking the leap with the oculus hmd and CAD-plucking at thin air? Proc. Technol. 20, 149–154 (2015)
Bordegoni, M.: Product Virtualization: An Effective Method for the Evaluation of Concept Design of New Products, pp. 117–141. Springer, London (2011). https://doi.org/10.1007/978-0-85729-775-4_7
Bougaa, M., Bornhofen, S., Kadima, H., Rivière, A.: Virtual reality for manufacturing engineering in the factories of the future. Appl. Mech. Mater. 789, 1275–1282 (2015)
Bourdot, P., Convard, T., Picon, F., Ammi, M., Touraine, D., Vézien, J.M.: VR-CAD integration: multimodal immersive interaction and advanced haptic paradigms for implicit edition of CAD models. Comput. Aided Des. 42(5), 445–461 (2010)
Caggianese, G., Gallo, L., Neroni, P.: An investigation of leap motion based 3D manipulation techniques for use in egocentric viewpoint. In: De Paolis, L.T., Mongelli, A. (eds.) AVR 2016. LNCS, vol. 9769, pp. 318–330. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-40651-0_26
Choi, S., Jung, K., Noh, S.D.: Virtual reality applications in manufacturing industries: past research, present findings, and future directions. Concur. Eng. 23(1), 40–63 (2015)
Choi, S., Cheung, H.: A versatile virtual prototyping system for rapid product development. Comput. Ind. 59(5), 477–488 (2008)
Cook, M.: Virtual serendipity: preserving embodied browsing activity in the 21st century research library. J. Acad. Librariansh. 44(1), 145–149 (2018)
Cordeiro, E., Giannini, F., Monti, M., Mendes, D., Ferreira, A.: A study on natural 3D shape manipulation in VR. In: Livesu, M., Pintore, G., Signoroni, A. (eds.) Smart Tools and Apps for Graphics - Eurographics Italian Chapter Conference. The Eurographics Association (2018). https://doi.org/10.2312/stag.20181296
Cui, J., Kuijper, A., Fellner, D.W., Sourin, A.: Understanding people’s mental models of mid-air interaction for virtual assembly and shape modeling. In: Proceedings of the 29th International Conference on Computer Animation and Social Agents, pp. 139–146. ACM (2016)
Cui, J., Kuijper, A., Sourin, A.: Exploration of natural free-hand interaction for shape modeling using leap motion controller. In: 2016 International Conference on Cyberworlds (CW), pp. 41–48. IEEE (2016)
Cui, J., Sourin, A.: Mid-air interaction with optical tracking for 3D modeling. Comput. Graph. 74, 1–11 (2018)
Gunawardane, P., Medagedara, N.T.: Comparison of hand gesture inputs of leap motion controller & data glove in to a soft finger. In: 2017 IEEE International Symposium on Robotics and Intelligent Sensors (IRIS), pp. 62–68. IEEE (2017)
Henriques, D., Mendes, D., Pascoal, P., Trancoso, I., Ferreira, A.: Poster: evaluation of immersive visualization techniques for 3D object retrieval. In: 2014 IEEE Symposium on 3D User Interfaces (3DUI), pp. 145–146. IEEE (2014)
Jezernik, A., Hren, G.: A solution to integrate computer-aided design (CAD) and virtual reality (VR) databases in design and manufacturing processes. Int. J. Adv. Manuf. Technol. 22(11–12), 768–774 (2003)
Koutsabasis, P., Domouzis, C.K.: Mid-air browsing and selection in image collections. In: Proceedings of the International Working Conference on Advanced Visual Interfaces, pp. 21–27. ACM (2016)
Kovar, J., Mouralova, K., Ksica, F., Kroupa, J., Andrs, O., Hadas, Z.: Virtual reality in context of industry 4.0 proposed projects at brno university of technology. In: 2016 17th International Conference on Mechatronics-Mechatronika (ME), pp. 1–7. IEEE (2016)
Lawson, G., Salanitri, D., Waterfield, B.: Future directions for the development of virtual reality within an automotive manufacturer. Appl. Ergon. 53, 323–330 (2016)
Lin, J., Schulze, J.P.: Towards naturally grabbing and moving objects in VR. Electron. Imaging 2016(4), 1–6 (2016)
Liu, H., Ju, Z., Ji, X., Chan, C.S., Khoury, M.: Human Motion Sensing and Recognition. SCI, vol. 675. Springer, Heidelberg (2017). https://doi.org/10.1007/978-3-662-53692-6
Liu, L., Huai, Y.: Dynamic hand gesture recognition using lmc for flower and plant interaction. Int. J. Pattern Recognit Artif Intell. 33(01), 1950003 (2018)
Lupinetti, K., Giannini, F., Monti, M., Pernot, J.P.: Multi-criteria similarity assessment for CAD assembly models retrieval. IMATI Report Series (18–07), 21 (08/2018 2018). http://irs.imati.cnr.it/reports/irs18-07
Lupinetti, K., Giannini, F., Monti, M., Pernot, J.P.: Multi-criteria retrieval of CAD assembly models. J. Comput. Des. Eng. 5(1), 41–53 (2018)
Mujber, T.S., Szecsi, T., Hashmi, M.S.: Virtual reality applications in manufacturing process simulation. J. Mater. Process. Technol. 155, 1834–1838 (2004)
Nakazato, M., Huang, T.S.: 3D Mars: immersive virtual reality for content-based image retrieval. In: IEEE International Conference on Multimedia and Expo, 2001. ICME 2001. (ICME). pp. 44–47 (2001). https://doi.org/10.1109/ICME.2001.1237651
Nguyen, T.T.H., Duval, T., Pontonnier, C.: A new direct manipulation technique for immersive 3D virtual environments. In: ICAT-EGVE 2014: the 24th International Conference on Artificial Reality and Telexistence and the 19th Eurographics Symposium on Virtual Environments, p. 8 (2014)
Okuya, Y., Ladeveze, N., Fleury, C., Bourdot, P.: Shapeguide: shape-based 3D interaction for parameter modification of native CAD data. Front. Robot. AI 5, 118 (2018)
Okuya, Y., Ladeveze, N., Gladin, O., Fleury, C., Bourdot, P.: Distributed architecture for remote collaborative modification of parametric CAD data. In: IEEE VR International Workshop on 3D Collaborative Virtual Environments (3DCVE 2018) (2018)
Ottosson, S.: Virtual reality in the product development process. J. Eng. Des. 13(2), 159–172 (2002)
Park, H., Son, J.S., Lee, K.H.: Design evaluation of digital consumer products using virtual reality-based functional behaviour simulation. J. Eng. Des. 19(4), 359–375 (2008)
Peng, C., Hansberger, J.T., Cao, L., Shanthakumar, V.A.: Hand gesture controls for image categorization in immersive virtual environments. In: 2017 IEEE Virtual Reality (VR), pp. 331–332. IEEE (2017)
Rucco, M., Lupinetti, K., Giannini, F., Monti, M., Pernot, J.-P.: CAD assembly retrieval and browsing. In: Ríos, J., Bernard, A., Bouras, A., Foufou, S. (eds.) PLM 2017. IAICT, vol. 517, pp. 499–508. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-72905-3_44
Seif, M.A., Umeda, R., Higa, H.: An attempt to control a 3D object in medical training system using leap motion. In: 2017 International Conference on Intelligent Informatics and Biomedical Sciences (ICIIBMS), pp. 159–162. IEEE (2017)
Toyama, S., Al Sada, M., Nakajima, T.: VRowser: a virtual reality parallel web browser. In: Chen, J.Y.C., Fragomeni, G. (eds.) VAMR 2018. LNCS, vol. 10909, pp. 230–244. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-91581-4_17
Vanacken, L., Grossman, T., Coninx, K.: Exploring the effects of environment density and target visibility on object selection in 3D virtual environments. In: IEEE Symposium on 3D User Interfaces, pp. 115–222. IEEE (2007)
Vitali, A., Regazzoni, D., Rizzi, C.: Guidelines to develop natural user interfaces for virtual reality solutions. In: International Conference on Innovative Design and Manufacturing: ICIDM2017, Milan, Italy, July 2017 (2017)
Vosinakis, S., Koutsabasis, P., Makris, D., Sagia, E.: A kinesthetic approach to digital heritage using leap motion: the cycladic sculpture application. In: 2016 8th International Conference on Games and Virtual Worlds for Serious Applications (VS-GAMES), pp. 1–8 (2016). https://doi.org/10.1109/VS-GAMES.2016.7590334
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Lupinetti, K., Bonino, B., Giannini, F., Monti, M. (2019). Exploring the Benefits of the Virtual Reality Technologies for Assembly Retrieval Applications. In: De Paolis, L., Bourdot, P. (eds) Augmented Reality, Virtual Reality, and Computer Graphics. AVR 2019. Lecture Notes in Computer Science(), vol 11613. Springer, Cham. https://doi.org/10.1007/978-3-030-25965-5_5
Download citation
DOI: https://doi.org/10.1007/978-3-030-25965-5_5
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-25964-8
Online ISBN: 978-3-030-25965-5
eBook Packages: Computer ScienceComputer Science (R0)