Abstract
During the COVID-19 pandemic, the government decided to suspend all arts cultural events to prevent the spread of the virus. This situation is a challenge for batik artisans to survive. This research aims to develop a virtual try-on platform that is an alternative medium for artisans to solve their problems. Development platforms based on augmented reality technology can be an option for the problems. Platform designed based on mobile devices has advantages in the practicality of use that is not limited by space and time. Implementation of human motion capture and hand gesture recognition provides an immersive experience for users. Motion capture is used for a virtual try-on scheme for batik apparel that can make users try batik apparel virtually and can automatically fit the user’s body. In addition, the implementation of hand gesture recognition allows users to apply batik motifs to virtual apparel interactively combined with material fitting function, which can assist users in positioning batik motifs. Apart from technical matters, this platform also provides information about the history of batik motifs. Alpha testing is used in testing the platform and confusion matrix to validate the accuracy of implementing the functions that exist on the platform. The results of testing the accuracy of hand gesture recognition reached 97%, and human motion capture reached 93%, which means the system can run well. This paper describes the initial efforts made to develop a virtual try-on platform for batik apparel based on Augmented Intelligence Technology.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Nabi, S., Mishra, V.P.: Analysis and Impact of COVID-19 on economy and organization. In: International Conference on Computational Intelligence and Knowledge Economy (ICCIKE), pp. 219–224. IEEE, Dubai, United Arab Emirates (2021)
Miranto, C., Rante, H., Sukaridhoto, S., Pasila, F., Aliwarga, H.: Preliminary Development of virtual reality for batik exhibition. Psychol. Educ. J. 57(9), (2020)
Behzadan, A.H., Kamat, V.R.: Enabling discovery-based learning in construction using telepresent augmented reality. Autom. Constr. 33, 3–10 (2013)
Puyuelo, M., Higón, J.L., Merino, L., Contero, M.: Experiencing augmented reality as an accessibility resource in the UNESCO heritage site called “La Lonja.” Procedia Comput. Sci. 25, 171–178 (2013)
Wojciechowski, R., Cellary, W.: Evaluation of learners’ attitude toward learning in ARIES augmented reality environments. Comput. Educ. 68, 570–585 (2013)
Kysela, J., ŠTorková, P.: Using augmented reality as a medium for teaching history and tourism. Procedia Soc. Behav. Sci. 174, 926–931 (2015)
Fajrianti, E.D., et al.: Design and development of human anatomy learning platform for medical students based on augmented intelligence technology. In: International Electronics Symposium (IES), pp. 195–202. IEEE, Surabaya, Indonesia (2021).
Hebbar, A.: Augmented intelligence: enhancing human capabilities. In: 2017 Third International Conference on Research in Computational Intelligence and Communication Networks (ICRCICN), pp. 251–254. IEEE, Kolkata, India (2017)
Wójcik, M.: Augmented intelligence technology. The ethical and practical problems of its implementation in libraries. Libr. Hi Tech. 39(2), 435–447 (2020)
He, Z., Wu, L., Li, X.R.: When art meets tech: the role of augmented reality in enhancing museum experiences and purchase intentions. Tour. Manage. 68, 127–139 (2018)
Hwangbo, H., Kim, E.H., Lee, S.H., Jang, Y.J.: Effects of 3D Virtual “try-on” on online sales and customers’ purchasing experiences. IEEE Access 8, 189479–189489 (2020)
Liu, T., Li, L., Zhang, X.: Real-time 3D virtual dressing based on users’ skeletons. In: 4th International Conference on Systems and Informatics (ICSAI), pp. 1378–1382. IEEE, Hangzhou, China (2017)
Yuan, M., Khan, I.R., Farbiz, F., Yao, S., Niswar, A., Foo, M.H.: A mixed reality virtual clothes try-on system. IEEE Trans. Multim. 15(8), 1958–1968 (2013)
Gunes, S., Sanli, O., Ergun, O.O.: Augmented reality tool for markerless virtual try-on around human arm. In: IEEE International Symposium on Mixed and Augmented Reality - Media, Art, Social Science, Humanities and Design, pp. 59–60. IEEE, Fukuoka, Japan (2015)
Chu, C.H., Cheng, C.H., Wu, H.S., Kuo, C.C.: A cloud service framework for virtual try-on of footwear in augmented reality. J. Comput. Inf. Sci. Eng. 19(2), (2019)
Yousefi, S., Kidane, M., Delgado, Y., Chana, J., Reski, N.: 3D gesture-based interaction for immersive experience in mobile VR. In: 2016 23rd International Conference on Pattern Recognition (ICPR), pp. 2121–2126. IEEE, Cancun, Mexico (2016)
Ekneling, S., Sonestedt, T., Georgiadis, A., Yousefi, S., Chana, J.: Magestro: Gamification of the data collection process for development of the hand gesture recognition technology. In: IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct), pp. 417–418. IEEE, Munich, Germany (2018)
Kusumaningsih, A., Kurniawati, A., Angkoso, C.V., Yuniarno, E.M., Hariadi, M.: User experience measurement on virtual dressing room of Madura batik clothes. In: 2017 International Conference on Sustainable Information Engineering and Technology (SIET), pp. 203–208. IEEE, Malang, Indonesia (2017)
ARKit. https://developer.apple.com/documentation/arkit. Accessed 8 Sept 2021
Capturing Body Motion in 3D. https://developer.apple.com/documentation/arkit/content_anchors/capturing_body_motion_in_3d. Accessed 8 Sept 2021
ARBodyAnchor. https://developer.apple.com/documentation/arkit/arbodyanchor. Accessed 8 Sept 2021
RealityKit. https://developer.apple.com/documentation/realitykit/. Accessed 8 Sept 2021
Validating a Model for Motion Capture. https://developer.apple.com/documentation/arkit/content_anchors/validating_a_model_for_motion_capture. Accessed 8 Sept 2021
ManoMotion hand tracking SDK. https://www.manomotion.com/mobile-ar/. Accessed 8 Sept 2021
ManoMotion Gesture Documentation. https://sdk.manomotion.com/SDK_Pro_v1.4.8/. Accessed 8 Sept 2021
Caradonna, G., Lionetti, S., Tarantino, E., Verdoscia, C.: A Comparison of low-poly algorithms for sharing 3D models on the web. In: Cefalo, R., Zieliński, J., Barbarella, M. (eds.) New Advanced GNSS and 3D Spatial Techniques. Lecture Notes in Geoinformation and Cartography, pp. 237–244. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-56218-6_19
Bullinger, H.J., Behlau, L.: Technology Guide: Principles – Applications – Trends. Springer, Heidelberg (2009)
AssetBundle. https://docs.unity3d.com/AssetBundlesIntro.html. Accessed 8 Sept 2021
Visa, S., Ramsay, B., Ralescu, A.L., Knaap, E.V.D.: Confusion matrix-based feature selection. In: Proceedings of the 22nd Midwest Artificial Intelligence and Cognitive Science Conference (MAICS), vol. 710, pp. 120–127 (2011)
Makhtar, M., Neagu, D.C., Ridley, M.J.: Comparing multi-class classifiers: on the similarity of confusion matrices for predictive toxicology applications. In: Yin, H., Wang, W., Rayward-Smith V. (eds.) Intelligent Data Engineering and Automated Learning - IDEAL 2011, LNCS, vol. 6936, pp. 252–261. Springer, Berlin (2011). https://doi.org/10.1007/978-3-642-23878-9_31
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 ICST Institute for Computer Sciences, Social Informatics and Telecommunications Engineering
About this paper
Cite this paper
Firmanda, A., Sukaridhoto, S., Rante, H., Fajrianti, E.D. (2022). Preliminary Development of Virtual Try-On Platform for Batik Apparel Based on Mobile Augmented Intelligence Technology. In: Seyman, M.N. (eds) Electrical and Computer Engineering. ICECENG 2022. Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering, vol 436. Springer, Cham. https://doi.org/10.1007/978-3-031-01984-5_4
Download citation
DOI: https://doi.org/10.1007/978-3-031-01984-5_4
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-01983-8
Online ISBN: 978-3-031-01984-5
eBook Packages: Computer ScienceComputer Science (R0)