Skip to main content

Preliminary Development of Virtual Try-On Platform for Batik Apparel Based on Mobile Augmented Intelligence Technology

  • Conference paper
  • First Online:
Electrical and Computer Engineering (ICECENG 2022)

Abstract

During the COVID-19 pandemic, the government decided to suspend all arts cultural events to prevent the spread of the virus. This situation is a challenge for batik artisans to survive. This research aims to develop a virtual try-on platform that is an alternative medium for artisans to solve their problems. Development platforms based on augmented reality technology can be an option for the problems. Platform designed based on mobile devices has advantages in the practicality of use that is not limited by space and time. Implementation of human motion capture and hand gesture recognition provides an immersive experience for users. Motion capture is used for a virtual try-on scheme for batik apparel that can make users try batik apparel virtually and can automatically fit the user’s body. In addition, the implementation of hand gesture recognition allows users to apply batik motifs to virtual apparel interactively combined with material fitting function, which can assist users in positioning batik motifs. Apart from technical matters, this platform also provides information about the history of batik motifs. Alpha testing is used in testing the platform and confusion matrix to validate the accuracy of implementing the functions that exist on the platform. The results of testing the accuracy of hand gesture recognition reached 97%, and human motion capture reached 93%, which means the system can run well. This paper describes the initial efforts made to develop a virtual try-on platform for batik apparel based on Augmented Intelligence Technology.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 64.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 84.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Nabi, S., Mishra, V.P.: Analysis and Impact of COVID-19 on economy and organization. In: International Conference on Computational Intelligence and Knowledge Economy (ICCIKE), pp. 219–224. IEEE, Dubai, United Arab Emirates (2021)

    Google Scholar 

  2. Miranto, C., Rante, H., Sukaridhoto, S., Pasila, F., Aliwarga, H.: Preliminary Development of virtual reality for batik exhibition. Psychol. Educ. J. 57(9), (2020)

    Google Scholar 

  3. Behzadan, A.H., Kamat, V.R.: Enabling discovery-based learning in construction using telepresent augmented reality. Autom. Constr. 33, 3–10 (2013)

    Article  Google Scholar 

  4. Puyuelo, M., Higón, J.L., Merino, L., Contero, M.: Experiencing augmented reality as an accessibility resource in the UNESCO heritage site called “La Lonja.” Procedia Comput. Sci. 25, 171–178 (2013)

    Article  Google Scholar 

  5. Wojciechowski, R., Cellary, W.: Evaluation of learners’ attitude toward learning in ARIES augmented reality environments. Comput. Educ. 68, 570–585 (2013)

    Article  Google Scholar 

  6. Kysela, J., ŠTorková, P.: Using augmented reality as a medium for teaching history and tourism. Procedia Soc. Behav. Sci. 174, 926–931 (2015)

    Google Scholar 

  7. Fajrianti, E.D., et al.: Design and development of human anatomy learning platform for medical students based on augmented intelligence technology. In: International Electronics Symposium (IES), pp. 195–202. IEEE, Surabaya, Indonesia (2021).

    Google Scholar 

  8. Hebbar, A.: Augmented intelligence: enhancing human capabilities. In: 2017 Third International Conference on Research in Computational Intelligence and Communication Networks (ICRCICN), pp. 251–254. IEEE, Kolkata, India (2017)

    Google Scholar 

  9. Wójcik, M.: Augmented intelligence technology. The ethical and practical problems of its implementation in libraries. Libr. Hi Tech. 39(2), 435–447 (2020)

    Google Scholar 

  10. He, Z., Wu, L., Li, X.R.: When art meets tech: the role of augmented reality in enhancing museum experiences and purchase intentions. Tour. Manage. 68, 127–139 (2018)

    Article  Google Scholar 

  11. Hwangbo, H., Kim, E.H., Lee, S.H., Jang, Y.J.: Effects of 3D Virtual “try-on” on online sales and customers’ purchasing experiences. IEEE Access 8, 189479–189489 (2020)

    Article  Google Scholar 

  12. Liu, T., Li, L., Zhang, X.: Real-time 3D virtual dressing based on users’ skeletons. In: 4th International Conference on Systems and Informatics (ICSAI), pp. 1378–1382. IEEE, Hangzhou, China (2017)

    Google Scholar 

  13. Yuan, M., Khan, I.R., Farbiz, F., Yao, S., Niswar, A., Foo, M.H.: A mixed reality virtual clothes try-on system. IEEE Trans. Multim. 15(8), 1958–1968 (2013)

    Article  Google Scholar 

  14. Gunes, S., Sanli, O., Ergun, O.O.: Augmented reality tool for markerless virtual try-on around human arm. In: IEEE International Symposium on Mixed and Augmented Reality - Media, Art, Social Science, Humanities and Design, pp. 59–60. IEEE, Fukuoka, Japan (2015)

    Google Scholar 

  15. Chu, C.H., Cheng, C.H., Wu, H.S., Kuo, C.C.: A cloud service framework for virtual try-on of footwear in augmented reality. J. Comput. Inf. Sci. Eng. 19(2), (2019)

    Google Scholar 

  16. Yousefi, S., Kidane, M., Delgado, Y., Chana, J., Reski, N.: 3D gesture-based interaction for immersive experience in mobile VR. In: 2016 23rd International Conference on Pattern Recognition (ICPR), pp. 2121–2126. IEEE, Cancun, Mexico (2016)

    Google Scholar 

  17. Ekneling, S., Sonestedt, T., Georgiadis, A., Yousefi, S., Chana, J.: Magestro: Gamification of the data collection process for development of the hand gesture recognition technology. In: IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct), pp. 417–418. IEEE, Munich, Germany (2018)

    Google Scholar 

  18. Kusumaningsih, A., Kurniawati, A., Angkoso, C.V., Yuniarno, E.M., Hariadi, M.: User experience measurement on virtual dressing room of Madura batik clothes. In: 2017 International Conference on Sustainable Information Engineering and Technology (SIET), pp. 203–208. IEEE, Malang, Indonesia (2017)

    Google Scholar 

  19. ARKit. https://developer.apple.com/documentation/arkit. Accessed 8 Sept 2021

  20. Capturing Body Motion in 3D. https://developer.apple.com/documentation/arkit/content_anchors/capturing_body_motion_in_3d. Accessed 8 Sept 2021

  21. ARBodyAnchor. https://developer.apple.com/documentation/arkit/arbodyanchor. Accessed 8 Sept 2021

  22. RealityKit. https://developer.apple.com/documentation/realitykit/. Accessed 8 Sept 2021

  23. Validating a Model for Motion Capture. https://developer.apple.com/documentation/arkit/content_anchors/validating_a_model_for_motion_capture. Accessed 8 Sept 2021

  24. ManoMotion hand tracking SDK. https://www.manomotion.com/mobile-ar/. Accessed 8 Sept 2021

  25. ManoMotion Gesture Documentation. https://sdk.manomotion.com/SDK_Pro_v1.4.8/. Accessed 8 Sept 2021

  26. Caradonna, G., Lionetti, S., Tarantino, E., Verdoscia, C.: A Comparison of low-poly algorithms for sharing 3D models on the web. In: Cefalo, R., Zieliński, J., Barbarella, M. (eds.) New Advanced GNSS and 3D Spatial Techniques. Lecture Notes in Geoinformation and Cartography, pp. 237–244. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-56218-6_19

  27. Bullinger, H.J., Behlau, L.: Technology Guide: Principles – Applications – Trends. Springer, Heidelberg (2009)

    Book  Google Scholar 

  28. AssetBundle. https://docs.unity3d.com/AssetBundlesIntro.html. Accessed 8 Sept 2021

  29. Visa, S., Ramsay, B., Ralescu, A.L., Knaap, E.V.D.: Confusion matrix-based feature selection. In: Proceedings of the 22nd Midwest Artificial Intelligence and Cognitive Science Conference (MAICS), vol. 710, pp. 120–127 (2011)

    Google Scholar 

  30. Makhtar, M., Neagu, D.C., Ridley, M.J.: Comparing multi-class classifiers: on the similarity of confusion matrices for predictive toxicology applications. In: Yin, H., Wang, W., Rayward-Smith V. (eds.) Intelligent Data Engineering and Automated Learning - IDEAL 2011, LNCS, vol. 6936, pp. 252–261. Springer, Berlin (2011). https://doi.org/10.1007/978-3-642-23878-9_31

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Ardiman Firmanda .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2022 ICST Institute for Computer Sciences, Social Informatics and Telecommunications Engineering

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Firmanda, A., Sukaridhoto, S., Rante, H., Fajrianti, E.D. (2022). Preliminary Development of Virtual Try-On Platform for Batik Apparel Based on Mobile Augmented Intelligence Technology. In: Seyman, M.N. (eds) Electrical and Computer Engineering. ICECENG 2022. Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering, vol 436. Springer, Cham. https://doi.org/10.1007/978-3-031-01984-5_4

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-01984-5_4

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-01983-8

  • Online ISBN: 978-3-031-01984-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics