Abstract
The article deals with a recording procedure for motion dataset building mainly for sign language synthesis systems. Data gloves and two types of optical motion capture techniques are considered such as one source of sign language speech data for advanced training of more natural and acceptable body movements of signing avatars. A summary of the state-of-the-art technologies provides an overview of possibilities, and even limiting factors in relation to the sign language recording. The combination of the motion capture technologies overcomes the existing difficulties of such a complex task of recording both manual and non-manual component of the sign language. A result is the recording procedure for simultaneous motion capture of signing subject towards further research yet unexplored phenomenon of sign language production by a human.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
References
Gibet, S., Courty, N., Duarte, K., Naour, T.L.: The signcom system for data-driven animation of interactive virtual signers: methodology and evaluation. ACM Trans. Interact. Intell. Syst. 1(1), 6:1–6:23 (2011). http://doi.acm.org/10.1145/2030365.2030371
Gibet, S., Lefebvre-Albaret, F., Hamon, L., Brun, R., Turki, A.: Interactive editing in French Sign Language dedicated to virtual signers: requirementsand challenges. Universal Access in the Information Society, September 2015. https://hal.archives-ouvertes.fr/hal-01205742
Hasler, N., Rosenhahn, B., Thormahlen, T., Wand, M., Gall, J., Seidel, H.P.: Markerless motion capture with unsynchronized moving cameras. In: Computer Vision and Pattern Recognition, CVPR 2009, pp. 224–231 (2009)
Huenerfauth, M., Lu, P., Kacorri, H.: Synthesizing and evaluating animations ofamerican sign language verbs modeled from motion-capture data. In: SLPAT 2015, pp. 22–28. ACL, Dresden (2015). http://www.aclweb.org/anthology/W15-5105
Krňoul, Z., Kanis, J., Železný, M., Müller, L.: Czech text-to-sign speech synthesizer. In: Popescu-Belis, A., Renals, S., Bourlard, H. (eds.) MLMI 2007. LNCS, vol. 4892, pp. 180–191. Springer, Heidelberg (2008)
Krňoul, Z., Kanis, J., Železný, M., Müller, L.: Semiautomatic data glove calibration for sign language corpora building. In: 7th Workshop on the Representation and Processing of Sign Languages: Corpus Mining, LREC, May 2016, in press
Lefebvre-Albaret, F., Gibet, S., Turki, A., Hamon, L., Brun, R.: Overview ofthe Sign3D project high-fidelity 3D recording, indexing and editing of French Sign Language content. In: SLTAT 2013, Chicago, United States (2013). https://hal.archives-ouvertes.fr/hal-00914661
Lu, P., Huenerfauth, M.: Accessible motion-capture glove calibration protocolfor recording sign language data from deaf subjects. In: Proceedings of the11th International ACM SIGACCESS Conference on Computers and Accessibility, Assets 2009, pp. 83–90. ACM, New York (2009). http://doi.acm.org/10.1145/1639642.1639658
Wang, Y., Neff, M.: Data-driven glove calibration for hand motion capture. In: Proceedings of the 12th ACM SIGGRAPH/Eurographics Symposium on Computer Animation, SCA 2013, pp. 15–24. ACM, New York (2013). http://doi.acm.org/10.1145/2485895.2485901
Acknowledgments
This work was supported by the project LO1506 of the Czech Ministry of Education, Youth and Sports and by the UWB grant, project No. SGS-2016-039.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer International Publishing Switzerland
About this paper
Cite this paper
Krňoul, Z., Jedlička, P., Kanis, J., Železný, M. (2016). Toward Sign Language Motion Capture Dataset Building. In: Ronzhin, A., Potapova, R., Németh, G. (eds) Speech and Computer. SPECOM 2016. Lecture Notes in Computer Science(), vol 9811. Springer, Cham. https://doi.org/10.1007/978-3-319-43958-7_86
Download citation
DOI: https://doi.org/10.1007/978-3-319-43958-7_86
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-43957-0
Online ISBN: 978-3-319-43958-7
eBook Packages: Computer ScienceComputer Science (R0)