Abstract
Computer-assisted pronunciation tutoring (CAPT) methods have been established during the last decade. Recent systems usually include a distinct user feedback and an automatic pronunciation assessment system. This study is based on the audiovisual CAPT system, in which an extensive feedback mechanism and several speech databases for Slavonic learners of German were developed. We intend to adapt the existing system for Chinese learners of German and report on the first usage experiences. We have thus analyzed the deviations of German utterances produced by Chinese learners in comparison to those of German natives, especially in term of prosodic and phonetic issues. We also designed supplementary database and organized perceptual evaluation tests by German native listeners with respect to individual phones as well as to general rhythm and intonation. In this way the language transfer of tonal Chinese can be demonstrated, which is vital to the system adaption for Chinese learners.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Qian, X., Meng, H., Soong, F.: Capturing L2 Segmental Mispronunciations with Joint-sequence Models in Computer-Aided Pronunciation Training (CAPT). In: Proc. Chinese Spoken Language Processing (ISCSLP), pp. 84–88 (2010)
Minematsu, N., Okabe, K., Ogaki, K., Hirose, K.: Measurement of Objective Intelligibility of Japanese Accented English Using ERJ (English Read by Japanese) Database. In: INTERSPEECH 2011, pp. 1481–1484 (2011)
Hussein, H., Mixdorff, H., et al.: Towards a Computer-aided Pronunciation Training System for German Learners of Mandarin - Prosodic Analysis. In: L2WS-2010, Tokyo (2010)
Jokisch, O., et al.: The EURONOUNCE Project - An Intelligent Language Tutoring System with Multimodal Feedback Functions: Roadmap and Specification. In: Proc. Konferenz Elektronische Sprachsignalverarbeitung (ESSV), Frankfurt, pp. 116–123 (2008)
Ding, H., Jokisch, O., Hoffmann, R.: Perception and Analysis of Chinese-accented German Vowels. Archives of Acoustics 32(1), 89–100 (2007)
Ding, H., Mixdorff, H., Jokisch, O.: Pronunciation of German Syllable Codas of Mandarin Chinese Speakers. In: Proc. Konferenz Elektronische Sprachsignalverarbeitung (ESSV), Berlin, pp. 281–287 (2010)
Ding, H., Jokisch, O., Hoffmann, R.: An Acoustic and Perceptive Analysis of Postvocalic/l/ in Mandarin Chinese Learners of German. In: 17th Intern. Congress of Phonetic Sciences (ICPhS), Hongkong (2011)
Jokisch, O., Ding, H.: Acoustic Analysis of Postvocalic /l/ in Chinese Learners of German in the Context of an Overall Perception Experiment. In: Proc. Speech and Language Technology in Education (SLaTE), Venice (2011)
Hilbert, A., Mixdorff, H., Ding, H., Pfitzinger, H., Jokisch, O.: Prosodic analysis of German produced by Russian and Chinese learners. In: Proc. 5th Intern. Conf. on Speech Prosody, Chicago (2010)
Ding, H., Jokisch, O., Hoffmann, R.: F0 Analysis of Chinese Accented German Speech. In: Proc. 5th Intern. Symposium on Chinese Spoken Language Processing (ISCSLP), Singapore, pp. 49–56 (2006)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Ding, H., Jokisch, O., Hoffmann, R. (2012). An Audiovisual Feedback System for Pronunciation Tutoring – Mandarin Chinese Learners of German. In: Esposito, A., Esposito, A.M., Vinciarelli, A., Hoffmann, R., Müller, V.C. (eds) Cognitive Behavioural Systems. Lecture Notes in Computer Science, vol 7403. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-34584-5_15
Download citation
DOI: https://doi.org/10.1007/978-3-642-34584-5_15
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-34583-8
Online ISBN: 978-3-642-34584-5
eBook Packages: Computer ScienceComputer Science (R0)