Abstract
Seeing the talker’s lips in addition to audition can improve speech understanding which is rather based on lips shape temporal evolution than on absolute mouth shape. In this article, we propose an adaptation of Active Shape Model (ASM) to the extraction of lips shape over an image sequence. The algorithm does not require any make-up or markers and works under natural lighting conditions.
After the definition of a training base, initial mouth model is iteratively deformed under constraints according to spatiotemporal energies depending either on luminance or hue. A robust prior detection of four points of the model is proposed in order to automatically and accurately initialize the egde detection.
The success of our approach is tested on many image sequences of multi-speakers with multi-speaking.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Baumberg, A., Hogg, D.: Learning Flexible Models from Image Sequences. In: ECCV 1994, Stockolhm, Sweden, pp. 299–308 (1994)
Bregler, C., Konig, Y.: Eigenlips for Robust Speech Recognition. In: IEEE ICASSP, Adelaide, Australia, pp. 669–672 (1991)
Caplier, A., Delmas, P., Lam, D.: Robust Initialisation for Lips Edges Detection. In: 11th SCIA, Kangerlussuaq, Greeland, June 7-11, pp. 523–528 (1999)
Cootes, T., Taylor, C., Cooper, D., Graham, J.: Active Shape Models: Their Training and Application. Computer Vision and Image Understanding 61(1), 38–59 (1995)
Jain, A., Zhong, Y., Dubuisson-Jolly, M.: Deformable Template Models: a review. Signal Processing 71, 109–129 (1998)
Kervran, C.: Learning Probabilistic Deformation models from Image Sequences. Signal Processing 71, 155–171 (1998)
Lanitis, A., Taylor, C.J., Cootes, T.F.: Automoatic Interpretation and Coding of Face Images Using Flexible Models. IEEE Trans. on PAMI 19(7), 743–755 (1997)
Liévin, M., Luthon, F.: Unsupervised Lip Segmentation under Natural Conditions. In: Proc. of IEEE Int. Conf. On Acoustic, Speech and Signal Processing (ICASSP 1999), Phoenix, Arizona (1999)
Wildes, R.P.: A Measure of Motion Salience for Surveillance Applications. In: Proc. of ICIP, Chicago, Illinois, USA (October 1998)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2000 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Caplier, A. (2000). Adaptation of ASM to Lips Edge Detection. In: Nagel, HH., Perales López, F.J. (eds) Articulated Motion and Deformable Objects. AMDO 2000. Lecture Notes in Computer Science, vol 1899. Springer, Berlin, Heidelberg. https://doi.org/10.1007/10722604_3
Download citation
DOI: https://doi.org/10.1007/10722604_3
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-67912-7
Online ISBN: 978-3-540-44591-3
eBook Packages: Springer Book Archive