Faces are among the most important classes of objects computers have to deal with. Consequently, automatic processing and recognition of facial images have attracted considerable attention in the last decades. In this chapter we focus on a strict view of facial image processing, i.e. transforming an input facial image into another and involving no high-level semantic classification like face recognition. A brief overview of facial image processing techniques is presented. Typical applications include removal of eyeglasses, facial expression synthesis, red-eye removal, strabismus simulation, facial weight-change simulation, caricature generation, and restoration of facial images.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
B. Abboud, F. Davoine, and M. Dang. Facial expression recognition and synthesis based on an appearance model. Signal Processing: Image Communication, 19(8):723–740, 2004
B. Abboud and F. Davoine. Bilinear factorisation for facial expression analysis and synthesis. IEE Proceedings of the Vision Image and Signal Processing, 152(3):327–333, 2005
V. Blanz, C. Basso, T. Poggio, and T. Vetter. Reanimating faces in images and video. Computer Graphics Forum, 22(3):641–650, 2003
V. Blanz, K. Scherbaum, T. Vetter, and H.-P. Seidel. Exchanging faces in images. Computer Graphics Forum, 23(3):669–676, 2004
F. Bookstein. Principal warps: Thin-plate splines and the decomposition of deformations. IEEE Transactions on Pattern Analysis and Machine Intelligence, 11(6):567–585, 1989
C. Bregler, M. Covell, and M. Slaney. Video rewrite: Driving visual speech with audio. In Proceedings of SIGGRAPH, pages 353–360, 1997
N.P. Chandrasiri, T. Naemura, and H. Harashima. Interactive analysis and synthesis of facial expressions based on personal facial expression space. In Proceedings of IEEE International Conference on Automatic Face and Gesture Recognition, pages 105–110, 2004
K. Chang, K. Bowyer, and P. Flynn. A survey of approaches and challenges in 3D and multi-modal 2D+3D face recognition. Computer Vision and Image Understanding, 101(1):1–15, 2006
H. Chen, Y.-Q. Xu, H.-Y. Shum, S.-C. Zhu, and N.-N. Zheng. Example-based facial sketch generation with non-parametric sampling. In Proceedings of International Conference on Computer Vision, volume 2, pages 433–438, 2001
P.-Y. Chiang, W.-H. Liao, and T.-Y. Li. Automatic caricature generation by analyzing facial features. In Proceedings of Asian Conference on Computer Vision, 2004
D.K. Coats, E.A. Paysse, A.J. Towler, and R.L. Dipboye. Impact of large angle horizontal strabismus on ability to obtain employment. Ophthalmology, 107(2):402–405, 2000
U. Danino, N. Kiryati, and M. Furst. Algorithm for facial weight-change. Proceedings of International Conference on Electronics, Circuits and Systems, pages 318–321, 2004
Y. Du and Y. Lin. Emotional facial expression model building. Pattern Recognition Letters, 24(16):2923–2934, 2003
P. Eisert. Analysis and synthesis of facial expressions. In N. Sarris and G.M. Strintzis, editors, 3D Modeling and Animation: Synthesis and Analysis Techniques for the Human Body, pages 235–265, Idea Group Inc., 2004
B. Fasel and J. Luettin. Automatic facial expression analysis: A survey. Pattern Recognition, 36(1):259–275, 2003
F. Gasparini, R. Schettini. Automatic redeye removal for smart enhancement of photos of unknown origin. In Proceedings of the International Conference on Visual Information Systems, 2005
M. Gaubatz and R. Ulichney. Automatic red-eye detection and correction. In Proceedings of International Conference on Image Processing, volume I, pages 804–807, 2002
J. Ghent and J. McDonald. Photo-realistic facial expression synthesis. Image and Vision Computing, 23(12):1041–1050, 2005
E. Hjelmas and B.K. Low. Face detection: A survey. Computer Vision and Image Understanding, 83:237–274, 2001
A. Hoover, G. Jean-Baptiste, X. Jiang, P.J. Flynn, H. Bunke, D. Goldgof, K. Bowyer, D. Eggert, A. Fitzgibbon, and R. Fisher. An experimental comparison of range image segmentation algorithms. IEEE Transactions on Pattern Analysis and Machine Intelligence, 18(7):673–689, 1996
B.-W. Hwang and S.-W. Lee. Reconstruction of partially damaged face images based on a morphable face model. IEEE Transactions on Pattern Analysis and Machine Intelligence, 25(3):365–372, 2003
X. Jiang, M. Binkert, B. Achermann, and H. Bunke. Towards detection of glasses in facial images. Pattern Analysis and Applications, 3(1):9–18, 2000
X. Jiang, S. Rothaus, K. Rothaus, and D. Mojon. Synthesizing face images by iris replacement: Strabismus simulation. In Proceedings of first International Conference on Computer Vision Theory and Applications, pages 41–47, 2006
Z. Jing and R. Mariani. Glasses detection and extraction by deformable contour. In Proceedings of International Conference on Pattern Recognition, 933–936, 2000
B. Kamgar-Parsi and A.K. Jain. Synthetic eyes. In J. Kittler and M.S. Nixon, editors, Audio- and Video-Based Biometric Person Authentication, pages 412–420. Springer, Berlin Heidelberg New York, 2003
S. Kong, J. Heo, B. Abidi, J. Paik, and M. Abidi. Recent advances in visual and infrared face recognition – A review. Computer Vision and Image Understanding, 97(1), 103–135, 2005
H. Koshimizu, M. Tominaga, T. Fujiwara, and K. Murakami. On KANSEI facial image processing for computerized facialcaricaturing system PICASSO. In Proceedings of Conference on Systems, Man, and Cybernetics, volume 6, pages 294–299, 1999
S. Krinidis, I. Buciu, and I. Pitas. Facial expression analysis and synthesis: A survey. In Proceedings of International Conference on Human–Machine Interaction, pages 1432–1436, 2003
A. Lanitis, C.J. Taylor, and T.F. Cootes. Toward automatic simulation of aging effects on face images. IEEE Transactions on Pattern Analysis and Machine Intelligence, 24(4):442–455, 2002
S.Z. Li and A.K. Jain, editors. Handbook of Face Recognition. Springer, Berlin Heidelberg New York, 2005
L. Liang, H. Chen, Y.Q. Xu, and H.Y. Shum. Example-based caricature generation with exaggeration. In Proceedings of 10th Pacific Conference on Computer Graphics and Applications, 2002
P. Litwinowicz and L. Williams. Animating images with drawings. In Proceedings of SIGGRAPH, pages 409–412, 1994
Q. Liu, X. Tang, H. Jin, H. Lu, and S. Ma. A nonlinear approach for face sketch synthesis and recognition. In Proceedings of Conference on Computer Vision and Pattern Recognition, volume 1, pages 1005–1010, 2005
Z. Liu, Y. Shan, and Z. Zhang. Expressive expression mapping with ratio images. In Proceedings of SIGGRAPH, pages 271–276, 2001
Z. Liu, Z. Zhang, and Y. Shan. Image-based surface detail transfer. IEEE Computer Graphics and Applications, 24(3):30–35, 2004
S. Loffe. Red eye detection with machine learning. In Proceedings of International Conference on Image Processing, volume II, pages 871–874, 2003
H. Luo, J. Yen, and D. Tretter. An efficient automatic redeye detection and correction algorithm. In Proceedings of International Conference on Pattern Recognition, volume 2, pages 883–886, 2004
X.P. Miao and T. Sim. Automatic red-eye detection and removal. In Proceedings of International Conference on Multimedia and Expo, pages 1195–1198, 2004
A. Nikolaidis and I. Pitas. Robust watermarking of facial images based on salient geometric pattern matching. IEEE Transactions on Multimedia, 2(3):172–184, 2000
K.-I. Okada, F. Maeda, Y. Ichikawaa, and Y. Matsushita. Multiparty videoconferencing at virtual social distance: MAJIC design. In Proceedings of ACM Conference on Computer Supported Cooperative Work, pages 385–393, 1994
J.-S. Park and S.-W. Lee. Reconstruction of high-resolution facial images for visual surveillance. In C.H. Chen and P.S.P. Wang, editors, Handbook of Pattern Recognition and Computer Vision, 3rd edn., pages 445–459. World Scientific, Singapore, 2005
J.-S. Park, Y.-H. Oh, S.-C. Ahn, and S.-W. Lee. Glasses removal from face image using recursive error compensation. IEEE Transactions Pattern Analysis and Machine Intelligence, 27(5):805–811, 2005
F.I. Parke and K. Waters. Computer Facial Animation. A.K. Peters Ltd., 1996
P.J. Phillips, H. Moon, S.A. Rizvi, and P.J. Rauss. The FERET evaluation methodology for face-recognition algorithms. IEEE Transactions on Pattern Analysis and Machine Intelligence, 22(10):1090–1104, 2000
F. Pighin, J. Hecker, D. Lischinski, R. Szeliski, and D. Salesin. Synthesizing realistic facial expressions from photographs. In Proceedings of SIGGRAPH, pages 75–84, 1998
Y. Saito, Y. Kenmochi, and K. Kotani. Estimation of eyeglassless facial images using principal component analysis. In Proceedings of International Conference on Image Processing, volume 4, pages 197–201, 1999
J.S. Schildkraut and R.T. Gray. A fully automatic redeye detection and correction algorithm. In Proceedings of International Conference on Image Processing, volume I, pages 801–803, 2002
A. Sellen. Remote conversations: The effects of mediating talk with technology. Human Computer Interaction, 10(4):401–444, 1995
S.M. Seitz and C.R. Dyer. View morphing. In Proceedings of SIGGRAPH, pages 21–30, 1996
T.K. Shih and R.-C. Chang. Digital inpainting – survey and multilayer image inpainting algorithms. In Proceedings of International Conference on Information Technology and Applications, volume 1, pages 15–24, 2005
B. Smolka, K. Czubin, J.Y. Hardeberg, K.N. Plataniotis, M. Szczepanski, and K. Wojciechowski. Towards automatic redeye effect removal. Pattern Recognition Letters, 24:1767–1785, 2003
X. Tang and X. Wang. Face sketch recognition. IEEE Transactions Circuits and Systems for Video Technology, 14(1):50–57, 2004
P. Thompson. Margaret Thatcher: A new illusion. Perception, 9:483–484, 1980
R. Ulichney and M. Gaubatz. Perceptual-based correction of photo red-eye. In Proceedings of IASTED International Conference on Signal and Image Processing, 2005
J. Wan and X.P. Ren. Automatic red-eyes detection based on AAM. In Proceedings of International Conference on Systems, Man and Cybernetics, volume 7, pages 6337–6341, 2004
D. Weiner and N. Kiryati. Virtual gaze redirection in face images. In Proceedings of International Conference on Image Analysis and Processing, pages 76–81, 2003
Z. Wen, Z. Liu, and T.S. Huang. Face relighting with radiance environment maps. In Proceedings of Conference on Computer Vision and Pattern Recognition, volume 2, pages 158–165, 2003
C. Wu, C. Liu, and J. Zhou. Eyeglasses verification by support vector machine. In Proceedings of IEEE Pacific Rim Conference on Multimedia, pages 1126–1131, 2001
H. Wu, G. Yoshikawa, T. Shioyama, T. Lao, and T. Kawade. Glasses frame detection with 3D Hough transform. In Proceedings of International Conference on Pattern Recognition, volume 2, pages 346–349, 2002
Y. Xiao and H. Yan. Extraction of glasses in human face images. In Proceedings of International Conference on Biometric Authentication, pages 214–220, 2004
M.-H. Yang, D. Kriegman, and N. Ahuja. Detecting faces in images: A survey. IEEE Transactions on Pattern Analysis and Machine Intelligence, 24(1):34–58, 2002
L. Yin and A. Basu. Generating realistic facial expressions with wrinkles for model-based coding. Computer Vision and Image Understanding, 84(2):201–240, 2001
Q. Zhang, Z. Liu, B. Guo, D. Terzopoulos, and H.-Y. Shum. Geometry-driven photorealistic facial expression synthesis. IEEE Transactions Visualization and Computer Graphics, 12(1):48–60, 2006
L. Zhang, Y. Sun, M. Li, and H. Zhang. Automated red-eye detection and correction in digital photographs. In Proceedings of International Conference on Image Processing, volume IV, pages 2363–2366, 2004
W. Zhao, R. Chellappa, J. Phillips, and A. Rosenfeld. Face recognition: A literature survey. ACM Computing Surveys, 35(4):399–458, 2003
C. Zhou and X. Lin. Facial expressional image synthesis controlled by emotional parameters. Pattern Recognition Letters, 26(16):2611–2627, 2005
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2008 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Jiang, X., Chen, YF. (2008). Facial Image Processing. In: Bunke, H., Kandel, A., Last, M. (eds) Applied Pattern Recognition. Studies in Computational Intelligence, vol 91. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-76831-9_2
Download citation
DOI: https://doi.org/10.1007/978-3-540-76831-9_2
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-76830-2
Online ISBN: 978-3-540-76831-9
eBook Packages: EngineeringEngineering (R0)