Abstract
In this paper, we propose a new method for face recognition under varying illumination conditions using a single input image. Our method is based on a statistical shape-from-shading method which combines the strengths of the Lambertian model and statistical information obtained from a large number of images of different people under varying illumination. The main advantage of our method over the previous methods is that our method explicitly incorporates a correlation between surface points on a face in the MAP estimation of surface normals and albedos, so that a new image of the same face under novel illumination can be synthesized correctly even when the face is partially shadowed. Furthermore, our method introduces pixel grouping and reliability measure in the MAP estimation in order to reduce computational cost while maintaining accuracy. We demonstrate the effectiveness of our proposed method via experiments with real images.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Atick, J.J., Griffin, P.A., Redlich, A.N.: Statistical approach to shape from shading: reconstruction of three-dimensional face surfaces from single two-dimensional images. Neural Computation 8(6), 1321–1340 (1996)
Basri, R., Roth, D., Jacobs, D.: Clustering appearances of 3D objects. In: Proc. IEEE Int. Conf. Computer Vision and Pattern Recognition, pp. 414–420 (1998)
Belhumeur, P.N., Hespanha, J.P., Kriegman, D.J.: Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection. IEEE Trans. Pattern Analysis and Machine Intelligence 19(7), 711–720 (1997)
Belhumeur, P.N., Kriegman, D.J.: What is the set of images of an object under all possible lighting conditions? In: Proc. IEEE Int. Conf. Computer Vision and Pattern Recognition, pp. 270–277 (1996)
Blanz, V., Vetter, T.: Face Recognition Based on Fitting a 3D Morphable Model. IEEE Trans. Pattern Analysis and Machine Intelligence 25(9), 1063–1074 (2003)
Chellappa, R., Wilson, C.L., Sirohey, S.: Human and Machine Recognition of Faces, A Survey. Proc. of the IEEE 83, 705–740 (1995)
Georghiades, A.S., Kriegman, D.J., Belhumeur, P.N.: Illumination cones for recognition under variable lighting: faces. In: Proc. IEEE Int. Conf. Computer Vision and Pattern Recognition, pp. 52–58 (1998)
Horn, B.K.P.: Height and gradient from shading. Int. J. Computer Vision 5, 37–75 (1990)
Marschner, S.R., Westin, S.H., Lafortune, E.P.F., Torrance, K.E., Greenberg, D.P.: Image-based BRDF Measurement Including Human Skin. In: Proc. 10th Eurographics Workshop on Rendering, pp. 139–152 (1999)
Matthews, I., Baker, S.: Active appearance models revisited. Int. J. Computer Vision 60(2), 135–164 (2004)
Murase, H., Nayar, S.K.: Visual learning and Recognition of 3-D Objects from Appearance. Int. J. Computer Vision 14, 5–24 (1995)
Nagao, K.: Face recognition by distribution specific feature extraction. In: Proc. IEEE Int. Conf. Computer Vision and Pattern Recognition, pp. I–1278–1285 (2000)
Oja, E.: Subspace Methods for Pattern Recognition. Research Studies Press Ltd (1980)
Okabe, T., Sato, Y.: Object Recognition Based on Photometric Alignment Using RANSAC. In: Proc. IEEE Int. Conf. Computer Vision and Pattern Recognition, pp. I–221–228 (2003)
Okabe, T., Sato, Y.: Support Vector Machines for Object Recognition under Varying Illumination Conditions. In: Proc. Asian Conf. Computer Vision, pp. 724–729 (2004)
Shakunaga, T., Shigenari, K.: Decomposed Eigenface for Face Recognition under Various Lighting Conditions. In: Proc. IEEE Int. Conf. Computer Vision and Pattern Recognition, vol. 1, pp. 864–871 (2001)
Shimano, M., Nagao, K.: Simultaneous Optimization of Class Configuration and Feature Space for Object Recognition. In: Proc. Int. Conf. Pattern Recognition, vol. 2, pp. 7–10 (2004)
Sim, T., Kanade, T.: Combining Models and Exemplars for Face Recognition: An Illuminating Example. In: Proc. IEEE Int. Conf. Computer Vision and Pattern Recognition Workshop on Models versus Exemplars in Computer Vision (2001)
Sim, T., Baker, S., Bsat, M.: The CMU Pose, Illumination, and Expression (PIE) Database. In: Proc. IEEE Int. Conf. Automatic Face and Gesture Recognition, pp. 53–58 (2002)
Zhao, W., Chellappa, R.: Illumination-insensive face recognition using symmetric shape-from-shading. In: Proc. IEEE Int. Conf. Computer Vision and Pattern Recognition, vol. 1, pp. 286–293 (2000)
Zhao, W., Chellappa, R., Phillips, J., Rosenfeld, A.: Face Recognition in Still and Video Images: A Literature Surrey. ACM Computing Surveys 35, 399–458 (2003)
Zhou, S.K., Chellappa, R., Jacobs, D.W.: Characterization of Human Faces under Illumination Variations Using Rank, Integrability, and Symmetry Constraints. In: Pajdla, T., Matas, J. (eds.) ECCV 2004. LNCS, vol. 3021, pp. 588–601. Springer, Heidelberg (2004)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Shimano, M., Nagao, K., Okabe, T., Sato, I., Sato, Y. (2006). Face Recognition Under Varying Illumination Based on MAP Estimation Incorporating Correlation Between Surface Points. In: Narayanan, P.J., Nayar, S.K., Shum, HY. (eds) Computer Vision – ACCV 2006. ACCV 2006. Lecture Notes in Computer Science, vol 3851. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11612032_58
Download citation
DOI: https://doi.org/10.1007/11612032_58
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-31219-2
Online ISBN: 978-3-540-32433-1
eBook Packages: Computer ScienceComputer Science (R0)