Abstract
In this paper, we propose a fully automatic, effective and efficient framework for 3D face reconstruction based on a single face image in arbitrary view. First, a multi-view face alignment algorithm localizes the face feature points, and then EM algorithm is applied to derive the optimal 3D shape and position parameters. Moreover, the unit quaternion based pose representation is proposed for efficient 3D pose parameter optimization. Compared with other related works, this framework has the following advantages: 1) it is fully automatic, and only one single face image in arbitrary view is required; 2) EM algorithm and unit quaternion based pose representation are integrated for efficient shape and position parameters estimation; 3) the correspondence between 2D contour points and 3D model vertexes are dynamically determined by normal direction constraints, which facilitates the 3D reconstruction from arbitrary view image; 4) a weighted optimization strategy is applied for more robust parameter estimation. The experimental results show the effectiveness of our framework for 3D face reconstruction.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Hill, A., Cootes, T.F., Taylor, C.J.: Active Shape Models and the shape approximation problem. Image and Vision Computing 14(8), 601–608 (1996)
Horn, B.K.P.: Closed-form solution of absolute orientation using unit quaternions. Journal of the Optical Society of America 4(4), 629–642 (1987)
Hu, Y.X., Jiang, D.L., Yan, S.C., Zhang, L., Zhang, H.J.: Automatic 3D Reconstruction for Face Recognition. In: FG 2004 Proceedings, pp. 843–848 (2004)
Lam, K.-M., Yan, H.: An Analytic-to-Holistic Approach for Face Recognition Based on a Single Frontal View. In: PAMI 1998, vol. 2(7), pp. 673–686 (1998)
Lewis, J.P.: Algorithms for solid noise synthesis. In: SIGGRAPH 1989 Conference Proceedings. ACM, New York (1989)
Li, H., Yan, S.C., Peng, L.Z.: Robust Multi-view Face Alignment with Edge Based Texture. Submitted to Journal of Computer Science and Technology (2004)
Liu, Z., Zhang, Z., Jacobs, C., Cohen, M.: Rapid modeling of animated faces from video. In: Proc. 3rd International Conference on Visual Computing, Mexico City, vol. 12, pp. 58–67 (2000); Also in the special issue of The Journal of Visualization and Computer Animation 12, (2001)
Parke, F.I.: Computer generated animation of faces. In: ACM National Conference. ACM, New York (1972)
Parke, F.I.: A Parametric Model of Human Faces. PhD thesis, University of Utah, Salt Lake City (1974)
Romdhani, S., Blanz, V., Vetter, T.: Face identification by fitting a 3d morphable model using linear shape and texture error functions. In: Heyden, A., Sparr, G., Nielsen, M., Johansen, P. (eds.) ECCV 2002. LNCS, vol. 2353, pp. 3–19. Springer, Heidelberg (2002)
Magneneat-Thalmann, N., Minh, H., Angelis, M., Thalmann, D.: Design, transformation and animation of human faces. Visual Computer 5, 32–39 (1989)
Tipping, M., Bishop, C.: Probabilistic principal component analysis, Technical Report Technical Report NCRG/97/010, Neural Computing Research Group, Aston University, Birmingham, UK (September 1997)
Zhang, R., Tai, P.-S., Cryer, J.E., Sha, M.: Shape From Shading: A Survey. IEEE Trans. On PAMI 21(8), 690–706 (1999)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2004 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Wang, C., Yan, S., Li, H., Zhang, H., Li, M. (2004). Automatic, Effective, and Efficient 3D Face Reconstruction from Arbitrary View Image. In: Aizawa, K., Nakamura, Y., Satoh, S. (eds) Advances in Multimedia Information Processing - PCM 2004. PCM 2004. Lecture Notes in Computer Science, vol 3332. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-30542-2_68
Download citation
DOI: https://doi.org/10.1007/978-3-540-30542-2_68
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-23977-2
Online ISBN: 978-3-540-30542-2
eBook Packages: Computer ScienceComputer Science (R0)