Skip to main content
SpringerLink
Log in

iPDO: An Effective Feature Depth Estimation Method for 3D Face Reconstruction

  • Conference paper
  • First Online:
Rough Sets (IJCRS 2017)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 10313))

Included in the following conference series:

  • 1086 Accesses

Abstract

We present a 3D face modeling approach under uncontrolled conditions. In the heart of this work is an efficient and accurate facial landmark depth estimation algorithm. The objective function is formulated by similarity transformation among face images. In this method, pose parameters and depth values are optimized iteratively. The estimated 3D landmarks then are taken as control points to deform a generic 3D face shape into a specific face shape. Test results on synthesized images show that the proposed methods can obtain landmarks depth both effectively and efficiently. Whats’ more, the 3D faces generated from real-world photos are rather realistic based on a set of landmarks.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Institutional subscriptions

References

  1. Blanz, V., Vetter, T.: A morphable model for the synthesis of 3D faces. In: The 26th Annual Conference on Computer Graphics and Interactive Techniques, pp. 187–194. ACM Press/Addison-Wesley Publishing Co., Los Angeles (1999)

    Google Scholar 

  2. Torresani, L., Hertzmann, A., Bregler, C.: Non-rigid structure-from-motion: estimating shape and motion with hierarchical priors. IEEE Trans. Pattern Anal. Mach. Intell. 30(5), 878–892 (2008)

    Article  Google Scholar 

  3. Shu, L., Linda, S., Ira, K.: Internet-based morphable model. In: IEEE International Conference on Computer Vision, pp. 3256–3263. IEEE Computer Society (2015)

    Google Scholar 

  4. Liang, S., Shapiro, L.G., Kemelmacher-Shlizerman, I.: Head reconstruction from internet photos. In: Leibe, B., Matas, J., Sebe, N., Welling, M. (eds.) ECCV 2016. LNCS, vol. 9906, pp. 360–374. Springer, Cham (2016). doi:10.1007/978-3-319-46475-6_23

    Chapter  Google Scholar 

  5. Roth, J., Tong, Y., Liu, X.: Unconstrained 3D face reconstruction. In: IEEE Computer Vision and Pattern Recognition, pp. 2606–2615. IEEE Computer Society (2015)

    Google Scholar 

  6. Koo, H., Lam, K.: Recovering the 3D shape and poses of face images based on the similarity transform. Pattern Recogn. Lett. 29(6), 712–723 (2008)

    Article  Google Scholar 

  7. Sun, Z., Lam, K., Gao, Q.: Depth estimation of face images using the nonlinear least-squares model. IEEE Trans. Image Process. 22(1), 17–30 (2013)

    Article  MathSciNet  Google Scholar 

  8. Yang, C., Chen, J., Xia, C., et al.: A SFM-based sparse to dense 3D face reconstruction method robust to feature tracking errors. In: 20th IEEE International Conference on Image Processing (ICIP 2013), pp. 3617–3621 (2013)

    Google Scholar 

  9. Gong, X., Wang, G., Li, X., et al.: A statistical two-step method for 3D face reconstruction from single image. Chin. J. Electron. 20(4), 671–675 (2011)

    MathSciNet  Google Scholar 

  10. Le, V., Tang, H., Cao, L., et al.: Accurate and efficient reconstruction of 3D faces from stereo images. In: 17th IEEE International Conference on Image Processing (ICIP 2010), pp. 4265–4268 (2010)

    Google Scholar 

  11. Kennedy, J., Eberhart, R.: Particle swarm optimization. In: IEEE International Conference on Neural Networks, Perth, WA, pp. 1942–1948 (1995)

    Google Scholar 

  12. Gong, X., Wang, G.: Example-based learning for depth estimation of facial landmarks and its application in face modeling. Chin. J. Electron. 19(4), 676–680 (2010)

    Google Scholar 

  13. Gong, X., Wang, G.: Realistic face modeling based on multiple deformations. J. Chin. Univ. Posts Telecommun. 14(4), 110–117 (2007)

    Article  Google Scholar 

  14. Savran, A., Alyüz, N., Dibeklioğlu, H., Çeliktutan, O., Gökberk, B., Sankur, B., Akarun, L.: Bosphorus database for 3D face analysis. In: Schouten, B., Juul, N.C., Drygajlo, A., Tistarelli, M. (eds.) BioID 2008. LNCS, vol. 5372, pp. 47–56. Springer, Heidelberg (2008). doi:10.1007/978-3-540-89991-4_6

    Chapter  Google Scholar 

  15. Gong, X., Luo, J., Fu, Z.: Normalization for unconstrained pose-invariant 3D face recognition. In: Sun, Z., Shan, S., Yang, G., Zhou, J., Wang, Y., Yin, Y.L. (eds.) CCBR 2013. LNCS, vol. 8232, pp. 1–8. Springer, Cham (2013). doi:10.1007/978-3-319-02961-0_1

    Chapter  Google Scholar 

  16. Blanz, V., Mehl, A., Vetter, T., et al.: A statistical method for robust 3D surface reconstruction from sparse data. In: Proceeding of the 2nd International Symposium on 3D Data Processing, Visualization, Thessaloniki, Greece, pp. 293–300. IEEE Computer Society (2004)

    Google Scholar 

  17. Nordstrom, M.M., Larsen, M., Sierakowski, J., et al.: The IMM face database - an annotated dataset of 240 face images. Technical Richard Petersens Plads, Building 321 (2004)

    Google Scholar 

Download references

Acknowledgment

This work is partially supported by the National Natural Science Foundation of China (No. 61202191), State’s Key Project of Research and Development Plan (No. 2016YFC0802209) and Chongqing Key Laboratory of Computational Intelligence (CQ-LCI-2013-06).

Author information

Authors and Affiliations

  1. School of Information Science and Technology, Southwest Jiaotong University, Chengdu, 611756, People’s Republic of China

    Xun Gong, Shengdong Du & Yang Zhao

  2. Jincheng College of Sichuan University, Chengdu, 611731, People’s Republic of China

    Xinxin Li

Authors
  1. Xun Gong
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Xinxin Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Shengdong Du
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Yang Zhao
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Xinxin Li .

Editor information

Editors and Affiliations

  1. Polish-Japanese Academy of Information Technology, Warsaw, Poland

    Lech Polkowski

  2. University of Regina, Regina, SK, Canada

    Yiyu Yao

  3. University of Warmia and Mazury, Olsztyn, Poland

    Piotr Artiemjew

  4. University of Milano-Bicocca, Milano, Italy

    Davide Ciucci

  5. Southwest Jiaotong University, Chengdu, China

    Dun Liu

  6. Warsaw University, Warszawa, Poland

    Dominik Ślęzak

  7. Silesian University, Sosnowiec, Poland

    Beata Zielosko

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer International Publishing AG

About this paper

Cite this paper

Gong, X., Li, X., Du, S., Zhao, Y. (2017). iPDO: An Effective Feature Depth Estimation Method for 3D Face Reconstruction. In: Polkowski, L., et al. Rough Sets. IJCRS 2017. Lecture Notes in Computer Science(), vol 10313. Springer, Cham. https://doi.org/10.1007/978-3-319-60837-2_34

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-60837-2_34

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-60836-5

  • Online ISBN: 978-3-319-60837-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation