Abstract
3D face reconstruction is highly important in the ergonomics study of 3D face, especially in terms of designing face-related products. With the development of machine vision and deep learning, it becomes feasible to reconstruct the 3D face from a single image, which can make it practical to obtain a large scale data of 3D face shape instead of using the 3D scanning technology. The 3D face reconstruction methods, to recover the 3D facial geometry under unconstrained situations from 2D images, are roughly classified into two categories, namely (1) 3D Morphable Model (3DMM) fitting based method and (2) End-to-end deep convolutional neural network (CNN) based method. The 3DMM as a general face representation is introduced emphatically and two kinds of 3DMM fitting based methods are introduced when improving the 3DMM modeling mechanism. Four representative CNN based methods are compared when regressing from pixels of face image to the 3D face coordinates in different gird-like data structures. Finally, six common face datasets largely used in the training and testing are listed.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Chu C-H, Huang S-H, Yang C-K, Tseng C-Y (2015) Design customization of respiratory mask based on 3D face anthropometric data. Int J Prec Eng Manuf 16(3):487–494. https://doi.org/10.1007/s12541-015-0066-5
Lacko D, Vleugels J, Fransen E, Huysmans T, De Bruyne G, Van Hulle MM, Sijbers J, Verwulgen S (2017) Ergonomic design of an EEG headset using 3D anthropometry. Appl Ergon 58:128–136
Skals S, Ellena T, Subic A, Mustafa H, Pang TY (2016) Improving fit of bicycle helmet liners using 3D anthropometric data. Int J Ind Ergon 55:86–95
Long J, Helland, M, Anshel J (2011) A vision for strengthening partnerships between optometry and ergonomics. In: HFESA 47th Annual Conference
Blanz V, Vetter T (1999) A morphable model for the synthesis of 3D faces. In: Siggraph
Blanz V, Vetter T (2003) Face recognition based on fitting a 3d morphable model. IEEE Trans Pattern Anal Mach Intell 25(9):1063–1074
Egger B, Smith WA, Tewari A, Wuhrer S, Zollhoefer M, Beeler T, Bernard F, Bolkart T, Kortylewski A, Romdhani S (2019) 3D Morphable Face Models–Past, Present and Future. arXiv preprint arXiv:1909.01815
Jolliffe I (2011) Principal component analysis. Springer
Cao C, Weng Y, Zhou S, Tong Y, Zhou K (2013) Facewarehouse: A 3d facial expression database for visual computing. IEEE Trans Visual Comput Graph 20(3):413–425
Paysan P, Knothe R, Amberg B, Romdhani S, Vetter T (2010) A 3D face model for pose and illumination invariant face recognition. In: 2009 Sixth IEEE International Conference on Advanced Video and Signal Based Surveillance. IEEE
Cristinacce D, Cootes T (2008) Automatic feature localisation with constrained local models. Pattern Recogn 41(10):3054–3067
Cootes TF, Edwards GJ, Taylor CJ (2001) Active appearance models. IEEE Trans Pattern Anal Mach Intell 6:681–685
Zhu X, Liu X, Lei Z, Li SZ (2017) Face alignment in full pose range: A 3d total solution. IEEE Trans Pattern Anal Mach Intell 41(1):78–92
Dollár P, Welinder P, Perona P (2010) Cascaded pose regression. In: 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. IEEE
Sun Y, Wang X, Tang X (2013) Deep convolutional network cascade for facial point detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition
Zhang Z, Luo P, Loy CC, Tang X (2014) Facial landmark detection by deep multi-task learning. In: European Conference on Computer Vision. Springer
Jourabloo A, Liu X (2016) Large-pose face alignment via CNN-based dense 3D model fitting. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition
Feng Y, Wu F, Shao X, Wang Y, Zhou X (2018) Joint 3d face reconstruction and dense alignment with position map regression network. In: Proceedings of the European Conference on Computer Vision (ECCV)
Jackson  AS, Bulat A, Argyriou V,  Tzimiropoulos G (2017) Large pose 3D face reconstruction from a single image via direct volumetric CNN regression. In: Proceedings of the IEEE International Conference on Computer Vision
Zeng X, Peng X, Qiao Y (2019) DF2Net: A dense-fine-finer network for detailed 3D face reconstruction. In: Proceedings of the IEEE International Conference on Computer Vision
Wei H, Liang S, Wei Y (2019) 3D Dense Face Alignment via Graph Convolution Networks. arXiv preprint arXiv:1904.05562
Liu Z, Luo P, Wang X, Tang X (2015) Deep learning face attributes in the wild. In: Proceedings of the IEEE International Conference on Computer Vision)
Koestinger M, Wohlhart P, Roth PM (2011) Annotated facial landmarks in the wild: A large-scale, real-world database for facial landmark localization. In: 2011 IEEE International Conference on Computer Vision Workshops (ICCV workshops). IEEE
Burgos-Artizzu XP, Perona P, Dollár P (2013) Robust face landmark estimation under occlusion. In: Proceedings of the IEEE International Conference on Computer Vision
Belhumeur PN, Jacobs DW, Kriegman DJ, Kumar N (2013) Localizing parts of faces using a consensus of exemplars. IEEE Trans Anal Mach Intell 35(12):2930–2940
Jeni LA, Tulyakov S, Yin L, Sebe N, Cohn JF (2016) The first 3d face alignment in the wild (3dfaw) challenge. In: European Conference on Computer Vision. Springer
Sagonas C, Tzimiropoulos G, Zafeiriou S, Pantic M (2013) 300 faces in-the-wild challenge: The first facial landmark localization challenge. In: Proceedings of the IEEE International Conference on Computer Vision Workshops
Zhu X, Ramanan D (2012) Face detection, pose estimation, and landmark localization in the wild. In: 2012 IEEE Conference on Computer Vision and Pattern Recognition. IEEE
Le V, Brandt J, Lin, Z, Bourdev L, Huang TS (2012) Interactive facial feature localization. In: European Conference on Computer Vision. Springer
Messer K, Matas J, Kittler J, Luettin J, Maitre G (1999) XM2VTSDB: The extended M2VTS database. In: Second International Conference on Audio and Video-Based Biometric Person Authentication
Shen J, Zafeiriou S, Chrysos GG, Kossaifi J, Tzimiropoulos G, Pantic M (2015) The first facial landmark tracking in-the-wild challenge: Benchmark and results. In: Proceedings of the IEEE International Conference On Computer Vision Workshops
Wu W, Qian C, Yang S, Wang Q, Cai Y, Zhou Q (2018) Look at boundary: A boundary-aware face alignment algorithm. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition
Yin L, Sun XCY, Worm T, Reale M (2008) A high-resolution 3D dynamic facial expression database. In: IEEE International Conference on Automatic Face and Gesture Recognition, Amsterdam, The Netherlands
Bagdanov AD, Del Bimbo A, Masi I (2011) The florence 2D/3D hybrid face dataset. In: Proceedings of the 2011 Joint ACM Workshop on Human Gesture and Behavior Understanding. ACM
Zhang X, Yin L, Cohn JF, Canavan S, Reale M, Horowitz A, Liu P, Girard JM (2014) Bp4d-spontaneous: a high-resolution spontaneous 3d dynamic facial expression database. Image Vis Comput 32(10):692–706
Bulat A, Tzimiropoulos G (2017) How far are we from solving the 2D & 3D face alignment problem? (and a dataset of 230,000 3d facial landmarks). In: Proceedings of the IEEE International Conference on Computer Vision
Jain V, Learned-Miller E (2010) Fddb: A benchmark for face detection in unconstrained settings. UMass Amherst Technical Report
Acknowledgement
This work was supported by The Hong Kong Research Grants Council (RGC PolyU. 15603419).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Zhang, J., Zhou, K., Luximon, Y. (2021). A Brief Review of 3D Face Reconstruction Methods for Face-Related Product Design. In: Gutierrez, A.M.J., Goonetilleke, R.S., Robielos, R.A.C. (eds) Convergence of Ergonomics and Design. ACEDSEANES 2020. Advances in Intelligent Systems and Computing, vol 1298. Springer, Cham. https://doi.org/10.1007/978-3-030-63335-6_37
Download citation
DOI: https://doi.org/10.1007/978-3-030-63335-6_37
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-63334-9
Online ISBN: 978-3-030-63335-6
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)