Skip to main content
SpringerLink
Log in

Video-Based Face Recognition: State of the Art

  • Conference paper
Biometric Recognition (CCBR 2011)

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 7098))

Included in the following conference series:

Abstract

Face recognition in videos is a hot topic in computer vision and biometrics over many years. Compared to traditional face analysis, video based face recognition has advantages of more abundant information to improve accuracy and robustness, but also suffers from large scale variations, low quality of facial images, illumination changes, pose variations and occlusions. Related to applications, we divide the existing video based face recognition approaches into two categories: video-image based methods and video-video based methods, which are surveyed and analyzed in this paper.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Shakhnarovich, G., Fisher, J.W., Darrell, T.: Face Recognition from Long-Term Observations. In: Heyden, A., Sparr, G., Nielsen, M., Johansen, P. (eds.) ECCV 2002, Part III. LNCS, vol. 2352, pp. 851–865. Springer, Heidelberg (2002)

    Chapter  Google Scholar 

  2. Liu, X., Chen, T., Thornton, S.M.: Eigenspace updating for non-stationary process and its application to face recognition. Pattern Recognition 36(9), 1945–1959 (2003)

    Article  MATH  Google Scholar 

  3. Liu, X., Cheng, T.: Video-based face recognition using adaptive hidden markov models. In: Proceedings of 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 1, pp. I–340. IEEE (2003)

    Google Scholar 

  4. Lee, K.C., Ho, J., Yang, M.H., Kriegman, D.: Video-based face recognition using probabilistic appearance manifolds. In: Proceedings of 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 1, pp. I–313. IEEE (2003)

    Google Scholar 

  5. Lee, K.C., Ho, J., Yang, M.H., Kriegman, D.: Visual tracking and recognition using probabilistic appearance manifolds. Computer Vision and Image Understanding 99, 303–331 (2005)

    Article  Google Scholar 

  6. Zhou, S., Krueger, V., Chellappa, R.: Probabilistic recognition of human faces from video q. Computer Vision and Image Understanding 91, 214–245 (2003)

    Article  Google Scholar 

  7. Zhou, S.K., Chellappa, R., Moghaddam, B.: Visual tracking and recognition using appearance-adaptive models in particle filters. IEEE Transactions on Image Processing 13(11), 1491–1506 (2004)

    Article  Google Scholar 

  8. Aggarwal, G., Chowdhury, A.K.R., Chellappa, R.: A system identification approach for video-based face recognition. In: Proceedings of 17th International Conference on Pattern Recognition, ICPR 2004, vol. 4, pp. 175–178. IEEE Computer Society (2004)

    Google Scholar 

  9. Arandjelović, O., Cipolla, R.: Face recognition from face motion manifolds using robust kernel resistor-average distance. In: Conference on Computer Vision and Pattern Recognition Workshop, CVPRW 2004, p. 88. IEEE (2004)

    Google Scholar 

  10. Arandjelović, O., Shakhnarovich, G., Fisher, J., Cipolla, R., Darrell, T.: Face recognition with image sets using manifold density divergence (2005)

    Google Scholar 

  11. Cipolla, R., Arandjelović, O.: A pose-wise linear illumination manifold model for face recognition using video. Computer Vision and Image Understanding 113(1), 113–125 (2009)

    Article  Google Scholar 

  12. Fukui, K., Yamaguchi, O.: Face recognition using multi-viewpoint patterns for robot vision. In: Robotics Research, pp. 192–201 (2005)

    Google Scholar 

  13. Nishiyama, M., Yamaguchi, O., Fukui, K.: Face Recognition with the Multiple Constrained Mutual Subspace Method. In: Kanade, T., Jain, A., Ratha, N.K. (eds.) AVBPA 2005. LNCS, vol. 3546, pp. 71–80. Springer, Heidelberg (2005)

    Chapter  Google Scholar 

  14. Li, J., Wang, Y., Tan, T.: Video-Based Face Recognition Using A Metric of Average Euclidean Distance. In: Li, S.Z., Lai, J.-H., Tan, T., Feng, G.-C., Wang, Y. (eds.) SINOBIOMETRICS 2004. LNCS, vol. 3338, pp. 224–232. Springer, Heidelberg (2004)

    Chapter  Google Scholar 

  15. Li, J., Wang, Y., Tan, T.: Video-Based Face Recognition Using Earth Mover’s Distance. In: Kanade, T., Jain, A., Ratha, N.K. (eds.) AVBPA 2005. LNCS, vol. 3546, pp. 229–238. Springer, Heidelberg (2005)

    Chapter  Google Scholar 

  16. Turk, M.A., Pentland, A.P.: Face recognition using eigenfaces. In: Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR 1991, pp. 586–591. IEEE (1991)

    Google Scholar 

  17. Belhumeur, P.N., Hespanha, J.P., Kriegman, D.J.: Eigenfaces vs. fisherfaces: Recognition using class specific linear projection. IEEE Transactions on Pattern Analysis and Machine Intelligence 19(7), 711–720 (1997)

    Article  Google Scholar 

  18. Satoh, S.: Comparative evaluation of face sequence matching for content-based video access. In: Proceedings of Fourth IEEE International Conference on Automatic Face and Gesture Recognition 2000, pp. 163–168. IEEE (2000)

    Google Scholar 

  19. Arca, S., Campadelli, P., Lanzarotti, R.: A face recognition system based on automatically determined facial fiducial points. Pattern Recognition 39(3), 432–443 (2006)

    Article  MATH  Google Scholar 

  20. Stallkamp, J., Ekenel, H.K., Stiefelhagen, R.: Video-based face recognition on real-world data. In: IEEE 11th International Conference on Computer Vision, ICCV 2007, pp. 1–8. IEEE (2007)

    Google Scholar 

  21. Kokiopoulou, E., Frossard, P.: Video face recognition with graph-based semi-supervised learning. In: IEEE International Conference on Multimedia and Expo, ICME 2009, pp. 1564–1565. IEEE (2009)

    Google Scholar 

  22. Hu, C., Harguess, J., Aggarwal, J.K.: Patch-based face recognition from video. In: 2009 16th IEEE International Conference on Image Processing (ICIP), pp. 3321–3324. IEEE (2009)

    Google Scholar 

  23. Choi, J.Y., Ro, Y.M., Plataniotis, K.N.: Feature subspace determination in video-based mismatched face recognition. In: 8th IEEE International Conference on Automatic Face & Gesture Recognition, FG 2008, pp. 1–6. IEEE (2008)

    Google Scholar 

  24. Eidenberger, H.: Kalman filtering for pose-invariant face recognition. In: 2006 IEEE International Conference on Image Processing, pp. 2037–2040. IEEE (2006)

    Google Scholar 

  25. Park, U., Jain, A.K., Ross, A.: Face recognition in video: Adaptive fusion of multiple matchers. In: 2007 IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–8. IEEE (2007)

    Google Scholar 

  26. Lapedriza, A., Masip, D., Vitria, J.: Face verification using external features. In: 7th International Conference on Automatic Face and Gesture Recognition, FGR 2006, pp. 132–137. IEEE (2006)

    Google Scholar 

  27. Mian, A.: Unsupervised learning from local features for video-based face recognition. In: 8th IEEE International Conference on Automatic Face & Gesture Recognition, FG 2008, pp. 1–6. IEEE (2008)

    Google Scholar 

  28. Wolf, L., Shashua, A.: Kernel principal angles for classification machines with applications to image sequence interpretation (2003)

    Google Scholar 

  29. Fan, W., Yeung, D.Y.: Locally linear models on face appearance manifolds with application to dual-subspace based classification (2006)

    Google Scholar 

  30. Moghaddam, B., Jebara, T., Pentland, A.: Bayesian face recognition. Pattern Recognition 33(11), 1771–1782 (2000)

    Article  Google Scholar 

  31. Zhou, S.K., Chellappa, R.: From sample similarity to ensemble similarity: Probabilistic distance measures in reproducing kernel hilbert space. IEEE transactions on pattern analysis and machine intelligence, 917–929 (2006)

    Google Scholar 

  32. Fan, W., Wang, Y., Tan, T.: Video-Based Face Recognition Using Bayesian Inference Model. In: Kanade, T., Jain, A., Ratha, N.K. (eds.) AVBPA 2005. LNCS, vol. 3546, pp. 122–130. Springer, Heidelberg (2005)

    Chapter  Google Scholar 

  33. Li, Y., Gong, S., Liddell, H.: Modelling faces dynamically across views and over time. In: Proceedings of Eighth IEEE International Conference on Computer Vision, ICCV 2001, vol. 1, pp. 554–559. IEEE (2001)

    Google Scholar 

  34. Li, Y., Gong, S., Liddell, H.: Video-based online face recognition using identity surfaces. ratfg-rts, 40 (2001)

    Google Scholar 

  35. Li, Y., Gong, S., Liddell, H.: Constructing facial identity surfaces in a nonlinear discriminating space (2001)

    Google Scholar 

  36. Liu, L., Wang, Y., Tan, T.: Online appearance model learning for video-based face recognition. In: 2007 IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–7. IEEE (2007)

    Google Scholar 

  37. Kim, M., Kumar, S., Pavlovic, V., Rowley, H.: Face tracking and recognition with visual constraints in real-world videos. In: IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2008, pp. 1–8. IEEE (2008)

    Google Scholar 

  38. Matta, F., Dugelay, J.L.: Person recognition using facial video information: A state of the art. Journal of Visual Languages & Computing 20(3), 180–187 (2009)

    Article  Google Scholar 

  39. Saeed, U., Matta, F., Dugelay, J.L.: Person recognition based on head and mouth dynamics. In: 2006 IEEE 8th Workshop on Multimedia Signal Processing, pp. 29–32. IEEE (2006)

    Google Scholar 

  40. Matta, F., Dugelay, J.L.: Video face recognition: a physiological and behavioural multimodal approach. In: IEEE International Conference on Image Processing, 2007. ICIP 2007, vol. 4, pp. IV–497. IEEE (2007)

    Google Scholar 

  41. Matta, F., Dugelay, J.-L.: Person recognition using human head motion information. In: Perales, F.J., Fisher, R.B. (eds.) AMDO 2006. LNCS, vol. 4069, pp. 326–335. Springer, Heidelberg (2006)

    Chapter  Google Scholar 

  42. Huang, K.S., Trivedi, M.M.: Streaming face recognition using multicamera video arrays. In: Proceedings of 16th International Conference on Pattern Recognition 2002, vol. 4, pp. 213–216. IEEE (2002)

    Google Scholar 

  43. Gross, R., Shi, J.: The cmu motion of body (mobo) database (2001)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Laboratory of Intelligent Recognition and Image Processing, Beihang University, Beijing, China

    Zhaoxiang Zhang

  2. Beijing Key Laboratory of Digital Media, Beihang University, Beijing, China

    Chao Wang

  3. School of Computer Science and Engineering, Beihang University, Beijing, China

    Yunhong Wang

Authors
  1. Zhaoxiang Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Chao Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Yunhong Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. National Laboratory of Pattern Recognition, Center for Biometrics and Security Research, Chinese Academy of Sciences, Institute of Automation, P.O. Box 2728, 100190, Beijing, China

    Zhenan Sun  & Tieniu Tan  & 

  2. School of Information Science and Technolog, Sun Yat-Sen University, 510275, Guangzhou, China

    Jianhuang Lai

  3. Institute of Computing Technology, Chinese Academy of Sciences, 100190, Beijing, China

    Xilin Chen

Rights and permissions

Reprints and permissions

Copyright information

© 2011 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Zhang, Z., Wang, C., Wang, Y. (2011). Video-Based Face Recognition: State of the Art. In: Sun, Z., Lai, J., Chen, X., Tan, T. (eds) Biometric Recognition. CCBR 2011. Lecture Notes in Computer Science, vol 7098. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-25449-9_1

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-25449-9_1

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-25448-2

  • Online ISBN: 978-3-642-25449-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation