Skip to main content

Facial Expression Recognition Based on Regularized Semi-supervised Deep Learning

  • Conference paper
  • First Online:
Advances in Intelligent Information Hiding and Multimedia Signal Processing

Part of the book series: Smart Innovation, Systems and Technologies ((SIST,volume 157))

Abstract

In the field of facial expression recognition, deep learning has attracted more and more researchers’ attention as a powerful tool. The method can effectively train and test data by using a neural network. This paper mainly uses the semi-supervised deep learning model for feature extraction and adds a regularized sparse representation model as a classifier. The combination of deep learning features and sparse representations fully exploits the advantages of deep learning in feature learning and the advantages of sparse representation in recognition. Experiments show that the features obtained by deep learning have certain subspace features, which accord with the subspace hypothesis of face recognition based on sparse representation. The method of this paper has a good recognition accuracy in facial expression recognition and has certain advantages in small sample problems.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 219.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Weston, J., Ratle, F., Mobahi, H., et al.: Deep learning via semi-supervised embedding. Neural Networks: Tricks of the Trade, pp. 639–655. Springer, Berlin, Heidelberg (2012)

    Google Scholar 

  2. Lee, D.H.: Pseudo-label: the simple and efficient semi-supervised learning method for deep neural networks. In: Workshop on Challenges in Representation Learning, ICML, vol. 3, p. 2 (2013)

    Google Scholar 

  3. Huang, K., Aviyente, S.: Sparse representation for signal classification. Advances in Neural Information Processing Systems, pp. 609–616 (2007)

    Google Scholar 

  4. Lee, K.C., Ho, J., Kriegman, D.J.: Acquiring linear subspaces for face recognition under variable lighting. IEEE Trans. Pattern Anal. Mach. Intell. 5, 684–698 (2005)

    Google Scholar 

  5. Wright, J., Yang, A.Y., Ganesh, A., et al.: Robust face recognition via sparse representation. IEEE Trans. Pattern Anal. Mach. Intell. 31(2), 210–227 (2009)

    Article  Google Scholar 

  6. Yang, M., Zhang, L., Feng, X., et al.: Fisher discrimination dictionary learning for sparse representation. In: 2011 IEEE International Conference on Computer Vision (ICCV), pp. 543–550. IEEE (2011)

    Google Scholar 

  7. Deng, W., Hu, J., Guo, J.: Extended SRC: undersampled face recognition via intraclass variant dictionary. IEEE Trans. Pattern Anal. Mach. Intell. 34(9), 1864–1870 (2012)

    Article  Google Scholar 

  8. Fan, Z., Ni, M., Zhu, Q., et al.: Weighted sparse representation for face recognition. Neurocomputing 151, 304–309 (2015)

    Article  Google Scholar 

  9. Guo, Y., Zhao, G., Pietikäinen, M.: Dynamic facial expression recognition with atlas construction and sparse representation. IEEE Trans. Image Process. 25(5), 1977–1992 (2016)

    Article  MathSciNet  Google Scholar 

  10. Goodfellow, I.J., Erhan, D., Carrier, P.L., et al.: Challenges in representation learning: a report on three machine learning contest. In: International Conference on Neural Information Processing, pp. 117–124. Springer, Berlin, Heidelberg (2013)

    Chapter  Google Scholar 

  11. Guo, Y., Tao, D., Yu, J., et al.: Deep neural networks with relativity learning for facial expression recognition. In: 2016 IEEE International Conference on Multimedia & Expo Workshops (ICMEW), pp. 1–6. IEEE (2016)

    Google Scholar 

  12. Kim, B.K., Roh, J., Dong, S.Y., et al.: Hierarchical committee of deep convolutional neural networks for robust facial expression recognition. J Multimodal User Interfaces 10(2), 173–189 (2016)

    Article  Google Scholar 

Download references

Acknowledgements

This paper is supported by Jilin Provincial Education Department “13th five-year” Science, Technology Project (No. JJKH20170571KJ), National Natural Science Foundation of China under Grant 61873304, The Science & Technology Plan Project Changchun City under Grant No. 17SS012, and the Industrial Innovation Special Funds Project of Jilin Province under Grant No. 2018C038-2 & 2019C010.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Shuaishi Liu .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Liu, T., Guo, W., Sun, Z., Lian, Y., Liu, S., Wu, K. (2020). Facial Expression Recognition Based on Regularized Semi-supervised Deep Learning. In: Pan, JS., Li, J., Tsai, PW., Jain, L. (eds) Advances in Intelligent Information Hiding and Multimedia Signal Processing. Smart Innovation, Systems and Technologies, vol 157. Springer, Singapore. https://doi.org/10.1007/978-981-13-9710-3_34

Download citation

Publish with us

Policies and ethics