Skip to main content
SpringerLink
Log in

An efficient system for anomaly detection using deep learning classifier

  • Original Paper
  • Published:
Signal, Image and Video Processing Aims and scope Submit manuscript

Abstract

In this paper, a deep learning-based anomaly detection (DLAD) system is proposed to improve the recognition problem in video processing. Our system achieves complete detection of abnormal events by involving the following significant proposed modules a Background Estimation (BE) Module, an Object Segmentation (OS) Module, a Feature Extraction (FE) Module, and an Activity Recognition (AR) Module. At first, we have presented a BE (Background Estimation) module that generated an accurate background in which two-phase model is generated to compute the background estimation. After a high-quality background is generated, the OS model is developed to extract the object from videos, and then, object tracking process is used to track the object through the overlapping detection scheme. From the tracked objects, the FE module is extracted for some useful features such as shape, wavelet, and histogram to the abnormal event detection. For the final step, the proposed AR module is classified as abnormal or normal event using the deep learning classifier. Experiments are performed on the USCD benchmark dataset of abnormal activities, and comparisons with the state-of-the-art methods validate the advantages of our algorithm. We can see that the proposed activity recognition system has outperformed by achieving better EER of 0.75 % when compared with the existing systems (20 %). Also, it shows that the proposed method achieves 85 % precision rate in the frame-level performance.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

References

  1. Liu, J., Yu, Q., Javed, O., Ali, S., Tamrakar, A., Divakaran, A., Cheng, H., Sawhney, H.: Video event recognition using concept attributes. IEEE Workshop on Application of Computer Version (2013)

  2. Wang, X., Zhang, X.P.: An ICA mixture hidden conditional random field model for video event classification. IEEE Trans. Circuits Syst. Video Technol. 23(1), 46–59 (2012)

    Article  Google Scholar 

  3. Hanjalic, A.: Content-Based Analysis of Digital Video. Kluwer, Dordrecht (2004)

    MATH  Google Scholar 

  4. Kanade, T., Okutomi, M.: A stereo matching algorithm with an adaptive window: theory and experiment. IEEE Trans. Pattern Anal. Mach. Intell. 16(9), 920–932 (1994)

    Article  Google Scholar 

  5. Herbrich, R.: Learning Kernel Classifier: Theory and Algorithm. The MIT Press, Cambridge (2002)

    Google Scholar 

  6. Natarajan, P., Nevatia, R.: Real time tracking and recognition of human actions. In: Proceedings of IEEE Workshop on Motion and Video, Computing, pp. 1–8 (2008)

  7. Sempena, S., Maulidevi, N., Aryan, P.R.: Human action recognition using dynamic time warping. In: IEEE International Conference on Electrical Engineering and Informatics (ICEEI), pp. 1–5 (2011)

  8. Duong, T.V., Bui, H.H., Phung, D.Q., Venkatesh, S.: Activity recognition and abnormality detection with the switching hidden semi-Markov model. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR), vol. 1, pp. 838–845 (2005)

  9. Natarajan, P., Nevatia, R.: Online, real-time tracking and recognition of human actions. In: Proceedings of IEEE Workshop on Motion and Video Computing (WMVC), Copper Mountain, pp. 1–8 (2008)

  10. Du, Y., Chen, F., Xu, W.: Human interaction representation and recognition through motion decomposition. IEEE Signal Process. Lett. 14, 952–955 (2007)

    Article  Google Scholar 

  11. Schuldt, C., Laptev, I., Caputo, B.: Recognizing human actions: a local SVM approach. In: Proceedings of the 17th IEEE International Conference on Pattern Recognition (ICPR), vol. 3, pp. 32–36 (2004)

  12. Laptev, L., Marszalek, M., Schmid, C., Rozenfeld, B.: Learning realistic human actions from movies. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1–8 (2008)

  13. Foroughi, H., Naseri, A., Saberi, A., Yazdi, H.S.: An eigen space-based approach for human fall detection using integrated time motion image and neural network. In: Proceedings of IEEE 9th International Conference on Signal Processing (ICSP), pp. 1499–1503 (2008)

  14. Tipping, M.E.: Sparse Bayesian learning and the relevance vector machine. J. Mach. Learn. Res. 1, 211–244 (2001)

    MathSciNet  MATH  Google Scholar 

  15. Tipping, M.E.: The relevance vector machine. Adv. Neural Inf. Process. Syst. pp. 652–658 (2000)

  16. Bodor, R., Jackson, B., Papanikolopoulos, N.: Vision-based human tracking and activity recognition. In: Proceedings of the 11th Mediterranean Conference on Control and Automation, vol. 1, pp. 18–20 (2003)

  17. Ribeiro, P.C., Santos-Victor, J.: Human activity recognition from video: modeling, feature selection and classification architecture. In: Proceedings of the International Workshop on Human Activity Recognition and Modeling (HAREM), Oxford, UK, vol. 1, pp. 61–70 (2005)

  18. Ben-Arie, J., Wang, Z., Pandit, P., Rajaram, S.: Human activity recognition using multidimensional indexing. IEEE Trans. Pattern Anal. 24(8), 1091–1104 (2002)

    Article  Google Scholar 

  19. Kumari, S., Mitra, S.K.: Human action recognition using DFT. In: Proceedings of the Third IEEE National Conference on Computer Vision, Pattern Recognition, Image Processing and Graphics (NCVPRIPG), pp. 239–242 (2011)

  20. Linbo, W., Jieyu, Z.: Video image segmentation based on Bayesian learning. J. Image Graph. 1073–1078 (2005)

  21. Zhu, Y., Nayak, N.M., Roy-Chowdhury, A.K.: Context-aware activity recognition and anomaly detection in video. IEEE J. Sel. Top. Signal Process. 7(1), 91–101 (2013)

    Article  Google Scholar 

  22. Lin, W., Chu, H., Wu, J., Sheng, B., Chen, Z.: A heat-map-based algorithm for recognizing group activities in videos. IEEE Trans. Circuits Syst. Video Technol. 23(11), 1980–1992 (2013)

    Article  Google Scholar 

  23. Lee, S.Y., Sim, J.Y., Kim, C.S., Lee, S.U.: Correspondence matching of multi-view video sequences using mutual information based similarity measure. IEEE Trans. Multimed. 15(8), 1719–1731 (2013)

    Article  Google Scholar 

  24. Vijayakumar, V., Nedunchezhian, R.: Event detection in cricket video based on visual and acoustic features. J. Glob. Res. Comput. Sci. 3(8), 26–29 (2012)

    Google Scholar 

  25. Goyani, M.M., Dutta, S.K., Raj, P.: Key frame detection based semantic event detection and classification using hierarchical approach for cricket sport video indexing. Adv. Comput. Sci. Inform. Technol. Commun. Comput. Inform. Sci. 131, 388–397 (2011)

    Article  Google Scholar 

  26. San Miguel, J.C., Martinez, J.M.: A semantic-based probabilistic approach for real-time video event recognition. Comput. Vis. Image Underst. 116(9), 937–952 (2012)

    Article  Google Scholar 

  27. UCSD Anomaly Detection Dataset. http://www.svcl.ucsd.edu/projects/anomaly/dataset.htm

  28. Gonzalez, R.C., Woods, R.E., Eddins, S.L.: Digital Image Processing Using Matlab. Pearson Education, Inc., Upper Saddle River (2004)

  29. Hinton, G.E., Osindero, S., Teh, Y.: A fast learning algorithm for deep belief nets. Neural Comput. 18(7), 1527–1554 (2006)

    Article  MathSciNet  MATH  Google Scholar 

  30. Cong, Y., Yuan, J., Tang, Y.: Video anomaly search in crowded scenes via spatio-temporal motion context. IEEE Trans. Inform. Forensics Secur. 8(10), 1590–1599 (2013)

  31. Mahadevan, V., Li, W., Bhalodia, V., Vasconcelos, N: Anomaly detection in crowded scenes. In: CVPR, vol. 249, pp. 250, (2010)

  32. Cong, Y., Yuan, J., Liu, J.: Sparse reconstruction cost for abnormal event detection. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 3449–3456 (2011)

Download references

Author information

Authors and Affiliations

  1. SRM- Valliammai Engineering College, Chennai, India

    A. R. Revathi

  2. Department of Information Technology, Anna University, MIT, Chennai, India

    Dhananjay Kumar

Authors
  1. A. R. Revathi
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Dhananjay Kumar
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to A. R. Revathi.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Revathi, A.R., Kumar, D. An efficient system for anomaly detection using deep learning classifier. SIViP 11, 291–299 (2017). https://doi.org/10.1007/s11760-016-0935-0

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11760-016-0935-0

Keywords

Search

Navigation