Skip to main content
SpringerLink
Log in

Vehicle classification for large-scale traffic surveillance videos using Convolutional Neural Networks

  • Special Issue Paper
  • Published:
Machine Vision and Applications Aims and scope Submit manuscript

Abstract

Vehicle classification plays an important role in intelligent transport system. However, because the conventional vehicle classification methods are not robust to variations such as illumination, weather, noise, and the classification accuracy cannot meet the requirements of practical applications. Therefore, a new vehicle classification method using Convolutional Neural Networks is proposed in this paper, which consists of two steps: pre-training and fine-tuning. In pre-training, GoogLeNet is pre-trained on ILSVRC-2012 dataset to obtain the initial model with the corresponding connection weights. In fine-tuning, the initial model is further fine-tuned on VehicleDataset which is constructed with 13,700 images in this paper to obtain the final classification model. All images in the VehicleDataset are extracted from real highway surveillance videos, including variations of illumination, noise, resolution, angle of video cameras and weather. The vehicles are divided into six categories, i.e., bus, car, motorcycle, minibus, truck and van. The performance evaluation is carried out on the VehicleDataset. The experimental results show that the proposed method can avoid the complicated process of manually extracting features and the average classification accuracy is up to 98.26%, which is 3.42% higher than the conventional methods using “Feature + Classifier”.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

References

  1. Barth, M., Boriboonsomsin, K.: Environmentally beneficial intelligent transportation systems. Control Transp. Syst. 42, 342–345 (2009)

    Google Scholar 

  2. Imazu, K., Mita, Y.: Range-measurement-type optical vehicle detector. In: IEEE, pp. 48–53 (1995). ISBN: 0-7803-2587-7

  3. Li, P., Tan, D., Lin, B., : Embedded flexible assembly system for car latch based on laser identification. In: International, IET 2006, Technology and Innovation Conference, ITIC 2006, pp. 241–245 (2006)

  4. Duarte, M.F., Hu, Y.H.: Vehicle classification in distributed sensor networks. J. Parallel Distrib. Comput. 64(7), 826–838 (2004)

    Article  Google Scholar 

  5. Ng, L.T., Suandi, S.A., Teoh, S.S. : Vehicle classification using visual background extractor and multi-class support vector machines. In: The 8th International Conference on Robotic, Vision, Signal Processing & Power Applications, pp. 221–227. Springer, Singapore (2014)

  6. Chen, Y., Qin, G.F. : Video-based vehicle detection and classification in challenging scenarios. Int. J. Smart Sens. Intell. Syst. 7(3) (2014)

  7. Matos, F.M.S., de Souza, R.M.C.R. : Hierarchical classification of vehicle images using NN with conditional adaptive distance. In: International Conference on Neural Information Processing, pp. 745–752. Springer, Berlin (2013)

  8. Cui, Y.Y.: Research on Vehicle Recognition in Intelligent Transportation. University of Electronic Science and Technology of China, Chengdu (2013)

    Google Scholar 

  9. Wen, X., Shao, L., Xue, Y., et al.: A rapid learning algorithm for vehicle classification. Inf. Sci. 295(1), 395–406 (2015)

    Article  Google Scholar 

  10. Ku, W.L., Chou, H.C., Peng, W.H.: Discriminatively-learned global image representation using CNN as a local feature extractor for image retrieval. In: Visual Communications and Image Processing (VCIP), IEEE 2015, pp. 1–4 (2015)

  11. Girshick, R.: Fast R-CNN. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 1440–1448 (2015)

  12. Ren, S., He, K., Girshick, R., et al.: Faster R-CNN: towards real-time object detection with region proposal networks. In: Advances in Neural Information Processing Systems, pp. 91–99 (2015)

  13. Szegedy, C., Liu, W., Jia, Y., et al.: Going deeper with convolutions. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–9 (2015)

  14. Russakovsky, O., Deng, J., Su, H., et al.: Imagenet large scale visual recognition challenge. Int. J. Comput. Vis. 115(3), 211–252 (2015)

    Article  MathSciNet  Google Scholar 

  15. Szegedy, C., Liu, W., Jia, Y, et al.: Going deeper with convolutions. In: IEEE Conference on Computer Vision and Pattern Recognition. IEEE Computer Society, vol. 7, pp. 1–9 (2015)

  16. Peng, Y., Yan, Y., Zhu, W. et al.: Vehicle classification using sparse coding and spatial pyramid matching. In: 2014 IEEE 17th International Conference on Intelligent Transportation Systems (ITSC), IEEE, pp. 259–263 (2014)

  17. Krizhevsky, A., Sutskever, I., Hinton, G.E. : Imagenet classification with deep convolutional neural networks. In: Advances in Neural Information Processing Systems, pp. 1097–1105 (2012)

  18. Zhou, K., Zhuo, L., Geng, Z.: Convolutional neural networks based pornographic image classification. In: IEEE Second International Conference on Multimedia Big Data, pp. 206–209 (2016)

  19. Phung, S.L., Bouzerdoum, A.: A pyramidal neural network for visual pattern recognition. IEEE Trans. Neural Netw. 18(2), 329–343 (2007)

    Article  Google Scholar 

  20. Phung, S.L., Bouzerdoum, A.: MATLAB library for convolutional neural networks. Technical Report. University of Wollongong. http://www.elec.uow.edu.au/staff/sphung (2009)

  21. Lin, M., Chen, Q.: Yan S. Network in network. arXiv preprint arXiv:1312.4400 (2013)

  22. Ma, T., Zou, Y., Ding, Q.: Urban vehicle classification based on linear SVM with efficient vector sparse coding. In: 2013 IEEE International Conference on Information and Automation (ICIA), IEEE, pp. 527–532 (2013)

  23. Yang, L., Luo, P., Change Loy C., et al.: A large-scale car dataset for fine-grained categorization and verification. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 3973–3981 (2015)

  24. Collobert, R., Kavukcuoglu, K., Farabet, C.: Torch7: a matlab-like environment for machine learning, BigLearn, NIPS Workshop (EPFL-CONF-192376), pp. 1–6 (2011)

  25. Chollet, F.: Keras Deep Learning Library. https://github.com/fchollet/keras (2016)

  26. Krizhevsky, A., Sutskever, I., Hinton, G.E.: Imagenet classification with deep convolutional neural networks. In: Advances in Neural Information Processing Systems, pp. 1097–1105 (2012)

  27. Zhang, Y.: Vehicle Type Recognition in Traffic Video Surveillance. Wuhan University of Technology, Wuhan (2012)

    Google Scholar 

  28. Li, Y.: Research of Vehicle Type Recognition Base on Video Sequence. Zhejiang University, Hangzhou (2014)

    Google Scholar 

  29. Gu, B., Sheng, V.S., Li, S.: Bi-parameter space partition for cost-sensitive SVM. In: Proceedings of the 24th International Conference on Artificial Intelligence. AAAI Press, pp. 3532–3539 (2015)

  30. Gu, B., Sun, X., Sheng, V.S.: Structural minimax probability machine. IEEE Trans. Neural Netw. Learn. Syst. 1–11 (2016). doi:10.1109/TNNLS.2016.2544779

  31. Gu, B., Sheng, V.S.: A robust regularization path algorithm for \(\nu \)-support vector classification. IEEE Trans. Neural Netw. Learn. Syst. 28(5), 1241–1248 (2017)

Download references

Acknowledgements

The work in this paper is supported by the National Natural Science Foundation of China (No. 61531006), the Importation and Development of High-Caliber Talents Project of Beijing Municipal Institutions (Nos. CIT&TCD20150311, CIT&TCD201404043), the Beijing Natural Science Foundation (No. 4142009), the Science and Technology Development Program of Beijing Education Committee (No. KM201410005002, No. KM201510005004), Funding Project for Academic Human Resources Development in Institutions of Higher Learning Under the Jurisdiction of Beijing Municipality.

Author information

Authors and Affiliations

  1. Signal and Information Processing Lab, Beijing University of Technology, Beijing, China

    Li Zhuo, Liying Jiang, Ziqi Zhu, Jiafeng Li, Jing Zhang & Haixia Long

  2. Collaborative Innovation Center of Electric Vehicles in Beijing, Beijing, China

    Li Zhuo

Authors
  1. Li Zhuo
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Liying Jiang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Ziqi Zhu
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Jiafeng Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Jing Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Haixia Long
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Liying Jiang.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zhuo, L., Jiang, L., Zhu, Z. et al. Vehicle classification for large-scale traffic surveillance videos using Convolutional Neural Networks. Machine Vision and Applications 28, 793–802 (2017). https://doi.org/10.1007/s00138-017-0846-2

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00138-017-0846-2

Keywords

Search

Navigation