Abstract
Car park video surveillance data provides plenty of semantic rich data such as vehicle color, trajectory, speed, and type which can be tapped into and extracted for video and data analytics. We present methods for extracting and retrieving color and motion semantics from long term carpark video surveillance. This is a challenging task in outdoor scenarios due to ever-changing illumination and weather conditions, while retrieval time also increases as data size grows. To address these challenges, we subdivided the search space into smaller chunks by introducing spatio-temporal cubes or atoms, which can store and retrieve these semantics at ease. The proposed method was tested on 2 days of continuous data from an outdoor carpark under various lighting and weather conditions. We report the precision, recall and \(F_1\) scores to determine the overall performance of the system.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Brent, B., Kay, P.: Basic Color Terms: Their Universality and Evolution. University of California Press, Berkeley (1991)
Castañón, G., Elgharib, M., Saligrama, V., Jodoin, P.M.: Retrieval in long-surveillance videos using user-described motion and object attributes. IEEE Trans. Circ. Syst. Video Technol. 26(12), 2313–2327 (2016)
d’Acierno, A., Saggese, A., Vento, M.: Designing huge repositories of moving vehicles trajectories for efficient extraction of semantic data. IEEE Trans. Intell. Transp. Syst. 16(4), 2038–2049 (2015)
Dehghan, A., Masood, S.Z., Shu, G., Ortiz, E., et al.: View independent vehicle make, model and color recognition using convolutional neural network. arXiv preprint arXiv:1702.01721 (2017)
Feris, R.S., Siddiquie, B., Petterson, J., Zhai, Y., Datta, A., Brown, L.M., Pankanti, S.: Large-scale vehicle detection, indexing, and search in urban surveillance videos. IEEE Trans. Multimed. 14(1), 28–42 (2012)
Hu, C., Bai, X., Qi, L., Chen, P., Xue, G., Mei, L.: Vehicle color recognition with spatial pyramid deep learning. IEEE Trans. Intell. Transp. Syst. 16(5), 2925–2934 (2015)
Lim, R.W.S., Cheong, C.W., See, J., Tan, I.K.T., Wong, L.K., Khor, H.Q.: On vehicle state tracking for long-term carpark video surveillance. In: IEEE International Conference on Signal and Image Processing Applications (2017, to appear)
Moghimi, M.K., Pourghassem, H.: Shadow detection based on combinations of HSV color space and orthogonal transformation in surveillance videos. In: 2014 Iranian Conference on Intelligent Systems (ICIS), pp. 1–6. IEEE (2014)
Rachmadi, R.F., Purnama, I.: Vehicle color recognition using convolutional neural network. arXiv preprint arXiv:1510.07391 (2015)
Redmon, J., Divvala, S., Girshick, R., Farhadi, A.: You only look once: unified, real-time object detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 779–788 (2016)
Zhang, T., Liu, S., Xu, C., Lu, H.: Mining semantic context information for intelligent video surveillance of traffic scenes. IEEE Trans. Industr. Inf. 9(1), 149–160 (2013)
Acknowledgment
This work is supported in part by Telekom Malaysia Research & Development Grant No. RDTC/160903 (SHERLOCK) and Multimedia University.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer International Publishing AG
About this paper
Cite this paper
Cheong, C.W., Lim, R.WS., See, J., Wong, LK., Tan, I.K.T., Aris, A. (2018). Vehicle Semantics Extraction and Retrieval for Long-Term Carpark Video Surveillance. In: Schoeffmann, K., et al. MultiMedia Modeling. MMM 2018. Lecture Notes in Computer Science(), vol 10705. Springer, Cham. https://doi.org/10.1007/978-3-319-73600-6_27
Download citation
DOI: https://doi.org/10.1007/978-3-319-73600-6_27
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-73599-3
Online ISBN: 978-3-319-73600-6
eBook Packages: Computer ScienceComputer Science (R0)