Abstract
Autonomous vehicles have been investigated broadly during the last decade and predicted to decrease road fatalities by shifting control of safety-critical tasks from humans to machines. An early unsafety detection consequently becomes a key feature in every self-driving cars and trucks. In this paper, we present a promising approach for the safety prediction problem in autonomous vehicles by using one dataset collected from the competition CMDC 2019, which can capture multiple safe or unsafe situations from a front car camera put in different autonomous buses. We consider various ways to extract potential features from images provided and apply numerous machine learning techniques to learn an efficient detection algorithm. The experimental results show that by combining Histogram-of-Gradients (HOG) features as well as deep-learning ones computed from both ResNet50 and our proposed deep neural networks (MRNets), we can achieve an auspicious performance in terms of both micro-averaged F1-score and macro-averaged F1-score. The outcome of our papers can give an additional contribution to the current study of the problem.
Two first authors have equal contribution.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Althoff, M., Stursberg, O., Buss, M.: Model-based probabilistic collision detection in autonomous driving. IEEE Trans. Intell. Transp. Syst. 10(2), 299–310 (2009). https://doi.org/10.1109/TITS.2009.2018966
Dalal, N., Triggs, B.: Histograms of oriented gradients for human detection. In: Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR 2005) - Volume 1 - Volume 01, CVPR 2005, pp. 886–893. IEEE Computer Society, Washington, DC (2005). https://doi.org/10.1109/CVPR.2005.177
Gunn, S.R., et al.: Support vector machines for classification and regression. ISIS Tech. Rep. 14(1), 5–16 (1998)
Hancock, P.A., Nourbakhsh, I., Stewart, J.: On the future of transportation in an era of automated and autonomous vehicles. Proc. Nat. Acad. Sci. 116(16), 7684–7691 (2019). https://doi.org/10.1073/pnas.1805770115. https://www.pnas.org/content/116/16/7684
He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 770–778 (2016)
Kabeer, M., Riaz, F., Jabbar, S., Aloqaily, M., Abid, S.: Real world modeling and design of novel simulator for affective computing inspired autonomous vehicle. In: 2019 15th International Wireless Communications Mobile Computing Conference (IWCMC), pp. 1923–1928, June 2019. https://doi.org/10.1109/IWCMC.2019.8766745
Lee, H., Grosse, R., Ranganath, R., Ng, A.Y.: Convolutional deep belief networks for scalable unsupervised learning of hierarchical representations. In: Proceedings of the 26th Annual International Conference on Machine Learning, pp. 609–616 (2009)
Lin, T.-Y., et al.: Microsoft COCO: common objects in context. In: Fleet, D., Pajdla, T., Schiele, B., Tuytelaars, T. (eds.) ECCV 2014. LNCS, vol. 8693, pp. 740–755. Springer, Cham (2014). https://doi.org/10.1007/978-3-319-10602-1_48
Lowe, D.G.: Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis. 60(2), 91–110 (2004). https://doi.org/10.1023/B:VISI.0000029664.99615.94
Nguyen, H.D., Yeom, S., Lee, G.S., Yang, H.J., Na, I.S., Kim, S.H.: Facial emotion recognition using an ensemble of multi-level convolutional neural networks. Int. J. Pattern Recognit Artif Intell. 33(11), 1940015 (2019). https://doi.org/10.1142/S0218001419400159
Pang, S., Huang, B.: Sensor array data for autonomous vehicle incident detection. In: The 10th International Cybersecurity Data Mining Competition (CDMC 2019) (2019)
Penmetsa, P., Adanu, E.K., Wood, D., Wang, T., Jones, S.L.: Perceptions and expectations of autonomous vehicles – a snapshot of vulnerable road user opinion. Technol. Forecast. Soc. Change 143, 9–13 (2019). https://doi.org/10.1016/j.techfore.2019.02.010. http://www.sciencedirect.com/science/article/pii/S0040162518316603
Rajasekhar, M.V., Jaswal, A.K.: Autonomous vehicles: the future of automobiles. In: 2015 IEEE International Transportation Electrification Conference (ITEC), pp. 1–6, August 2015. https://doi.org/10.1109/ITEC-India.2015.7386874
Riaz, F., Jabbar, S., Sajid, M., Ahmad, M., Naseer, K., Ali, N.: A collision avoidance scheme for autonomous vehicles inspired by human social norms. Comput. Electr. Eng. 69, 690–704 (2018). https://doi.org/10.1016/j.compeleceng.2018.02.011. http://www.sciencedirect.com/science/article/pii/S0045790617327039
Russakovsky, O., et al.: ImageNet large scale visual recognition challenge. Int. J. Comput. Vision 115(3), 211–252 (2015). https://doi.org/10.1007/s11263-015-0816-y
Stilgoe, J.: Machine learning, social learning and the governance of self-driving cars. Soc. Stud. Sci. 48(1), 25–56 (2018). https://doi.org/10.1177/0306312717741687. pMID: 29160165
Tian, Y., Pei, K., Jana, S., Ray, B.: DeepTest: automated testing of deep-neural-network-driven autonomous cars. In: Proceedings of the 40th International Conference on Software Engineering, ICSE 2018, pp. 303–314. Association for Computing Machinery, New York (2018). https://doi.org/10.1145/3180155.3180220
Xie, S., Girshick, R., Dollár, P., Tu, Z., He, K.: Aggregated residual transformations for deep neural networks. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1492–1500 (2017)
Acknowledgement
This research is funded by Vietnam National University HoChiMinh City (VNU-HCM) under grant number NCM2019-18-01.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Pham, T., Dang, T., Nguyen, N., Ha, T., Nguyen, B.T. (2020). Early Unsafety Detection in Autonomous Vehicles. In: Nguyen, N.T., Hoang, B.H., Huynh, C.P., Hwang, D., Trawiński, B., Vossen, G. (eds) Computational Collective Intelligence. ICCCI 2020. Lecture Notes in Computer Science(), vol 12496. Springer, Cham. https://doi.org/10.1007/978-3-030-63007-2_32
Download citation
DOI: https://doi.org/10.1007/978-3-030-63007-2_32
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-63006-5
Online ISBN: 978-3-030-63007-2
eBook Packages: Computer ScienceComputer Science (R0)