Abstract
The automotive industry is currently focusing on automation in their vehicles, and perceiving the surroundings of an automobile requires the ability to detect and identify objects, events and persons, not only from the outside of the vehicle but also from the inside of the cabin. This constitutes relevant information for defining intelligent responses to events happening on both environments. This work presents a new method for in-vehicle monitoring of passengers, specifically the task of real-time face detection in thermal images, by applying transfer learning with YOLOv3. Using this kind of imagery for this purpose brings some advantages, such as the possibility of detecting faces during the day and in the dark without being affected by illumination conditions, and also because it’s a completely passive sensing solution. Due to the lack of suitable datasets for this type of application, a database of in-vehicle images was created, containing images from 38 subjects performing different head poses and at varying ambient temperatures. The tests in our database show an AP50 of 99.7% and an AP of 78.5%.
Supported by Bosch Car Multimedia Portugal, S.A. and INESC TEC Porto, Portugal.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Basbrain, A.M., Gan, J.Q., Clark, A.: Accuracy enhancement of the viola-jones algorithm for thermal face detection. In: Huang, D.-S., Hussain, A., Han, K., Gromiha, M.M. (eds.) ICIC 2017. LNCS (LNAI), vol. 10363, pp. 71–82. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-63315-2_7
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., Fei-Fei, L.: ImageNet: a large-scale hierarchical image database. In: 2009 IEEE Conference on Computer Vision and Pattern Recognition (2009). https://doi.org/10.1109/CVPRW.2009.5206848
Korukçu, M.Z., Kilic, M.: The usage of IR thermography for the temperature measurements inside an automobile cabin. Int. Commun. Heat Mass Transf. 36(8), 872–877 (2009). https://doi.org/10.1016/j.icheatmasstransfer.2009.04.010
Kwásniewska, A., Rumiński, J., Rad, P.: Deep features class activation map for thermal face detection and tracking. In: Proceedings - 2017 10th International Conference on Human System Interactions, HSI 2017, pp. 41–47 (2017). https://doi.org/10.1109/HSI.2017.8004993
Lin, T.-Y., et al.: Microsoft COCO: common objects in context. In: Fleet, D., Pajdla, T., Schiele, B., Tuytelaars, T. (eds.) ECCV 2014. LNCS, vol. 8693, pp. 740–755. Springer, Cham (2014). https://doi.org/10.1007/978-3-319-10602-1_48
Nonaka, Y., Yoshida, D., Kitamura, S., Yokota, T., Hasegawa, M., Ootsu, K.: Monocular color-IR imaging system applicable for various light environments. In: 2018 IEEE International Conference on Consumer Electronics (ICCE), pp. 1–5. IEEE, Las Vegas (2018). https://doi.org/10.1109/ICCE.2018.8326238
Ojala, T., Pietikäinen, M., Harwood, D.: A comparative study of texture measures with classification based on feature distributions. Pattern Recogn. 29(1), 51–59 (1996). https://doi.org/10.1016/0031-3203(95)00067-4
Redmon, J., Farhadi, A.: YOLOv3: an incremental improvement (2018). https://doi.org/10.1109/CVPR.2017.690
Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., Wojna, Z.: Rethinking the inception architecture for computer vision. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2818–2826 (2015). https://doi.org/10.1109/CVPR.2016.308
Viola, P., Jones, M.J.: Robust real-time face detection. Int. J. Comput. Vision 57(2), 137–154 (2004). https://doi.org/10.1023/B:VISI.0000013087.49260.fb
Zhang, K., Zhang, Z., Li, Z., Qiao, Y.: Joint face detection and alignment using multitask cascaded convolutional networks. IEEE Signal Process. Lett. 23(10), 1499–1503 (2016). https://doi.org/10.1109/LSP.2016.2603342
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Silva, G., Monteiro, R., Ferreira, A., Carvalho, P., Corte-Real, L. (2019). Face Detection in Thermal Images with YOLOv3. In: Bebis, G., et al. Advances in Visual Computing. ISVC 2019. Lecture Notes in Computer Science(), vol 11845. Springer, Cham. https://doi.org/10.1007/978-3-030-33723-0_8
Download citation
DOI: https://doi.org/10.1007/978-3-030-33723-0_8
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-33722-3
Online ISBN: 978-3-030-33723-0
eBook Packages: Computer ScienceComputer Science (R0)