Skip to main content

Augmented Reality Based Traffic Sign Recognition for Improved Driving Safety

  • Conference paper
Communication Technologies for Vehicles (Nets4Cars/Nets4Trains/Nets4Aircraft 2015)

Part of the book series: Lecture Notes in Computer Science ((LNCCN,volume 9066))

Included in the following conference series:

Abstract

In recent years, automotive active safety systems have become increasingly common in road vehicles since they provide an opportunity to significantly reduce traffic fatalities by active vehicle control. Augmented Reality (AR) applications can enhance intelligent transportation systems by superimposing surrounding traffic information on the users view and keep drivers and pedestrians view on roads. However, due to the existence of a complex environment such as weather conditions, illuminations and geometric distortions, Traffic Sign Recognition(TSR) systems has always been considered as a challenging task. The aim of this paper is to evaluate the effectiveness of AR cues in improving driving safety by deploying an on-board camera-based driver alert system against approaching traffic signs such as stop, speed limit, unique, danger signs, etc. A new approach is presented for marker-less AR-TSR system that superimposes augmented virtual objects onto a real scene under all types of driving situations including unfavorable weather conditions. Our method is composed of both online and offline stages. An intrinsic camera parameter change depending on the zoom values is calibrated. A Haar-like feature with Adaboost has been used to train a Haar detector in the offline stage. Extrinsic camera parameters are then estimated based on homography method in the online stage. With the complete set of camera parameters, virtual objects can be coherently inserted into the video sequence captured by the camera so that synthetic traffic signs may be added to increase safety.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Azuma, R., Baillot, Y., Behringer, R., Feiner, S., Julier, S., MacIntyre, B.: Recent advances in augmented reality. IEEE Computer Graphics and Applications 21(6), 34–47 (2001)

    Article  Google Scholar 

  2. Gabbard, J.L., Edward Swan III, J., Hix, D.: The effects of text drawing styles, background textures, and natural lighting on text legibility in outdoor augmented reality. Presence: Teleoperators and Virtual Environments 15(1), 16–32 (2006)

    Google Scholar 

  3. Gabbard, J.L., Swan, J.E., Hix, D., Schulman, R.S., Lucas, J., Gupta, D.: An empirical user-based study of text drawing styles and outdoor background textures for augmented reality. In: Proceedings of IEEE Virtual Reality 2005, pp. 11–18. IEEE (2005)

    Google Scholar 

  4. Geronimo, D., Lopez, A.M., Sappa, A.D., Graf, T.: Survey of pedestrian detection for advanced driver assistance systems. IEEE Transactions on Pattern Analysis and Machine Intelligence 32(7), 1239–1258 (2010)

    Article  Google Scholar 

  5. Guo, H., Zhao, F., Wang, W., Jiang, X.: Analyzing drivers attitude towards hud system using a stated preference survey. Advances in Mechanical Engineering 2014 (2014)

    Google Scholar 

  6. Guo, L., Ge, P.S., Zhang, M.H., Li, L.H., Zhao, Y.B.: Pedestrian detection for intelligent transportation systems combining adaboost algorithm and support vector machine. Expert Systems with Applications 39(4), 4274–4286 (2012)

    Article  Google Scholar 

  7. Ho, C., Reed, N., Spence, C.: Multisensory in-car warning signals for collision avoidance. Human Factors: The Journal of the Human Factors and Ergonomics Society 49(6), 1107–1114 (2007)

    Article  Google Scholar 

  8. Ho, C., Spence, C.: Assessing the effectiveness of various auditory cues in capturing a driver’s visual attention. Journal of Experimental Psychology: Applied 11(3), 157 (2005)

    Google Scholar 

  9. Hussain, K., Kaptan, V.: Modeling and simulation with augmented reality. RAIRO-Operations Research 38(02), 89–103 (2004)

    Article  MATH  MathSciNet  Google Scholar 

  10. Kramer, A.F., Cassavaugh, N., Horrey, W.J., Becic, E., Mayhugh, J.L.: Influence of age and proximity warning devices on collision avoidance in simulated driving. Human Factors: The Journal of the Human Factors and Ergonomics Society 49(5), 935–949 (2007)

    Article  Google Scholar 

  11. McCall, J.C., Trivedi, M.M.: Video-based lane estimation and tracking for driver assistance: survey, system, and evaluation. IEEE Transactions on Intelligent Transportation Systems 7(1), 20–37 (2006)

    Article  Google Scholar 

  12. Mogelmose, A., Trivedi, M.M., Moeslund, T.B.: Vision-based traffic sign detection and analysis for intelligent driver assistance systems: Perspectives and survey. IEEE Transactions on Intelligent Transportation Systems 13(4), 1484–1497 (2012)

    Article  Google Scholar 

  13. Park, J.-G., Kim, K.-J.: Design of a visual perception model with edge-adaptive gabor filter and support vector machine for traffic sign detection. Expert Systems with Applications 40(9), 3679–3687 (2013)

    Article  Google Scholar 

  14. Scott, J.J., Gray, R.: A comparison of tactile, visual, and auditory warnings for rear-end collision prevention in simulated driving. Human Factors: The Journal of the Human Factors and Ergonomics Society 50(2), 264–275 (2008)

    Article  Google Scholar 

  15. Sobel, D., Jędrasiak, K., Daniec, K., Wrona, J., Jurgaś, P., Nawrat, A.M.: Camera calibration for tracked vehicles augmented reality applications. In: Innovative Control Systems for Tracked Vehicle Platforms, pp. 147–162. Springer (2014)

    Google Scholar 

  16. Stallkamp, J., Schlipsing, M., Salmen, J., Igel, C.: The german traffic sign recognition benchmark: A multi-class classification competition. In: The 2011 International Joint Conference on Neural Networks (IJCNN), pp. 1453–1460. IEEE (2011)

    Google Scholar 

  17. Topór-Kamiñski, T., Krupanek, B., Homa, J.: Delays models of measurement and control data transmission network. In: Nawrat, A., Simek, K., Świerniak, A. (eds.) Advanced Technologies for Intelligent Systems. SCI, vol. 440, pp. 257–278. Springer, Heidelberg (2013)

    Google Scholar 

  18. Viola, P., Jones, M.J.: Robust real-time face detection. International Journal of Computer Vision 57(2), 137–154 (2004)

    Article  Google Scholar 

  19. Wang, J.G., Lin, C.J., Chen, S.M.: Applying fuzzy method to vision-based lane detection and departure warning system. Expert Systems with Applications 37(1), 113–126 (2010)

    Article  MATH  Google Scholar 

  20. Yeh, M., Wickens, C.D.: Display signaling in augmented reality: Effects of cue reliability and image realism on attention allocation and trust calibration. Human Factors: The Journal of the Human Factors and Ergonomics Society 43(3), 355–365 (2001)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Lotfi Abdi .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2015 Springer International Publishing Switzerland

About this paper

Cite this paper

Abdi, L., Meddeb, A., Abdallah, F.B. (2015). Augmented Reality Based Traffic Sign Recognition for Improved Driving Safety. In: Kassab, M., Berbineau, M., Vinel, A., Jonsson, M., Garcia, F., Soler, J. (eds) Communication Technologies for Vehicles. Nets4Cars/Nets4Trains/Nets4Aircraft 2015. Lecture Notes in Computer Science(), vol 9066. Springer, Cham. https://doi.org/10.1007/978-3-319-17765-6_9

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-17765-6_9

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-17764-9

  • Online ISBN: 978-3-319-17765-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics