Skip to main content
SpringerLink
Log in

Hybrid Statistical and Machine Learning Methods for Road Traffic Prediction: A Review and Tutorial

  • Chapter
  • First Online:
Smart Infrastructure and Applications

Part of the book series: EAI/Springer Innovations in Communication and Computing ((EAISICC))

Abstract

Mobility is one of the major dimensions of smart city design and development. Transportation analysis and prediction play important parts in mobility research and development. Recent years have seen many new types of transportation data emerging, such as social media and Global Positioning System (GPS) data. These data contains hidden knowledge, which can be used in many applications to improve city operations; road traffic prediction is one aspect of this. Researchers have traditionally used single traffic flow prediction methods, which work well only under specific conditions. Some work has emerged in recent years on combining these methods into various hybrid methods. However, this work is in its infancy, and further investigations are required. More importantly, these hybrid methods have mostly been developed on stand-alone, nondistributed platforms, limiting the data and problem sizes that can be addressed, as well as the accuracy that can be achieved. This chapter gives a review of traffic flow prediction and modeling methods and discusses the limitations of each method. A review of the various types of transportation traffic data sources is provided. Notable big data analysis tools, including the Apache Spark platform, are described. Finally, we describe a hybrid method for road traffic prediction and provide a tutorial on the process of hybrid traffic flow prediction. The hybrid method is based on the autoregressive integrated moving average (ARIMA) and support vector machine (SVM) methods.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 119.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 159.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 219.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Büscher, M., Coulton, P., Efstratiou, C., Gellersen, H., Hemment, D., Mehmood, R., Sangiorgi, D.: Intelligent mobility systems: some socio-technical challenges and opportunities. In: Communications Infrastructure. Systems and Applications in Europe, Lecture Notes of the Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering, LNICST 16. pp. 140–152 (2009)

    Google Scholar 

  2. Suma, S., Mehmood, R., Albugami, N., Katib, I., Albeshri, A.: Enabling next generation logistics and planning for smarter societies. In: Procedia Computer Science. pp. 1122–1127 (2017)

    Article  Google Scholar 

  3. Suma, S., Mehmood, R., Albeshri, A.: Automatic event detection in smart cities using big data analytics. In: International Conference on Smart Cities, Infrastructure, Technologies and Applications (SCITA 2017): Lecture Notes of the Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering, LNICST, Volume 224. pp. 111–122. Springer, Cham (2018)

    Google Scholar 

  4. Alomari, E., Mehmood, R.: Analysis of tweets in Arabic language for detection of road traffic conditions. In: Lecture Notes of the Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering, LNICST, Volume 224. pp. 98–110. Springer, Cham (2018)

    Google Scholar 

  5. Ayres, G., Mehmood, R., Mitchell, K., Race, N.J.P.: Localization to enhance security and services in Wi-Fi networks under privacy constraints. In: Lecture Notes of the Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering, LNICST, Volume 16. pp. 175–188. Springer (2009)

    Google Scholar 

  6. Ayres, G., Mehmood, R.: LocPriS: a security and privacy preserving location based services development framework. In: Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), LNAI, Volume 6279, Part 4. pp. 566–575. Springer (2010)

    Google Scholar 

  7. Elmirghani, J.M.H., Badic, B., Li, Y., Liu, R., Mehmood, R., Wang, C., Xing, W., Garcia Zuazola, I.J., Jones, S.: IRIS: an intelligent radio-fibre telematics system. In: Proceedings of the 13th ITS World Congress, London, 8–12 October (2006)

    Google Scholar 

  8. Ayres, G., Mehmood, R.: On discovering road traffic information using virtual reality simulations. In: 11th International Conference on Computer Modelling and Simulation, UKSim 2009. pp. 411–416 (2009)

    Google Scholar 

  9. Mehmood, R.: Towards understanding intercity traffic interdependencies. In: 14th World Congress on Intelligent Transport Systems, ITS 2007. pp. 1793–1799. ITS America, Beijing (2007)

    Google Scholar 

  10. Mehmood, R., Nekovee, M.: Vehicular ad hoc and grid networks: discussion, design and evaluation. In: 14th World Congress on Intelligent Transport Systems, ITS 2007. pp. 1555–1562. ITS America, Beijing (2007)

    Google Scholar 

  11. Gillani, S., Shahzad, F., Qayyum, A., Mehmood, R.: A survey on security in vehicular ad hoc networks. In: Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). pp. 59–74 (2013)

    Google Scholar 

  12. Alvi, A., Greaves, D., Mehmood, R.: Intra-vehicular verification and control: a two-pronged approach. In: 7th IEEE International Symposium on Communication Systems, Networks and Digital Signal Processing, CSNDSP 2010. pp. 401–405 (2010)

    Google Scholar 

  13. Schlingensiepen, J., Nemtanu, F., Mehmood, R., McCluskey, L.: Autonomic transport management systems—enabler for smart cities, personalized medicine, participation and industry Grid/Industry 4.0. In: Intelligent Transportation Systems—Problems and Perspectives, Volume 32 of the series Studies in Systems, Decision and Control. pp. 3–35. Springer (2016)

    Google Scholar 

  14. Schlingensiepen, J., Mehmood, R., Nemtanu, F.C.: Framework for an autonomic transport system in smart cities. Cybern. Inf. Technol. 15, 50–62 (2015)

    Google Scholar 

  15. Schlingensiepen, J., Mehmood, R., Nemtanu, F.C., Niculescu, M.: Increasing sustainability of road transport in European cities and metropolitan areas by facilitating autonomic road transport systems (ARTS). In: Wellnitz, J., Subic, A., Trufin, R. (eds.) Sustainable Automotive Technologies 2013 Proceedings of the 5th International Conference ICSAT 2013, pp. 201–210. Springer, Ingolstadt (2014)

    Chapter  Google Scholar 

  16. Alam, F., Mehmood, R., Katib, I.: D2TFRS: an object recognition method for autonomous vehicles based on RGB and spatial values of pixels. In: Lecture Notes of the Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering, LNICST, Volume 224. pp. 155–168. Springer, Cham (2018)

    Google Scholar 

  17. Alazawi, Z., Altowaijri, S., Mehmood, R., Abdljabar, M.B.: Intelligent disaster management system based on cloud-enabled vehicular networks. In: 2011 11th International Conference on ITS Telecommunications, ITST 2011. pp. 361–368. IEEE (2011)

    Google Scholar 

  18. Alazawi, Z., Abdljabar, M.B., Altowaijri, S., Vegni, A.M., Mehmood, R.: ICDMS: an intelligent cloud based disaster management system for vehicular networks. In: Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), LNCS, Volume 7266. pp. 40–56. Springer, Vilnius (2012)

    Google Scholar 

  19. Alazawi, Z., Alani, O., Abdljabar, M.B., Altowaijri, S., Mehmood, R.: A smart disaster management system for future cities. In: Proceedings of the 2014 ACM International Workshop on Wireless and Mobile Technologies for Smart Cities—WiMobCity ’14. pp. 1–10. ACM, New York (2014)

    Google Scholar 

  20. Alazawi, Z., Alani, O., Abdljabar, M.B., Mehmood, R.: An intelligent disaster management system based evacuation strategies. In: 2014 9th International Symposium on Communication Systems, Networks and Digital Signal Processing, CSNDSP 2014. pp. 673–678 (2014)

    Google Scholar 

  21. Alazawi, Z., Alani, O., Abdljabar, M.B., Mehmood, R.: Transportation evacuation strategies based on VANET disaster management system. Procedia Econ. Financ. 18, 352–360 (2014)

    Article  Google Scholar 

  22. Aqib, M., Mehmood, R., Albeshri, A., Alzahrani, A.: Disaster management in smart cities by forecasting traffic plan using deep learning and GPUs. In: Lecture Notes of the Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering, LNICST, Volume 224. pp. 139–154 (2018)

    Google Scholar 

  23. Mehmood, R., Meriton, R., Graham, G., Hennelly, P., Kumar, M.: Exploring the influence of big data on city transport operations: a Markovian approach. Int. J. Oper. Prod. Manag. 37, 75–104 (2017)

    Article  Google Scholar 

  24. Mehmood, R., Lu, J.A.: Computational Markovian analysis of large systems. J. Manuf. Technol. Manag. 22, 804–817 (2011)

    Article  Google Scholar 

  25. Mehmood, R., Graham, G.: Big data logistics: a health-care transport capacity sharing model. In: Procedia Computer Science. pp. 1107–1114 (2015)

    Article  Google Scholar 

  26. Arfat, Y., Mehmood, R., Albeshri, A.: Parallel shortest path graph computations of United States road network data on Apache Spark. In: Lecture Notes of the Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering, LNICST, Volume 224. pp. 323–336. Springer, Cham (2018)

    Google Scholar 

  27. Arfat, Y., Aqib, M., Mehmood, R., Albeshri, A., Katib, I., Albogami, N., Alzahrani, A.: Enabling smarter societies through mobile big data fogs and clouds. Procedia Computer Science 109: 1128–1133 (2017)

    Article  Google Scholar 

  28. Mehmood, R., Bhaduri, B., Katib, I., Chlamtac, I. eds: Smart Societies, Infrastructure, Technologies and Applications, Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering (LNICST), Volume 224. Springer, Cham (2018)

    Google Scholar 

  29. Petalas, Y.G., Ammari, A., Georgakis, P., Nwagboso, C.: A big data architecture for traffic forecasting using multi-source information. Presented at the (2017)

    Google Scholar 

  30. Via, C.E., Hall, P., Tech, V., States, U., Author, C.: Transport-domain applications of widely used data sources in the smart transportation: a survey Sina Dabiri. 1–52 (2018)

    Google Scholar 

  31. Hadi Hosseini, S., Hadi Hosseini, S., Rahimi-kian, A.: Traffic flow prediction using MI algorithm and considering noisy and data loss conditions: an application to Minnesota traffic flow prediction. 26, 393–403 (2014)

    Google Scholar 

  32. Gandewar, R., Phakatkar, A.: Classification approach for big data driven traffic flow prediction using apache spark. Int. Res. J. Eng. Technol. 4(9), 2395–2356 (2017)

    Google Scholar 

  33. Zhang, R., Shu, Y., Yang, Z., Cheng, P., Chen, J.: Hybrid traffic speed modeling and prediction using real-world data. In: 2015 IEEE International Congress on Big Data (BigData Congress), New York, pp. 230–237 (2015)

    Google Scholar 

  34. C.P.IJ. van Hinsbergen, J.W.C. van Lint, F.M.S.: Short term traffic prediction models deliverable DIIF-1a

    Google Scholar 

  35. Coifman, B.: Vehicle level evaluation of loop detectors and the remote traffic microwave sensor. J. Transp. Eng. 132, 213–226 (2006)

    Article  Google Scholar 

  36. Hu, J.H.J., Cao, W.C.W., Luo, J.L.J., Yu, X.Y.X.: Dynamic modeling of urban population travel behavior based on data fusion of mobile phone positioning data and FCD. 2009 17th Int. Conf. Geoinformatics. 1–5 (2009)

    Google Scholar 

  37. Abidin, A.F., Kolberg, M., Hussain, A.: Integrating Twitter traffic information with Kalman filter models for public transportation vehicle arrival time prediction. In: Big-Data Analytics and Cloud Computing. pp. 67–82. Springer, Cham (2015)

    Chapter  Google Scholar 

  38. Yan, D., Zhou, J., Zhao, Y., Wu, B.: Short-term subway passenger flow prediction based on ARIMA. Presented at the December (2018)

    Google Scholar 

  39. Gandewar, R.R., Phakatkar, A.G., Student, M.E.: Survey on classification and prediction approaches in traffic flow. Int. J. Innov. Res. Comput. Commun. Eng. 5, (2017)

    Google Scholar 

  40. Wang, Y., Li, L., Xu, X.: A piecewise hybrid of ARIMA and SVMs for short-term traffic flow prediction. In: International Conference on Neural Information Processing. pp. 493–502. Springer, Cham (2017)

    Chapter  Google Scholar 

  41. Vasantha Kumar, S., Vanajakshi, L.: Short-term traffic flow prediction using seasonal ARIMA model with limited input data. Eur. Transp. Res. Rev. 21 (2015)

    Google Scholar 

  42. Ma, X., Tao, Z., Wang, Y., Yu, H., Wang, Y.: Long short-term memory neural network for traffic speed prediction using remote microwave sensor data. Transp. Res. Part C Emerg. Technol. 54, 187–197 (2015)

    Article  Google Scholar 

  43. Yin, C., Lin, Y., Yang, C.: A classification and predication framework for taxi-hailing based on big data. In: International Conference on Intelligent Computing ICIC 2017: Intelligent Computing Methodologies. p. pp 747–758. Springer (2017)

    Google Scholar 

  44. Florido, E., Castaño, O., Troncoso, A., Martínez-Álvarez, F.: Data mining for predicting traffic congestion and its application to Spanish data. In: 10th International Conference on Soft Computing Models in Industrial and Environmental Applications. pp 341–351. Springer, Cham (2015)

    Google Scholar 

  45. Park, D., Rilett, L.R.: Forecasting freeway link travel times with a multilayer feedforward neural network. Comput. Civ. Infrastruct. Eng. 14, 357–367 (1999)

    Article  Google Scholar 

  46. Pamuła, T.: CCIS 329—Traffic flow analysis based on the real data using neural networks. In: CCIS. pp. 364–371. Springer, Berlin (2012)

    Chapter  Google Scholar 

  47. Ban, X., Guo, C., Li, G., Ban, X., Guo, C, Guo, C., Li, G.: Application of extreme learning machine on large scale traffic congestion prediction high-speed. In: Proceedings in Adaptation, Learning and Optimization. pp. 293–305. Springer, Cham (2016)

    Chapter  Google Scholar 

  48. Deshpande, M., Bajaj, P.R.: Performance analysis of support vector machine for traffic flow prediction. In: 2016 International Conference on Global Trends in Signal Processing, Information Computing and Communication (ICGTSPICC). pp. 126–129. IEEE (2016)

    Google Scholar 

  49. Zhou, X., Wang, W., Yu, L., Zhou, X., Yu, Á.L., Wang, W., Lu, W.: Traffic flow analysis and prediction based on GPS data of floating cars. In: Lecture Notes in Electrical Engineering. pp. 497–508. Springer, Berlin (2012)

    Google Scholar 

  50. Li, Y., Huang, C., Jiang, J.: Research of bus arrival prediction model based on GPS and SVM. In: 2018 Chinese Control And Decision Conference (CCDC). pp. 575–579. IEEE (2018)

    Google Scholar 

  51. Hu, W., Yan, L., Liu, K., Wang, H.: A short-term traffic flow forecasting method based on the hybrid PSO-SVR. Neural. Process. Lett. 43, 155–172 (2016)

    Article  Google Scholar 

  52. Shoro, A.G., Soomro, T.R.: Big data analysis: Ap spark perspective. Glob. J. Comput. Sci. Technol. 15, 7–14 (2015)

    Google Scholar 

  53. Meng, M., Shao, C.-F., Wong, Y.-D., Wang, B.-B., Li, H.-X.: A two-stage short-term traffic flow prediction method based on AVL and AKNN techniques. J. Cent. South Univ. 22, 779–786 (2015)

    Article  Google Scholar 

  54. Xie, J., Choi, Y.-K.: Hybrid traffic prediction scheme for intelligent transportation systems based on historical and real-time data. Int. J. Distrib. Sens. Networks. 13, 1–11 (2017)

    Google Scholar 

  55. Li, K.-L., Zhai, C.-J., Xu, J.-M.: Short-term traffic flow prediction using a methodology based on ARIMA and RBF-ANN. In: 2017 Chinese Automation Congress (CAC). pp. 2804–2807. IEEE (2017)

    Google Scholar 

  56. Prathilothamai, M., Sree Lakshmi, A.M., Viswanthan, D.: Cost effective road traffic prediction model using apache spark. Indian J. Sci. Technol. 9, (2016). https://doi.org/10.17485/ijst/2016/v9i17/87334

  57. Castro, P.S.., Zhang, D.., Li, S: Urban traffic modelling and prediction using large scale taxi GPS traces. In: Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). pp. 57–72. Springer, Berlin (2012)

    Google Scholar 

  58. Wang, Y., Cao, J., Li, W., Gu, T., Shi, W.: Exploring traffic congestion correlation from multiple data sources. Pervasive Mob. Comput. 41, 470–483 (2017)

    Article  Google Scholar 

  59. Usama, M., Liu, M., Chen, M.: Job schedulers for big data processing in Hadoop environment: testing real-life schedule with benchmark programs. Digit. Commun. Networks. 3(4), 260–273 (2017)

    Article  Google Scholar 

  60. Deng, Z., Bai, Y.: Floating car data processing model based on Hadoop-GIS tools. In: 2016 Fifth International Conference on Agro-Geoinformatics (Agro-Geoinformatics). pp. 1–4. IEEE (2016)

    Google Scholar 

  61. Karau, H., Konwinski, A., Wendell, P., Zaharia, M.: Learning spark: lightning-fast big data analysis. (2015)

    Google Scholar 

  62. Zeng, D., Xu, J., Gu, J., Liu, L., Xu, G.: Short term traffic flow prediction using hybrid ARIMA and ANN models. In: 2008 Workshop on Power Electronics and Intelligent Transportation System. pp. 621–625. IEEE (2008)

    Google Scholar 

  63. Yang, Y., Lu, H.: Short-term traffic flow combined forecasting model based on SVM. In: 2010 International Conference on Computational and Information Sciences. pp. 262–265. IEEE (2010)

    Google Scholar 

Download references

Acknowledgements

The work carried out in this chapter is supported by the High Performance Computing (HPC) Center at the King Abdulaziz University, Jeddah.

Author information

Authors and Affiliations

  1. Department of Computer Science, FCIT, King Abdulaziz University, Jeddah, Saudi Arabia

    Bdoor Alsolami & Aiiad Albeshri

  2. High Performance Computing Center, King Abdulaziz University, Jeddah, Saudi Arabia

    Rashid Mehmood

Authors
  1. Bdoor Alsolami
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Rashid Mehmood
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Aiiad Albeshri
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Bdoor Alsolami .

Editor information

Editors and Affiliations

  1. High Performance Computing Center, King Abdulaziz University, Jeddah, Saudi Arabia

    Rashid Mehmood

  2. Nvidia AI Technology Center, Singapore, Singapore

    Simon See

  3. Faculty of Computing and Information Technology (FCIT), King Abdulaziz University, Jeddah, Saudi Arabia

    Iyad Katib

  4. European Alliance for Innovation, Gent, Belgium

    Imrich Chlamtac

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Alsolami, B., Mehmood, R., Albeshri, A. (2020). Hybrid Statistical and Machine Learning Methods for Road Traffic Prediction: A Review and Tutorial. In: Mehmood, R., See, S., Katib, I., Chlamtac, I. (eds) Smart Infrastructure and Applications. EAI/Springer Innovations in Communication and Computing. Springer, Cham. https://doi.org/10.1007/978-3-030-13705-2_5

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-13705-2_5

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-13704-5

  • Online ISBN: 978-3-030-13705-2

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics

Search

Navigation