Short Term Traffic State Prediction via Hyperparameter Optimization Based Classifiers

Short-term traffic state prediction has become an integral component of an advanced traveler information system (ATIS) in intelligent transportation systems (ITS). Accurate modeling and short-term traffic prediction are quite challenging due to its intricate characteristics, stochastic, and dynamic traffic processes. Existing works in this area follow different modeling approaches that are focused to fit speed, density, or the volume data. However, the accuracy of such modeling approaches has been frequently questioned, thereby traffic state prediction over the short-term from such methods inflicts an overfitting issue. We address this issue to accurately model short-term future traffic state prediction using state-of-the-art models via hyperparameter optimization. To do so, we focused on different machine learning classifiers such as local deep support vector machine (LD-SVM), decision jungles, multi-layers perceptron (MLP), and CN2 rule induction. Moreover, traffic states are evaluated using traffic attributes such as level of service (LOS) horizons and simple if–then rules at different time intervals. Our findings show that hyperparameter optimization via random sweep yielded superior results. The overall prediction performances obtained an average improvement by over 95%, such that the decision jungle and LD-SVM achieved an accuracy of 0.982 and 0.975, respectively. The experimental results show the robustness and superior performances of decision jungles (DJ) over other methods.

[1]  Alexandre M. Bayen,et al.  Traffic state estimation on highway: A comprehensive survey , 2017, Annu. Rev. Control..

[2]  Mohammad Naim Rastgoo,et al.  Balancing exploration and exploitation in particle swarm optimization on search tasking , 2014 .

[3]  Chris Eliasmith,et al.  Hyperopt: a Python library for model selection and hyperparameter optimization , 2015 .

[4]  Hua-pu Lu,et al.  Short-Term Traffic Flow Combined Forecasting Model Based on SVM , 2010, 2010 International Conference on Computational and Information Sciences.

[5]  Jiang Ji-yu Research on Kernel Parameter Optimization of Support Vector Machine in Speaker Recognition , 2010 .

[6]  Dawei Chen,et al.  Research on Traffic Flow Prediction in the Big Data Environment Based on the Improved RBF Neural Network , 2017, IEEE Transactions on Industrial Informatics.

[7]  Wei Deng,et al.  New Bayesian combination method for short-term traffic flow forecasting , 2014 .

[8]  Mark Dougherty,et al.  SHORT TERM INTER-URBAN TRAFFIC FORECASTS USING NEURAL NETWORKS , 1997 .

[9]  Peter C. Y. Chen,et al.  LSTM network: a deep learning approach for short-term traffic forecast , 2017 .

[10]  Wei Cheng,et al.  Short-Term Traffic Forecasting Using Self-Adjusting k-Nearest Neighbours , 2017 .

[11]  Limin Jia,et al.  Road Traffic State Prediction with a Maximum Entropy Method , 2009, 2009 Fifth International Joint Conference on INC, IMS and IDC.

[12]  Prasoon Goyal,et al.  Local Deep Kernel Learning for Efficient Non-linear SVM Prediction , 2013, ICML.

[13]  Yangzhou Chen,et al.  Freeway Short-Term Travel Speed Prediction Based on Data Collection Time-Horizons: A Fast Forest Quantile Regression Approach , 2020, Sustainability.

[14]  Lee D. Han,et al.  Online-SVR for short-term traffic flow prediction under typical and atypical traffic conditions , 2009, Expert Syst. Appl..

[15]  Yang Liu,et al.  DeepPF: A deep learning based architecture for metro passenger flow prediction , 2019, Transportation Research Part C: Emerging Technologies.

[16]  Pawan Lingras,et al.  Short-term traffic prediction on different types of roads with genetically designed regression and time delay neural network models , 2005 .

[17]  Abdul Hanan Abdullah,et al.  A Secure Trust Model Based on Fuzzy Logic in Vehicular Ad Hoc Networks With Fog Computing , 2017, IEEE Access.

[18]  Chadi Assi,et al.  Vehicular networking: A survey on spectrum access technologies and persisting challenges , 2015, Veh. Commun..

[19]  Bin Yu,et al.  Improved k-nn for Short-Term Traffic Forecasting Using Temporal and Spatial Information , 2014 .

[20]  Sachin Kumar,et al.  ANN based short-term traffic flow forecasting in undivided two lane highway , 2018, Journal of Big Data.

[21]  Gurcan Comert,et al.  An Online Change-Point-Based Model for Traffic Parameter Prediction , 2013, IEEE Transactions on Intelligent Transportation Systems.

[22]  Ying Wang,et al.  Modeling and Density Estimation of an Urban Freeway Network Based on Dynamic Graph Hybrid Automata , 2017, Sensors.

[23]  David G. Stork,et al.  Pattern Classification (2nd ed.) , 1999 .

[24]  Manoranjan Parida,et al.  Short term traffic flow prediction in heterogeneous condition using artificial neural network , 2013 .

[25]  Alessandro De Gloria,et al.  Time-Aware Multivariate Nearest Neighbor Regression Methods for Traffic Flow Prediction , 2015, IEEE Transactions on Intelligent Transportation Systems.

[26]  Lili Du,et al.  An adaptive information fusion model to predict the short-term link travel time distribution in dynamic traffic networks , 2012 .

[27]  Billy M. Williams Multivariate Vehicular Traffic Flow Prediction: Evaluation of ARIMAX Modeling , 2001 .

[28]  邵春福,et al.  A two-stage short-term traffic flow prediction method based on AVL and AKNN techniques , 2015 .

[29]  Ou Yangjun,et al.  Short-term urban traffic forecasting based on multi-kernel SVM model , 2010 .

[30]  Sebastian Nowozin,et al.  Decision Jungles: Compact and Rich Models for Classification , 2013, NIPS.

[31]  Stan Szpakowicz,et al.  Beyond Accuracy, F-Score and ROC: A Family of Discriminant Measures for Performance Evaluation , 2006, Australian Conference on Artificial Intelligence.

[32]  Der-Horng Lee,et al.  Short-term freeway traffic flow prediction : Bayesian combined neural network approach , 2006 .

[33]  Arindam Ghosh,et al.  Annotation and prediction of stress and workload from physiological and inertial signals , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[34]  Marcin Bernaś,et al.  Segmentation of vehicle detector data for improved k-nearest neighbours-based traffic flow prediction , 2015 .

[35]  Zhirui Ye,et al.  Subway Passenger Flow Prediction for Special Events Using Smart Card Data , 2020, IEEE Transactions on Intelligent Transportation Systems.

[36]  Billy M. Williams,et al.  Modeling and Forecasting Vehicular Traffic Flow as a Seasonal ARIMA Process: Theoretical Basis and Empirical Results , 2003, Journal of Transportation Engineering.

[37]  Reinhard Klette,et al.  Accurate and Interpretable Bayesian MARS for Traffic Flow Prediction , 2014, IEEE Transactions on Intelligent Transportation Systems.

[38]  Mohammad Naim Rastgoo,et al.  A Hybrid of Modified PSO and Local Search on a Multi-Robot Search System , 2015 .

[39]  Steven L. Salzberg,et al.  On growing better decision trees from data , 1996 .

[40]  Peter Clark,et al.  The CN2 Induction Algorithm , 1989, Machine Learning.

[41]  Nicolai Meinshausen,et al.  Quantile Regression Forests , 2006, J. Mach. Learn. Res..

[42]  黒田 孝次,et al.  Highway Capacity Manual改訂の動向--テイラ-教授の講演より , 1984 .

[43]  Biao Leng,et al.  A novel wavelet-SVM short-time passenger flow prediction in Beijing subway system , 2015, Neurocomputing.

[44]  Fuquan Pan,et al.  Short-Term Traffic Flow Forecasting Method Based on LSSVM Model Optimized by GA-PSO Hybrid Algorithm , 2018 .

[45]  Tony R. Martinez,et al.  Reducing Decision Tree Ensemble Size Using Parallel Decision DAGs , 2009, Int. J. Artif. Intell. Tools.

[46]  Peter Clark,et al.  Rule Induction with CN2: Some Recent Improvements , 1991, EWSL.

[47]  A. Jamal,et al.  Using Microscopic Simulation-Based Analysis to Model Driving Behavior: A Case Study of Khobar-Dammam in Saudi Arabia , 2019, Sustainability.

[48]  Jingsha He,et al.  Improving Efficiency of Passive RFID Tag Anti-Collision Protocol Using Dynamic Frame Adjustment and Optimal Splitting , 2018, Sensors.

[49]  Fei-Yue Wang,et al.  Traffic Flow Prediction With Big Data: A Deep Learning Approach , 2015, IEEE Transactions on Intelligent Transportation Systems.

[50]  Jinde Cao,et al.  Real-Time Prediction of Seasonal Heteroscedasticity in Vehicular Traffic Flow Series , 2018, IEEE Transactions on Intelligent Transportation Systems.

[51]  Hesham El-Sayed,et al.  Accurate Traffic Flow Prediction in Heterogeneous Vehicular Networks in an Intelligent Transport System Using a Supervised Non-Parametric Classifier , 2018, Sensors.

[52]  Bin Ran,et al.  Missing Value Imputation for Traffic-Related Time Series Data Based on a Multi-View Learning Method , 2019, IEEE Transactions on Intelligent Transportation Systems.

[53]  Mohd Zakree Ahmad Nazri,et al.  A multi-swarm particle swarm optimization with local search on multi-robot search system , 2015 .

[54]  Mascha C. van der Voort,et al.  Combining kohonen maps with arima time series models to forecast traffic flow , 1996 .

[55]  Miguel Garcia,et al.  Group-based protocol and mobility model for VANETs to offer internet access , 2013, J. Netw. Comput. Appl..

[56]  K. Takahashi,et al.  Remarks on SVM-based emotion recognition from multi-modal bio-potential signals , 2004, RO-MAN 2004. 13th IEEE International Workshop on Robot and Human Interactive Communication (IEEE Catalog No.04TH8759).

[57]  Xiangjie Kong,et al.  Urban traffic congestion estimation and prediction based on floating car trajectory data , 2016, Future Gener. Comput. Syst..

[58]  Ellen J. Hong,et al.  Deep-Learning-Based Real-Time Road Traffic Prediction Using Long-Term Evolution Access Data , 2019, Sensors.

[59]  Mohsen Jahanshahi,et al.  Predicting the Next State of Traffic by Data Mining Classification Techniques , 2012 .

[60]  Hans van Lint,et al.  Short-Term Traffic and Travel Time Prediction Models , 2012 .

[61]  Eleni I. Vlahogianni,et al.  Short-term traffic forecasting: Where we are and where we’re going , 2014 .

[62]  Dirk Van den Poel,et al.  Predicting customer retention and profitability by using random forests and regression forests techniques , 2005, Expert Syst. Appl..

[63]  Wanlei Zhou,et al.  Traffic Flow Prediction for Road Intersection Safety , 2018, 2018 IEEE SmartWorld, Ubiquitous Intelligence & Computing, Advanced & Trusted Computing, Scalable Computing & Communications, Cloud & Big Data Computing, Internet of People and Smart City Innovation (SmartWorld/SCALCOM/UIC/ATC/CBDCom/IOP/SCI).

[64]  Athanasios V. Vasilakos,et al.  Mobile Crowd Sensing for Traffic Prediction in Internet of Vehicles , 2016, Sensors.

[65]  Tharam S. Dillon,et al.  Neural-Network-Based Models for Short-Term Traffic Flow Forecasting Using a Hybrid Exponential Smoothing and Levenberg–Marquardt Algorithm , 2012, IEEE Transactions on Intelligent Transportation Systems.

[66]  Hong Huang,et al.  Relevance analysis and short-term prediction of PM2.5 concentrations in Beijing based on multi-source data , 2017 .

[67]  A. Chhabra Road Traffic Prediction Using KNN and Optimized Multilayer Perceptron , 2018 .

[68]  Baher Abdulhai,et al.  Short-Term Traffic Flow Prediction Using Neuro-Genetic Algorithms , 2002, J. Intell. Transp. Syst..

[69]  Hojjat Adeli,et al.  Dynamic Wavelet Neural Network Model for Traffic Flow Forecasting , 2005 .

[70]  Zhonghui Chen,et al.  Short-term traffic flow prediction with optimized Multi-kernel Support Vector Machine , 2017, 2017 IEEE Congress on Evolutionary Computation (CEC).