Traffic Flow Anomaly Detection Based on Robust Ridge Regression with Particle Swarm Optimization Algorithm

Traffic flow anomaly detection is helpful to improve the efficiency and reliability of detecting fault behavior and the overall effectiveness of the traffic operation. The data detected by the traffic flow sensor contains a lot of noise due to equipment failure, environmental interference, and other factors. In the case of large traffic flow data noises, a traffic flow anomaly detection method based on robust ridge regression with particle swarm optimization (PSO) algorithm is proposed. Feature sets containing historical characteristics with a strong linear correlation and statistical characteristics using the optimal sliding window are constructed. Then by providing the feature sets inputs to the PSO-Huber-Ridge model and the model outputs the traffic flow. The Huber loss function is recommended to reduce noise interference in the traffic flow. The regular term of the ridge regression is employed to reduce the degree of overfitting of the model training. A fitness function is constructed, which can balance the relative size between the k-fold cross-validation root mean square error and the k-fold cross-validation average absolute error with the control parameter to improve the optimization efficiency of the optimization algorithm and the generalization ability of the proposed model. The hyperparameters of the robust ridge regression forecast model are optimized by the PSO algorithm to obtain the optimal hyperparameters. The traffic flow data set is used to train and validate the proposed model. Compared with other optimization methods, the proposed model has the lowest RMSE, MAE, and MAPE. Finally, the traffic flow that forecasted by the proposed model is used to perform anomaly detection. The abnormality of the error between the forecasted value and the actual value is detected by the abnormal traffic flow threshold based on the sliding window. The experimental results verify the validity of the proposed anomaly detection model.

[1]  Lelitha Vanajakshi,et al.  Short-term traffic flow prediction using seasonal ARIMA model with limited input data , 2015, European Transport Research Review.

[2]  Darrell Whitley,et al.  A genetic algorithm tutorial , 1994, Statistics and Computing.

[3]  Jianchuan Yin,et al.  Vessel traffic flow analysis and prediction by an improved PSO-BP mechanism based on AIS data , 2018, Evol. Syst..

[4]  Philippe Smets,et al.  The Transferable Belief Model , 1994, Artif. Intell..

[5]  R. Snee,et al.  Ridge Regression in Practice , 1975 .

[6]  Xiaojun Zhou,et al.  State Transition Algorithm , 2012, ArXiv.

[7]  Qiufang Ma.  Design of BP neural network urban short-term traffic flow prediction software based on improved particle swarm optimization , 2019 .

[8]  Jinde Cao,et al.  Short-Term Traffic Flow Prediction Based on Least Square Support Vector Machine with Hybrid Optimization Algorithm , 2019, Neural Processing Letters.

[9]  Jianjun Jiao,et al.  Inspired grey wolf optimizer for solving large-scale function optimization problems , 2018, Applied Mathematical Modelling.

[10]  Danyang Li,et al.  Traffic Flow Prediction during the Holidays Based on DFT and SVR , 2019, J. Sensors.

[11]  Xianglong Luo,et al.  An Algorithm for Traffic Flow Prediction Based on Improved SARIMA and GA , 2018, KSCE Journal of Civil Engineering.

[12]  Paul Petrus,et al.  Robust Huber adaptive filter , 1999, IEEE Trans. Signal Process..

[13]  Zhu Xiao,et al.  Bayesian optimization of support vector machine for regression prediction of short-term traffic flow , 2019, Intell. Data Anal..

[14]  Teng Zhou,et al.  PSO-ELM: A Hybrid Learning Model for Short-Term Traffic Flow Forecasting , 2020, IEEE Access.

[15]  Wang Yue,et al.  Spatial–temporal traffic outlier detection by coupling road level of service , 2019 .

[16]  Feng Shu,et al.  Short-term traffic flow prediction based on spatio-temporal analysis and CNN deep learning , 2019, Transportmetrica A: Transport Science.

[17]  Wei Li,et al.  Daily long-term traffic flow forecasting based on a deep neural network , 2019, Expert Syst. Appl..

[18]  José Antonio Lozano,et al.  Sensitivity Analysis of k-Fold Cross Validation in Prediction Error Estimation , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Xiaojun Zhou,et al.  An External Archive-Based Constrained State Transition Algorithm for Optimal Power Dispatch , 2019, Complex..

[20]  Adel W. Sadek,et al.  Quantifying uncertainty in short-term traffic prediction and its application to optimal staffing plan development , 2018, Transportation Research Part C: Emerging Technologies.

[21]  Andrew Lewis,et al.  Grey Wolf Optimizer , 2014, Adv. Eng. Softw..

[22]  Hai Le Vu,et al.  An effective spatial-temporal attention based neural network for traffic flow prediction , 2019, Transportation Research Part C: Emerging Technologies.

[23]  Hanghang Tong,et al.  Spatial-temporal traffic flow pattern identification and anomaly detection with dictionary-based compression theory in a large-scale urban network , 2016 .

[24]  Jianjun Jiao,et al.  An exploration-enhanced grey wolf optimizer to solve high-dimensional numerical optimization , 2018, Eng. Appl. Artif. Intell..

[25]  Taha Hossein Rashidi,et al.  Ensemble of ARIMA: combining parametric and bootstrapping technique for traffic flow prediction , 2020 .

[26]  Jerry Chun-Wei Lin,et al.  Adapted K-Nearest Neighbors for Detecting Anomalies on Spatio–Temporal Traffic Flow , 2019, IEEE Access.

[27]  Zijian Liu,et al.  A deep learning based multitask model for network-wide traffic speed prediction , 2020, Neurocomputing.

[28]  Shou-yi Yu,et al.  Fuzzy adaptive genetic algorithm based on auto-regulating fuzzy rules , 2010 .