Non-recurrent Traffic Congestion Detection with a Coupled Scalable Bayesian Robust Tensor Factorization Model

Non-recurrent traffic congestion (NRTC) usually brings unexpected delays to commuters. Hence, it is critical to accurately detect and recognize the NRTC in a real-time manner. The advancement of road traffic detectors and loop detectors provides researchers with a large-scale multivariable temporal-spatial traffic data, which allows the deep research on NRTC to be conducted. However, it remains a challenging task to construct an analytical framework through which the natural spatial-temporal structural properties of multivariable traffic information can be effectively represented and exploited to better understand and detect NRTC. In this paper, we present a novel analytical training-free framework based on coupled scalable Bayesian robust tensor factorization (Coupled SBRTF). The framework can couple multivariable traffic data including traffic flow, road speed, and occupancy through sharing a similar or the same sparse structure. And, it naturally captures the high-dimensional spatial-temporal structural properties of traffic data by tensor factorization. With its entries revealing the distribution and magnitude of NRTC, the shared sparse structure of the framework compasses sufficiently abundant information about NRTC. While the low-rank part of the framework, expresses the distribution of general expected traffic condition as an auxiliary product. Experimental results on real-world traffic data show that the proposed method outperforms coupled Bayesian robust principal component analysis (coupled BRPCA), the rank sparsity tensor decomposition (RSTD), and standard normal deviates (SND) in detecting NRTC. The proposed method performs even better when only traffic data in weekdays are utilized, and hence can provide more precise estimation of NRTC for daily commuters.

[1]  Liqing Zhang,et al.  Bayesian CP Factorization of Incomplete Tensors with Automatic Rank Determination , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Wei Wang,et al.  Accuracy Analysis of Freeway Traffic Speed Estimation Based on the Integration of Cellular Probe System and Loop Detectors , 2015, J. Intell. Transp. Syst..

[3]  Zenglin Xu,et al.  Bayesian Nonparametric Models for Multiway Data Analysis , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Tamara G. Kolda,et al.  Tensor Decompositions and Applications , 2009, SIAM Rev..

[5]  Jian Zhang,et al.  Using Tensor Completion Method to Achieving Better Coverage of Traffic State Estimation from Sparse Floating Car Data , 2016, PloS one.

[6]  Jianli Xiao,et al.  SVM and KNN ensemble learning for traffic incident detection , 2019, Physica A: Statistical Mechanics and its Applications.

[7]  Anima Anandkumar,et al.  Tensor decompositions for learning latent variable models , 2012, J. Mach. Learn. Res..

[8]  Carroll J Messer,et al.  Incident detection on urban freeways , 1974 .

[9]  Baozhen Yao,et al.  A support vector machine with the tabu search algorithm for freeway incident detection , 2014, Int. J. Appl. Math. Comput. Sci..

[10]  Hilmi Berk Celikoglu,et al.  Overview to some existing incident detection algorithms: a comparative evaluation , 2011 .

[11]  Rajesh Krishnan,et al.  The Use of Convolutional Neural Networks for Traffic Incident Detection at a Network Level , 2018 .

[12]  Onder Tutsoy,et al.  Adaptive estimator design for unstable output error systems: A test problem and traditional system identification based analysis , 2015, J. Syst. Control. Eng..

[13]  Jieping Ye,et al.  Tensor Completion for Estimating Missing Values in Visual Data , 2013, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Moshe Levin,et al.  INCIDENT DETECTION: A BAYESIAN APPROACH , 1978 .

[15]  Fred L. Hall,et al.  Incident Detection on an Arterial Roadway , 1997 .

[16]  Moggan Motamed.  Developing a real-time freeway incident detection model using machine learning techniques , 2016 .

[17]  Zenglin Xu,et al.  Scalable Nonparametric Multiway Data Analysis , 2015, AISTATS.

[18]  MengChu Zhou,et al.  Temporal Pattern-Aware QoS Prediction via Biased Non-Negative Latent Factorization of Tensors , 2020, IEEE Transactions on Cybernetics.

[19]  Wang Ya.  Traffic Congestion Identification Method for Urban Expressway , 2014 .

[20]  Andong Wang,et al.  Noisy low-tubal-rank tensor completion , 2019, Neurocomputing.

[21]  Liqing Zhang,et al.  Bayesian Robust Tensor Factorization for Incomplete Multiway Data , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[22]  Xiao Feng,et al.  Expressway traffic flow model study based on different traffic rules , 2018, IEEE/CAA Journal of Automatica Sinica.

[23]  Zenglin Xu,et al.  Regularized nonnegative matrix factorization with adaptive local structure learning , 2020, Neurocomputing.

[24]  Yong-Kul Ki,et al.  An incident detection algorithm using artificial neural networks and traffic information , 2018, 2018 Cybernetics & Informatics (K&I).

[25]  Stephen G. Ritchie,et al.  Simulation Of Freeway Incident Detection Using Artificial Neural Networks , 1993 .

[26]  Berk Anbaroglu,et al.  Spatio-temporal clustering for non-recurrent traffic congestion detection on urban road networks , 2013 .

[27]  Konstantinos Kalpakis,et al.  Detecting Road Traffic Events by Coupling Multiple Timeseries With a Nonparametric Bayesian Method , 2014, IEEE Transactions on Intelligent Transportation Systems.

[28]  Johan A. K. Suykens,et al.  Robust Low-Rank Tensor Recovery With Regularized Redescending M-Estimator , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[29]  Hao Wang,et al.  Traffic Speed Prediction Under Non-Recurrent Congestion: Based on LSTM Method and BeiDou Navigation Satellite System Data , 2019, IEEE Intelligent Transportation Systems Magazine.

[30]  Chuan Ding,et al.  Prioritizing Influential Factors for Freeway Incident Clearance Time Prediction Using the Gradient Boosting Decision Trees Method , 2017, IEEE Transactions on Intelligent Transportation Systems.

[31]  Hojjat Adeli,et al.  Comparison of fuzzy-wavelet radial basis function neural network freeway incident detection model with California algorithm , 2002 .

[32]  Xin Wang,et al.  Graph based Tensor Recovery for Accurate Internet Anomaly Detection , 2018, IEEE INFOCOM 2018 - IEEE Conference on Computer Communications.

[33]  Yu Zheng,et al.  Travel time estimation of a path using sparse trajectories , 2014, KDD.

[34]  E.C.-P. Chang,et al.  Fuzzy systems based automatic freeway incident detection , 1994, Proceedings of IEEE International Conference on Systems, Man and Cybernetics.

[35]  Guangdong Feng,et al.  A Tensor Based Method for Missing Traffic Data Completion , 2013 .

[36]  J A Martin,et al.  AUTOMATIC INCIDENT DETECTION - TRRL ALGORITHMS HIOCC AND PATREG , 1979 .

[37]  Bin Ran,et al.  Robust Missing Traffic Flow Imputation Considering Nonnegativity and Road Capacity , 2014 .

[38]  Yu Zheng,et al.  Deep Spatio-Temporal Residual Networks for Citywide Crowd Flows Prediction , 2016, AAAI.

[39]  Andrzej Cichocki,et al.  Smooth PARAFAC Decomposition for Tensor Completion , 2015, IEEE Transactions on Signal Processing.

[40]  Lijun Sun,et al.  A Bayesian tensor decomposition approach for spatiotemporal traffic data imputation , 2019, Transportation Research Part C: Emerging Technologies.

[41]  Wei Chu,et al.  Probabilistic Models for Incomplete Multi-dimensional Arrays , 2009, AISTATS.

[42]  Xinyu Chen,et al.  Spatial-temporal traffic speed patterns discovery and incomplete data recovery via SVD-combined tensor decomposition , 2018 .

[43]  Alexander Skabardonis,et al.  Measuring Recurrent and Nonrecurrent Traffic Congestion , 2008 .

[44]  D. Dunson,et al.  Sparse Bayesian infinite factor models. , 2011, Biometrika.

[45]  Abdulhamit Subasi,et al.  Traffic accident detection using random forest classifier , 2018, 2018 15th Learning and Technology Conference (L&T).

[46]  Chaodit Aswakul,et al.  Recurrent and Non-recurrent Congestion Based Gridlock Detection on Chula-SSS Urban Road Network , 2019, SUMO.

[47]  Bin Ran,et al.  Short-Term Traffic Prediction Based on Dynamic Tensor Completion , 2016, IEEE Transactions on Intelligent Transportation Systems.

[48]  Bin Ran,et al.  Freeway Short-Term Travel Time Prediction Based on Dynamic Tensor Completion , 2015 .

[49]  Samuel C Tignor,et al.  FREEWAY INCIDENT-DETECTION ALGORITHMS BASED ON DECISION TREES WITH STATES , 1978 .

[50]  Guangdong Feng,et al.  Traffic volume data outlier recovery via tensor model , 2013 .

[51]  Yin Li,et al.  Optimum Subspace Learning and Error Correction for Tensors , 2010, ECCV.

[52]  Kevin P. Murphy,et al.  Machine learning - a probabilistic perspective , 2012, Adaptive computation and machine learning series.

[53]  Z Ketselidou,et al.  A Calibration Process for Automatic Incident Detection Algorithms , 1993 .

[54]  Andrzej Cichocki,et al.  Nonnegative Tensor Factorization for Continuous EEG Classification , 2007, Int. J. Neural Syst..

[55]  Zenglin Xu,et al.  Knowledge Base Completion by Variational Bayesian Neural Tensor Decomposition , 2018, Cognitive Computation.

[56]  H J Payne,et al.  DEVELOPMENT AND TESTING OF INCIDENT DETECTION ALGORITHMS, VOLUME 2: RESEARCH METHODOLOGY AND DETAILED RESULTS , 1976 .

[57]  Markos Papageorgiou,et al.  Local ramp metering with distant downstream bottlenecks: A comparative study , 2016 .

[58]  Maja Kalinic,et al.  Fuzzy inference approach in traffic congestion detection , 2019, Ann. GIS.