Macroscopic Traffic Flow Modeling with Physics Regularized Gaussian Process: A New Insight into Machine Learning Applications

Despite the wide implementation of machine learning (ML) techniques in traffic flow modeling recently, those data-driven approaches often fall short of accuracy in the cases with a small or noisy dataset. To address this issue, this study presents a new modeling framework, named physics regularized machine learning (PRML), to encode classical traffic flow models (referred as physical models) into the ML architecture and to regularize the ML training process. More specifically, a stochastic physics regularized Gaussian process (PRGP) model is developed and a Bayesian inference algorithm is used to estimate the mean and kernel of the PRGP. A physical regularizer based on macroscopic traffic flow models is also developed to augment the estimation via a shadow GP and an enhanced latent force model is used to encode physical knowledge into stochastic processes. Based on the posterior regularization inference framework, an efficient stochastic optimization algorithm is also developed to maximize the evidence lowerbound of the system likelihood. To prove the effectiveness of the proposed model, this paper conducts empirical studies on a real-world dataset which is collected from a stretch of I-15 freeway, Utah. Results show the new PRGP model can outperform the previous compatible methods, such as calibrated pure physical models and pure machine learning methods, in estimation precision and input robustness.

[1]  L. Mihaylova,et al.  A particle filter for freeway traffic estimation , 2004, 2004 43rd IEEE Conference on Decision and Control (CDC) (IEEE Cat. No.04CH37601).

[2]  J. Lebacque,et al.  Generic Second Order Traffic Flow Modelling , 2007 .

[3]  H. M. Zhang A NON-EQUILIBRIUM TRAFFIC MODEL DEVOID OF GAS-LIKE BEHAVIOR , 2002 .

[4]  Markos Papageorgiou,et al.  Real-time freeway traffic state estimation based on extended Kalman filter: a general approach , 2005 .

[5]  Benjamin Coifman,et al.  Estimating travel times and vehicle trajectories on freeways using dual loop detectors , 2002 .

[6]  W. Y. Szeto,et al.  Stochastic cell transmission model (SCTM): A stochastic dynamic traffic model for traffic state surveillance and assignment , 2011 .

[7]  Serge P. Hoogendoorn,et al.  State-of-the-art of vehicular traffic flow modelling , 2001 .

[8]  Daniel B. Work,et al.  Phase transition model of non-stationary traffic flow: Definition, properties and solution method , 2013 .

[9]  Markos Papageorgiou,et al.  Real-Time Freeway Traffic State Estimation Based on Extended Kalman Filter: A Case Study , 2007, Transp. Sci..

[10]  Nicholas Polson,et al.  Bayesian Particle Tracking of Traffic Flows , 2014, IEEE Transactions on Intelligent Transportation Systems.

[11]  Daiheng Ni,et al.  Markov Chain Monte Carlo Multiple Imputation Using Bayesian Networks for Incomplete Intelligent Transportation Systems Data , 2005 .

[12]  G. Fasshauer Positive definite kernels: past, present and future , 2011 .

[13]  Ying Sun,et al.  Gaussian Processes for Short-Term Traffic Volume Forecasting , 2010 .

[14]  Jianfeng Zheng,et al.  A probabilistic stationary speed–density relation based on Newell’s simplified car-following model , 2014 .

[15]  Benjamin Seibold,et al.  Comparative model accuracy of a data-fitted generalized Aw-Rascle-Zhang model , 2013, Networks Heterog. Media.

[16]  A. Bayen,et al.  On sequential data assimilation for scalar macroscopic traffic flow models , 2012 .

[17]  Hwasoo Yeo,et al.  Data-Driven Imputation Method for Traffic Data in Sectional Units of Road Links , 2016, IEEE Transactions on Intelligent Transportation Systems.

[18]  Andreas Hegyi,et al.  An unscented Kalman filter for freeway traffic estimation , 2006 .

[19]  J. M. D. Castillo,et al.  The reaction time of drivers and the stability of traffic flow , 1994 .

[20]  Tsuyoshi Idé,et al.  Travel-Time Prediction Using Gaussian Process Regression: A Trajectory-Based Approach , 2009, SDM.

[21]  Kuzman Ganchev,et al.  Cross-Lingual Discriminative Learning of Sequence Models with Posterior Regularization , 2013, EMNLP.

[22]  Jeong Gyu Kang,et al.  Estimating destination-specific traffic densities on urban freeways for advanced traffic management , 1994 .

[23]  Alexandre M. Bayen,et al.  Traffic state estimation on highway: A comprehensive survey , 2017, Annu. Rev. Control..

[24]  King-Sun Fu,et al.  IEEE Transactions on Pattern Analysis and Machine Intelligence Publication Information , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  Markus Heinonen,et al.  Learning unknown ODE models with Gaussian processes , 2018, ICML.

[26]  Denos C. Gazis,et al.  Application of Kalman Filtering to the Surveillance and Control of Traffic Systems , 1972 .

[27]  M. R. C. McDowell,et al.  Kinetic Theory of Vehicular Traffic , 1972 .

[28]  David Filliat,et al.  Modelling stop intersection approaches using Gaussian processes , 2013, 16th International IEEE Conference on Intelligent Transportation Systems (ITSC 2013).

[29]  Carl E. Rasmussen,et al.  Gaussian processes for machine learning , 2005, Adaptive computation and machine learning.

[30]  Jorge A. Laval,et al.  Stochastic Extension of Newell's Three-Detector Method , 2012 .

[31]  William E. Schiesser,et al.  Linear and nonlinear waves , 2009, Scholarpedia.

[32]  M. Zhong,et al.  ESTIMATION OF MISSING TRAFFIC COUNTS USING FACTOR, GENETIC, NEURAL AND REGRESSION TECHNIQUES , 2004 .

[33]  Francisco C. Pereira,et al.  Heteroscedastic Gaussian processes for uncertainty modeling in large-scale crowdsourced traffic data , 2018, Transportation Research Part C: Emerging Technologies.

[34]  Markos Papageorgiou,et al.  SOME REMARKS ON MACROSCOPIC TRAFFIC FLOW MODELLING , 1998 .

[35]  M. Kuwahara Theory, Solution Method and Applications of Kinematic Wave , 2015 .

[36]  David Barber,et al.  Gaussian Processes for Bayesian Estimation in Ordinary Differential Equations , 2014, ICML.

[37]  E FasshauerG Positive definite kernels: past, present and future , 2011 .

[38]  Neil D. Lawrence,et al.  Accelerating Bayesian Inference over Nonlinear Differential Equations with Gaussian Processes , 2008, NIPS.

[39]  S. L. Paveri-Fontana,et al.  On Boltzmann-like treatments for traffic flow: A critical review of the basic model and an alternative proposal for dilute traffic analysis , 1975 .

[40]  P. I. Richards Shock Waves on the Highway , 1956 .

[41]  Michael Schreckenberg,et al.  A cellular automaton model for freeway traffic , 1992 .

[42]  Richard Courant,et al.  Methods of Mathematical Physics II: Partial Di erential Equations , 1963 .

[43]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[44]  Bin Ran,et al.  Robust Missing Traffic Flow Imputation Considering Nonnegativity and Road Capacity , 2014 .

[45]  Hilbert,et al.  Methods of Mathematical Physics, vol. II. Partial Differential Equations , 1963 .

[46]  Guangdong Feng,et al.  A Tensor Based Method for Missing Traffic Data Completion , 2013 .

[47]  Michel Rascle,et al.  Resurrection of "Second Order" Models of Traffic Flow , 2000, SIAM J. Appl. Math..

[48]  Denos C. Gazis,et al.  On-Line Estimation of Traffic Densities from Time-Series of Flow and Speed Data , 1971 .

[49]  Nicholas G. Polson,et al.  Deep learning for short-term traffic flow prediction , 2016, 1604.04527.

[50]  Chiu Liu,et al.  Kalman filtering estimation of traffic counts for two network links in tandem , 2003 .

[51]  Barak A. Pearlmutter,et al.  Automatic differentiation in machine learning: a survey , 2015, J. Mach. Learn. Res..

[52]  Ben Taskar,et al.  Graph-Based Posterior Regularization for Semi-Supervised Structured Prediction , 2013, CoNLL.

[53]  Harold J Payne,et al.  MODELS OF FREEWAY TRAFFIC AND CONTROL. , 1971 .

[54]  Bin Ran,et al.  A hybrid deep learning based traffic flow prediction method and its understanding , 2018 .

[55]  Yinhai Wang,et al.  A hybrid approach to integrate fuzzy C-means based imputation method with genetic algorithm for missing traffic volume data estimation , 2015 .

[56]  Paris Perdikaris,et al.  Machine learning of linear differential equations using Gaussian processes , 2017, J. Comput. Phys..

[57]  Neil D. Lawrence,et al.  Linear Latent Force Models Using Gaussian Processes , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[58]  Fei-Yue Wang,et al.  An efficient realization of deep learning for traffic data imputation , 2016 .

[59]  Neil D. Lawrence,et al.  Modelling transcriptional regulation using Gaussian Processes , 2006, NIPS.

[60]  Alexandre M. Bayen,et al.  An ensemble Kalman filtering approach to highway traffic estimation using GPS enabled mobile devices , 2008, 2008 47th IEEE Conference on Decision and Control.

[61]  Markos Papageorgiou,et al.  Macroscopic modelling of traffic flow on the Boulevard Périphérique in Paris , 1989 .

[62]  Andrew Gordon Wilson,et al.  Deep Kernel Learning , 2015, AISTATS.

[63]  Nasser M. Nasrabadi,et al.  Pattern Recognition and Machine Learning , 2006, Technometrics.

[64]  Michel Bierlaire,et al.  Dynamic network loading: a stochastic differentiable model that derives link state distributions , 2011 .

[65]  Ben Taskar,et al.  Posterior Regularization for Structured Latent Variable Models , 2010, J. Mach. Learn. Res..

[66]  Li Li,et al.  Efficient missing data imputing for traffic flow by considering temporal and spatial dependence , 2013 .

[67]  Francisco C. Pereira,et al.  Multi-Output Gaussian Processes for Crowdsourced Traffic Data Imputation , 2018, IEEE Transactions on Intelligent Transportation Systems.

[68]  Rinaldo M. Colombo,et al.  Hyperbolic Phase Transitions in Traffic Flow , 2003, SIAM J. Appl. Math..

[69]  David Griffeath,et al.  The Ergodic Theory of Traffic Jams , 2001 .

[70]  Ramayya Krishnan,et al.  Adaptive collective routing using gaussian process dynamic congestion models , 2013, KDD.

[71]  K. Wada,et al.  An optimization modeling of coordinated traffic signal control based on the variational theory and its stochastic extension , 2018, Transportation Research Part B: Methodological.

[72]  Alexandros Sopasakis,et al.  Lattice Free Stochastic Dynamic , 2012 .

[73]  Ning Chen,et al.  Bayesian inference with posterior regularization and applications to infinite latent SVMs , 2012, J. Mach. Learn. Res..

[74]  Hesham Rakha,et al.  Imputing Erroneous Data of Single-Station Loop Detectors for Nonincident Conditions: Comparison Between Temporal and Spatial Methods , 2012, J. Intell. Transp. Syst..

[75]  Kyandoghere Kyamakya,et al.  Recent Advances in Nonlinear Dynamics and Synchronization , 2009 .

[76]  Henry X. Liu,et al.  A stochastic model of traffic flow: Theoretical foundations , 2011 .

[77]  C. Daganzo Requiem for second-order fluid approximations of traffic flow , 1995 .

[78]  Xuan Di,et al.  Hybrid Extended Kalman Filtering Approach for Traffic Density Estimation along Signalized Arterials , 2010 .

[79]  Thore Graepel,et al.  Solving Noisy Linear Operator Equations by Gaussian Processes: Application to Ordinary and Partial Differential Equations , 2003, ICML.

[80]  Henry X. Liu,et al.  A stochastic model of traffic flow: Gaussian approximation and estimation , 2013 .

[81]  William Stafford Noble,et al.  Entropic Graph-based Posterior Regularization : Extended Version , 2015 .

[82]  M J Lighthill,et al.  On kinematic waves II. A theory of traffic flow on long crowded roads , 1955, Proceedings of the Royal Society of London. Series A. Mathematical and Physical Sciences.

[83]  Alexandros Sopasakis,et al.  Stochastic Modeling and Simulation of Traffic Flow: Asymmetric Single Exclusion Process with Arrhenius look-ahead dynamics , 2006, SIAM J. Appl. Math..

[84]  Yang Song,et al.  Kernel Bayesian Inference with Posterior Regularization , 2016, NIPS.