Real-Time Traffic Modeling and Estimation with Streaming Probe Data using Machine Learning

Traffic information systems play an important role in the world as numerous people rely on the road transportation network for their most important daily functions. This dissertation proposes a general system architecture for processing traffic data and for disseminating accurate, timely traffic information via the internet. It also specifically addresses the challenges with estimating arterial traffic conditions using only data from GPS probe vehicles. GPS probe data promises to be the most ubiquitous source of traffic data for years to come as transit agencies decrease their investment in traditional fixed-location sensing infrastructure. The dissertation introduces the architecture design and implementation of the Mobile Millennium system. A joint project between UC Berkeley, Nokia and Navteq, Mobile Millennium aggregates data from numerous sources, runs state of the art estimation and forecast algorithms, and provides timely traffic information to drivers and other targets. This system took over two years to build and the result is a robust framework for any traffic estimation researcher to access vast stores of data quickly and easily as well as test any number of estimation algorithms. For estimating arterial traffic conditions, this dissertation proposes a hybrid approach leveraging advances in the fields of machine learning and traffic theory (based on hydrodynamic theory). This approach provides a foundation for any arterial traffic estimation model. A variety of model/algorithm approaches are presented, with one ultimately proving to be superior to the rest and the one that should be carried forward as research in this area continues.

[1]  Alexander Skabardonis,et al.  Performance Evaluation of Travel Time Methods for Real Time Traffic Applications , 2007 .

[2]  Lawrence A Klein,et al.  SUMMARY OF VEHICLE DETECTION AND SURVEILLANCE TECHNOLOGIES USED IN INTELLIGENT TRANSPORTATION SYSTEMS , 2000 .

[3]  Matthew Brand,et al.  Coupled hidden Markov models for modeling interacting processes , 1997 .

[4]  Andreas Krause,et al.  Toward Community Sensing , 2008, 2008 International Conference on Information Processing in Sensor Networks (ipsn 2008).

[5]  Xuegang Ban,et al.  Bottleneck Identification and Calibration for Corridor Management Planning , 2007 .

[6]  Henry X. Liu,et al.  Virtual Probe Approach for Time-Dependent Arterial Travel Time Estimation , 2008 .

[7]  Laurence A. Wolsey,et al.  Integer and Combinatorial Optimization , 1988 .

[8]  Der-Horng Lee,et al.  Calibration-free arterial link speed estimation model using loop data , 2001 .

[9]  Alexander Skabardonis,et al.  Real-Time Monitoring and Control on Signalized Arterials , 2008, J. Intell. Transp. Syst..

[10]  P. Pfeifer,et al.  A Three-Stage Iterative Procedure for Space-Time Modeling , 1980 .

[11]  A. Bayen,et al.  A Distributed Highway Velocity Model for Traffic State Reconstruction , 2009 .

[12]  Darcy M. Bullock,et al.  Real-Time Travel Time Estimates Using Media Access Control Address Matching , 2008 .

[13]  Pravin P Varaiya Freeway Performance Measurement System (PeMS), PeMS 7.0 , 2007 .

[14]  Peter Norvig,et al.  Artificial Intelligence: A Modern Approach , 1995 .

[15]  Alexandre M. Bayen,et al.  Traffic flow reconstruction using mobile sensors and loop detector data , 2007 .

[16]  R. Horowitz,et al.  Mixture Kalman filter based highway congestion mode and vehicle density estimator and its application , 2004, Proceedings of the 2004 American Control Conference.

[17]  Alexandre M. Bayen,et al.  Lax–Hopf Based Incorporation of Internal Boundary Conditions Into Hamilton–Jacobi Equation. Part I: Theory , 2010, IEEE Transactions on Automatic Control.

[18]  C. Robert The Bayesian choice : a decision-theoretic motivation , 1996 .

[19]  Yiannis Kamarianakis,et al.  Space-time modeling of traffic flow , 2002, Comput. Geosci..

[20]  Alexandre M. Bayen,et al.  Lax–Hopf Based Incorporation of Internal Boundary Conditions Into Hamilton-Jacobi Equation. Part II: Computational Methods , 2010, IEEE Transactions on Automatic Control.

[21]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[22]  Yi Zhang,et al.  Short-term traffic flow forecasting of urban network based on dynamic STARIMA model , 2009, 2009 12th International IEEE Conference on Intelligent Transportation Systems.

[23]  A. Bayen,et al.  Minimal error certificates for detection of faulty sensors using convex optimization , 2009, 2009 47th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[24]  P. I. Richards Shock Waves on the Highway , 1956 .

[25]  Eugene Charniak,et al.  Statistical language learning , 1997 .

[26]  Alexandre M. Bayen,et al.  Virtual trip lines for distributed privacy-preserving traffic monitoring , 2008, MobiSys '08.

[27]  Taehyung Park,et al.  A Bayesian Approach for Estimating Link Travel Time on Urban Arterial Road Network , 2004, ICCSA.

[28]  Alexander Skabardonis,et al.  Detecting Errors and Imputing Missing Data for Single-Loop Surveillance Systems , 2003 .

[29]  R. Herring,et al.  A hydrodynamic theory based statistical model of arterial traffic , 2010 .

[30]  Michael I. Jordan,et al.  Graphical Models, Exponential Families, and Variational Inference , 2008, Found. Trends Mach. Learn..

[31]  Finn V. Jensen,et al.  Bayesian Networks and Decision Graphs , 2001, Statistics for Engineering and Information Science.

[32]  Alexander Skabardonis,et al.  Improved Speed-Flow Relationships for Planning Applications , 1997 .

[33]  Liping Fu,et al.  Decomposing Travel Times Measured by Probe-based Traffic Monitoring Systems to Individual Road Segments , 2008 .

[34]  M J Lighthill,et al.  On kinematic waves II. A theory of traffic flow on long crowded roads , 1955, Proceedings of the Royal Society of London. Series A. Mathematical and Physical Sciences.

[35]  Pravin Varaiya,et al.  Arterial travel time estimation based on vehicle re-identification using wireless magnetic sensors , 2009 .

[36]  H. V. van Zuylen,et al.  Predicting Urban Arterial Travel Time with State-Space Neural Networks and Kalman Filters , 2006 .

[37]  Will Recker,et al.  Using Microscopic Simulation to Evaluate Potential Intelligent Transportation System Strategies Under Nonrecurrent Congestion , 2004 .

[38]  Philip D. Wasserman,et al.  Neural computing - theory and practice , 1989 .

[39]  Gaetano Valenti,et al.  Traffic Estimation And Prediction Based On Real Time Floating Car Data , 2008, 2008 11th International IEEE Conference on Intelligent Transportation Systems.

[40]  N. Gordon,et al.  Novel approach to nonlinear/non-Gaussian Bayesian state estimation , 1993 .

[41]  Hui Xiong,et al.  Enhancing Security and Privacy in Traffic-Monitoring Systems , 2006, IEEE Pervasive Computing.

[42]  John Krumm,et al.  Inference Attacks on Location Tracks , 2007, Pervasive.

[43]  Benjamin Coifman,et al.  Estimating travel times and vehicle trajectories on freeways using dual loop detectors , 2002 .

[44]  Erik van Zwet,et al.  A simple and effective method for predicting travel times on freeways , 2004, IEEE Transactions on Intelligent Transportation Systems.

[45]  Alexander Skabardonis,et al.  Prediction of Arrival Profiles and Queue Lengths along Signalized Arterials by using a Markov Decision Process , 2005 .

[46]  Baruch Schieber,et al.  On-line dynamic programming with applications to the prediction of RNA secondary structure , 1991, SODA '90.

[47]  Pravin Varaiya,et al.  Freeway Performance Measurement System: Mining Loop Detector Data , 2001 .

[48]  Stuart E. Dreyfus,et al.  Applied Dynamic Programming , 1965 .

[49]  Alexander Skabardonis,et al.  Real-Time Estimation of Travel Times on Signalized Arterials , 2005 .

[50]  I G Taylor,et al.  THE USE OF THE OUTPUT FROM VEHICLE DETECTORS TO ASSESS DELAY IN COMPUTER-CONTROLLED AREA TRAFFIC CONTROL SYSTEMS , 1981 .

[51]  Alexandre M. Bayen,et al.  Evaluation of traffic data obtained via GPS-enabled mobile phones: The Mobile Century field experiment , 2009 .

[52]  Robert Brewer,et al.  Evaluation of Cell Phone Traffic Data in Minnesota , 2008 .

[53]  Alexandre M. Bayen,et al.  Estimating arterial traffic conditions using sparse probe data , 2010, 13th International IEEE Conference on Intelligent Transportation Systems.

[54]  Trevor Hastie,et al.  The Elements of Statistical Learning , 2001 .

[55]  G. Evensen Data Assimilation: The Ensemble Kalman Filter , 2006 .

[56]  Virginia P Sisiopiku Travel time estimation from loop detector data for advanced traveler information systems applications. , 1994 .

[57]  Arnaud de La Fortelle,et al.  A Belief Propagation Approach to Traffic Prediction using Probe Vehicles , 2007, 2007 IEEE Intelligent Transportation Systems Conference.

[58]  J D Margulici California Center for Innovative Transportation: Five Years of Public-Private-Academia Partnerships and ITS Deployment , 2009 .

[59]  James F. Gimpel A theory of discrete patterns and their implementation in SNOBOL4 , 1973, Commun. ACM.

[60]  Alexandre M. Bayen,et al.  Using Mobile Phones to Forecast Arterial Traffic through Statistical Learning , 2010 .

[61]  Neil J. Gordon,et al.  A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking , 2002, IEEE Trans. Signal Process..

[62]  Claudene Sproles United States Department of Transportation homepage , 2006, Gov. Inf. Q..

[63]  Sivan Toledo,et al.  VTrack: accurate, energy-aware road traffic delay estimation using mobile phones , 2009, SenSys '09.

[64]  Stephen G. Ritchie,et al.  Anonymous Vehicle Tracking for Real-Time Traffic Surveillance and Performance on Signalized Arterials , 2002 .

[65]  Alexandre M. Bayen,et al.  Optimal Sensor Placement for Freeway Travel Time Estimation , 2009 .

[66]  Chao Chen,et al.  The PeMS algorithms for accurate, real-time estimates of g-factors and speeds from single-loop detectors , 2001, ITSC 2001. 2001 IEEE Intelligent Transportation Systems. Proceedings (Cat. No.01TH8585).

[67]  Alexandre M. Bayen,et al.  Delay Pattern Estimation for Signalized Intersections Using Sampled Travel Times , 2009 .

[68]  G. M.,et al.  Partial Differential Equations I , 2023, Applied Mathematical Sciences.

[69]  K. Ozbay,et al.  A Clustering Based Methodology for Determining the Optimal Roadway Configuration of Detectors for Travel Time Estimation , 2006, 2006 IEEE Intelligent Transportation Systems Conference.

[70]  Gordon F. Newell THEORY OF HIGHWAY TRAFFIC SIGNALS , 1989 .

[71]  C. Daganzo THE CELL TRANSMISSION MODEL.. , 1994 .

[72]  Alexandre M. Bayen,et al.  An ensemble Kalman filtering approach to highway traffic estimation using GPS enabled mobile devices , 2008, 2008 47th IEEE Conference on Decision and Control.

[73]  Cheol Oh,et al.  Anonymous Vehicle Tracking for Real-Time Freeway and Arterial Street Performance Measurement , 2005 .