Vision-Based Traffic Conflict Detection Using Trajectory Learning and Prediction

Although traffic conflict techniques have proven to be effective means for road safety analysis, they still suffer from incomplete conceptualization, observer subjectivity, and high data collection cost. To address these problems, video analysis has been increasingly applied to gain a better understanding of the behaviors of road users based on detailed motion data. However, the motion patterns underlying these data are rarely extracted to study the safety of their interactions. This article presents a vision-based method of traffic conflict detection through learning motion patterns from trajectories, for which an original algorithm was established through clustering and subsequent modeling. Using the extracted path and velocity information, we clustered trajectories hierarchically by applying an improved fuzzy $K$ -means algorithm with a modified Hausdorff distance. Each obtained cluster was taken as a labeled set to determine the structure and train the parameters of a hidden Markov model (HMM) that encoded the spatiotemporal characteristics of the trajectories as motion patterns. Based on the targeted trajectory predictions by the learned HMMs following the conflict development, a probabilistic model was developed to estimate the collision likelihood between vehicles to identify traffic conflicts. The experimental results obtained using actual traffic videos demonstrated the applicability of the algorithms for learning motion patterns and the feasibility of the approach for traffic conflict detection. The predicted trajectories were sufficiently accurate to calculate the collision probability, which was qualified as an indicator for measuring the conflict severity. These findings will have important implications for effective improvements in active road safety.

[1]  C. Hydén,et al.  Evaluation of traffic safety, based on micro-level behavioural data: theoretical framework and first implementation. , 2010, Accident; analysis and prevention.

[2]  Andrew J. Bulpitt,et al.  Learning spatio-temporal patterns for predicting object behaviour , 2000, Image Vis. Comput..

[3]  N Lerner AGE AND DRIVER PERCEPTION-REACTION TIME FOR SIGHT DISTANCE DESIGN REQUIREMENTS , 1995 .

[4]  Nicolas Saunier Automated Road Safety Analysis Using Video Data , 2007 .

[5]  Osama Masoud,et al.  A vision-based approach to collision prediction at traffic intersections , 2005, IEEE Transactions on Intelligent Transportation Systems.

[6]  Tieniu Tan,et al.  Traffic accident prediction using 3-D model-based vehicle tracking , 2004, IEEE Transactions on Vehicular Technology.

[7]  Shen Jun,et al.  A Hierarchical Self-Organizing Approach for Learning the Patterns of Motion Trajectories , 2003 .

[8]  Dirk Abel,et al.  Learning scenario-specific vehicle motion models for intelligent infrastructure applications , 2019, IFAC-PapersOnLine.

[9]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[10]  David C. Hogg,et al.  Learning the Distribution of Object Trajectories for Event Recognition , 1995, BMVC.

[11]  W. Eric L. Grimson,et al.  Learning Patterns of Activity Using Real-Time Tracking , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Nicolas Saunier,et al.  Motion Prediction Methods for Surrogate Safety Analysis , 2013 .

[13]  Nicolas Saunier,et al.  Behavior Analysis Using a Multilevel Motion Pattern Learning Framework , 2014 .

[14]  Klaus C. J. Dietmayer,et al.  Intentions of Vulnerable Road Users—Detection and Forecasting by Means of Machine Learning , 2018, IEEE Transactions on Intelligent Transportation Systems.

[15]  C. Hydén THE DEVELOPMENT OF A METHOD FOR TRAFFIC SAFETY EVALUATION: THE SWEDISH TRAFFIC CONFLICTS TECHNIQUE , 1987 .

[16]  W. Eric L. Grimson,et al.  Learning Semantic Scene Models by Trajectory Analysis , 2006, ECCV.

[17]  Tarek Sayed,et al.  Traffic conflict standards for intersections , 1999 .

[18]  Dan Schonfeld,et al.  Object Trajectory-Based Activity Classification and Recognition Using Hidden Markov Models , 2007, IEEE Transactions on Image Processing.

[19]  Fen Wang,et al.  Modeling Drivers' Dynamic Decision-Making Behavior During the Phase Transition Period: An Analytical Approach Based on Hidden Markov Model Theory , 2016, IEEE Transactions on Intelligent Transportation Systems.

[20]  Tarek Sayed,et al.  A Probabilistic Framework for the Automated Analysis of the Exposure to Road Collision , 2008 .

[21]  Hassan Foroosh,et al.  Trajectory Rectification and Path Modeling for Video Surveillance , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[22]  S. M. Sohel Mahmud,et al.  Application of proximal surrogate indicators for safety evaluation: A review of recent developments and research needs , 2017 .

[23]  Zhang Yi,et al.  Trajectory Predictor by Using Recurrent Neural Networks in Visual Tracking , 2017, IEEE Transactions on Cybernetics.

[24]  Chengcheng Xu,et al.  A crash prediction method based on bivariate extreme value theory and video-based vehicle trajectory data. , 2019, Accident; analysis and prevention.

[25]  A. Poritz,et al.  Hidden Markov models: a guided tour , 1988, ICASSP-88., International Conference on Acoustics, Speech, and Signal Processing.

[26]  Zhang Lanfang Halcon and OpenCV-Based Traffic Automatic Conflicting Detecting Method and Data Transaction , 2010 .

[27]  Tarek Sayed,et al.  Comprehensive Safety Diagnosis Using Automated Video Analysis: Applications to an Urban Intersection in Edmonton, Alberta, Canada , 2016 .

[28]  Wolfram Burgard,et al.  Learning Motion Patterns of People for Compliant Robot Motion , 2005, Int. J. Robotics Res..

[29]  John Hourdos,et al.  Outline for a causal model of traffic conflicts and crashes. , 2011, Accident; analysis and prevention.

[30]  Mohamed Abdel-Aty,et al.  Time-varying Analysis of Traffic Conflicts at the Upstream Approach of Toll Plaza. , 2020, Accident; analysis and prevention.

[31]  Tay Christopher,et al.  Analysis of Dynamic Scenes: Application to Driving Assistance , 2009 .

[32]  Christian Laugier,et al.  Incremental Learning of Statistical Motion Patterns With Growing Hidden Markov Models , 2007, IEEE Transactions on Intelligent Transportation Systems.

[33]  Tim J. Ellis,et al.  Path detection in video surveillance , 2002, Image Vis. Comput..

[34]  Mohan M. Trivedi,et al.  Learning, Modeling, and Classification of Vehicle Track Patterns from Live Video , 2008, IEEE Transactions on Intelligent Transportation Systems.

[35]  Tieniu Tan,et al.  A system for learning statistical motion patterns , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[36]  Nikolaos Papanikolopoulos,et al.  Clustering of Vehicle Trajectories , 2010, IEEE Transactions on Intelligent Transportation Systems.

[37]  Chafic Mokbel,et al.  Dynamic and Contextual Information in HMM Modeling for Handwritten Word Recognition , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[38]  Dizan Vasquez,et al.  A survey on motion prediction and risk assessment for intelligent vehicles , 2014, ROBOMECH Journal.

[39]  Christer Hydén,et al.  Estimating the severity of safety related behaviour. , 2006, Accident; analysis and prevention.

[40]  Jin Young Choi,et al.  Two-stage online inference model for traffic pattern analysis and anomaly detection , 2014, Machine Vision and Applications.

[41]  Åse Svensson,et al.  A method for analysing the traffic process in a safety perspective , 1998 .

[42]  Nicolas Saunier,et al.  An Automated Surrogate Safety Analysis at Protected Highway Ramps Using Cross-Sectional and Before- , 2013 .

[43]  Katsushi Ikeuchi,et al.  Traffic monitoring and accident detection at intersections , 2000, IEEE Trans. Intell. Transp. Syst..

[44]  Thierry Fraichard,et al.  Motion prediction for moving objects: a statistical approach , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[45]  Kaan Ozbay,et al.  Mining automatically extracted vehicle trajectory data for proactive safety analytics , 2019, Transportation Research Part C: Emerging Technologies.

[46]  Gerald Brown,et al.  Traffic conflicts for road user safety studies , 1994 .

[47]  Rui Xu,et al.  Survey of clustering algorithms , 2005, IEEE Transactions on Neural Networks.

[48]  Mohan M. Trivedi,et al.  A Survey of Vision-Based Trajectory Learning and Analysis for Surveillance , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[49]  Jonas Firl,et al.  Online maneuver recognition and multimodal trajectory prediction for intersection assistance using non-parametric regression , 2014, 2014 IEEE Intelligent Vehicles Symposium Proceedings.

[50]  Ulrich Konigorski,et al.  Prediction of highway lane changes based on prototype trajectories , 2019, Forschung im Ingenieurwesen.

[51]  Tarek Sayed,et al.  Automated Analysis and Validation of Right-Turn Merging Behavior , 2015 .

[52]  Tim J. Ellis,et al.  Spatial and Probabilistic Modelling of Pedestrian Behaviour , 2002, BMVC.