StylePredict: Machine Theory of Mind for Human Driver Behavior From Trajectories

Studies have shown that autonomous vehicles (AVs) behave conservatively in a traffic environment composed of human drivers and do not adapt to local conditions and socio-cultural norms. It is known that socially aware AVs can be designed if there exist a mechanism to understand the behaviors of human drivers. We present a notion of Machine Theory of Mind (M-ToM) to infer the behaviors of human drivers by observing the trajectory of their vehicles. Our M-ToM approach, called StylePredict, is based on trajectory analysis of vehicles, which has been investigated in robotics and computer vision. StylePredict mimics human ToM to infer driver behaviors, or styles, using a computational mapping between the extracted trajectory of a vehicle in traffic and the driver behaviors using graph-theoretic techniques, including spectral analysis and centrality functions. We use StylePredict to analyze driver behavior in different cultures in the USA, China, India, and Singapore, based on traffic density, heterogeneity, and conformity to traffic rules and observe an inverse correlation between longitudinal (overspeeding) and lateral (overtaking, lane-changes) driving styles.

[1]  D. French,et al.  Behavioral correlates of individual differences in road-traffic crash risk: an examination method and findings. , 1993, Psychological bulletin.

[2]  Yi Lu Murphey,et al.  Driver's style classification using jerk analysis , 2009, 2009 IEEE Workshop on Computational Intelligence in Vehicles and Vehicular Systems.

[3]  Dinesh Manocha,et al.  CMetric: A Driving Behavior Measure Using Centrality Functions , 2020, ArXiv.

[4]  Brigitte d'Andréa-Novel,et al.  The kinematic bicycle model: A consistent model for planning feasible trajectories for autonomous vehicles? , 2017, 2017 IEEE Intelligent Vehicles Symposium (IV).

[5]  D. French,et al.  Decision-making style, driving style, and self-reported involvement in road traffic accidents. , 1993, Ergonomics.

[6]  Tomer Toledo,et al.  Driving Behaviors: Models and Challenges for Non-Lane Based Mixed Traffic , 2016 .

[7]  Dinesh Manocha,et al.  Simulating Heterogeneous Crowd BehaviorsUsing Personality Trait Theory , 2011 .

[8]  Farida Saad,et al.  Behavioural adaptations to new driver support systems: some critical issues , 2004, 2004 IEEE International Conference on Systems, Man and Cybernetics (IEEE Cat. No.04CH37583).

[9]  Ahmad Aljaafreh,et al.  Driving style recognition using fuzzy logic , 2012, 2012 IEEE International Conference on Vehicular Electronics and Safety (ICVES 2012).

[10]  Alejandro Lozano,et al.  Impact of driving styles on exhaust emissions and fuel economy from a heavy-duty truck: laboratory tests , 2006 .

[11]  Dinesh Manocha,et al.  DensePeds: Pedestrian Tracking in Dense Crowds Using Front-RVO and Sparse Features , 2019, 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[12]  D. Calvetti,et al.  Tikhonov Regularization of Large Linear Problems , 2003 .

[13]  Krzysztof Czarnecki,et al.  Keep Calm and Ride Along: Passenger Comfort and Anxiety as Physiological Responses to Autonomous Driving Styles , 2020, CHI.

[14]  Kenneth H Beck,et al.  Distress Tolerance as a Predictor of Risky and Aggressive Driving , 2014, Traffic injury prevention.

[15]  Mile Šikić,et al.  Epidemic centrality — is there an underestimated epidemic impact of network peripheral nodes? , 2011, 1110.2558.

[16]  Lin Li,et al.  Driving Style Classification Using a Semisupervised Support Vector Machine , 2017, IEEE Transactions on Human-Machine Systems.

[17]  Hui Liu,et al.  Evaluating Driving Styles by Normalizing Driving Behavior Based on Personalized Driver Modeling , 2015, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[18]  Simon Lucey,et al.  Argoverse: 3D Tracking and Forecasting With Rich Maps , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[19]  Dirk Helbing,et al.  General Lane-Changing Model MOBIL for Car-Following Models , 2007 .

[20]  B. Sahakian,et al.  Knowing me, knowing you: theory of mind in AI , 2020, Psychological Medicine.

[21]  Shlomo Bekhor,et al.  A passing gap acceptance model for two-lane rural highways , 2009 .

[22]  Francisco Aparecido Rodrigues,et al.  Network Centrality: An Introduction , 2018, A Mathematical Modeling Approach from Nonlinear Dynamics to Complex Systems.

[23]  Zhang Wei-hua,et al.  Selected Model and Sensitivity Analysis of Aggressive Driving Behavior , 2012 .

[24]  G. Matthews,et al.  DIMENSIONS OF DRIVER STRESS , 1989 .

[25]  Edouard Leurent,et al.  Social Attention for Autonomous Decision-Making in Dense Traffic , 2019, ArXiv.

[26]  Julian Jara-Ettinger,et al.  Theory of mind as inverse reinforcement learning , 2019, Current Opinion in Behavioral Sciences.

[27]  Helbing,et al.  Congested traffic states in empirical observations and microscopic simulations , 2000, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[28]  Glenn Lawyer,et al.  Understanding the influence of all nodes in a network , 2015, Scientific Reports.

[29]  Javier Alonso-Mora,et al.  Social behavior for autonomous vehicles , 2019, Proceedings of the National Academy of Sciences.

[30]  Barry A. T. Brown,et al.  The Trouble with Autopilots: Assisted and Autonomous Driving on the Social Road , 2017, CHI.

[31]  Rajeev Motwani,et al.  The PageRank Citation Ranking : Bringing Order to the Web , 1999, WWW 1999.

[32]  Ruigang Yang,et al.  The ApolloScape Open Dataset for Autonomous Driving and Its Application , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[33]  Dinesh Manocha,et al.  RobustTP: End-to-End Trajectory Prediction for Heterogeneous Road-Agents in Dense Traffic with Noisy Sensor Inputs , 2019, CSCS.

[34]  Sebastien Glaser,et al.  Simultaneous Localization and Mapping: A Survey of Current Trends in Autonomous Driving , 2017, IEEE Transactions on Intelligent Vehicles.

[35]  R. Saxe,et al.  Theory of Mind: A Neural Prediction Problem , 2013, Neuron.

[36]  Yiman Du,et al.  Leveraging longitudinal driving behaviour data with data mining techniques for driving style analysis , 2015 .

[37]  M. Akamatsu,et al.  Indices for characterizing driving style and their relevance to car following behavior , 2007, SICE Annual Conference 2007.

[38]  Desmond C. Ong,et al.  Empathy and well-being correlate with centrality in different social networks , 2017, Proceedings of the National Academy of Sciences.

[39]  Dinesh Manocha,et al.  TraPHic: Trajectory Prediction in Dense and Heterogeneous Traffic Using Weighted Interactions , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[40]  B. Krahé,et al.  Predicting aggressive driving behavior : the role of macho personality, age and power of car , 2002 .

[41]  U. Frith,et al.  Autism: beyond “theory of mind” , 1994, Cognition.

[42]  B. Bower.  A Child's Theory of Mind , 1993 .

[43]  Malte Risto,et al.  The social behavior of autonomous vehicles , 2016, UbiComp Adjunct.

[44]  Dinesh Manocha,et al.  RoadTrack: Realtime Tracking of Road Agents in Dense and Heterogeneous Environments , 2020, 2020 IEEE International Conference on Robotics and Automation (ICRA).

[45]  Razvan Pascanu,et al.  Sharp Minima Can Generalize For Deep Nets , 2017, ICML.

[46]  Fridulv Sagberg,et al.  A Review of Research on Driving Styles and Road Safety , 2015, Hum. Factors.

[47]  Hamish A Deery,et al.  Hazard and Risk Perception among Young Novice Drivers , 1999 .

[48]  Mustapha Mouloua,et al.  Predictive Validity of the Aggressive Driver Behavior Questionnaire (ADBQ) in a Simulated Environment , 2009 .

[49]  Dinesh Manocha,et al.  Forecasting Trajectory and Behavior of Road-Agents Using Spectral Clustering in Graph-LSTMs , 2019, IEEE Robotics and Automation Letters.

[50]  R. S. Lynch,et al.  Development of a Driving Anger Scale , 1994, Psychological reports.

[51]  Anca D. Dragan,et al.  Planning for Autonomous Cars that Leverage Effects on Human Actions , 2016, Robotics: Science and Systems.

[52]  Dinesh Manocha,et al.  Aggressive, Tense or Shy? Identifying Personality Traits from Crowd Videos , 2017, IJCAI.

[53]  M. Mikulincer,et al.  The multidimensional driving style inventory--scale construct and validation. , 2004, Accident; analysis and prevention.

[54]  Mahamod Ismail,et al.  Abnormal driving detection using real time Global Positioning System data , 2011, Proceeding of the 2011 IEEE International Conference on Space Science and Communication (IconSpace).