Recognizing Potential Traffic Risks through Logic-based Deep Scene Understanding

Automatic recognition of risks in traffic scenes is a core technology of Intelligent Transportation Systems. While most of the existing work on traffic risk recognition has been done in the context of motion prediction of vehicles relying on directly observed information (e.g., velocity), exploiting implicit information inferable from observed information (e.g., the intention of pedestrians) has rarely been explored. This paper proposes a novel risk prediction model that uses abductive reasoning to infer implicit information from observations and jointly identifies the most-likely risks in traffic scenes. To evaluate the authors model, create a novel benchmark dataset that contains a wide variety of risk prediction problems. The authors experiments indicate that the abduction-based framework has a great potential for solving risk prediction problems. The developed dataset is made publicly available for research purposes.

[1]  Yotaro Watanabe,et al.  Online Large-margin Weight Learning for First-order Logic-based Abduction (情報論的学習理論と機械学習・第15回情報論的学習理論ワークショップ) , 2012 .

[2]  Tara N. Sainath,et al.  Deep Neural Networks for Acoustic Modeling in Speech Recognition: The Shared Views of Four Research Groups , 2012, IEEE Signal Processing Magazine.

[3]  Franz Kummert,et al.  Behavior prediction at multiple time-scales in inner-city scenarios , 2011, 2011 IEEE Intelligent Vehicles Symposium (IV).

[4]  Eugene Santos,et al.  On the Generation of Alternative Explanations with Implications for Belief Revision , 1991, UAI.

[5]  Paulo E. Santos,et al.  Probabilistic Logic Reasoning about Traffic Scenes , 2011, TAROS.

[6]  Hwee Tou Ng,et al.  Abductive Plan Recognition and Diagnosis: A Comprehensive Empirical Evaluation , 1992, KR.

[7]  Bernt Schiele,et al.  Ten Years of Pedestrian Detection, What Have We Learned? , 2014, ECCV Workshops.

[8]  Hermann Winner,et al.  Three Decades of Driver Assistance Systems: Review and Future Perspectives , 2014, IEEE Intelligent Transportation Systems Magazine.

[9]  Honglak Lee,et al.  Convolutional deep belief networks for scalable unsupervised learning of hierarchical representations , 2009, ICML '09.

[10]  Dariu Gavrila,et al.  Monocular Pedestrian Detection: Survey and Experiments , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Jerry R. Hobbs,et al.  Abductive Reasoning with a Large Knowledge Base for Discourse Processing , 2011, IWCS.

[12]  Steven C. H. Hoi,et al.  Exact Soft Confidence-Weighted Learning , 2012, ICML.

[13]  Kentaro Inui,et al.  Boosting the Efficiency of First-Order Abductive Reasoning Using Pre-estimated Relatedness between Predicates , 2015 .

[14]  Imre Horváth,et al.  Progress with situation assessment and risk prediction in advanced driver assistance systems: A survey , 2009 .

[15]  Dizan Vasquez,et al.  A survey on motion prediction and risk assessment for intelligent vehicles , 2014, ROBOMECH Journal.

[16]  Juan Liu,et al.  An Efficient Computational Architecture for a Collision Early-Warning System for Vehicles, Pedestrians, and Bicyclists , 2011, IEEE Transactions on Intelligent Transportation Systems.

[17]  Luc Van Gool,et al.  A mobile vision system for robust multi-person tracking , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[18]  Robert P. Goldman,et al.  A Probabilistic Model of Plan Recognition , 1991, AAAI.

[19]  T. Kanade,et al.  Monte Carlo road safety reasoning , 2005, IEEE Proceedings. Intelligent Vehicles Symposium, 2005..

[20]  Raymond Mooney,et al.  Bayesian Abductive Logic Programs , 2010, StarAI@AAAI.

[21]  Andreas D. Lattner,et al.  Knowledge-based risk assessment for intelligent vehicles , 2005, International Conference on Integration of Knowledge Intensive Multi-Agent Systems, 2005..

[22]  Thorsten Joachims,et al.  Optimizing search engines using clickthrough data , 2002, KDD.