Trajectory analysis and prediction for improved pedestrian safety: Integrated framework and evaluations

This paper presents a monocular and purely vision based pedestrian trajectory tracking and prediction framework with integrated map-based hazard inference. In Advanced Driver Assistance systems research, a lot of effort has been put into pedestrian detection over the last decade, and several pedestrian detection systems are indeed showing impressive results. Considerably less effort has been put into processing the detections further. We present a tracking system for pedestrians, which based on detection bounding boxes tracks pedestrians and is able to predict their positions in the near future. The tracking system is combined with a module which, based on the car's GPS position acquires a map and uses the road information in the map to know where the car can drive. Then the system warns the driver about pedestrians at risk, by combining the information about hazardous areas for pedestrians with a probabilistic position prediction for all observed pedestrians.

[1]  David A. McAllester,et al.  Object Detection with Discriminatively Trained Part Based Models , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Klaus C. J. Dietmayer,et al.  Stationary Detection of the Pedestrian?s Intention at Intersections , 2013, IEEE Intelligent Transportation Systems Magazine.

[3]  Mohan M. Trivedi,et al.  Part-Based Pedestrian Detection and Feature-Based Tracking for Driver Assistance: Real-Time, Robust Algorithms, and Evaluation , 2013, IEEE Transactions on Intelligent Transportation Systems.

[4]  Mohan M. Trivedi,et al.  Learning and Classification of Trajectories in Dynamic Scenes: A General Framework for Live Video Analysis , 2008, 2008 IEEE Fifth International Conference on Advanced Video and Signal Based Surveillance.

[5]  Mohan M. Trivedi,et al.  Tactical driver behavior prediction and intent inference: A review , 2011, 2011 14th International IEEE Conference on Intelligent Transportation Systems (ITSC).

[6]  Dariu Gavrila,et al.  Analysis of pedestrian dynamics from a vehicle perspective , 2014, 2014 IEEE Intelligent Vehicles Symposium Proceedings.

[7]  Dinesh Manocha,et al.  AdaPT: Real-time adaptive pedestrian tracking for crowded scenes , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[8]  M.M. Trivedi,et al.  Image based estimation of pedestrian orientation for improving path prediction , 2008, 2008 IEEE Intelligent Vehicles Symposium.

[9]  Pietro Perona,et al.  The Fastest Pedestrian Detector in the West , 2010, BMVC.

[10]  Tarak Gandhi,et al.  Pedestrian Protection Systems: Issues, Survey, and Challenges , 2007, IEEE Transactions on Intelligent Transportation Systems.

[11]  C. G. Keller,et al.  Will the Pedestrian Cross? A Study on Pedestrian Path Prediction , 2014, IEEE Transactions on Intelligent Transportation Systems.

[12]  Pietro Perona,et al.  Fast Feature Pyramids for Object Detection , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Mohan M. Trivedi,et al.  On surveillance for safety critical events: In-vehicle video networks for predictive driver assistance systems , 2015, Comput. Vis. Image Underst..

[14]  Reinhard Klette,et al.  Integrated Pedestrian and Direction Classification Using a Random Decision Forest , 2013, 2013 IEEE International Conference on Computer Vision Workshops.

[15]  Martial Hebert,et al.  Activity Forecasting , 2012, ECCV.

[16]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[17]  Pietro Perona,et al.  Pedestrian Detection: An Evaluation of the State of the Art , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  N. Schuurman,et al.  Pedestrian Injury and Human Behaviour: Observing Road-Rule Violations at High-Incident Intersections , 2011, PloS one.

[19]  Dariu Gavrila,et al.  UvA-DARE ( Digital Academic Repository ) Pedestrian Path Prediction with Recursive Bayesian Filters : A Comparative Study , 2013 .

[20]  Pietro Perona,et al.  Integral Channel Features , 2009, BMVC.

[21]  Dariu Gavrila,et al.  Integrated pedestrian classification and orientation estimation , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[22]  Mohan M. Trivedi,et al.  Attention estimation by simultaneous analysis of viewer and view , 2014, 17th International IEEE Conference on Intelligent Transportation Systems (ITSC).

[23]  Sheng Tang,et al.  Accurate Estimation of Human Body Orientation From RGB-D Sensors , 2013, IEEE Transactions on Cybernetics.

[24]  Dariu Gavrila,et al.  Person appearance modeling and orientation estimation using Spherical Harmonics , 2013, 2013 10th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG).

[25]  Dariu Gavrila,et al.  Joint probabilistic pedestrian head and body orientation estimation , 2014, 2014 IEEE Intelligent Vehicles Symposium Proceedings.

[26]  Mohan M. Trivedi,et al.  On-road prediction of driver's intent with multimodal sensory cues , 2011, IEEE Pervasive Computing.

[27]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.