Head detection and orientation estimation for pedestrian safety

Head detection and orientation estimation are a vital component in the intention recognition of pedestrians. In this paper we propose a novel framework to detect highly occluded pedestrians and estimate their head orientation. Detection is performed for pedestrian's heads only. For this we employ a part-based classifier with HOG/SVM combinations. Head orientations are estimated using discrete orientation classifiers and LBP features. Results are improved by leveraging orientation estimation for head and torso as well as motion information. The orientation estimation is integrated over time using a Hidden Markov Model. From the discrete model we obtain a contiunous head orientation. We evaluate our approach on image sequences with ground truth orientation measurements. To our best knowledge we outperform state of the art results.

[1]  David A. McAllester,et al.  Object Detection with Discriminatively Trained Part Based Models , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[3]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[4]  Paul A. Viola,et al.  Detecting Pedestrians Using Patterns of Motion and Appearance , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[5]  Antonio Torralba,et al.  HOGgles: Visualizing Object Detection Features , 2013, 2013 IEEE International Conference on Computer Vision.

[6]  Christian Wöhler,et al.  An adaptable time-delay neural-network algorithm for image sequence analysis , 1999, IEEE Trans. Neural Networks.

[7]  Dariu Gavrila,et al.  Integrated pedestrian classification and orientation estimation , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[8]  Alexandre Heili,et al.  A joint estimation of head and body orientation cues in surveillance video , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).

[9]  Hua Yan,et al.  Head orientation estimation using neural network , 2011, Proceedings of 2011 International Conference on Computer Science and Network Technology.

[10]  Ian D. Reid,et al.  Unsupervised learning of a scene-specific coarse gaze estimator , 2011, 2011 International Conference on Computer Vision.

[11]  Dariu Gavrila,et al.  Monocular Pedestrian Detection: Survey and Experiments , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Dariu Gavrila,et al.  Joint probabilistic pedestrian head and body orientation estimation , 2014, 2014 IEEE Intelligent Vehicles Symposium Proceedings.

[13]  M.M. Trivedi,et al.  Image based estimation of pedestrian orientation for improving path prediction , 2008, 2008 IEEE Intelligent Vehicles Symposium.

[14]  Kang Ryoung Park,et al.  Real-Time Gaze Estimator Based on Driver's Head Orientation for Forward Collision Warning System , 2011, IEEE Transactions on Intelligent Transportation Systems.

[15]  Chih-Jen Lin,et al.  LIBLINEAR: A Library for Large Linear Classification , 2008, J. Mach. Learn. Res..

[16]  Yuan Li,et al.  Head orientation estimation for covert-tracking robot , 2009, 2009 IEEE International Symposium on Computational Intelligence in Robotics and Automation - (CIRA).

[17]  Andreas Geiger,et al.  Joint 3D Estimation of Objects and Scene Layout , 2011, NIPS.

[18]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[19]  Jean-Marc Odobez,et al.  We are not contortionists: Coupled adaptive learning for head and body orientation estimation in surveillance video , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[20]  Dariu Gavrila,et al.  A Multilevel Mixture-of-Experts Framework for Pedestrian Classification , 2011, IEEE Transactions on Image Processing.

[21]  A. P. Grassi,et al.  Geht er oder geht er nicht? - Ein FAS zur Vorhersage von Fußgängerabsichten , 2008 .

[22]  David A. McAllester,et al.  A discriminatively trained, multiscale, deformable part model , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.