Recognizing Pedestrian Direction Using Convolutional Neural Networks

Pedestrian movement direction recognition is an important factor in autonomous driver assistance and security surveillance systems. Pedestrians are the most crucial and fragile moving objects in streets, roads and events where thousands of people may gather on a regular basis. People flow analysis on zebra crossings and in commercial centres or events such as demonstrations, are a key element to improve safety and to enable autonomous cars to drive in real life environments. This paper focuses on deep learning techniques such as Convolutional Neural Networks (CNN) to achieve a good and reliable detection of pedestrians moving in a particular direction. We present a novel input representation that leverages current pedestrian detection techniques to generate a sum of subtracted frames, which are used as an input for the proposed CNN. Moreover, we have also created a new dataset for this purpose.

[1]  Brian R. Gallagher,et al.  Analysis of Pedestrian Gait and Perception-Reaction at Signal-Controlled Crosswalk Intersections , 2000 .

[2]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, International Journal of Computer Vision.

[3]  M.M. Trivedi,et al.  Image based estimation of pedestrian orientation for improving path prediction , 2008, 2008 IEEE Intelligent Vehicles Symposium.

[4]  C. G. Keller,et al.  Will the Pedestrian Cross? A Study on Pedestrian Path Prediction , 2014, IEEE Transactions on Intelligent Transportation Systems.

[5]  Gunnar Farnebäck,et al.  Two-Frame Motion Estimation Based on Polynomial Expansion , 2003, SCIA.

[6]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[7]  Pietro Perona,et al.  Pedestrian Detection: An Evaluation of the State of the Art , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Bernt Schiele,et al.  Ten Years of Pedestrian Detection, What Have We Learned? , 2014, ECCV Workshops.

[9]  B. Schiele,et al.  How Far are We from Solving Pedestrian Detection? , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[10]  Nitish Srivastava,et al.  Improving neural networks by preventing co-adaptation of feature detectors , 2012, ArXiv.

[11]  Dariu Gavrila,et al.  UvA-DARE ( Digital Academic Repository ) Pedestrian Path Prediction with Recursive Bayesian Filters : A Comparative Study , 2013 .

[12]  Mohan M. Trivedi,et al.  Trajectory analysis and prediction for improved pedestrian safety: Integrated framework and evaluations , 2015, 2015 IEEE Intelligent Vehicles Symposium (IV).

[13]  Dariu Gavrila,et al.  Monocular Pedestrian Detection: Survey and Experiments , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Bernt Schiele,et al.  New features and insights for pedestrian detection , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[15]  Yoshua Bengio,et al.  Understanding the difficulty of training deep feedforward neural networks , 2010, AISTATS.

[16]  Dariu Gavrila,et al.  Integrated pedestrian classification and orientation estimation , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[17]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[18]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[19]  Michael Goldhammer,et al.  Analysis on termination of pedestrians' gait at urban intersections , 2014, 17th International IEEE Conference on Intelligent Transportation Systems (ITSC).

[20]  Klaus C. J. Dietmayer,et al.  Stationary Detection of the Pedestrian?s Intention at Intersections , 2013, IEEE Intelligent Transportation Systems Magazine.