Hardware-friendly pedestrian detection and impact prediction

We present a system for pedestrian detection and impact prediction, from a frontal camera situated on a moving vehicle. The system combines together the output of several algorithms to form a reliable detection and positioning of pedestrians. One of the important contributions of this paper is a highly-efficient algorithm for classification of pedestrian images using a learned set of features, each feature based on a 5/spl times/5 pixels shape. The learning of the features is done using AdaBoost and genetic-like algorithms. The described application was developed as a part of the CAMELLIA project, thus all the algorithms used in this application are designed to use a special set of low level image processing operations provided by the smart imaging core developed in the project. Fusion of the various algorithms results and tracking of pedestrians is done using particle filtering, providing a good tool to predict the future movement of pedestrians, in order to estimate impact probability.

[1]  Yoav Freund,et al.  A decision-theoretic generalization of on-line learning and an application to boosting , 1995, EuroCOLT.

[2]  A. Doucet,et al.  Particle filtering for multi-target tracking and sensor management , 2002, Proceedings of the Fifth International Conference on Information Fusion. FUSION 2002. (IEEE Cat.No.02EX5997).

[3]  Neil J. Gordon,et al.  A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking , 2002, IEEE Trans. Signal Process..

[4]  P. Pérez,et al.  Tracking multiple objects with particle filtering , 2002 .

[5]  Peter Pirsch,et al.  A core for ambient and mobile intelligent imaging applications , 2003, 2003 International Conference on Multimedia and Expo. ICME '03. Proceedings (Cat. No.03TH8698).

[6]  Edward H. Adelson,et al.  Analyzing and recognizing walking figures in XYT , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Massimo Bertozzi,et al.  Shape-based pedestrian detection , 2000, Proceedings of the IEEE Intelligent Vehicles Symposium 2000 (Cat. No.00TH8511).

[8]  Paul A. Viola,et al.  Detecting Pedestrians Using Patterns of Motion and Appearance , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[9]  Thomas Kalinke,et al.  Walking pedestrian recognition , 2000, IEEE Trans. Intell. Transp. Syst..

[10]  Neil J. Gordon,et al.  A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking , 2002, IEEE Trans. Signal Process..

[11]  Fredrik Gustafsson,et al.  Particle filters for positioning, navigation, and tracking , 2002, IEEE Trans. Signal Process..

[12]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[13]  Dariu Gavrila,et al.  Sensor-Based Pedestrian Protection , 2001, IEEE Intell. Syst..

[14]  Nando de Freitas,et al.  Sequential Monte Carlo Methods in Practice , 2001, Statistics for Engineering and Information Science.

[15]  Gerard de Haan,et al.  Real-time recursive motion segmentation of video data on a programmable device , 2001, IEEE Trans. Consumer Electron..