Surround view pedestrian detection using heterogeneous classifier cascades

Pedestrian detection is of particular interest to the automotive domain, where an accurate estimation of a pedestrian's position is the first step towards reliable collision avoidance systems. Driven by rapid advances in technology, several systems to detect pedestrians in front of a moving vehicle have been proposed in recent years. This paper introduces a novel pedestrian detection system for low-speed driving scenarios, capable of detecting pedestrians in a 360-degree fashion around the vehicle. Detected pedestrians are displayed to the driver in an intuitive way using a dynamically generated Birds's Eye View image. Furthermore, a novel classifier architecture to efficiently handle this complex application scenario is provided. By combining the processing speed of a classifier cascade with the discriminative power of a multi-stage neural network, the system achieves state of the art performance while retaining real-time capability. To keep classifier complexity low, a new feature-based inter-stage information transfer method is presented. All classifier components are compared to recent pedestrian detection approaches and evaluated on a real-world data set.

[1]  Dariu Gavrila,et al.  High-Level Fusion of Depth and Intensity for Pedestrian Classification , 2009, DAGM-Symposium.

[2]  Chu-Song Chen,et al.  Fast Human Detection Using a Novel Boosted Cascading Structure With Meta Stages , 2008, IEEE Transactions on Image Processing.

[3]  Yair Weiss,et al.  Learning object detection from a small number of examples: the importance of good features , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[4]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[5]  Fatih Murat Porikli,et al.  Integral histogram: a fast way to extract histograms in Cartesian spaces , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[6]  Subhransu Maji,et al.  Classification using intersection kernel support vector machines is efficient , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Bernt Schiele,et al.  New features and insights for pedestrian detection , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[8]  Wolfgang Schulz,et al.  Pedestrian Recognition from a Moving Catadioptric Camera , 2007, DAGM-Symposium.

[9]  Luc Van Gool,et al.  A mobile vision system for robust multi-person tracking , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Alain Rakotomamonjy,et al.  A Pedestrian Detector Using Histograms of Oriented Gradients and a Support Vector Machine Classifier , 2007, 2007 IEEE Intelligent Transportation Systems Conference.

[11]  A. Shashua,et al.  Pedestrian detection for driving assistance systems: single-frame classification and system level performance , 2004, IEEE Intelligent Vehicles Symposium, 2004.

[12]  Dariu Gavrila,et al.  Monocular Pedestrian Detection: Survey and Experiments , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Tomás Pajdla,et al.  Hand-eye autocalibration of camera positions on vehicles , 2010, 13th International IEEE Conference on Intelligent Transportation Systems.

[14]  K. Fuerstenberg,et al.  Pedestrian Recognition and Tracking of Vehicles using a vehicle based Multilayer Laserscanner , 2003 .

[15]  Cordelia Schmid,et al.  Human Detection Using Oriented Histograms of Flow and Appearance , 2006, ECCV.

[16]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[17]  Anil K. Jain,et al.  Statistical Pattern Recognition: A Review , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  Jiri Matas,et al.  Inter-stage feature propagation in cascade building with AdaBoost , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[19]  Roland Schweiger,et al.  Camera and imaging radar feature level sensorfusion for night vision pedestrian recognition , 2009, 2009 IEEE Intelligent Vehicles Symposium.

[20]  Mohan M. Trivedi,et al.  On Color-, Infrared-, and Multimodal-Stereo Approaches to Pedestrian Detection , 2007, IEEE Transactions on Intelligent Transportation Systems.

[21]  Dariu Gavrila,et al.  Pedestrian Detection from a Moving Vehicle , 2000, ECCV.

[22]  Fawzi Nashashibi,et al.  Fast Pedestrian Detection in Dense Environment with a Laser Scanner and a Camera , 2009, VTC Spring 2009 - IEEE 69th Vehicular Technology Conference.

[23]  Tomás Pajdla,et al.  Maneuvering Aid for Large Vehicle using Omnidirectional Cameras , 2007, 2007 IEEE Workshop on Applications of Computer Vision (WACV '07).

[24]  Markus Glaser,et al.  Omnidirectional Cameras as Backing-Up Aid , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[25]  Yoav Freund,et al.  A decision-theoretic generalization of on-line learning and an application to boosting , 1995, EuroCOLT.

[26]  A. Broggi,et al.  Pedestrian Detection on a Moving Vehicle: an Investigation about Near Infra-Red Images , 2006, 2006 IEEE Intelligent Vehicles Symposium.