A Real-Time Detection Algorithm for Vision-Based Pedestrian Protection

This paper discusses the robust, real-time detection of stationary and moving pedestrians utilizing a single car-mounted monochrome camera. First, the system detects potential pedestrians above the ground plane by combining conventional Inverse Perspective Mapping (IPM)-based obstacle detection with the vertical 1D profile evaluation of the IPM detection result. Usage of the vertical profile increases the robustness of detection in low-contrast images as well as the detection of distant pedestrians significantly. A fast digital image stabilization algorithm is used to compensate for erroneous detections whenever the flat ground plane assumption is an inaccurate model of the road surface. Finally, a low-level pedestrian-oriented segmentation and fast symmetry search on the leg region of pedestrians is also presented. A novel approach termed Pedestrian Detection Strip (PDS) is used to improve the calculation time by a factor of six compared to conventional approaches.

[1]  G. Jiang,et al.  Lane and obstacle detection based on fast inverse perspective mapping algorithm , 2000, Smc 2000 conference proceedings. 2000 ieee international conference on systems, man and cybernetics. 'cybernetics evolving to systems, humans, organizations, and their complex interactions' (cat. no.0.

[2]  Dariu Gavrila,et al.  The Visual Analysis of Human Movement: A Survey , 1999, Comput. Vis. Image Underst..

[3]  Darius Burschka,et al.  Advances in Computational Stereo , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  A. Shashua,et al.  Pedestrian detection for driving assistance systems: single-frame classification and system level performance , 2004, IEEE Intelligent Vehicles Symposium, 2004.

[5]  Dariu Gavrila,et al.  Pedestrian Detection from a Moving Vehicle , 2000, ECCV.

[6]  S. Muller-Schneiders,et al.  A Real Time Object Detection Approach Applied to Reliable Pedestrian Detection , 2007, 2007 IEEE Intelligent Vehicles Symposium.

[7]  A. Hussain,et al.  Implementation of inverse perspective mapping algorithm for the development of an automatic lane tracking system , 2004, 2004 IEEE Region 10 Conference TENCON 2004..

[8]  Massimo Bertozzi,et al.  GOLD: a parallel real-time stereo vision system for generic obstacle and lane detection , 1998, IEEE Trans. Image Process..

[9]  Massimo Bertozzi,et al.  AN EXTENSION TO THE INVERSE PERSPECTIVE MAPPING TO HANDLE NON-FLAT ROADS , 1998 .

[10]  Heinrich Niemann,et al.  Integrated motion and geometry-based obstacle detection in image sequences of traffic scenes , 1996, Defense, Security, and Sensing.

[11]  Olivier Faugeras,et al.  Three-Dimensional Computer Vision , 1993 .

[12]  A. Broggi,et al.  Low-level Pedestrian Detection by means of Visible and Far Infra-red Tetra-vision , 2006, 2006 IEEE Intelligent Vehicles Symposium.

[13]  Frank Lindner,et al.  Autonomous Driving approaches Downtown , 1999 .

[14]  Kazunori Onoguchi,et al.  Shadow elimination method for moving object detection , 1998, Proceedings. Fourteenth International Conference on Pattern Recognition (Cat. No.98EX170).

[15]  Dariu Gavrila,et al.  The Issues , 2011 .

[16]  R.M. Haralick.  Monocular vision using inverse perspective projection geometry: analytic relations , 1989, Proceedings CVPR '89: IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[17]  Massimo Bertozzi,et al.  Stereo inverse perspective mapping: theory and applications , 1998, Image Vis. Comput..

[18]  Dariu Gavrila,et al.  Real-time object detection for "smart" vehicles , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[19]  Andreas Kuehnle.  Symmetry-based vehicle location for AHS , 1997, Other Conferences.

[20]  T. Anthony Marsland,et al.  Parallel Search of Strongly Ordered Game Trees , 1982, CSUR.

[21]  D. Baehring,et al.  Detection of close cut-in and overtaking vehicles for driver assistance based on planar parallax , 2005, IEEE Proceedings. Intelligent Vehicles Symposium, 2005..

[22]  J. Little,et al.  Inverse perspective mapping simplifies optical flow computation and obstacle detection , 2004, Biological Cybernetics.

[23]  Anton Kummert,et al.  Vision-based pedestrian detection -reliable pedestrian candidate detection by combining IPM and a 1D profile , 2007, 2007 IEEE Intelligent Transportation Systems Conference.

[24]  Massimo Bertozzi,et al.  Stereo vision-based vehicle detection , 2000, Proceedings of the IEEE Intelligent Vehicles Symposium 2000 (Cat. No.00TH8511).

[25]  Mikio Umeda,et al.  Obstacle Avoidance System for Autonomous Transportation Vehicle Based on Image Processing , 2002 .

[26]  László Havasi,et al.  Pedestrian Detection using derived Third-Order Symmetry of Legs , 2004 .

[27]  Pietro Cerri,et al.  Free Space Detection on Highways using Time Correlation between Stabilized Sub-pixel precision IPM Images , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[28]  Martin A. Fischler,et al.  Computational Stereo , 1982, CSUR.

[29]  T. Williamson.  A high-performance stereo vision system for obstacle detection , 1998 .

[30]  M. Aoki,et al.  Pedestrian detection and tracking in far infrared images , 2005 .

[31]  Xia Liu,et al.  Pedestrian detection and tracking with night vision , 2005, IEEE Transactions on Intelligent Transportation Systems.

[32]  A. Broggi,et al.  Pedestrian Detection on a Moving Vehicle: an Investigation about Near Infra-Red Images , 2006, 2006 IEEE Intelligent Vehicles Symposium.

[33]  Sarp Ertürk,et al.  Sast digital image stabilization using one bit transform based sub-image motion estimation , 2005, IEEE Transactions on Consumer Electronics.

[34]  Yan Zhang,et al.  Robust Moving Object Detection at Distance in the Visible Spectrum and Beyond Using A Moving Camera , 2006, 2006 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'06).