Real-time pedestrian detection with the videos of car camera

Pedestrians in the vehicle path are in danger of being hit, thus causing severe injury to pedestrians and vehicle occupants. Therefore, real-time pedestrian detection with the video of vehicle-mounted camera is of great significance to vehicle–pedestrian collision warning and traffic safety of self-driving car. In this article, a real-time scheme was proposed based on integral channel features and graphics processing unit. The proposed method does not need to resize the input image. Moreover, the computationally expensive convolution of the detectors and the input image was converted into the dot product of two larger matrixes, which can be computed effectively using a graphics processing unit. The experiments showed that the proposed method could be employed to detect pedestrians in the video of car camera at 20+ frames per second with acceptable error rates. Thus, it can be applied in real-time detection tasks with the videos of car camera.

[1]  Wuhong Wang,et al.  Intercultural Analyses of Time-to-Collision in Vehicle–Pedestrian Conflict on an Urban Midblock Crosswalk , 2015, IEEE Transactions on Intelligent Transportation Systems.

[2]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, International Journal of Computer Vision.

[3]  Wuhong Wang,et al.  A safety-based approaching behavioural model with various driving characteristics , 2011 .

[4]  M.-M. Meinecke,et al.  Radar sensors and sensor platform used for pedestrian protection in the EC-funded project SAVE-U , 2004, IEEE Intelligent Vehicles Symposium, 2004.

[5]  Paul A. Viola,et al.  Robust Real-time Object Detection , 2001 .

[6]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[7]  Massimo Bertozzi,et al.  Shape-based pedestrian detection , 2000, Proceedings of the IEEE Intelligent Vehicles Symposium 2000 (Cat. No.00TH8511).

[8]  David A. McAllester,et al.  Cascade object detection with deformable part models , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[9]  D.M. Gavrila,et al.  Vision-based pedestrian detection: the PROTECTOR system , 2004, IEEE Intelligent Vehicles Symposium, 2004.

[10]  Luc Van Gool,et al.  Pedestrian detection at 100 frames per second , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[11]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[12]  Pietro Perona,et al.  The Fastest Pedestrian Detector in the West , 2010, BMVC.

[13]  Pietro Perona,et al.  Integral Channel Features , 2009, BMVC.