NIR image based pedestrian detection in night vision with cascade classification and validation

Pedestrian detection is one of the vital issues in advanced driving assistance applications. It is even more important in nighttime. This paper presents a robust algorithm for a nighttime pedestrian detection system. A NIR (Near Infrared) camera is used in this system to take images of a night scene. As there are large intra class variations in the pedestrian poses, a tree structured classifier is proposed here to handle the problem by training it with different subset of images and different sizes. This paper discusses about combination of Haar-Cascade and HOG-SVM (Histogram of Oriented Gradients-Support Vector Machine) for classification and validation. Haar-Cascade is trained such that to classify the full body of humans which eliminates most of the non-pedestrian regions. For refining the pedestrians after detection, a part based SVM classifier with HOG features is used. Upper and lower body part HOG features of the pedestrians are used for part based validation of detected bounding boxes. A full body validation scheme is also implemented using HOG-SVM when any one of the part based validation does not validate that particular part. Combination of the different types of complementary features yields better results. Experiments on test images determines that the proposed pedestrian detection system has a high detection rate and low false alarm rate since it works on part based validation process.

[1]  Massimo Bertozzi,et al.  Pedestrian detection for driver assistance using multiresolution infrared vision , 2004, IEEE Transactions on Vehicular Technology.

[2]  Yupin Luo,et al.  Real-Time Pedestrian Detection and Tracking at Nighttime for Driver-Assistance Systems , 2009, IEEE Transactions on Intelligent Transportation Systems.

[3]  Charles Kim,et al.  An IR-based Pedestrian Detection System Implemented with Matlab-Equipped Laptop and Low-Cost Microcontroller , 2011 .

[4]  Jianfei Dong,et al.  Nighttime Pedestrian Detection with Near Infrared using Cascaded Classifiers , 2007, 2007 IEEE International Conference on Image Processing.

[5]  A. Broggi,et al.  Pedestrian Detection using Infrared images and Histograms of Oriented Gradients , 2006, 2006 IEEE Intelligent Vehicles Symposium.

[6]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, International Journal of Computer Vision.

[7]  Paul A. Viola,et al.  Robust Real-time Object Detection , 2001 .

[8]  Jian Cheng,et al.  Pedestrian Detection Based on HOG-LBP Feature , 2011, 2011 Seventh International Conference on Computational Intelligence and Security.

[9]  Hiromitsu Hama,et al.  Bundling Multislit-HOG Features of Near Infrared Images for Pedestrian Detection , 2009, 2009 Fourth International Conference on Innovative Computing, Information and Control (ICICIC).

[10]  Keiichi Yamada,et al.  A shape-independent method for pedestrian detection with far-infrared images , 2004, IEEE Transactions on Vehicular Technology.

[11]  Li-Chen Fu,et al.  Near-infrared based nighttime pedestrian detection by combining multiple features , 2011, 2011 14th International IEEE Conference on Intelligent Transportation Systems (ITSC).

[12]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[13]  Yun Luo,et al.  Pedestrian detection in near-infrared night vision system , 2010, 2010 IEEE Intelligent Vehicles Symposium.

[14]  Yi-Shu Lee,et al.  Nighttime pedestrian detection by selecting strong near-infrared parts and enhanced spatially local model , 2012, 2012 15th International IEEE Conference on Intelligent Transportation Systems.

[15]  Mohan M. Trivedi,et al.  Two-stage part-based pedestrian detection , 2012, 2012 15th International IEEE Conference on Intelligent Transportation Systems.