A Comparison of Color and Infrared Stereo Approaches to Pedestrian Detection

This paper presents an analysis of color and infrared stereo approaches to pedestrian detection. We design a four camera experimental testbed consisting of two color and two infrared cameras that allows for synchronous capture and direct frame-by-frame comparison of pedestrian detection approaches. We incorporate this four camera system in a test vehicle and conduct comparative experiments of stereo-based approaches to obstacle detection using color and infrared imagery. A detailed analysis of these experiments shows the robustness of both color and infrared stereo imagery to generate the dense stereo maps necessary for robust object detection and motivates investigation of color and infrared features that can be used to further classify detected obstacles into pedestrian regions. The complementary nature of color and infrared features gives rise to a discussion of a feature fusion techniques, including a cross-spectral stereo solution to pedestrian detection.

[1]  A. Broggi,et al.  Pedestrian Detection using Infrared images and Histograms of Oriented Gradients , 2006, 2006 IEEE Intelligent Vehicles Symposium.

[2]  L. Andreone,et al.  SVM-based pedestrian recognition on near-infrared images , 2005, ISPA 2005. Proceedings of the 4th International Symposium on Image and Signal Processing and Analysis, 2005..

[3]  Kurt Konolige,et al.  Small Vision Systems: Hardware and Implementation , 1998 .

[4]  Bernt Schiele,et al.  Pedestrian detection in crowded scenes , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[5]  Mohan M. Trivedi,et al.  Multimodal Stereo Image Registration for Pedestrian Detection , 2006, 2006 IEEE Intelligent Transportation Systems Conference.

[6]  Xia Liu,et al.  Pedestrian detection using stereo night vision , 2004, IEEE Transactions on Vehicular Technology.

[7]  Keiichi Yamada,et al.  A shape-independent method for pedestrian detection with far-infrared images , 2004, IEEE Transactions on Vehicular Technology.

[8]  Gang Hua,et al.  A statistical field model for pedestrian detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[9]  Xia Liu,et al.  Pedestrian detection and tracking with night vision , 2005, IEEE Transactions on Intelligent Transportation Systems.

[10]  Mohan M. Trivedi,et al.  Mutual information based registration of multimodal stereo videos for person tracking , 2007, Comput. Vis. Image Underst..

[11]  Jean-Philippe Tarel,et al.  Real time obstacle detection in stereovision on non flat road geometry through "v-disparity" representation , 2002, Intelligent Vehicle Symposium, 2002. IEEE.

[12]  Nanning Zheng,et al.  Pedestrian detection using sparse Gabor filter and support vector machine , 2005, IEEE Proceedings. Intelligent Vehicles Symposium, 2005..

[13]  Massimo Bertozzi,et al.  Pedestrian detection by means of far-infrared stereo vision , 2007, Comput. Vis. Image Underst..

[14]  Tarak Gandhi,et al.  Looking-In and Looking-Out of a Vehicle: Computer-Vision-Based Enhanced Vehicle Safety , 2007, IEEE Transactions on Intelligent Transportation Systems.

[15]  Ignacio Parra,et al.  Pedestrian Detection Using SVM and Multi-Feature Combination , 2006, 2006 IEEE Intelligent Transportation Systems Conference.

[16]  Mohan M. Trivedi,et al.  Occupant posture analysis with stereo and thermal infrared video: algorithms and experimental evaluation , 2004, IEEE Transactions on Vehicular Technology.

[17]  Alberto Broggi,et al.  Model-based validation approaches and matching techniques for automotive vision based pedestrian detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[18]  Keiichi Yamada,et al.  Comparison between infrared-image-based and visible-image-based approaches for pedestrian detection , 2003, IEEE IV2003 Intelligent Vehicles Symposium. Proceedings (Cat. No.03TH8683).

[19]  A. Zelinsky,et al.  3D vision sensing for improved pedestrian safety , 2004, IEEE Intelligent Vehicles Symposium, 2004.

[20]  Dariu Gavrila,et al.  An Experimental Study on Pedestrian Classification , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.