Pedestrian detection algorithm based on video sequences and laser point cloud

Pedestrian detection is a critical problem in the field of computer vision. Although most existing algorithms are able to detect pedestrians well in controlled environments, it is often difficult to achieve accurate pedestrian detection from video sequences alone, especially in pedestrianintensive scenes wherein pedestrians may cause mutual occlusion and thus incomplete detection. To surmount these difficulties, this paper presents pedestrian detection algorithm based on video sequences and laser point cloud. First, laser point cloud is interpreted and classified to separate pedestrian data and vehicle data. Then a fusion of video image data and laser point cloud data is achieved by calibration. The region of interest after fusion is determined using feature information contained in video image and three-dimensional information of laser point cloud to remove false detection of pedestrian and thus to achieve pedestrian detection in intensive scenes. Experimental verification and analysis in video sequences demonstrate that fusion of two data improves the performance of pedestrian detection and has better detection results.

[1]  Roland Siegwart,et al.  A Layered Approach to People Detection in 3D Range Data , 2010, AAAI.

[2]  P. Shih,et al.  Face detection using distribution-based distance and support vector machine , 2005, Sixth International Conference on Computational Intelligence and Multimedia Applications (ICCIMA'05).

[3]  M. Szarvas,et al.  Pedestrian detection with convolutional neural networks , 2005, IEEE Proceedings. Intelligent Vehicles Symposium, 2005..

[4]  Jiang-tao Wang,et al.  On pedestrian detection and tracking in infrared videos , 2012, Pattern Recognit. Lett..

[5]  Ying Lin,et al.  Extrinsic calibration of a 3D LIDAR and a camera using a trihedron , 2013 .

[6]  Ryosuke Shibasaki,et al.  Multi-modal tracking of people using laser scanners and video camera , 2008, Image Vis. Comput..

[7]  Ryosuke Shibasaki,et al.  Laser-based detection and tracking of multiple people in crowds , 2007, Comput. Vis. Image Underst..

[8]  Paul A. Viola,et al.  Robust Real-time Object Detection , 2001 .

[9]  Ajith Abraham,et al.  A novel multiplex cascade classifier for pedestrian detection , 2013, Pattern Recognit. Lett..

[10]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, International Journal of Computer Vision.

[11]  P. Litkey,et al.  INTEGRATION OF LASER SCANNING AND PHOTOGRAMMETRY , 2007 .

[12]  Shengcai Liao,et al.  Robust Multi-resolution Pedestrian Detection in Traffic Scenes , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[13]  Dariu Gavrila,et al.  Monocular Pedestrian Detection: Survey and Experiments , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[15]  Jian Zhang,et al.  Fast Pedestrian Detection Using a Cascade of Boosted Covariance Features , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[16]  Tomaso A. Poggio,et al.  A Trainable System for Object Detection , 2000, International Journal of Computer Vision.

[17]  Kurt Kubik,et al.  Fusing airborne laser scanner data and aerial imagery for the automatic extraction of buildings in densely built-up areas , 2004 .

[18]  T. Barbu,et al.  MULTIPLE OBJECT DETECTION AND TRACKING IN SONAR MOVIES USING AN IMPROVED TEMPORAL DIFFERENCING APPROACH AND TEXTURE ANALYSIS , 2012 .

[19]  Alan L. Jennings,et al.  Optical Flow Background Estimation for Real-time Pan/tilt Camera Object Tracking , 2014 .

[20]  Jun Miura,et al.  Pedestrian Recognition Using High-definition LIDAR , 2011 .

[21]  David A. McAllester,et al.  Object Detection with Discriminatively Trained Part Based Models , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Paul A. Viola,et al.  Detecting Pedestrians Using Patterns of Motion and Appearance , 2005, International Journal of Computer Vision.

[23]  Serdar Korukoglu,et al.  Moving object detection and tracking by using annealed background subtraction method in videos: Performance optimization , 2012, Expert Syst. Appl..

[24]  Jing Xiao,et al.  Fusion of airborne laserscanning point clouds and images for supervised and unsupervised scene classification , 2014 .

[25]  Derek D. Lichti,et al.  Static Calibration and Analysis of the Velodyne HDL-64E S2 for High Accuracy Mobile Scanning , 2010, Remote. Sens..

[26]  Xiaogang Wang,et al.  Single-Pedestrian Detection Aided by Multi-pedestrian Detection , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[27]  Xuelong Li,et al.  Transfer learning for pedestrian detection , 2013, Neurocomputing.

[28]  Michael Himmelsbach,et al.  Fusing vision and LIDAR - Synchronization, correction and occlusion reasoning , 2010, 2010 IEEE Intelligent Vehicles Symposium.