A Lidar and Vision-based Approach for Pedestrian and Vehicle Detection and Tracking

This paper presents a sensorial-cooperative architecture to detect, track and classify entities in semi-structured outdoor scenarios for intelligent vehicles. In order to accomplish this task, information provided by in-vehicle Lidar and monocular vision is used. The detection and tracking phases are performed in the laser space, and the object classification methods work both in laser space (using a Gaussian Mixture Model classifier) and in vision spaces (AdaBoost classifier). A Bayesian-sum decision rule is used in order to combine the results of both classification techniques, and hence a more reliable object classification is achieved. Experiments confirm the effectiveness of the proposed architecture.

[1]  Pietro Perona,et al.  One-shot learning of object categories , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Jiri Matas,et al.  On Combining Classifiers , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Massimo Bertozzi,et al.  Shape-based pedestrian detection , 2000, Proceedings of the IEEE Intelligent Vehicles Symposium 2000 (Cat. No.00TH8511).

[4]  Günther Schmidt,et al.  Fusing range and intensity images for mobile robot localization , 1999, IEEE Trans. Robotics Autom..

[5]  Yakov Bar-Shalom,et al.  Multitarget-Multisensor Tracking: Principles and Techniques , 1995 .

[6]  L.C. Bento,et al.  Multi-target detection and tracking with a laser scanner , 2004, IEEE Intelligent Vehicles Symposium, 2004.

[7]  Joni-Kristian Kämäräinen,et al.  Feature representation and discrimination based on Gaussian mixture model probability densities - Practices and algorithms , 2006, Pattern Recognit..

[8]  Dominique Gruyer,et al.  Cooperative Fusion for Multi-Obstacles Detection With Use of Stereovision and Laser Scanner , 2005, Auton. Robots.

[9]  K. Dietmayer,et al.  Object tracking and classification using a multiple hypothesis approach , 2004, IEEE Intelligent Vehicles Symposium, 2004.

[10]  E. Nebot,et al.  Simultaneous Localization and Map Building Using Natural features in Outdoor Environments , .

[11]  Y. Freund,et al.  Discussion of the Paper \additive Logistic Regression: a Statistical View of Boosting" By , 2000 .

[12]  Tomaso A. Poggio,et al.  Pedestrian detection using wavelet templates , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[13]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[14]  Jean-Yves Bouguet,et al.  Camera calibration toolbox for matlab , 2001 .

[15]  Ignacio Parra,et al.  Pedestrian Detection Using SVM and Multi-Feature Combination , 2006, 2006 IEEE Intelligent Transportation Systems Conference.

[16]  G. McLachlan,et al.  The EM algorithm and extensions , 1996 .

[17]  Til Aach,et al.  Detection and recognition of moving objects using statistical motion detection and Fourier descriptors , 2003, 12th International Conference on Image Analysis and Processing, 2003.Proceedings..

[18]  Pólo de Coimbra,et al.  Segmentation and Geometric Primitives Extraction from 2D Laser Range Data for Mobile Robot Applications , 2005 .

[19]  Wolfram Burgard,et al.  Using Boosted Features for the Detection of People in 2D Range Data , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[20]  Cristiano Premebida,et al.  A Multi-Target Tracking and GMM-Classifier for Intelligent Vehicles , 2006, 2006 IEEE Intelligent Transportation Systems Conference.

[21]  Dariu Gavrila,et al.  Real-time object detection for "smart" vehicles , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[22]  Ryosuke Shibasaki,et al.  Joint Tracking and Classification of Moving Objects at Intersection Using a Single-Row Laser Range Scanner , 2006, 2006 IEEE Intelligent Transportation Systems Conference.

[23]  Paulo Peixoto,et al.  A Hierarchical Fuzzy Integration of Local and Global Feature-based Classifiers to Recognize Objects in Autonomous Vehicles , 2007 .

[24]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[25]  S. Heinrich,et al.  Fast obstacle detection for urban traffic situations , 2002, IEEE Trans. Intell. Transp. Syst..