Moving object detection with laser scanners

The detection and tracking of moving objects is an essential task in robotics. The CMU‐RI Navlab group has developed such a system that uses a laser scanner as its primary sensor. We will describe our algorithm and its use in several applications. Our system worked successfully on indoor and outdoor platforms and with several different kinds and configurations of two‐dimensional and three‐dimensional laser scanners. The applications vary from collision warning systems, people classification, observing human tracks, and input to a dynamic planner. Several of these systems were evaluated in live field tests and shown to be robust and reliable. © 2012 Wiley Periodicals, Inc.

[1]  C. M. Shoemaker,et al.  The Demo III UGV program: a testbed for autonomous navigation research , 1998, Proceedings of the 1998 IEEE International Symposium on Intelligent Control (ISIC) held jointly with IEEE International Symposium on Computational Intelligence in Robotics and Automation (CIRA) Intell.

[2]  Anil K. Jain,et al.  Data clustering: a review , 1999, CSUR.

[3]  David Mumford,et al.  Statistics of natural images and models , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[4]  David Mumford,et al.  Statistics of range images , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[5]  Wolfram Burgard,et al.  Tracking multiple moving objects with a mobile robot , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[6]  Erwin Prassler,et al.  Fast and robust tracking of multiple moving objects with a laser range finder , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[7]  Jan-Olof Eklundh,et al.  Detecting and tracking moving objects from a mobile platform using a laser range scanner , 2001, Proceedings 2001 IEEE/RSJ International Conference on Intelligent Robots and Systems. Expanding the Societal Role of Robotics in the the Next Millennium (Cat. No.01CH37180).

[8]  William Whittaker,et al.  Conditional particle filters for simultaneous mobile robot localization and people-tracking , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[9]  Universityof SouthernCalifornia LosAngeles.  Laser-based People Tracking , 2002 .

[10]  R. Aufrere,et al.  Multiple sensor fusion for detecting location of curbs, walls, and barriers , 2003, IEEE IV2003 Intelligent Vehicles Symposium. Proceedings (Cat. No.03TH8683).

[11]  Juan I. Nieto,et al.  Multiple target tracking using Sequential Monte Carlo Methods and statistical data association , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[12]  Geoffrey J. Gordon,et al.  Better Motion Prediction for People-tracking , 2004 .

[13]  A 2D COLLISION WARNING FRAMEWORK BASED ON A MONTE CARLO APPROACH , 2004 .

[14]  Daniel Castro,et al.  Feature extraction for moving objects tracking system in indoor environments , 2004 .

[15]  A Multiple Hypothesis Walking Person Tracker with Switched Dynamic Model , 2004 .

[16]  K. Dietmayer,et al.  Object tracking and classification for multiple active safety and comfort applications using a multilayer laser scanner , 2004, IEEE Intelligent Vehicles Symposium, 2004.

[17]  Dominique Gruyer,et al.  Cooperative Fusion for Multi-Obstacles Detection With Use of Stereovision and Laser Scanner , 2005, Auton. Robots.

[18]  Rui Xu,et al.  Survey of clustering algorithms , 2005, IEEE Transactions on Neural Networks.

[19]  António E. Ruano,et al.  Fast Line, Arc/Circle and Leg Detection from Laser Scan Data in a Player Driver , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[20]  J. Scholz,et al.  Reliable pedestrian protection using laserscanners , 2005, IEEE Proceedings. Intelligent Vehicles Symposium, 2005..

[21]  K.Ch. Fuerstenberg,et al.  Pedestrian protection using laserscanners , 2005 .

[22]  Ryosuke Shibasaki,et al.  A novel system for tracking pedestrians using multiple single-row laser-range scanners , 2005, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[23]  Pólo de Coimbra,et al.  Segmentation and Geometric Primitives Extraction from 2D Laser Range Data for Mobile Robot Applications , 2005 .

[24]  Alonzo Kelly,et al.  Toward Reliable Off Road Autonomous Vehicles Operating in Challenging Environments , 2006, Int. J. Robotics Res..

[25]  D. Aubert,et al.  Long Range Obstacle Detection Using Laser Scanner and Stereovision , 2006, 2006 IEEE Intelligent Vehicles Symposium.

[26]  Martial Hebert,et al.  Natural terrain classification using three‐dimensional ladar data for ground robot mobility , 2006, J. Field Robotics.

[27]  Frank Dellaert,et al.  MCMC Data Association and Sparse Factorization Updating for Real Time Multitarget Tracking with Merged and Multiple Measurements , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  Zehang Sun,et al.  On-road vehicle detection: a review , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[29]  Robert A. MacLachlan,et al.  Tracking of Moving Objects from a Moving Vehicle Using a Scanning Laser Rangefinder , 2006, 2006 IEEE Intelligent Transportation Systems Conference.

[30]  M. Hebert,et al.  Predictive Mover Detection and Tracking in Cluttered Environments , 2006 .

[31]  Ryosuke Shibasaki,et al.  Joint Tracking and Classification of Moving Objects at Intersection Using a Single-Row Laser Range Scanner , 2006, 2006 IEEE Intelligent Transportation Systems Conference.

[32]  P. Peixoto,et al.  Tracking and Classification of Dynamic Obstacles Using Laser Range Finder and Vision , 2006 .

[33]  M. Mahlisch,et al.  Sensorfusion Using Spatio-Temporal Aligned Video and Lidar for Improved Vehicle Detection , 2006, 2006 IEEE Intelligent Vehicles Symposium.

[34]  Ryosuke Shibasaki,et al.  Monitoring a populated environment using single-row laser range scanners from a mobile platform , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[35]  Ryosuke Shibasaki,et al.  Laser-based detection and tracking of multiple people in crowds , 2007, Comput. Vis. Image Underst..

[36]  Nico Kämpchen,et al.  Feature-level fusion of laser scanner and video data for advanced driver assistance systems , 2007 .

[37]  Tarak Gandhi,et al.  Pedestrian Protection Systems: Issues, Survey, and Challenges , 2007, IEEE Transactions on Intelligent Transportation Systems.

[38]  Wolfram Burgard,et al.  Using Boosted Features for the Detection of People in 2D Range Data , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[39]  Roland Siegwart,et al.  A comparison of line extraction algorithms using 2D range data for indoor mobile robotics , 2007, Auton. Robots.

[40]  V. Cherfaoui,et al.  Tracking objects using a laser scanner in driving situation based on modeling target shape , 2007, 2007 IEEE Intelligent Vehicles Symposium.

[41]  Hiroshi Ishiguro,et al.  Laser tracking of human body motion using adaptive shape modeling , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[42]  Shao-Wen Yang,et al.  Interacting Object Tracking in Crowded Urban Areas , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[43]  D. Burschka,et al.  Motion segmentation and scene classification from 3D LIDAR data , 2008, 2008 IEEE Intelligent Vehicles Symposium.

[44]  William Whittaker,et al.  Autonomous driving in urban environments: Boss and the Urban Challenge , 2008 .

[45]  Dirk Wollherr,et al.  A clustering method for efficient segmentation of 3D laser data , 2008, 2008 IEEE International Conference on Robotics and Automation.

[46]  Christoph Mertz,et al.  LADAR-based Pedestrian Detection and Tracking , 2008 .

[47]  Paul E. Rybski,et al.  An Adaptive Model Switching Approach for a Multisensor Tracking System used for Autonomous Driving in an Urban Environment , 2008 .

[48]  Wolfram Burgard,et al.  Efficient people tracking in laser range data using a multi-hypothesis leg-tracker with adaptive occlusion probabilities , 2008, 2008 IEEE International Conference on Robotics and Automation.

[49]  Ryosuke Shibasaki,et al.  Multi-modal tracking of people using laser scanners and video camera , 2008, Image Vis. Comput..

[50]  Multi-sensor Detection and Tracking of Humans for Safe Operations with Unmanned Ground Vehicles , 2008 .

[51]  G. Gate,et al.  Using targets appearance to improve pedestrian classification with a laser scanner , 2008, 2008 IEEE Intelligent Vehicles Symposium.

[52]  Xuan Song,et al.  Tracking interacting targets with laser scanner via on-line supervised learning , 2008, 2008 IEEE International Conference on Robotics and Automation.

[53]  Fawzi Nashashibi,et al.  Fast algorithm for pedestrian and group of pedestrians detection using a laser scanner , 2009, 2009 IEEE Intelligent Vehicles Symposium.

[54]  Sanjiv Singh,et al.  The DARPA Urban Challenge: Autonomous Vehicles in City Traffic, George Air Force Base, Victorville, California, USA , 2009, The DARPA Urban Challenge.

[55]  Siddhartha S. Srinivasa,et al.  Planning-based prediction for pedestrians , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[56]  Thierry Chateau,et al.  A method based on multilayer laserscanner to detect and track pedestrians in urban environment , 2009, 2009 IEEE Intelligent Vehicles Symposium.

[57]  Dariu Gavrila,et al.  Monocular Pedestrian Detection: Survey and Experiments , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[58]  Luc Van Gool,et al.  You'll never walk alone: Modeling social behavior for multi-target tracking , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[59]  Paul E. Rybski,et al.  Obstacle Detection and Tracking for the Urban Challenge , 2009, IEEE Transactions on Intelligent Transportation Systems.

[60]  William Whittaker,et al.  Autonomous driving in urban environments: Boss and the Urban Challenge , 2008, J. Field Robotics.

[61]  Christoph Mertz,et al.  Pedestrian Detection and Tracking Using Three-dimensional LADAR Data , 2010, Int. J. Robotics Res..

[62]  Roland Siegwart,et al.  A Layered Approach to People Detection in 3D Range Data , 2010, AAAI.

[63]  Luke Fletcher,et al.  A High-rate, Heterogeneous Data Set From The DARPA Urban Challenge , 2010, Int. J. Robotics Res..

[64]  Kai Oliver Arras,et al.  People tracking with human motion predictions from social forces , 2010, 2010 IEEE International Conference on Robotics and Automation.

[65]  Thierry Peynot,et al.  The Marulan Data Sets: Multi-sensor Perception in a Natural Environment with Challenging Conditions , 2010, Int. J. Robotics Res..

[66]  Ryan M. Eustice,et al.  Ford Campus vision and lidar data set , 2011, Int. J. Robotics Res..

[67]  Charles E. Thorpe,et al.  The annotated laser data set for navigation in urban areas , 2011, Int. J. Robotics Res..