Multitarget Multisensor Motion Tracking of Vehicles with Vehicle Based Multilayer 2D Laser Range Finders

For tracking, autonomous vehicles often use 3D laser range finders (LRFs), which are expensive. In order to make autonomous cars affordable as a mass product, we use multiple, more affordable 2D LRFs for tracking and implement an algorithm with the goal of achieving a similar performance. Our tracking algorithm comprises the following steps: Data preprocessing, segmentation, classification, feature extraction, data association, and track management. To compensate the information reduction, we re-use track information and focus on reducing over-segmentation and effects of the shape change problem. We test the algorithm on own labeled data and training data sets of “The KITTI Vision Benchmark Suite” with the CLEARMOT and MT/PT/ML metrics. In addition, we test specific properties with specific scenarios. Our algorithm obtains a MOT accuracy, which reflects the amount of correctly detected objects, of 0.79 on our own and negative values on the KITTI data sets. Obtained MOT precision, which is an averaged detection precision, is around 60 percent on all data sets. Out of all tracks, 47.83 percent are mostly tracked on our own data and zero percent on KITTI data sets. Our algorithm for tracking multiple objects with multiple moving 2D LRFs does not reach 3D performance. Improvements of feature extraction and especially classification to distinguish between vehicle and non-vehicle objects would boost its performance.

[1]  Klaus Dietmayer,et al.  Lane detection and street type classification using laser range images , 2001, ITSC 2001. 2001 IEEE Intelligent Transportation Systems. Proceedings (Cat. No.01TH8585).

[2]  Geovany de Araújo Borges,et al.  A split-and-merge segmentation algorithm for line extraction in 2D range images , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[3]  Silvio Savarese,et al.  A Probabilistic Framework for Real-time 3D Segmentation using Spatial, Temporal, and Semantic Cues , 2016, Robotics: Science and Systems.

[4]  Paulo Peixoto,et al.  A Lidar and Vision-based Approach for Pedestrian and Vehicle Detection and Tracking , 2007, 2007 IEEE Intelligent Transportation Systems Conference.

[5]  Evan Ackerman,et al.  Lidar that will make self-driving cars affordable [News] , 2016 .

[6]  Martial Hebert,et al.  Moving object detection with laser scanners , 2013, J. Field Robotics.

[7]  Rui Xu,et al.  Survey of clustering algorithms , 2005, IEEE Transactions on Neural Networks.

[8]  Martin David Adams,et al.  On-line gradient based surface discontinuity detection for outdoor scanning range sensors , 2001, Proceedings 2001 IEEE/RSJ International Conference on Intelligent Robots and Systems. Expanding the Societal Role of Robotics in the the Next Millennium (Cat. No.01CH37180).

[9]  Pólo de Coimbra,et al.  Segmentation and Geometric Primitives Extraction from 2D Laser Range Data for Mobile Robot Applications , 2005 .

[10]  Hans-Peter Kriegel,et al.  A Density-Based Algorithm for Discovering Clusters in Large Spatial Databases with Noise , 1996, KDD.

[11]  R. J. Adcock A Problem in Least Squares , 1878 .

[12]  Erwin Prassler,et al.  Tracking Multiple Moving Objects for Real-Time Robot Navigation , 2000, Auton. Robots.

[13]  Ragunathan Rajkumar,et al.  Towards a viable autonomous driving research platform , 2013, 2013 IEEE Intelligent Vehicles Symposium (IV).

[14]  F. Nashashibi,et al.  Laser-based vehicles tracking and classification using occlusion reasoning and confidence estimation , 2008, 2008 IEEE Intelligent Vehicles Symposium.

[15]  L.C. Bento,et al.  Multi-target detection and tracking with a laser scanner , 2004, IEEE Intelligent Vehicles Symposium, 2004.

[16]  Ram Nevatia,et al.  Learning to associate: HybridBoosted multi-target tracker for crowded scene , 2009, CVPR.

[17]  Rainer Stiefelhagen,et al.  Evaluating Multiple Object Tracking Performance: The CLEAR MOT Metrics , 2008, EURASIP J. Image Video Process..

[18]  Stergios I. Roumeliotis,et al.  SEGMENTS: a layered, dual-Kalman filter algorithm for indoor feature extraction , 2000, Proceedings. 2000 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2000) (Cat. No.00CH37113).

[19]  Geovany de Araújo Borges,et al.  Line Extraction in 2D Range Images for Mobile Robotics , 2004, J. Intell. Robotic Syst..

[20]  Bin Gao,et al.  A Vehicle Detection and Tracking Approach Using Probe Vehicle LIDAR Data , 2007 .

[21]  Jurgen Vandorpe,et al.  Exact dynamic map building for a mobile robot using geometrical primitives produced by a 2D range finder , 1996, Proceedings of IEEE International Conference on Robotics and Automation.

[22]  W. Sardha Wijesoma,et al.  Road-boundary detection and tracking using ladar sensing , 2004, IEEE Transactions on Robotics and Automation.

[23]  Robert A. MacLachlan,et al.  Tracking of Moving Objects from a Moving Vehicle Using a Scanning Laser Rangefinder , 2006, 2006 IEEE Intelligent Transportation Systems Conference.

[24]  T. Başar,et al.  A New Approach to Linear Filtering and Prediction Problems , 2001 .

[25]  Anil K. Jain,et al.  Data clustering: a review , 1999, CSUR.

[26]  Paul E. Rybski,et al.  Obstacle Detection and Tracking for the Urban Challenge , 2009, IEEE Transactions on Intelligent Transportation Systems.

[27]  David G. Kirkpatrick,et al.  On the shape of a set of points in the plane , 1983, IEEE Trans. Inf. Theory.

[28]  Chieh-Chih Wang,et al.  LADAR-based detection and tracking of moving objects from a ground vehicle at high speeds , 2003, IEEE IV2003 Intelligent Vehicles Symposium. Proceedings (Cat. No.03TH8683).

[29]  Andreas Geiger,et al.  Are we ready for autonomous driving? The KITTI vision benchmark suite , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[30]  Konrad Schindler,et al.  Challenges of Ground Truth Evaluation of Multi-target Tracking , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[31]  Sebastian Thrun,et al.  Precision tracking with sparse 3D and dense color 2D data , 2013, 2013 IEEE International Conference on Robotics and Automation.

[32]  Dirk Wollherr,et al.  A clustering method for efficient segmentation of 3D laser data , 2008, 2008 IEEE International Conference on Robotics and Automation.

[33]  Urs Ramer,et al.  An iterative procedure for the polygonal approximation of plane curves , 1972, Comput. Graph. Image Process..

[34]  Wayne A. Fuller,et al.  Measurement Error Models , 1988 .