Multimodal sparse LIDAR object tracking in clutter

one of the key components of the perception system in an autonomous vehicle or ADAS is the target tracking module. Using target tracking in the sea of clutter, self-driving cars are able to better understand the environment and make predictions about the surrounding objects. Cuboids obtained from a sparse LIDAR often exhibit a fluctuating behavior due to segmentation problems and errors accumulated from the motion correction module. Furthermore, targets in real life scenarios do not move in a predictable manner, so it is very difficult for a classical motion model to describe the complex behavior of any road objects in such cases. In this paper we propose a two-step data association scheme that efficiently and effectively finds correspondences between tracks and measurements. Then we aim to generate better position estimates for objects with an ambiguous dynamic behavior by associating and combining the results from two different motion models. The proposed solution runs in real time and it was validated using a high precision GPS, and also by projecting the prediction results in the corresponding intensity image and assessing whether the prediction falls on the correct item.

[1]  Subhash Challa,et al.  Gating techniques for maneuvering target tracking in clutter , 2002 .

[2]  Pólo de Coimbra Tracking and Data Association Using Data from a LRF , 2005 .

[3]  R. E. Kalman,et al.  A New Approach to Linear Filtering and Prediction Problems , 2002 .

[4]  T. Başar,et al.  A New Approach to Linear Filtering and Prediction Problems , 2001 .

[5]  Michael Himmelsbach,et al.  Fast segmentation of 3D point clouds for ground vehicles , 2010, 2010 IEEE Intelligent Vehicles Symposium.

[6]  Olivier Aycard,et al.  Layer-based supervised classification of moving objects in outdoor dynamic environment using 3D laser scanner , 2014, 2014 IEEE Intelligent Vehicles Symposium Proceedings.

[7]  William Whittaker,et al.  Autonomous driving in urban environments: Boss and the Urban Challenge , 2008, J. Field Robotics.

[8]  Ling Shao,et al.  Recent advances and trends in visual tracking: A review , 2011, Neurocomputing.

[9]  Yaakov Bar-Shalom,et al.  Tracking methods in a multitarget environment , 1978 .

[10]  Mathias Perrollaz,et al.  54 Awareness of Road Scene Participants for Autonomous Driving , 2012 .

[11]  Siavash Hosseinyalamdary,et al.  Tracking 3D Moving Objects Based on GPS/IMU Navigation Solution, Laser Scanner Point Cloud and GIS Data , 2015, ISPRS Int. J. Geo Inf..

[12]  Jeffrey K. Uhlmann,et al.  Unscented filtering and nonlinear estimation , 2004, Proceedings of the IEEE.

[13]  Christoph Stiller,et al.  Joint self-localization and tracking of generic objects in 3D range data , 2013, 2013 IEEE International Conference on Robotics and Automation.

[14]  Stefan Roth,et al.  MOTChallenge 2015: Towards a Benchmark for Multi-Target Tracking , 2015, ArXiv.

[15]  P. Peixoto,et al.  Detection and Tracking of Moving Objects Using 2 . 5 D Motion Grids , 2015 .

[16]  Y. Bar-Shalom,et al.  The probabilistic data association filter , 2009, IEEE Control Systems.

[17]  Stefan Roth,et al.  MOT16: A Benchmark for Multi-Object Tracking , 2016, ArXiv.

[18]  Marcus Baum,et al.  A nearest neighbour ensemble Kalman Filter for multi-object tracking , 2017, 2017 IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems (MFI).

[19]  M. L. Krieg,et al.  Multi-sensor, probabilistic multi-hypothesis tracking , 1996, Proceeding of 1st Australian Data Fusion Symposium.

[20]  S. Stankovic,et al.  Integrated probabilistic data association (IPDA) , 1992, [1992] Proceedings of the 31st IEEE Conference on Decision and Control.

[21]  Andreas Geiger,et al.  Are we ready for autonomous driving? The KITTI vision benchmark suite , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[22]  Bastian Leibe,et al.  Multi-scale object candidates for generic object tracking in street scenes , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[23]  S.S. Blackman,et al.  Multiple hypothesis tracking for multiple target tracking , 2004, IEEE Aerospace and Electronic Systems Magazine.

[24]  Keum-Shik Hong,et al.  An IMM Algorithm for Tracking Maneuvering Vehicles in an Adaptive Cruise Control Environment , 2004 .

[25]  Sebastian Thrun,et al.  Model based vehicle detection and tracking for autonomous urban driving , 2009, Auton. Robots.

[26]  Jian Cheng,et al.  Robust vehicle detection using 3D Lidar under complex urban environment , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[27]  Olivier Buffet,et al.  Tracking multiple interacting targets using a joint probabilistic Data Association filter , 2014, 17th International Conference on Information Fusion (FUSION).

[28]  Joel A. Hesch,et al.  Tracking People with a 360-Degree Lidar , 2010, 2010 7th IEEE International Conference on Advanced Video and Signal Based Surveillance.