A new geometric 3D LiDAR feature for model creation and classification of moving objects

In this paper, we introduce a new geometric 3D feature combined with a clustering approach. Besides 3D data provided by a LiDAR point cloud, reflectivity information is used to further enhance the descriptivity of the feature. The proposed feature can be extracted and compared in real-time. Similar parts of an object, such as features belonging to an automobile headlight, are automatically clustered in an object model without explicit specification. Additionally, we provide a method for autonomous vehicles to automatically learn the shapes of observed moving objects and use them for real-time classification. The resulting object models consisting of the extracted feature clusters are interpretable by humans.

[1]  Dirk Schulz,et al.  A Probabilistic Exemplar Approach to Combine Laser and Vision for Person Tracking , 2006, Robotics: Science and Systems.

[2]  Roland Siegwart,et al.  A Layered Approach to People Detection in 3D Range Data , 2010, AAAI.

[3]  Carlos González,et al.  LIDAR based perception solution for autonomous vehicles , 2011, 2011 11th International Conference on Intelligent Systems Design and Applications.

[4]  Ulrich Neumann,et al.  Training-Based Object Recognition in Cluttered 3D Point Clouds , 2013, 2013 International Conference on 3D Vision.

[5]  Nico Blodow,et al.  Fast Point Feature Histograms (FPFH) for 3D registration , 2009, 2009 IEEE International Conference on Robotics and Automation.

[6]  Florentin Wörgötter,et al.  Voxel Cloud Connectivity Segmentation - Supervoxels for Point Clouds , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Dieter Fox,et al.  Object Recognition in 3D Point Clouds Using Web Data and Domain Adaptation , 2010, Int. J. Robotics Res..

[8]  Stefan Roth,et al.  People-tracking-by-detection and people-detection-by-tracking , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[9]  M. Himmelsbach,et al.  Real-time object classification in 3D point clouds using point feature histograms , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[10]  Silvio Savarese,et al.  Combining 3D Shape, Color, and Motion for Robust Anytime Tracking , 2014, Robotics: Science and Systems.

[11]  Sebastian Thrun,et al.  Towards 3D object recognition via classification of arbitrary object tracks , 2011, 2011 IEEE International Conference on Robotics and Automation.

[12]  Wolfram Burgard,et al.  Point feature extraction on 3D range scans taking into account object boundaries , 2011, 2011 IEEE International Conference on Robotics and Automation.

[13]  Sebastian Thrun,et al.  Model based vehicle detection and tracking for autonomous urban driving , 2009, Auton. Robots.

[14]  Konrad Schindler,et al.  IMPLICIT SHAPE MODELS FOR OBJECT DETECTION IN 3D POINT CLOUDS , 2012, ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences.

[15]  Wolfram Burgard,et al.  Instace-Based AMN Classification for Improved Object Recognition in 2D and 3D Laser Range Data , 2007, IJCAI.

[16]  Michael Himmelsbach,et al.  Autonomous Offroad Navigation Under Poor GPS Conditions , 2009 .

[17]  Alex Brooks,et al.  A 3D laser and vision based classifier , 2009, 2009 International Conference on Intelligent Sensors, Sensor Networks and Information Processing (ISSNIP).

[18]  Michael Himmelsbach,et al.  Fast segmentation of 3D point clouds for ground vehicles , 2010, 2010 IEEE Intelligent Vehicles Symposium.

[19]  Hans-Joachim Wünsche,et al.  Autonomous convoy driving by night: The vehicle tracking system , 2015, 2015 IEEE International Conference on Technologies for Practical Robot Applications (TePRA).

[20]  Kresimir Kusevic,et al.  Object Class Recognition in Mobile Urban Lidar Data Using Global Shape Descriptors , 2013, 2013 International Conference on 3D Vision.

[21]  B. V. K. Vijaya Kumar,et al.  A multi-sensor fusion system for moving object detection and tracking in urban driving environments , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[22]  Andrew E. Johnson,et al.  Using Spin Images for Efficient Object Recognition in Cluttered 3D Scenes , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[23]  Fernando Puente León,et al.  NON-LINEAR MULTIMODAL OBJECT TRACKING BASED ON 2D LIDAR DATA , 2009 .

[24]  Martial Hebert,et al.  Parts-based 3D object classification , 2004, CVPR 2004.