3D Lidar-based static and moving obstacle detection in driving environments: An approach based on voxels and multi-region ground planes

Artificial perception, in the context of autonomous driving, is the process by which an intelligent system translates sensory data into an effective model of the environment surrounding a vehicle. In this paper, and considering data from a 3D-LIDAR mounted onboard an intelligent vehicle, a 3D perception system based on voxels and planes is proposed for ground modeling and obstacle detection in urban environments. The system, which incorporates time-dependent data, is composed of two main modules: (i) an effective ground surface estimation using a piecewise plane fitting algorithm and RANSAC-method, and (ii) a voxel-grid model for static and moving obstacles detection using discriminative analysis and ego-motion information. This perception system has direct application in safety systems for intelligent vehicles, particularly in collision avoidance and vulnerable road users detection, namely pedestrians and cyclists. Experiments, using point-cloud data from a Velodyne LIDAR and localization data from an Inertial Navigation System were conducted for both a quantitative and a qualitative assessment of the static/moving obstacle detection module and for the surface estimation approach. Reported results, from experiments using the KITTI database, demonstrate the applicability and efficiency of the proposed approach in urban scenarios. A complete framework for ground surface estimation and static/moving obstacle detection in driving environments is proposed.A piecewise surface fitting algorithm, based on a 'multi-region' strategy and Velodyne LIDAR scans behavior is proposed to estimate a finite set of multiple surfaces that fit the road and its vicinity.A 3D voxel-based representation, using discriminative analysis is proposed for obstacle modeling. The proposed approach detects moving obstacles by integrating and processing information from previous measurements.A set of diversified experiments, and corresponding result analysis, aimed at evaluating the performance of the proposed approach were performed.

[1]  Olivier Aycard,et al.  Layer-based supervised classification of moving objects in outdoor dynamic environment using 3D laser scanner , 2014, 2014 IEEE Intelligent Vehicles Symposium Proceedings.

[2]  A. Nuchter,et al.  6D SLAM with approximate data association , 2005, ICAR '05. Proceedings., 12th International Conference on Advanced Robotics, 2005..

[3]  Paulo Peixoto,et al.  Detection and Tracking of Moving Objects Using 2.5D Motion Grids , 2015, 2015 IEEE 18th International Conference on Intelligent Transportation Systems.

[4]  Wolfram Burgard,et al.  Multi-Level Surface Maps for Outdoor Terrain Mapping and Loop Closing , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[5]  Sergiu Nedevschi,et al.  Stereovision-Based Multiple Object Tracking in Traffic Scenarios Using Free-Form Obstacle Delimiters and Particle Filters , 2015, IEEE Transactions on Intelligent Transportation Systems.

[6]  Wolfram Burgard,et al.  An Efficient Extension to Elevation Maps for Outdoor Terrain Mapping and Loop Closing , 2007, Int. J. Robotics Res..

[7]  Wolfram Burgard,et al.  OctoMap: an efficient probabilistic 3D mapping framework based on octrees , 2013, Autonomous Robots.

[8]  Julius Ziegler,et al.  Making Bertha Drive—An Autonomous Journey on a Historic Route , 2014, IEEE Intelligent Transportation Systems Magazine.

[9]  Fadi Dornaika,et al.  Road Approximation in Euclidean and v -Disparity Space: A Comparative Study , 2007, EUROCAST.

[10]  Luke Fletcher,et al.  A perception‐driven autonomous urban vehicle , 2008, J. Field Robotics.

[11]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[12]  Paul J. Besl,et al.  Method for registration of 3-D shapes , 1992, Other Conferences.

[13]  Hans P. Moravec,et al.  High resolution maps from wide angle sonar , 1985, Proceedings. 1985 IEEE International Conference on Robotics and Automation.

[14]  Jean-Philippe Tarel,et al.  Real time obstacle detection in stereovision on non flat road geometry through "v-disparity" representation , 2002, Intelligent Vehicle Symposium, 2002. IEEE.

[15]  Mathias Perrollaz,et al.  54 Awareness of Road Scene Participants for Autonomous Driving , 2012 .

[16]  Paulo Peixoto,et al.  Two-Stage Static/Dynamic Environment Modeling Using Voxel Representation , 2015, ROBOT.

[17]  William Whittaker,et al.  Autonomous driving in urban environments: Boss and the Urban Challenge , 2008, J. Field Robotics.

[18]  Uwe Franke,et al.  6D-Vision: Fusion of Stereo and Motion for Robust Environment Perception , 2005, DAGM-Symposium.

[19]  A. Bensrhair,et al.  Sensors for Obstacle Detection - A Survey , 2007, 2007 30th International Spring Seminar on Electronics Technology (ISSE).

[20]  Luke Fletcher,et al.  A perception-driven autonomous urban vehicle , 2008 .

[21]  Jizhong Xiao,et al.  Multi-volume occupancy grids: An efficient probabilistic 3D mapping model for micro aerial vehicles , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[22]  Wolfram Burgard,et al.  A comparison of methods for line extraction from range data , 2004 .

[23]  Allen R. Hanson,et al.  Obstacle Detection Based on Qualitative and Quantitative 3D Reconstruction , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[24]  Robin R. Murphy,et al.  Introduction to AI Robotics , 2000 .

[25]  Andreas Geiger,et al.  Vision meets robotics: The KITTI dataset , 2013, Int. J. Robotics Res..

[26]  Dirk Hähnel,et al.  Mapping with mobile robots , 2005 .

[28]  Ramesh C. Jain,et al.  Building an environment model using depth information , 1989, Computer.

[29]  Huosheng Hu,et al.  3D mapping with multi-resolution occupied voxel lists , 2010, Auton. Robots.

[30]  Luc Van Gool,et al.  Object Detection and Tracking for Autonomous Navigation in Dynamic Environments , 2010, Int. J. Robotics Res..

[31]  Sergiu Nedevschi,et al.  Processing Dense Stereo Data Using Elevation Maps: Road Surface, Traffic Isle, and Obstacle Detection , 2010, IEEE Transactions on Vehicular Technology.

[32]  Massimo Bertozzi,et al.  Real-time obstacle detection using stereo vision for autonomous ground vehicles: A survey , 2014, 17th International IEEE Conference on Intelligent Transportation Systems (ITSC).

[33]  Alberto Broggi,et al.  A full-3D voxel-based dynamic obstacle detection for urban scenario using stereo vision , 2013, 16th International IEEE Conference on Intelligent Transportation Systems (ITSC 2013).

[34]  Takeo Kanade,et al.  Terrain mapping for a roving planetary explorer , 1989, Proceedings, 1989 International Conference on Robotics and Automation.

[35]  Uwe Franke,et al.  The Stixel World - A Compact Medium Level Representation of the 3D-World , 2009, DAGM-Symposium.

[36]  Amaury Nègre,et al.  Probabilistic Analysis of Dynamic Scenes and Collision Risks Assessment to Improve Driving Safety , 2011, IEEE Intelligent Transportation Systems Magazine.

[37]  Cristiano Premebida,et al.  Simultaneous Segmentation and Superquadrics Fitting in Laser-Range Data , 2015, IEEE Transactions on Vehicular Technology.

[38]  Uwe Franke,et al.  Efficient representation of traffic scenes by means of dynamic stixels , 2010, 2010 IEEE Intelligent Vehicles Symposium.

[39]  Surya P. N. Singh,et al.  Hybrid elevation maps: 3D surface models for segmentation , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[40]  Mohan M. Trivedi,et al.  Looking at Vehicles on the Road: A Survey of Vision-Based Vehicle Detection, Tracking, and Behavior Analysis , 2013, IEEE Transactions on Intelligent Transportation Systems.

[41]  Donald Meagher,et al.  Geometric modeling using octree encoding , 1982, Computer Graphics and Image Processing.

[42]  Paulo Dias,et al.  Scene Representations for Autonomous Driving: An Approach Based on Polygonal Primitives , 2015, ROBOT.

[43]  Sebastian Thrun,et al.  Junior: The Stanford entry in the Urban Challenge , 2008, J. Field Robotics.