Obstacle detection using U-disparity on quadratic road surfaces

This paper addresses the problem of detecting obstacles that protruding from the road. Traditionally, the road surface has been considered flat, and camera orientation is fixed. However, both assumptions are not strictly true in urban scenarios. The proposed algorithm employs a time-of-flight (ToF) camera. It allows dynamic pitch/roll angles, height variations and represents the ground as a quadratic surface. The range information given by the camera is represented in both Euclidean and disparity domains, so that their domain characteristics support each other to achieve accurate and efficient detection results. Gradient filtering of the disparity image presents Euclidean planner patches, with which outliers can be minimised during road fittings. Obstacle points are subsequently detected by the connect component labelling algorithm. Experimental results show that the proposed method can effectively segment and detect multiple obstacles and presents their bounding boxes in complex scenarios.

[1]  Fadi Dornaika,et al.  An Efficient Approach to Onboard Stereo Vision System Pose Estimation , 2008, IEEE Transactions on Intelligent Transportation Systems.

[2]  Dale Anthony Carnegie,et al.  Analysis of Errors in ToF Range Imaging With Dual-Frequency Modulation , 2011, IEEE Transactions on Instrumentation and Measurement.

[3]  Roberto Manduchi,et al.  Obstacle Detection and Terrain Classification for Autonomous Off-Road Navigation , 2005, Auton. Robots.

[4]  Robert Lange,et al.  3D time-of-flight distance measurement with custom solid-state image sensors in CMOS/CCD-technology , 2006 .

[5]  G. Golub,et al.  Quadratically constrained least squares and quadratic problems , 1991 .

[6]  Jean-Philippe Tarel,et al.  Real time obstacle detection in stereovision on non flat road geometry through "v-disparity" representation , 2002, Intelligent Vehicle Symposium, 2002. IEEE.

[7]  Zhengyou Zhang,et al.  A stereovision system for a planetary rover: calibration, correlation, registration, and fusion , 1997, Machine Vision and Applications.

[8]  Diego Viejo,et al.  Using GNG to improve 3D feature extraction - Application to 6DoF egomotion , 2012, Neural Networks.

[9]  Sergiu Nedevschi,et al.  Obstacle Detection Based on Dense Stereovision for Urban ACC Systems , 2008 .

[10]  Jun Zhao,et al.  Detection of non-flat ground surfaces using V-Disparity images , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[11]  Sergiu Nedevschi,et al.  Road Surface and Obstacle Detection Based on Elevation Maps from Dense Stereo , 2007, 2007 IEEE Intelligent Transportation Systems Conference.

[12]  John G. Rarity,et al.  U-V-Disparity based Obstacle Detection with 3D Camera and steerable filter , 2011, 2011 IEEE Intelligent Vehicles Symposium (IV).

[13]  Keiichi Uchimura,et al.  A complete U-V-disparity study for stereovision based 3D driving environment analysis , 2005, Fifth International Conference on 3-D Digital Imaging and Modeling (3DIM'05).

[14]  Karsten Berns,et al.  Perception of Environment Properties Relevant for Off-road Navigation , 2009, AMS.