Fast 3D Time of Flight Data Segmentation Using the U-V-Histogram Approach

For modern assistance systems, time of flight (tof) cameras play a key role in the perception of the environmental situation. Due to benefits of this sensor type, especially in combination with video sensors, it outperforms typical sensor systems, like stereo cameras. However, tof depth image segmentation is yet not solved satisfactorily. Common approaches use homogeneous constraints and therefore assume objects to be parallel to the camera plane. This consequently leads to segmentation errors. This paper proposes a fast segmentation algorithm for detecting distinct planes using statistical knowledge. By projecting the depth image data along the image axis, u-v-histogram images can be constructed. It is shown, that in the histogram images, 3D planes correspond to line segments. A fast approach for line segment extraction in the histogram images is used to find the relevant planes. The algorithm was successfully tested with real data under varying conditions and can be applied for different tof camera sensors.

[1]  Andrew W. Fitzgibbon,et al.  An Experimental Comparison of Range Image Segmentation Algorithms , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Christoph Stiller,et al.  Segmentation of 3D lidar data in non-flat urban environments using a local convexity criterion , 2009, 2009 IEEE Intelligent Vehicles Symposium.

[3]  G. Wanielik,et al.  A precrash system based on sensor data fusion of laser scanner and short range radars , 2005, 2005 7th International Conference on Information Fusion.

[4]  Andreas Kolb,et al.  Real-time simulation of time-of-flight sensors , 2009, Simul. Model. Pract. Theory.

[5]  Ronald L. Graham,et al.  An Efficient Algorithm for Determining the Convex Hull of a Finite Planar Set , 1972, Inf. Process. Lett..

[6]  Jean-Philippe Tarel,et al.  Real time obstacle detection in stereovision on non flat road geometry through "v-disparity" representation , 2002, Intelligent Vehicle Symposium, 2002. IEEE.

[7]  Rüdiger Dillmann,et al.  Obstacle detection with a Photonic Mixing Device-camera in autonomous vehicles , 2008, Int. J. Intell. Syst. Technol. Appl..

[8]  Rüdiger Dillmann,et al.  Vision and ToF-based driving assistance for a personal transporter , 2009, 2009 International Conference on Advanced Robotics.

[9]  Q. M. Jonathan Wu,et al.  Real-Time Approach for Adaptive Object Segmentation in Time-of-Flight Sensors , 2008, 2008 20th IEEE International Conference on Tools with Artificial Intelligence.

[10]  G. Wanielik,et al.  Obstacle Detection and Pedestrian Recognition Using A 3D PMD Camera , 2006, 2006 IEEE Intelligent Vehicles Symposium.

[11]  Raymond K. K. Yip,et al.  Line Patterns Hough Transform for line segment detection , 1994, Proceedings of TENCON'94 - 1994 IEEE Region 10's 9th Annual International Conference on: 'Frontiers of Computer Technology'.

[12]  Keiichi Uchimura,et al.  A complete U-V-disparity study for stereovision based 3D driving environment analysis , 2005, Fifth International Conference on 3-D Digital Imaging and Modeling (3DIM'05).

[13]  Sebastian Thrun,et al.  Learning Occupancy Grid Maps with Forward Sensor Models , 2003, Auton. Robots.