Obstacle detection in stereo sequences using multiple representations of the disparity map

Object detection represents an important task in various application fields, such as automotive or assistive technologies. In this context stereo cameras are among the most common devices used for acquiring images and information from the environment. Efficient processing of the disparity maps computed from stereo images represents a crucial step in obstacle detection algorithms. In this paper we provide an application-independent framework for obstacle detection based on disparity processing. In order to identify regions in the 3D environment that can be classified as obstacles we employ multiple representations of the disparity map: V-disparity, U-disparity, θ-disparity. We provide a comprehensive overview of those representations and their use in obstacle detection algorithms. We evaluate the proposed framework in the context of automotive and visually impaired assistive applications, using data from both real and virtual environments.

[1]  Walter Stechele,et al.  Stereo Vision based Vehicle Detection , 2010, VISAPP.

[2]  M. Faruque,et al.  ELECTRONIC TRAVEL AID FOR THE BLIND , 2001 .

[3]  P.V.C. Hough,et al.  Machine Analysis of Bubble Chamber Pictures , 1959 .

[4]  LIVIC-INRETS Lcpc IN-VEHICLE OBSTACLES DETECTION AND CHARACTERIZATION BY STEREOVISION , 2003 .

[5]  Juan Manuel Saez Martinez,et al.  Stereo-based Aerial Obstacle Detection for the Visually Impaired , 2008 .

[6]  Liang-Chia Chen,et al.  Object segmentation method using depth slicing and region growing algorithms , 2010 .

[7]  R. A. Hamzah,et al.  Sum of Absolute Differences algorithm in stereo correspondence problem for stereo matching in computer vision application , 2010, 2010 3rd International Conference on Computer Science and Information Technology.

[8]  Heiko Hirschmüller,et al.  Stereo Processing by Semiglobal Matching and Mutual Information , 2008, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Soon Kwon,et al.  Stereo vision-based obstacle detection using dense disparity map , 2011, International Conference on Graphic and Image Processing.

[10]  Jean-Philippe Tarel,et al.  Real time obstacle detection in stereovision on non flat road geometry through "v-disparity" representation , 2002, Intelligent Vehicle Symposium, 2002. IEEE.

[11]  Andreas Geiger,et al.  Efficient Large-Scale Stereo Matching , 2010, ACCV.

[12]  Danica Kragic,et al.  Theta-Disparity: An Efficient Representation of the 3D Scene Structure , 2014, IAS.

[13]  Luis Miguel Bergasa,et al.  Assisting the Visually Impaired: Obstacle Detection and Warning System by Acoustic Feedback , 2012, Sensors.

[14]  Stefano Mattoccia,et al.  3D Glasses as Mobility Aid for Visually Impaired People , 2014, ECCV Workshops.

[15]  Jong-Hun Lee,et al.  Stereo vision-based vehicle detection using a road feature and disparity histogram , 2011 .

[16]  Andreas Geiger,et al.  Are we ready for autonomous driving? The KITTI vision benchmark suite , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[17]  Julius Ziegler,et al.  StereoScan: Dense 3d reconstruction in real-time , 2011, 2011 IEEE Intelligent Vehicles Symposium (IV).

[18]  Keiichi Uchimura,et al.  A complete U-V-disparity study for stereovision based 3D driving environment analysis , 2005, Fifth International Conference on 3-D Digital Imaging and Modeling (3DIM'05).