A disparity map refinement to enhance weakly-textured urban environment data

This paper presents an approach to refine noisy and sparse disparity maps from weakly-textured urban environments, enhancing their applicability in perception algorithms applied to autonomous vehicles urban navigation. Typically, the disparity maps are constructed by stereo matching techniques based on some image correlation algorithm. However, in urban environments with low texture variance elements, like asphalt pavements and shadows, the images' pixels are hard to match, which result in sparse and noisy disparity maps. In this work, the disparity map refinement will be performed by segmenting the reference image of the stereo system with a combination of filters and the Watershed transform to fit the formed clusters in planes with a RANSAC approach. The refined disparity map was processed with the KITTI flow benchmark achieving improvements in the final average error and data density.

[1]  Oscar C. Au,et al.  Hybrid plane fitting for depth estimation , 2012, Proceedings of The 2012 Asia Pacific Signal and Information Processing Association Annual Summit and Conference.

[2]  Luc Vincent,et al.  Morphological grayscale reconstruction in image analysis: applications and efficient algorithms , 1993, IEEE Trans. Image Process..

[3]  H. Hirschmüller Accurate and Efficient Stereo Processing by Semi-Global Matching and Mutual Information , 2005, CVPR.

[4]  Chen Yi-Liang,et al.  TerraMax: Team Oshkosh Urban RobotThe DARPA Urban Challenge , 2009 .

[5]  Venkataraman Sundareswaran,et al.  TerraMax: Team Oshkosh Urban Robot , 2009, The DARPA Urban Challenge.

[6]  Janito Vaqueiro Ferreira,et al.  Advances on Watershed Processing on GPU Architecture , 2011, ISMM.

[7]  Thomas Schamm,et al.  3D-segmentation of traffic environments with u/v-disparity supported by radar-given masterpoints , 2010, 2010 IEEE Intelligent Vehicles Symposium.

[8]  Siu-Yeung Cho,et al.  A color-based approach for disparity refinement , 2010, 2010 11th International Conference on Control Automation Robotics & Vision.

[9]  Fadi Dornaika,et al.  A New Framework for Stereo Sensor Pose Through Road Segmentation and Registration , 2011, IEEE Transactions on Intelligent Transportation Systems.

[10]  John S. Zelek,et al.  Structure from Infrared Stereo Images , 2008, 2008 Canadian Conference on Computer and Robot Vision.

[11]  Sanjiv Singh,et al.  The DARPA Urban Challenge: Autonomous Vehicles in City Traffic, George Air Force Base, Victorville, California, USA , 2009, The DARPA Urban Challenge.

[12]  Danilo Alves de Lima,et al.  A 2D/3D Vision Based Approach Applied to Road Detection in Urban Environments , 2013, 2013 IEEE Intelligent Vehicles Symposium (IV).

[13]  Peter Pirsch,et al.  Real-time stereo vision system using semi-global matching disparity estimation: Architecture and FPGA-implementation , 2010, 2010 International Conference on Embedded Computer Systems: Architectures, Modeling and Simulation.

[14]  Vladimir Kolmogorov,et al.  Computing visual correspondence with occlusions using graph cuts , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[15]  Andreas Geiger,et al.  Are we ready for autonomous driving? The KITTI vision benchmark suite , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[16]  Ryan M. Eustice,et al.  A perspective on emerging automotive safety applications, derived from lessons learned through participation in the DARPA Grand Challenges , 2008, J. Field Robotics.

[17]  Takeo Kanade,et al.  Development of a video-rate stereo machine , 1995, Proceedings 1995 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human Robot Interaction and Cooperative Robots.

[18]  Jos B. T. M. Roerdink,et al.  The Watershed Transform: Definitions, Algorithms and Parallelization Strategies , 2000, Fundam. Informaticae.

[19]  Roberto de Alencar Lotufo,et al.  Relationships between some watershed definitions and their tie-zone transforms , 2010, Image Vis. Comput..

[20]  Michael H. F. Wilkinson,et al.  A Comparison of Algorithms for Connected Set Openings and Closings , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  N. Hautiere,et al.  Road Segmentation Supervised by an Extended V-Disparity Algorithm for Autonomous Navigation , 2007, 2007 IEEE Intelligent Vehicles Symposium.

[22]  Jean-Philippe Tarel,et al.  Real time obstacle detection in stereovision on non flat road geometry through "v-disparity" representation , 2002, Intelligent Vehicle Symposium, 2002. IEEE.