An improved 2D cost aggregation method for advanced driver assistance systems

In advanced driver assistance systems, the stereo matching algorithm is the key resource to obtain depth information of outdoor scenes. Semi-Global Matching (SGM) is currently the most efficient stereo matching algorithm for outdoor environments. However, because the number of pixels is large, SGM uses only a subset of them when estimating the disparity of a pixel. To overcome this limitation, Cost Aggregation Table (CAT) was proposed which uses two-dimensional cost aggregation so as to utilize whole image information. In this paper, we propose improved global 2D cost aggregation methods by loosening aggregation constraints. It aggregates every cost in the whole image to estimate each disparity. Although our method aggregates every cost in the image, the computational complexity is the same as that of SGM and CAT. The proposed cost aggregation method achieves superior disparity accuracy compared to the SGM.

[1]  Martin Humenberger,et al.  A census-based stereo vision algorithm using modified Semi-Global Matching and plane fitting to improve matching quality , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops.

[2]  Sergiu Nedevschi,et al.  Real-time semi-global dense stereo solution with improved sub-pixel accuracy , 2010, 2010 IEEE Intelligent Vehicles Symposium.

[3]  Raúl Rojas,et al.  Weighted Semi-Global Matching and Center-Symmetric Census Transform for Robust Driver Assistance , 2013, CAIP.

[4]  Dariu Gavrila,et al.  Real-time dense stereo for intelligent vehicles , 2006, IEEE Transactions on Intelligent Transportation Systems.

[5]  Stefan K. Gehrig,et al.  A Real-Time Low-Power Stereo Vision Engine Using Semi-Global Matching , 2009, ICVS.

[6]  Ramin Zabih,et al.  Non-parametric Local Transforms for Computing Visual Correspondence , 1994, ECCV.

[7]  H. Hirschmüller.  Accurate and Efficient Stereo Processing by Semi-Global Matching and Mutual Information , 2005, CVPR.

[8]  Uwe Franke,et al.  Performance Evaluation of Stereo Algorithms for Automotive Applications , 2009, ICVS.

[9]  JeongMok Ha,et al.  Cost Aggregation Table: Cost Aggregation Method Using Summed Area Table Scheme for Dense Stereo Correspondence , 2014, ISVC.

[10]  Peter Pirsch,et al.  Real-time semi-global matching disparity estimation on the GPU , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).

[11]  Ines Ernst,et al.  Mutual Information Based Semi-Global Stereo Matching on the GPU , 2008, ISVC.

[12]  Andreas Geiger,et al.  Are we ready for autonomous driving? The KITTI vision benchmark suite , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[13]  Reinhard Klette,et al.  Illumination Invariant Cost Functions in Semi-Global Matching , 2010, ACCV Workshops.

[14]  Reinhard Klette,et al.  Performance of Correspondence Algorithms in Vision-Based Driver Assistance Using an Online Image Sequence Database , 2011, IEEE Transactions on Vehicular Technology.

[15]  Reinhard Klette,et al.  Iterative Semi-Global Matching for Robust Driver Assistance Systems , 2012, ACCV.

[16]  F. Bethmann,et al.  Object-based Multi-Image Semi-Global Matching - Concept and first results , 2014 .

[17]  Heiko Hirschmüller,et al.  Stereo Vision in Structured Environments by Consistent Semi-Global Matching , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[18]  Sergiu Nedevschi,et al.  SORT-SGM: Subpixel Optimized Real-Time Semiglobal Matching for Intelligent Vehicles , 2012, IEEE Transactions on Vehicular Technology.

[19]  Peter Pirsch,et al.  Evaluation of Penalty Functions for Semi-Global Matching Cost Aggregation , 2012 .

[20]  Peter Pirsch,et al.  Real-time stereo vision system using semi-global matching disparity estimation: Architecture and FPGA-implementation , 2010, 2010 International Conference on Embedded Computer Systems: Architectures, Modeling and Simulation.

[21]  D. Scharstein,et al.  A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms , 2001, Proceedings IEEE Workshop on Stereo and Multi-Baseline Vision (SMBV 2001).

[22]  Johannes Stallkamp,et al.  Real-time stereo vision: Optimizing Semi-Global Matching , 2013, 2013 IEEE Intelligent Vehicles Symposium (IV).

[23]  Reinhard Klette,et al.  Inclusion of a Second-Order Prior into Semi-Global Matching , 2009, PSIVT.

[24]  Néstor Morales,et al.  Performance analysis of stereo reconstruction algorithms , 2013, 16th International IEEE Conference on Intelligent Transportation Systems (ITSC 2013).

[25]  Raúl Rojas,et al.  Large scale Semi-Global Matching on the CPU , 2014, 2014 IEEE Intelligent Vehicles Symposium Proceedings.

[26]  Andreas Geiger,et al.  Vision meets robotics: The KITTI dataset , 2013, Int. J. Robotics Res..

[27]  Clemens Rabe,et al.  Real-time Semi-Global Matching on the CPU , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops.