Distributed dense stereo matching for 3D reconstruction using parallel-based processing advantages

Instead of measuring photo-similarity, SymStereo is a stereo vision algorithm that uses new cost functions to measure symmetry differences between pairs of images. In this paper we propose the acceleration of a complete signal processing pipeline for generating 3D volumes based on dense SymStereo. The outputs here generated achieve superior reconstruction quality namely for slant based scenarios, so typical in autonomous systems, that have to capture pairs of images and perform moving decisions in real-time. In particular, we analyse several parallelization strategies for the compute-intensive aggregation procedure using different parameters and evaluate a trade-off between processing time, and higher precision of the calculated depths and quality of the final reconstructed 3D volume. The developed parallel pipeline allows to process more than 4.5 volumes per second for high resolution images using commodity GPUs, which conveniently suits its application in a variety of robotics systems.

[1]  Michel Antunes,et al.  Stereo estimation of depth along virtual cut planes , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).

[2]  Eric Psota,et al.  Real-Time Stereo Matching on CUDA Using an Iterative Refinement Method for Adaptive Support-Weight Correspondences , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[3]  Richard Szeliski,et al.  Sampling the disparity space image , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Urbano Nunes,et al.  Using the GPU for fast symmetry-based dense stereo matching in high resolution images , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[5]  Richard Szeliski,et al.  A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms , 2001, International Journal of Computer Vision.

[6]  Michel Antunes,et al.  SymStereo: Stereo Matching using Induced Symmetry , 2014, International Journal of Computer Vision.

[7]  Leonel Sousa,et al.  Portable LDPC Decoding on Multicores Using OpenCL [Applications Corner] , 2012, IEEE Signal Processing Magazine.

[8]  Federico Tombari,et al.  Classification and evaluation of cost aggregation methods for stereo correspondence , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[9]  Koichi Ito,et al.  GPU implementation of phase-based stereo correspondence and its application , 2012, 2012 19th IEEE International Conference on Image Processing.

[10]  Georg Umlauf,et al.  Accurate real-time multi-camera stereo-matching on the GPU for 3D reconstruction , 2011, WSCG 2011.

[11]  Andreas Geiger,et al.  Are we ready for autonomous driving? The KITTI vision benchmark suite , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.