A Matlab-Based Testbed for Integration, Evaluation and Comparison of Heterogeneous Stereo Vision Matching Algorithms

Stereo matching is a heavily researched area with a prolific published literature and a broad spectrum of heterogeneous algorithms available in diverse programming languages. This paper presents a Matlab-based testbed that aims to centralize and standardize this variety of both current and prospective stereo matching approaches. The proposed testbed aims to facilitate the application of stereo-based methods to real situations. It allows for configuring and executing algorithms, as well as comparing results, in a fast, easy and friendly setting. Algorithms can be combined so that a series of processes can be chained and executed consecutively, using the output of a process as input for the next; some additional filtering and image processing techniques have been included within the testbed for this purpose. A use case is included to illustrate how these processes are sequenced and its effect on the results for real applications. The testbed has been conceived as a collaborative and incremental open-source project, where its code is accessible and modifiable, with the objective of receiving contributions and releasing future versions to include new algorithms and features. It is currently available online for the research community.

[1]  Baris Baykant Alagöz.  Obtaining Depth Maps From Color Images By Region Based Stereo Matching Algorithms , 2008, ArXiv.

[2]  H. Hirschmüller.  Accurate and Efficient Stereo Processing by Semi-Global Matching and Mutual Information , 2005, CVPR.

[3]  O. Faugeras,et al.  Variational principles, surface evolution, PDE's, level set methods and the stereo problem , 1998, 5th IEEE EMBS International Summer School on Biomedical Imaging, 2002..

[4]  H. H. Baker.  Building and Using Scene Representation in Image Understanding , 1993 .

[5]  Olivier D. Faugeras,et al.  Variational principles, surface evolution, PDEs, level set methods, and the stereo problem , 1998, IEEE Trans. Image Process..

[6]  Radim Sára,et al.  Efficient Sampling of Disparity Space for Fast And Accurate Matching , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Georgios D. Evangelidis,et al.  An enhanced correlation-based method for stereo correspondence with subpixel accuracy , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[8]  Yiannis Aloimonos,et al.  Shape and the Stereo Correspondence Problem , 2005, International Journal of Computer Vision.

[9]  Wilhelm Burger,et al.  Digital Image Processing - An Algorithmic Introduction using Java , 2008, Texts in Computer Science.

[10]  W. James MacLean,et al.  Reconfigurable hardware implementation of a phase-correlation stereoalgorithm , 2006, Machine Vision and Applications.

[11]  Yiannis Aloimonos,et al.  A Roadmap to the Integration of Early Visual Modules , 2007, International Journal of Computer Vision.

[12]  Rafael C. González,et al.  Local Determination of a Moving Contrast Edge , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Gonzalo Pajares Martinsanz,et al.  Fuzzy cognitive maps for stereovision matching , 2006 .

[14]  W. Eric L. Grimson,et al.  Computational Experiments with a Feature Based Stereo Algorithm , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Yoshiaki Shirai,et al.  Three-Dimensional Computer Vision , 1987, Symbolic Computation.

[16]  Kurt Konolige,et al.  Small Vision Systems: Hardware and Implementation , 1998 .

[17]  Richard Szeliski,et al.  A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms , 2001, International Journal of Computer Vision.

[18]  Hans-Peter Seidel,et al.  Accurate Real-Time Disparity Estimation with Variational Methods , 2009, ISVC.

[19]  James U. Korein,et al.  Robotics , 2018, IBM Syst. J..

[20]  Federico Tombari,et al.  Evaluation of stereo algorithms for 3D object recognition , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).

[21]  Martin A. Fischler,et al.  Computational Stereo , 1982, CSUR.

[22]  Anita Tailor,et al.  Introductory digital image processing: a remote sensing perspective: Jensen, J R Prentice-Hall, Englewood Cliffs, NJ, USA (1986) £51.30 pp 392 , 1986 .

[23]  Laura Hoch,et al.  Introductory Digital Image Processing , 2016 .

[24]  Alex Zelinsky,et al.  Learning OpenCV---Computer Vision with the OpenCV Library (Bradski, G.R. et al.; 2008)[On the Shelf] , 2009, IEEE Robotics & Automation Magazine.

[25]  Tom Drummond,et al.  Algorithmic methodologies for FPGA-based vision , 2012, Machine Vision and Applications.

[26]  Raúl Correal,et al.  Mejora del Proceso de Correspondencia en Imágenes Estereoscópicas Mediante Filtrado Homomórfico y Agrupaciones de Disparidad , 2013 .

[27]  Nicholas Ayache,et al.  Efficient registration of stereo images by matching graph descriptions of edge segments , 1987, International Journal of Computer Vision.

[28]  T. Ozanian.  Approaches for Stereo Matching , 1995 .

[29]  Gonzalo Pajares Martinsanz,et al.  Visión por computador: imágenes digitales y aplicaciones , 2001 .

[30]  Harvey F. Silverman,et al.  A Class of Algorithms for Fast Digital Image Registration , 1972, IEEE Transactions on Computers.

[31]  Gonzalo Pajares,et al.  Relaxation labeling in stereo image matching , 2000, Pattern Recognit..

[32]  Gérard G. Medioni,et al.  3-D Surface Description from Binocular Stereo , 1992, IEEE Trans. Pattern Anal. Mach. Intell..