A real-time global stereo-matching on FPGA

An improved global stereo matching algorithm is implemented on a single FPGA for real-time applications. Stereo matching is widely used in stereo vision systems, i.e. objects detection and autonomous vehicles. Global algorithms have much more accurate results than local algorithms, but global algorithms are not implemented on FPGA since they rely over high-end hardware resources. In this implementation the stereo pairs are divided into blocks, the hardware resources are reduced by processing one block once. The hardware implementation is based on a Xilinx Kintex 7 FPGA. Experiment results show that the proposed implementation has an accurate result for the Middlebury benchmarks and 30 frames per second (fps) @1920×1680 is achieved.

[1]  Qingxiong Yang,et al.  Stereo Matching Using Tree Filtering , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Peter Pirsch,et al.  Real-time stereo vision system using semi-global matching disparity estimation: Architecture and FPGA-implementation , 2010, 2010 International Conference on Embedded Computer Systems: Architectures, Modeling and Simulation.

[3]  Abiel Aguilar-González,et al.  An FPGA Stereo Matching Processor Based on the Sum of Hamming Distances , 2016, ARC.

[4]  Ding Yuan,et al.  Cross-trees, edge and superpixel priors-based cost aggregation for stereo matching , 2015, Pattern Recognit..

[5]  Horst Bischof,et al.  Hierarchical Disparity Estimation with Programmable 3D Hardware , 2004 .

[6]  Jae Wook Jeon,et al.  FPGA Design and Implementation of a Real-Time Stereo Vision System , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[7]  Nadia Baha,et al.  FPGA implementation for stereo matching algorithm , 2013, 2013 Science and Information Conference.

[8]  Antonios Gasteratos,et al.  Review of Stereo Vision Algorithms: From Software to Hardware , 2008 .

[9]  Roy P. Paily,et al.  Design and Implementation of Blind Assistance System Using Real Time Stereo Vision Algorithms , 2016, 2016 29th International Conference on VLSI Design and 2016 15th International Conference on Embedded Systems (VLSID).

[10]  In-So Kweon,et al.  Adaptive Support-Weight Approach for Correspondence Search , 2006, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  John Iselin Woodfill,et al.  Tyzx DeepSea High Speed Stereo Vision System , 2004, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[12]  Stefano Mattoccia,et al.  A passive RGBD sensor for accurate and real-time depth sensing self-contained into an FPGA , 2015, ICDSC.

[13]  Dongxiao Li,et al.  Fast stereo matching using adaptive guided filtering , 2014, Image Vis. Comput..

[14]  Liming Chen,et al.  A Fast Trilateral Filter-Based Adaptive Support Weight Method for Stereo Matching , 2015, IEEE Transactions on Circuits and Systems for Video Technology.

[15]  Darius Burschka,et al.  Advances in Computational Stereo , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  Luciano Lavagno,et al.  Analysis and Implementation of the Semi-Global Matching 3D Vision Algorithm Using Code Transformations and High-Level Synthesis , 2015, 2015 IEEE 81st Vehicular Technology Conference (VTC Spring).

[17]  Benno Stabernack,et al.  Hardware implementation of a full HD real-time disparity estimation algorithm , 2014, IEEE Transactions on Consumer Electronics.

[18]  Richard Szeliski,et al.  A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms , 2001, International Journal of Computer Vision.

[19]  Theocharis Theocharides,et al.  High-quality real-time hardware stereo matching based on guided image filtering , 2014, 2014 Design, Automation & Test in Europe Conference & Exhibition (DATE).

[20]  Horst Bischof,et al.  Hierarchical Disparity Estimation with Programmable Graphics Hardware , 2004, WSCG.

[21]  Madaín Pérez Patricio,et al.  An FPGA stereo matching unit based on fuzzy logic , 2016, Microprocess. Microsystems.

[22]  Markus Vincze,et al.  A fast stereo matching algorithm suitable for embedded real-time systems , 2010, Comput. Vis. Image Underst..

[23]  Diederik Verkest,et al.  Real-time high-definition stereo matching on FPGA , 2011, FPGA '11.

[24]  Federico Tombari,et al.  Near real-time stereo based on effective cost aggregation , 2008, 2008 19th International Conference on Pattern Recognition.

[25]  Lanying Li,et al.  FPGA Implementation for Binocular Stereo Matching Algorithm Based on Sobel Operator , 2016 .

[26]  B. Cyganek.  An Introduction to 3D Computer Vision Techniques and Algorithms , 2009 .

[27]  Johannes Stallkamp,et al.  Real-time stereo vision: Optimizing Semi-Global Matching , 2013, 2013 IEEE Intelligent Vehicles Symposium (IV).

[28]  Rob A. Rutenbar,et al.  Video-Rate Stereo Matching Using Markov Random Field TRW-S Inference on a Hybrid CPU+FPGA Computing Platform , 2013, IEEE Transactions on Circuits and Systems for Video Technology.