An efficient hardware-oriented stereo matching algorithm

This paper presents a novel stereo matching algorithm that synergistically exploits in an original way the Adaptive Census Transform and the Support Local Binary Pattern approaches. For the first time, the Support Local Binary Pattern technique is applied to efficiently process large windows of pixels without excessive computational requirements, and thus allowing easy design of specific integrated circuits. Results obtained for conventional benchmark image sets demonstrate that, despite the simplifications adopted to make the novel algorithm hardware-friendly, the method proposed here can reach qualities higher than its competitors. Several hardware implementations have been carried out and characterized on the Xilinx Virtex FPGA chips. For 640480 stereo images and a disparity range equal to 60, the proposed architecture guarantees an average error in computing the map as low as 9% with a throughput rate up to 68 frames per second. The cheapest version of a system designed as reported in this paper occupies less than 49,000 slices, 112 DSPs and 32 BRAMs.

[1]  O. Faugeras Three-dimensional computer vision: a geometric viewpoint , 1993 .

[2]  Stefania Perri,et al.  Adaptive Census Transform: A novel hardware-oriented stereovision algorithm , 2013, Comput. Vis. Image Underst..

[3]  Rafael Cabeza,et al.  Stereo matching using gradient similarity and locally adaptive support-weight , 2011, Pattern Recognit. Lett..

[4]  Richard Szeliski,et al.  A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms , 2001, International Journal of Computer Vision.

[5]  Sergiu Nedevschi,et al.  Real-time semi-global dense stereo solution with improved sub-pixel accuracy , 2010, 2010 IEEE Intelligent Vehicles Symposium.

[6]  Markus Vincze,et al.  A fast stereo matching algorithm suitable for embedded real-time systems , 2010, Comput. Vis. Image Underst..

[7]  Antonios Gasteratos,et al.  Stereo vision for robotic applications in the presence of non-ideal lighting conditions , 2010, Image Vis. Comput..

[8]  Yusuf Leblebici,et al.  Dynamically adaptive real-time disparity estimation hardware using iterative refinement , 2014, Integr..

[9]  Stefania Perri,et al.  SAD-Based Stereo Matching Circuit for FPGAs , 2006, 2006 13th IEEE International Conference on Electronics, Circuits and Systems.

[10]  John Iselin Woodfill,et al.  Tyzx DeepSea High Speed Stereo Vision System , 2004, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[11]  Jae Wook Jeon,et al.  Domain Transformation-Based Efficient Cost Aggregation for Local Stereo Matching , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[12]  Jae Wook Jeon,et al.  Support Local Pattern and its Application to Disparity Improvement and Texture Classification , 2014, IEEE Transactions on Circuits and Systems for Video Technology.

[13]  Barry McCullagh Real-time disparity map computation using the cell broadband engine , 2010, Journal of Real-Time Image Processing.

[14]  Tian-Sheuan Chang,et al.  Algorithm and Architecture of Disparity Estimation With Mini-Census Adaptive Support Weight , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[15]  Jae Wook Jeon,et al.  FPGA Design and Implementation of a Real-Time Stereo Vision System , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[16]  Marc M. Van Hulle,et al.  A two-level real-time vision machine combining coarse- and fine-grained parallelism , 2010, Journal of Real-Time Image Processing.

[17]  Bugao Xu,et al.  A portable stereo vision system for whole body surface imaging , 2010, Image Vis. Comput..

[18]  Peter Pirsch,et al.  Real-time stereo vision system using semi-global matching disparity estimation: Architecture and FPGA-implementation , 2010, 2010 International Conference on Embedded Computer Systems: Architectures, Modeling and Simulation.

[19]  Antonios Gasteratos,et al.  Biologically and psychophysically inspired adaptive support weights algorithm for stereo correspondence , 2010, Robotics Auton. Syst..

[20]  Ramin Zabih,et al.  Non-parametric Local Transforms for Computing Visual Correspondence , 1994, ECCV.

[21]  Georgios Ch. Sirakoulis,et al.  Real-time disparity map computation module , 2008, Microprocess. Microsystems.

[22]  Pascal Fua,et al.  Combining Stereo and Monocular Information to Compute Dense Depth Maps that Preserve Depth Discontinuities , 1991, IJCAI.

[23]  In-So Kweon,et al.  Adaptive Support-Weight Approach for Correspondence Search , 2006, IEEE Trans. Pattern Anal. Mach. Intell..

[24]  John N. Lygouras,et al.  Design and hardware implementation of a stereo-matching system based on dynamic programming , 2011, Microprocess. Microsystems.

[25]  Miao Liao,et al.  High-Quality Real-Time Stereo Using Adaptive Cost Aggregation and Dynamic Programming , 2006, Third International Symposium on 3D Data Processing, Visualization, and Transmission (3DPVT'06).

[26]  Antonios Gasteratos,et al.  Review of Stereo Vision Algorithms: From Software to Hardware , 2008 .

[27]  Andy Motten,et al.  A binary adaptable window SoC architecture for a stereo vision based depth field processor , 2010, 2010 18th IEEE/IFIP International Conference on VLSI and System-on-Chip.

[28]  Rafael Muñoz-Salinas,et al.  People detection and tracking using stereo vision and color , 2007, Image Vis. Comput..

[29]  Franz Franchetti,et al.  High Performance Stereo Vision Designed for Massively Data Parallel Platforms , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[30]  Eric Psota,et al.  Real-Time Stereo Matching on CUDA Using an Iterative Refinement Method for Adaptive Support-Weight Correspondences , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[31]  Lei Chen,et al.  A Parallel Reconfigurable Architecture for Real-Time Stereo Vision , 2009, 2009 International Conference on Embedded Software and Systems.

[32]  Stefania Perri,et al.  Low-cost FPGA stereo vision system for real time disparity maps calculation , 2012, Microprocess. Microsystems.

[33]  Kristian Ambrosch,et al.  Accurate hardware-based stereo vision , 2010, Comput. Vis. Image Underst..