Modified adaptive support weight and disparity search range estimation schemes for stereo matching processors

Recently, to obtain three-dimensional depth information from a set of stereo images, stereo matching processors are widely used in intelligent robots, autonomous vehicles, and the Internet of things environment, all of which require real-time processing capability with minimal hardware resources. In this paper, we propose a modified adaptive support weight scheme with rectangular ring-type window configurations that minimize hardware resources while maintaining matching accuracy. In addition, to reduce the computational overhead of window-based local stereo matching algorithms, we present a robust disparity search range estimation scheme based on stretched depth histograms. To evaluate the performance of the proposed schemes, we implemented them using C language and performed experiments. In addition, to show the feasibility of the hardware implementation of the proposed schemes, we also describe them using Verilog hardware description language and implemented them using a field-programmable gate array-based platform. Experimental results show that compared to conventional method, the proposed schemes reduced up to 57% of hardware resources and 33% of computational overhead, respectively.

[1]  James K. Archibald,et al.  Improved Census Transforms for Resource-Optimized Stereo Vision , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[2]  Sang Uk Lee,et al.  Robust Stereo Matching Using Adaptive Normalized Cross-Correlation , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Haibin Yu,et al.  Real-time stereo vision system using adaptive weight cost aggregation approach , 2011, EURASIP J. Image Video Process..

[4]  Miao Liao,et al.  High-Quality Real-Time Stereo Using Adaptive Cost Aggregation and Dynamic Programming , 2006, Third International Symposium on 3D Data Processing, Visualization, and Transmission (3DPVT'06).

[5]  Markus Vincze,et al.  A fast stereo matching algorithm suitable for embedded real-time systems , 2010, Comput. Vis. Image Underst..

[6]  Ramin Zabih,et al.  Non-parametric Local Transforms for Computing Visual Correspondence , 1994, ECCV.

[7]  Soo In Lee,et al.  Depth map-based disparity estimation technique using multiview and depth camera , 2006, Electronic Imaging.

[8]  Balqies Sadoun,et al.  The BAU GIS system using open source mapwindow , 2015, Human-centric Computing and Information Sciences.

[9]  Xiaoyan Hu,et al.  A Quantitative Evaluation of Confidence Measures for Stereo Vision , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Kwanghoon Sohn,et al.  Real-time depth range estimation and its application to mobile stereo camera , 2012, 2012 IEEE Consumer Communications and Networking Conference (CCNC).

[11]  Truong Q. Nguyen,et al.  Local stereo matching using motion cue and modified census in video disparity estimation , 2012, 2012 Proceedings of the 20th European Signal Processing Conference (EUSIPCO).

[12]  Kristian Ambrosch,et al.  An Optimized Software-Based Implementation of a Census-Based Stereo Matching Algorithm , 2008, ISVC.

[13]  Heiko Hirschmüller,et al.  Evaluation of Cost Functions for Stereo Matching , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[14]  Neil A. Dodgson,et al.  Real-Time Spatiotemporal Stereo Matching Using the Dual-Cross-Bilateral Grid , 2010, ECCV.

[15]  Heng-Suk Lee,et al.  GPU-based Stereo Matching Algorithm with the Strategy of Population-based Incremental Learning , 2009, J. Inf. Process. Syst..

[16]  Avinash C. Kak,et al.  Vision for Mobile Robot Navigation: A Survey , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Kyeong-ryeol Bae,et al.  A census-based stereo matching algorithm with multiple sparse windows , 2015, 2015 Seventh International Conference on Ubiquitous and Future Networks.

[18]  Antonios Gasteratos,et al.  Review of Stereo Vision Algorithms: From Software to Hardware , 2008 .

[19]  D. Scharstein,et al.  A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms , 2001, Proceedings IEEE Workshop on Stereo and Multi-Baseline Vision (SMBV 2001).

[20]  Andrew Howard,et al.  Real-time stereo visual odometry for autonomous ground vehicles , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[21]  Tao Yan,et al.  Study on multi-view video based on IOT and its application in intelligent security system , 2013, Proceedings 2013 International Conference on Mechatronic Sciences, Electric Engineering and Computer (MEC).

[22]  Erkan Bostanci,et al.  Augmented reality applications for cultural heritage using Kinect , 2015, Human-centric Computing and Information Sciences.

[23]  In-So Kweon,et al.  Adaptive Support-Weight Approach for Correspondence Search , 2006, IEEE Trans. Pattern Anal. Mach. Intell..

[24]  Dong-Hun Lee,et al.  Dynamic search range using sparse disparity map for fast stereo matching , 2012, IEEE international Symposium on Broadband Multimedia Systems and Broadcasting.

[25]  Federico Tombari,et al.  Classification and evaluation of cost aggregation methods for stereo correspondence , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[26]  Yo-Sung Ho Challenging Technical Issues of 3D Video Processing , 2013 .

[27]  Stefania Perri,et al.  Adaptive Census Transform: A novel hardware-oriented stereovision algorithm , 2013, Comput. Vis. Image Underst..

[28]  Sung Kyu Lim,et al.  Design and analysis of 3D IC-based low power stereo matching processors , 2013, International Symposium on Low Power Electronics and Design (ISLPED).

[29]  Peter Pirsch,et al.  Real-time stereo vision system using semi-global matching disparity estimation: Architecture and FPGA-implementation , 2010, 2010 International Conference on Embedded Computer Systems: Architectures, Modeling and Simulation.

[30]  Tian-Sheuan Chang,et al.  Algorithm and Architecture of Disparity Estimation With Mini-Census Adaptive Support Weight , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[31]  Hsing-yu Hou The Experimental Design of App Games to Bridge the Gap between Two Generations , 2013 .

[32]  Peter I. Corke,et al.  Quantitative Evaluation of Matching Methods and Validity Measures for Stereo Vision , 2001, Int. J. Robotics Res..

[33]  Nghia Tran,et al.  Advances in autonomy for small UGVs , 2005, SPIE Defense + Commercial Sensing.