Local Stereo Matching Based on Support Weight With Motion Flow for Dynamic Scene

Stereo matching is one of the most important and challenging subjects in the field of stereo vision. The disparity obtained in stereo matching can represent depth information in 3-D world to a great extent and shows great importance in stereo field. In general, stereo-matching methods primarily emphasize static image. However, the information provided by dynamic scene can be used fully and effectively to improve the results of stereo matching for dynamic scene, such as video sequences. In this paper, we propose a dynamic scene-based local stereo-matching algorithm which integrates a cost filter with motion flow of dynamic video sequences. In contrast to the existing local approaches, our algorithm puts forward a new computing model which fully considers motion information in dynamic video sequences and adds motion flow to calculate suitable support weight for accurately estimating disparity. Our algorithm can perform as an edge-preserving smoothing operator and shows improved behavior near the moving edges. The experimental results show that the proposed method achieves a better depth map and outperforms other local stereo-matching methods in disparity evaluation.

[1]  Margrit Gelautz,et al.  Secrets of adaptive support weight techniques for local stereo matching , 2013, Comput. Vis. Image Underst..

[2]  Minh N. Do,et al.  Patch Match Filter: Efficient Edge-Aware Filtering Meets Randomized Search for Fast Correspondence Field Estimation , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[3]  Enzo Baccarelli,et al.  Energy-efficient dynamic traffic offloading and reconfiguration of networked data centers for big data stream mobile computing: review, challenges, and a case study , 2016, IEEE Network.

[4]  Il Hong Suh,et al.  Robust stereo matching using adaptive random walk with restart algorithm , 2015, Image Vis. Comput..

[5]  Michael J. Black,et al.  Secrets of optical flow estimation and their principles , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[6]  Syed Hassan Ahmed,et al.  FBR: Fleet based video retrieval in 3G and 4G enabled Vehicular Ad Hoc Networks , 2016, 2016 IEEE International Conference on Communications (ICC).

[7]  Ding Yuan,et al.  Stereo matching by using the global edge constraint , 2014, Neurocomputing.

[8]  Joost van de Weijer,et al.  Accurate Stereo Matching by Two-Step Energy Minimization , 2015, IEEE Transactions on Image Processing.

[9]  Xing Mei,et al.  On building an accurate stereo matching system on graphics hardware , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).

[10]  Truong Q. Nguyen,et al.  Local Disparity Estimation With Three-Moded Cross Census and Advanced Support Weight , 2013, IEEE Transactions on Multimedia.

[11]  Yue Gao,et al.  A Bayesian framework for dense depth estimation based on spatial-temporal correlation , 2013, Neurocomputing.

[12]  Kuk-Jin Yoon,et al.  Locally adaptive support-weight approach for visual correspondence search , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[13]  Richard Szeliski,et al.  A Database and Evaluation Methodology for Optical Flow , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[14]  Truong Q. Nguyen,et al.  Spatio-temporal consistency in video disparity estimation , 2011, 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[15]  Richard Szeliski,et al.  A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms , 2001, International Journal of Computer Vision.

[16]  U. Raghavendra,et al.  Anchor-diagonal-based shape adaptive local support region for efficient stereo matching , 2015, Signal Image Video Process..

[17]  Liming Chen,et al.  A Fast Trilateral Filter-Based Adaptive Support Weight Method for Stereo Matching , 2015, IEEE Transactions on Circuits and Systems for Video Technology.

[18]  Carsten Rother,et al.  Fast cost-volume filtering for visual correspondence and beyond , 2011, CVPR 2011.

[19]  Minh N. Do,et al.  Cross-based local multipoint filtering , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[20]  Minh N. Do,et al.  Joint Histogram-Based Cost Aggregation for Stereo Matching , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Gauthier Lafruit,et al.  Cross-Based Local Stereo Matching Using Orthogonal Integral Images , 2009, IEEE Transactions on Circuits and Systems for Video Technology.

[22]  Xinyu Wu,et al.  Disparity prediction between adjacent frames for dynamic scenes , 2014, Neurocomputing.

[23]  M. Gelautz,et al.  Temporally consistent disparity maps from uncalibrated stereo videos , 2009, 2009 Proceedings of 6th International Symposium on Image and Signal Processing and Analysis.

[24]  Liming Chen,et al.  A Novel Trilateral Filter based Adaptive Support Weight Method for Stereo Matching , 2013, BMVC.

[25]  Neil A. Dodgson,et al.  Real-Time Spatiotemporal Stereo Matching Using the Dual-Cross-Bilateral Grid , 2010, ECCV.

[26]  Federico Tombari,et al.  Segmentation-Based Adaptive Support for Accurate Stereo Correspondence , 2007, PSIVT.

[27]  Jing Zhang,et al.  Depth map super-resolution using stereo-vision-assisted model , 2015, Neurocomputing.

[28]  Margrit Gelautz,et al.  Local stereo matching using geodesic support weights , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[29]  Jian Sun,et al.  Guided Image Filtering , 2010, ECCV.