Spatio-Temporal Consistency Enhancement for Disparity Sequence

Disparity estimation for still images has attracted much interest and acquired many promising results. However, simply applying these methods to produce a disparity sequence may suffer from the undesirable flickering artifacts. These errors not only distinctly decrease the visible quality of the synthesized video, but also significantly reduce the coding efficiency of the disparity sequence. In this paper, a novel temporal consistency enhancement algorithm based on Guided Filter and Temporal Gradient (GFTG) is proposed. The flickering artifacts and noises are effectively removed and the edges of objects are well preserved. Both quantitative and qualitative evaluations show that the spatio-temporal consistency has been highly improved by utilizing our approach.

[1]  Richard Szeliski,et al.  Computer Vision - Algorithms and Applications , 2011, Texts in Computer Science.

[2]  Darius Burschka,et al.  Advances in Computational Stereo , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Toby P. Breckon,et al.  An empirical comparison of real-time dense stereo approaches for use in the automotive environment , 2012, EURASIP J. Image Video Process..

[4]  Richard Szeliski,et al.  A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms , 2001, International Journal of Computer Vision.

[5]  Neil A. Dodgson,et al.  Real-Time Spatiotemporal Stereo Matching Using the Dual-Cross-Bilateral Grid , 2010, ECCV.

[6]  Nanning Zheng,et al.  Stereo Matching Using Belief Propagation , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Dana H. Ballard,et al.  Computer Vision , 1982 .

[8]  Changming Sun,et al.  An energy minimisation approach to stereo-temporal dense reconstruction , 2004, ICPR 2004.

[9]  Jian Sun,et al.  Guided Image Filtering , 2010, ECCV.

[10]  Carsten Rother,et al.  Fast cost-volume filtering for visual correspondence and beyond , 2011, CVPR 2011.

[11]  M. Gelautz,et al.  Temporally consistent disparity maps from uncalibrated stereo videos , 2009, 2009 Proceedings of 6th International Symposium on Image and Signal Processing and Analysis.

[12]  Olga Veksler,et al.  Fast Approximate Energy Minimization via Graph Cuts , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Anthony Vetro,et al.  Temporally consistent stereo matching using coherence function , 2010, 2010 3DTV-Conference: The True Vision - Capture, Transmission and Display of 3D Video.

[14]  In-So Kweon,et al.  Adaptive Support-Weight Approach for Correspondence Search , 2006, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Minh N. Do,et al.  Depth Video Enhancement Based on Weighted Mode Filtering , 2012, IEEE Transactions on Image Processing.