Super-resolution Reconstruction for Binocular 3D Data

In this study, a super-resolution reconstruction approach for binocular 3D data is proposed. The aim is to obtain the high-resolution (HR) disparity map from a low-resolution (LR) binocular image pair by super-resolution reconstruction. The proposed approach contains five stages, i.e., initial disparity map estimation using local aggregation, disparity plane model computation, global energy cost minimization, HR disparity map composition by region-based fusion (selection), and fused HR disparity map refinement. Based on the experimental results obtained in this study, in terms of PSNR and bad pixel rate (BPR), the final HR disparity maps by the proposed approach are better than those by four comparison approaches.

[1]  Xing Mei,et al.  On building an accurate stereo matching system on graphics hardware , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).

[2]  Rafael Cabeza,et al.  Near Real-Time Stereo Matching Using Geodesic Diffusion , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Jing Zhang,et al.  High quality depth maps from stereo matching and ToF camera , 2011, 2011 International Conference of Soft Computing and Pattern Recognition (SoCPaR).

[4]  Xing Mei,et al.  Stereo Matching with Reliable Disparity Propagation , 2011, 2011 International Conference on 3D Imaging, Modeling, Processing, Visualization and Transmission.

[5]  Olga Veksler,et al.  Fast variable window for stereo correspondence using integral images , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[6]  Minh N. Do,et al.  A revisit to MRF-based depth map super-resolution and enhancement , 2011, 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[7]  Xinggang Lin,et al.  Effective refinement for accurate dense stereo matching using in-situ color-weighted median filter , 2012 .

[8]  D. Nistér,et al.  Stereo Matching with Color-Weighted Correlation, Hierarchical Belief Propagation, and Occlusion Handling , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Murat Gevrekci,et al.  Depth map super resolution , 2011, 2011 18th IEEE International Conference on Image Processing.

[10]  Björn E. Ottersten,et al.  Pixel weighted average strategy for depth sensor data fusion , 2010, 2010 IEEE International Conference on Image Processing.

[11]  Zheng Zhi.  A Region Based Stereo Matching Algorithm Using Cooperative Optimization , 2009 .

[12]  Dani Lischinski,et al.  Joint bilateral upsampling , 2007, SIGGRAPH 2007.

[13]  Michael S. Brown,et al.  High quality depth map upsampling for 3D-TOF cameras , 2011, 2011 International Conference on Computer Vision.

[14]  Ruigang Yang,et al.  Reliability Fusion of Time-of-Flight Depth and Stereo Geometry for High Quality Depth Maps , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Dorin Comaniciu,et al.  Robust analysis of feature spaces: color image segmentation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[16]  Sebastian Thrun,et al.  LidarBoost: Depth superresolution for ToF 3D shape scanning , 2009, CVPR.

[17]  Dirk Gandolph,et al.  Confidence evaluation for robust, fast-converging disparity map refinement , 2010, 2010 IEEE International Conference on Multimedia and Expo.

[18]  Björn E. Ottersten,et al.  A new multi-lateral filter for real-time depth enhancement , 2011, 2011 8th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS).

[19]  Richard Szeliski,et al.  A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms , 2001, International Journal of Computer Vision.

[20]  Lifeng Sun,et al.  Joint Example-Based Depth Map Super-Resolution , 2012, 2012 IEEE International Conference on Multimedia and Expo.