Real-time depth range estimation and its application to mobile stereo camera

This paper proposes a real-time depth range estimation algorithm that produces a specialized depth map for mobile stereo camera and its applications. The proposed algorithm effectively controls the unwanted depth noise by using a simple depth fusion technique which is based-on the properties of different matching window size. Search range estimation used for the proposed algorithm improves both the algorithm efficiency and the accuracy of the proposed depth range map. In order to show the performance of the proposed algorithm, shooting guide functions such as auto-disparity control and comfortable zone indicator functions are implemented by using the proposed algorithm. Additionally, the out of focus images are represented as an image enhancement function. The proposed algorithm and the experimental results support that the proposed algorithm effectively controls the background artifacts and provide accurate dynamic range of depth with low computational complexity.

[1]  Daniel P. Huttenlocher,et al.  Efficient Belief Propagation for Early Vision , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[2]  Narendra Ahuja,et al.  A constant-space belief propagation algorithm for stereo matching , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[3]  Filippo Speranza,et al.  Effect of disparity and motion on visual comfort of stereoscopic images , 2006, Electronic Imaging.

[4]  D. Scharstein,et al.  A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms , 2001, Proceedings IEEE Workshop on Stereo and Multi-Baseline Vision (SMBV 2001).

[5]  Hujun Bao,et al.  Refilming with Depth-Inferred Videos , 2009, IEEE Transactions on Visualization and Computer Graphics.

[6]  Miao Liao,et al.  High-Quality Real-Time Stereo Using Adaptive Cost Aggregation and Dynamic Programming , 2006, Third International Symposium on 3D Data Processing, Visualization, and Transmission (3DPVT'06).

[7]  David K. Broberg,et al.  Guidance for horizontal image translation (HIT) of high definition stereoscopic video production , 2011, Electronic Imaging.

[8]  In-So Kweon,et al.  Stereo Matching with the Distinctive Similarity Measure , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[9]  Marcel P. Lucassen,et al.  Visual comfort of binocular and 3D displays , 2001, IS&T/SPIE Electronic Imaging.

[10]  Kwanghoon Sohn,et al.  Cost Aggregation and Occlusion Handling With WLS in Stereo Matching , 2008, IEEE Transactions on Image Processing.

[11]  Nanning Zheng,et al.  Stereo Matching Using Belief Propagation , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Vladimir Kolmogorov,et al.  Computing visual correspondence with occlusions using graph cuts , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[13]  Emanuele Trucco,et al.  A compact algorithm for rectification of stereo pairs , 2000, Machine Vision and Applications.

[14]  Richard I. Hartley,et al.  Theory and Practice of Projective Rectification , 1999, International Journal of Computer Vision.