High-quality multi-view depth generation using multiple color and depth cameras

In this paper, we propose a high-quality multi-view depth generation method using multiple color and depth cameras. After we capture low-resolution depth maps by three TOF cameras, the depth information is warped into color image positions and used as the initial disparity value. By applying the stereo matching using belief propagation with the initial disparity information, we have obtained more accurate and stable multi-view disparity maps, compared to those results without the initial disparity information.

[1]  Masayuki Tanimoto,et al.  FTV: Free-viewpoint Television , 2006, Signal Process. Image Commun..

[2]  Ruigang Yang,et al.  Fusion of time-of-flight depth and stereo for high accuracy depth maps , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[3]  Nanning Zheng,et al.  Stereo Matching Using Belief Propagation , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  M. Levoy,et al.  Automatic Color Calibration for Large Camera Arrays , 2005 .

[5]  Aljoscha Smolic,et al.  Interactive 3-D Video Representation and Coding Technologies , 2005, Proceedings of the IEEE.

[6]  Pedro F. Felzenszwalb,et al.  Efficient belief propagation for early vision , 2004, CVPR 2004.

[7]  Klaus-Dieter Kuhnert,et al.  Fusion of Stereo-Camera and PMD-Camera Data for Real-Time Suited Precise 3D Environment Reconstruction , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[8]  Yun-Suk Kang.  Multi-View Depth Generation using Multi-Depth Camera System , 2010 .

[9]  Reinhard Koch,et al.  Dense Depth Maps from Low Resolution Time-of-Flight Depth and High Resolution Color Views , 2009, ISVC.

[10]  Yo-Sung Ho,et al.  Geometrical compensation for multi-view video in multiple camera array , 2008, 2008 50th International Symposium ELMAR.

[11]  Rasmus Larsen,et al.  Fusion of stereo vision and Time-Of-Flight imaging for improved 3D estimation , 2008, Int. J. Intell. Syst. Technol. Appl..