New View Video Synthesis via Real Time Depth Image Processing

Depth video plays a significant role for generating 3D Video contents. In this paper, we first present a method for generating depth video in real-time from multiple video inputs. In the PGS framework, we employ plane sweeping algorithm using GPU for generating the depth video in real-time. Then we would also show the way of generating the depth video at the same camera parameters as the texture cameras in real-time, so that we can display the object scene with the auto-stereoscopic display in real-time.

[1]  Didier Arquès,et al.  Real-time Plane-sweep with Local Strategy , 2006, J. WSCG.

[2]  Michael Lehmann,et al.  An all-solid-state optical range camera for 3D real-time imaging with sub-centimeter depth resolution (SwissRanger) , 2004, SPIE Optical Systems Design.

[3]  Takeo Kanade,et al.  Shape reconstruction in projective grid space from large number of images , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[4]  Hideo Saito,et al.  Real-time free viewpoint video from uncalibrated cameras using plane-sweep algorithm , 2009, 2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops.