Recording multiple videos and 3D video display in a large-scale space

In this paper, we introduce our research for realizing a 3D (three-dimensional) video display system in a very large-scale space such as a soccer stadium, concert hall, etc. We have developed a 4D (four-dimensional) digitization system of a large-scale space. We place sixteen progressive scan cameras around the space. The videos from those cameras are digitized into PCs (personal computers) that are connected via Ethernet. A camera calibration technique for a large-scale space that is accurate enough to apply CV-based algorithms is developed. We propose a method for describing the shape of a 3D object with a set of planes in order to synthesize a view of the object effectively. The most effective layout of the planes can be determined based on the relative locations of an observer's viewing position, multiple cameras, and 3D objects. The data size of the 3D model and the processing time can be reduced drastically. The effectiveness of the proposed method is demonstrated by experimental results.

[1]  Takeo Kanade,et al.  Shape reconstruction in projective grid space from large number of images , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[2]  P. Anandan,et al.  From 2D images to 2.5D sprites: a layered approach to modeling 3D scenes , 1999, Proceedings IEEE International Conference on Multimedia Computing and Systems.

[3]  Xiaojun Wu,et al.  Homography based parallel volume intersection: toward real-time volume reconstruction using active cameras , 2000, Proceedings Fifth IEEE International Workshop on Computer Architectures for Machine Perception.

[4]  Robert T. Collins,et al.  A space-sweep approach to true multi-image matching , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[5]  Takeo Kanade,et al.  Virtualized Reality: Constructing Virtual Worlds from Real Scenes , 1997, IEEE Multim..

[6]  Ramesh C. Jain,et al.  An emerging medium: interactive three-dimensional digital video , 1996, Proceedings of the Third IEEE International Conference on Multimedia Computing and Systems.

[7]  Ramesh Raskar,et al.  Image-based visual hulls , 2000, SIGGRAPH.