Real-Time 3D-Teleimmersion

In this paper we present the first implementation of a new medium for telecollaboration. The realized testbed consists of two tele-cubicles at two Internet nodes. At each telecubicle a stereo-rig is used to provide an accurate dense 3D-reconstruction of a person in action. The two real dynamic worlds are transmitted over the network and visualized stereoscopically. The full-3D information facilitates interaction with any virtual object, demonstrating in an optimal way the confluence of graphics, vision, and communication.

[1]  Takeo Kanade,et al.  A Multiple-Baseline Stereo , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Dana H. Ballard,et al.  Computer Vision , 1982 .

[3]  Larry H. Matthies,et al.  Stereo vision for planetary rovers: Stochastic modeling to near real-time implementation , 1991, Optics & Photonics.

[4]  Roger Y. Tsai,et al.  A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses , 1987, IEEE J. Robotics Autom..

[5]  Kiriakos N. Kutulakos,et al.  Calibration-Free Augmented Reality , 1998, IEEE Trans. Vis. Comput. Graph..

[6]  Roberto Manduchi,et al.  Stereo Without Search , 1996, ECCV.

[7]  Yoshiaki Shirai,et al.  Three-Dimensional Computer Vision , 1987, Symbolic Computation.

[8]  Lance Williams,et al.  View Interpolation for Image Synthesis , 1993, SIGGRAPH.

[9]  Steven M. Seitz,et al.  Toward image-based scene representation using view morphing , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[10]  Richard Szeliski,et al.  Stereo matching with non-linear diffusion , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[11]  Peter N. Belhumeur,et al.  A Bayesian approach to binocular steropsis , 1996, International Journal of Computer Vision.

[12]  T. Poggio,et al.  A generalized ordering constraint for stereo correspondence , 1984 .

[13]  Hans P. Moravec.  Robot Rover Visual Navigation , 1981 .

[14]  Takeo Kanade,et al.  Constructing virtual worlds using dense stereo , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[15]  Steven M. Seitz,et al.  View morphing , 1996, SIGGRAPH.

[16]  Jake K. Aggarwal,et al.  Structure from stereo-a review , 1989, IEEE Trans. Syst. Man Cybern..

[17]  Olivier D. Faugeras,et al.  Computing differential properties of 3-D shapes from stereoscopic images without 3-D models , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[18]  Daniel Thalmann,et al.  An Indexed Bibliography on Computer Animation , 1985, IEEE Computer Graphics and Applications.

[19]  John Woodfill,et al.  Real-time stereo vision on the PARTS reconfigurable computer , 1997, Proceedings. The 5th Annual IEEE Symposium on Field-Programmable Custom Computing Machines Cat. No.97TB100186).

[20]  Charles Hansen,et al.  Rectification of images for binocular and trinocular stereovision , 1988, [1988 Proceedings] 9th International Conference on Pattern Recognition.