A framework of individually-focused teleconferencing (IFT) via an efficient 3D reprojection technique

In this paper, we propose a framework on individually-focused teleconferencing (IFT) which is supported by an efficient 3D reprojection technique. The goal of designing IFT is to provide sufficient 3D pose information to each teleconference participant in order to establish lively communication in a teleconference on low-bandwidth internet. A novel IFT deployment and an efficient 3D reprojection technique are two major contributions of this paper. Our 3D reprojection technique uses a mirror reference view in three-view epipolar geometry. It overcomes the inefficiency in previous techniques and provides visually good recovery of pose information of teleconference participants even though it is theoretically an approximation scheme.

[1]  Lance Williams,et al.  View Interpolation for Image Synthesis , 1993, SIGGRAPH.

[2]  Andrew Zisserman,et al.  Multiple view geometry in computer visiond , 2001 .

[3]  Stephen E. Deering,et al.  Host extensions for IP multicasting , 1986, RFC.

[4]  Joe John Duran.  Mainstream Videoconferencing: A Developer's Guide to Distance Multimedia , 1997 .

[5]  Richard Szeliski,et al.  Creating full view panoramic image mosaics and environment maps , 1997, SIGGRAPH.

[6]  Takeo Kanade,et al.  Virtual Space Teleconferencing Using a Sea of Cameras , 1994 .

[7]  Amnon Shashua,et al.  Novel view synthesis in tensor space , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[8]  Frederic I. Parke,et al.  A parametric model for human faces. , 1974 .

[9]  Andrew W. Fitzgibbon,et al.  Automatic Camera Recovery for Closed or Open Image Sequences , 1998, ECCV.

[10]  Zicheng Liu,et al.  Rapid modeling of animated faces from video , 2001, Comput. Animat. Virtual Worlds.

[11]  Michael R. Macedonia,et al.  MBone provides audio and video across the Internet , 1994, Computer.

[12]  Fumio Kishino,et al.  Real-time reproduction of 3D human images in virtual space teleconferencing , 1993, Proceedings of IEEE Virtual Reality Annual International Symposium.

[13]  Steve Benford,et al.  MASSIVE: a collaborative virtual environment for teleconferencing , 1995, TCHI.

[14]  Greg Welch,et al.  The office of the future: a unified approach to image-based modeling and spatially immersive displays , 1998, SIGGRAPH.

[15]  Amnon Shashua,et al.  Novel View Synthesis by Cascading Trilinear Tensors , 1998, IEEE Trans. Vis. Comput. Graph..

[16]  Andrew Zisserman,et al.  Robust parameterization and computation of the trifocal tensor , 1997, Image Vis. Comput..

[17]  Leonard McMillan,et al.  Plenoptic Modeling: An Image-Based Rendering System , 2023 .

[18]  Richard I. Hartley,et al.  In Defense of the Eight-Point Algorithm , 1997, IEEE Trans. Pattern Anal. Mach. Intell..