论文信息 - A hybrid image-based and model-based telepresence system using two-pass video projection onto a 3D scene model

A hybrid image-based and model-based telepresence system using two-pass video projection onto a 3D scene model

A telepresence system is presented that has the advantage of both model-based and image-based approaches, namely, free viewpoint control and real-time color update with live video. A remote place is presented as a virtual environment by using live video projection captured by a head-worn camera onto the static 3D geometry. The observer can then observe the remote place in cooperation with the remote camera man, and give him a set of 3D instructions by a mouse.

Kiyoshi Kiyokawa | Haruo Takemura | Takefumi Ogawa

[1] Suya You,et al. Augmented virtual environments (AVE): dynamic fusion of imagery and 3D models , 2003, IEEE Virtual Reality, 2003. Proceedings..

[2] Seiji Inokuchi,et al. 3-D tele-direction interface using video projector , 2003, SIGGRAPH '03.

[3] Leonard McMillan,et al. Plenoptic Modeling: An Image-Based Rendering System , 2023 .

[4] Hideaki Kuzuoka,et al. Spatial workspace collaboration: a SharedView video support system for remote collaboration capability , 1992, CHI.

[5] Yizhou Yu,et al. Efficient View-Dependent Image-Based Rendering with Projective Texture-Mapping , 1998, Rendering Techniques.

[6] Markus H. Gross,et al. Embedding imperceptible patterns into projected images for simultaneous acquisition and display , 2004, Third IEEE and ACM International Symposium on Mixed and Augmented Reality.

[7] Hideaki Kuzuoka,et al. Remote collaboration using a shoulder-worn active camera/laser , 2004, Eighth International Symposium on Wearable Computers.

[8] Steve Mann,et al. Telepointer: Hands-free completely self-contained wearable visual augmented reality without headwear and without any infrastructural reliance , 2000, Digest of Papers. Fourth International Symposium on Wearable Computers.

[9] Suya You,et al. Texture Painting from Video , 2005, J. WSCG.

[10] Joseph R. Spann,et al. Photogrammetry using 3D graphics and projective textures , 2000 .

[11] Marc Levoy,et al. Real-time 3D model acquisition , 2002, ACM Trans. Graph..