Life-sized projector-based dioramas

We introduce an idea and some preliminary results for a new projector-based approach to re-creating real and imagined sites. Our goal is to achieve re-creations that are both visually and spatially realistic, providing a small number of relatively unencumbered users with a strong sense of immersion as they jointly walkaround the virtual site.Rather than using head-mounted or general-purpose projector-based displays, our idea builds on previous projector-based work on spatially-augmented realityand shader lamps. Using simple white building blocks we construct a static physical model that approximates the size, shape, and spatial arrangementof the site. We then project dynamic imagery onto the blocks, transforming the lifeless physical model into a visually faithful reproduction of the actual site. Some advantages of this approach include wide field-of-view imagery, real walking around the site, reduced sensitivity to tracking errors, reduced sensitivity to system latency, auto-stereoscopic vision, the natural addition of augmented virtualityand the provision of haptics.In addition to describing the major challenges to (and limitations of) this vision, in this paper we describe some short-term solutions and practical methods, and we present some proof-of-concept results.

[1]  H. Leibowitz Recent Advances in our Understanding of Peripheral Vision and Some Implications , 1986 .

[2]  G. Michel,et al.  Restricting the Field of View: Perceptual and Performance Effects , 1990, Perceptual and motor skills.

[3]  O. Faugeras Three-Dimensional Computer Vision , 1993 .

[4]  Carolina Cruz-Neira,et al.  Surround-Screen Projection-Based Virtual Reality: The Design and Implementation of the CAVE , 2023 .

[5]  O. Faugeras Three-dimensional computer vision: a geometric viewpoint , 1993 .

[6]  Marc Levoy,et al.  A volumetric method for building complex models from range images , 1996, SIGGRAPH.

[7]  Michael Garland,et al.  Surface simplification using quadric error metrics , 1997, SIGGRAPH.

[8]  Greg Welch,et al.  The office of the future: a unified approach to image-based modeling and spatially immersive displays , 1998, SIGGRAPH.

[9]  Greg Welch,et al.  Efficient Image Generation for Multiprojector and Multisurface Displays , 1998, Rendering Techniques.

[10]  Voicu Popescu,et al.  Real-Time Rendering of Real World Environments , 1999, Rendering Techniques.

[11]  W. Brent Seales,et al.  Multi-projector displays using camera-based registration , 1999, Proceedings Visualization '99 (Cat. No.99CB37067).

[12]  Wolfgang Stuerzlinger,et al.  Imaging all Visible Surfaces , 1999, Graphics Interface.

[13]  Mary C. Whitton,et al.  Walking > walking-in-place > flying, in virtual environments , 1999, SIGGRAPH.

[14]  Anthony Steed,et al.  The London Travel Demonstrator , 1999, VRST '99.

[15]  Frederick P. Brooks What's Real About Virtual Reality? , 1999, IEEE Computer Graphics and Applications.

[16]  Marc Levoy,et al.  The digital Michelangelo project: 3D scanning of large statues , 2000, SIGGRAPH.

[17]  Michael S. Brown,et al.  Projected Imagery in Your "Office of the Future" , 2000, IEEE Computer Graphics and Applications.

[18]  David Salesin,et al.  Surface light fields for 3D photography , 2000, SIGGRAPH.

[19]  Dani Lischinski,et al.  Automatic Camera Placement for Image‐Based Modeling , 2000, Comput. Graph. Forum.

[20]  Mark Hereld,et al.  Introduction to building projection-based tiled display systems , 2000, IEEE Computer Graphics and Applications.

[21]  Effects of field of view on performance with head-mounted displays , 2000 .

[22]  G. Welch,et al.  Achieving color uniformity across multi-projector displays , 2000, Proceedings Visualization 2000. VIS 2000 (Cat. No.00CH37145).

[23]  Mary C. Whitton,et al.  Passive haptics significantly enhances virtual environments , 2001 .

[24]  Greg Welch,et al.  Shader Lamps: Animating Real Objects With Image-Based Illumination , 2001, Rendering Techniques.