Dynamic projection environments for immersive visualization

We present a system for dynamic projection on large, human-scale, moving projection screens and demonstrate this system for immersive visualization applications in several fields. We have designed and implemented efficient, low-cost methods for robust tracking of projection surfaces, and a method to provide high frame rate output for computationally-intensive, low frame rate applications. We present a distributed rendering environment which allows many projectors to work together to illuminate the projection surfaces. This physically immersive visualization environment promotes innovation and creativity in design and analysis applications and facilitates exploration of alternative visualization styles and modes. The system provides for multiple participants to interact in a shared environment in a natural manner. Our new human-scale user interface is intuitive and novice users require essentially no instruction to operate the visualization.

[1]  Greg Welch,et al.  The office of the future: a unified approach to image-based modeling and spatially immersive displays , 1998, SIGGRAPH.

[2]  Oliver Bimber,et al.  Real-Time Adaptive Radiometric Compensation , 2006, IEEE Transactions on Visualization and Computer Graphics.

[3]  Roland Siegwart,et al.  A Flexible Technique for Accurate Omnidirectional Camera Calibration and Structure from Motion , 2006, Fourth IEEE International Conference on Computer Vision Systems (ICVS'06).

[4]  Oliver Bimber,et al.  Compensating Indirect Scattering for Immersive and Semi-Immersive Projection Displays , 2006, IEEE Virtual Reality Conference (VR 2006).

[5]  Ramesh Raskar,et al.  Automatic projector calibration with embedded light sensors , 2004, UIST '04.

[6]  Aditi Majumder,et al.  Color nonuniformity in projection-based displays: analysis and solutions , 2004, IEEE Transactions on Visualization and Computer Graphics.

[7]  Johnny Chung Lee,et al.  Hybrid infrared and visible light projection for location tracking , 2007, UIST.

[8]  Greg Welch,et al.  Shader Lamps: Animating Real Objects With Image-Based Illumination , 2001, Rendering Techniques.

[9]  R. Y. Tsai,et al.  An Efficient and Accurate Camera Calibration Technique for 3D Machine Vision , 1986, CVPR 1986.

[10]  Markus H. Gross,et al.  Embedding imperceptible patterns into projected images for simultaneous acquisition and display , 2004, Third IEEE and ACM International Symposium on Mixed and Augmented Reality.

[11]  Barbara Cutler,et al.  Global Illumination Compensation for Spatially Augmented Reality , 2010, Comput. Graph. Forum.

[12]  Mark Ashdown,et al.  A flexible projector-camera system for multi-planar displays , 2004, CVPR 2004.

[13]  Anselmo Lastra,et al.  Life-sized projector-based dioramas , 2001, VRST '01.

[14]  Luc Van Gool,et al.  Blue-c: a spatially immersive display and 3D video portal for telepresence , 2003, IPT/EGVE.

[15]  Scott E. Hudson,et al.  Moveable interactive projected displays using projector based tracking , 2005, UIST.

[16]  Claudio S. Pinhanez.  The Everywhere Displays Projector: A Device to Create Ubiquitous Graphical Interfaces , 2001, UbiComp.

[17]  Ramesh Raskar,et al.  Modern approaches to augmented reality , 2005, SIGGRAPH Courses.

[18]  Ramesh Raskar,et al.  Modern approaches to augmented reality Video files associated with this course are available from the citation page , 2007, SIGGRAPH Courses.

[19]  Carolina Cruz-Neira,et al.  Surround-Screen Projection-Based Virtual Reality: The Design and Implementation of the CAVE , 2023 .

[20]  Gary W. Meyer,et al.  A handheld flexible display system , 2005, VIS 05. IEEE Visualization, 2005..

[21]  Scott E. Hudson,et al.  Foldable interactive displays , 2008, UIST '08.

[22]  Ramesh Raskar,et al.  Cartoon dioramas in motion , 2002, NPAR '02.

[23]  Koichi Hirota,et al.  Cross-section Projector: Interactive and Intuitive Presentation of 3D Volume Data using a Handheld Screen , 2007, 2007 IEEE Symposium on 3D User Interfaces.

[24]  Ramesh Raskar,et al.  Dynamic shader lamps : painting on movable objects , 2001, Proceedings IEEE and ACM International Symposium on Augmented Reality.

[25]  Raimund Dachselt,et al.  PaperLens: advanced magic lens interaction above the tabletop , 2009, ITS '09.