Superimposing pictorial artwork with projected imagery

We present an approach for using pictorial artwork as information displays and show how to combine almost any kind of computer-generated visual information directly with the painted content. We describe a novel technological approach, a mathematical model, a real-time rendering algorithm, and examples of presentation techniques. Our system displays such information while keeping the observers' attention on the original artifact and doesn't require additional screens.

[1]  Paul A. Beardsley,et al.  Natural video matting using camera arrays , 2006, ACM Trans. Graph..

[2]  Claudio S. Pinhanez.  The Everywhere Displays Projector: A Device to Create Ubiquitous Graphical Interfaces , 2001, UbiComp.

[3]  Ruigang Yang,et al.  PixelFlex: a reconfigurable multi-projector display system , 2001, Proceedings Visualization, 2001. VIS '01..

[4]  Oliver Bimber,et al.  Occlusion shadows: using projected light to generate realistic occlusion effects for view-dependent optical see-through displays , 2002, Proceedings. International Symposium on Mixed and Augmented Reality.

[5]  Greg Welch,et al.  Achieving color uniformity across multi-projector displays , 2000, Proceedings Visualization 2000. VIS 2000 (Cat. No.00CH37145).

[6]  Ramesh Raskar,et al.  Cartoon dioramas in motion , 2005, SIGGRAPH Courses.

[7]  Tony DeRose,et al.  Toolglass and magic lenses: the see-through interface , 1993, SIGGRAPH.

[8]  Greg Welch,et al.  Shader Lamps: Animating Real Objects With Image-Based Illumination , 2001, Rendering Techniques.

[9]  Oliver Bimber,et al.  Combining optical holograms with interactive computer graphics , 2005, Computer.

[10]  Adam Finkelstein,et al.  Automatic alignment of high-resolution multi-projector displays using an uncalibrated camera , 2000, Proceedings Visualization 2000. VIS 2000 (Cat. No.00CH37145).

[11]  Anselmo Lastra,et al.  Life-sized projector-based dioramas , 2001, VRST '01.

[12]  Hiroshi Ishii,et al.  Emancipated pixels: real-world graphics in the luminous room , 1999, SIGGRAPH.

[13]  T. Yoshida,et al.  A Virtual Color Reconstruction System for Real Heritage with Light Projection , 2003 .

[14]  Gordon Wetzstein,et al.  Consistent illumination within optical see-through augmented environments , 2003, SIGGRAPH '03.