Physically-based augmentation of real objects with virtual content under the influence of ambient light

In this article, we introduce a new method for the augmentation of a real object with virtual content under the influence of ambient light. For this purpose, we use a physically-based simulation and spectral data which is recorded separately for each of the components: projector, ambient light and real object. Then the simulation computes the influence of every component to the scene and uses the results to compute an adjusted virtual content, which can then be displayed by a real projector in the given situation. The adjustment of the projection can therefore be computed by considering the full dynamic range of the scene and that of the virtual content. Additionally, the virtual content is visualized with informations from the environment and therefore hidden objects or reflections can be integrated into the projection. The proposed methods and the physically-based simulation are validated and visualized through different experiments.

[1]  Aaas News,et al.  Book Reviews , 1893, Buffalo Medical and Surgical Journal.

[2]  Shree K. Nayar,et al.  Making one object look like another: controlling appearance using a projector-camera system , 2004, CVPR 2004.

[3]  Jitendra Malik,et al.  Recovering high dynamic range radiance maps from photographs , 1997, SIGGRAPH.

[4]  Shree K. Nayar,et al.  A Projection System with Radiometric Compensation for Screen Imperfections , 2003 .

[5]  Greg Ward,et al.  Picture Perfect RGB Rendering Using Spectral Prefiltering and Sharp Color Primaries , 2002, Rendering Techniques.

[6]  Jyh-Ming Lien.  Point-Based Minkowski Sum Boundary , 2007, 15th Pacific Conference on Computer Graphics and Applications (PG'07).

[7]  Steve Marschner,et al.  Dual photography , 2005, ACM Trans. Graph..

[8]  James T. Kajiya,et al.  The rendering equation , 1998 .

[9]  Gordon Wetzstein,et al.  Consistent illumination within optical see-through augmented environments , 2003, The Second IEEE and ACM International Symposium on Mixed and Augmented Reality, 2003. Proceedings..

[10]  Ramesh Raskar,et al.  Dynamic shader lamps : painting on movable objects , 2001, Proceedings IEEE and ACM International Symposium on Augmented Reality.

[11]  Daniel G. Aliaga,et al.  A virtual restoration stage for real-world objects , 2008, SIGGRAPH 2008.

[12]  Gregory J. Ward,et al.  The RADIANCE lighting simulation and rendering system , 1994, SIGGRAPH.

[13]  Gordon Wetzstein,et al.  Radiometric Compensation through Inverse Light Transport , 2007, 15th Pacific Conference on Computer Graphics and Applications (PG'07).

[14]  Greg Welch,et al.  Shader Lamps: Animating Real Objects With Image-Based Illumination , 2001, Rendering Techniques.

[15]  Ryugo Kijima,et al.  Free form projection display and application , 2008, PROCAMS '08.