Rendering Interior Cultural Heritage Scenes Using Image-based Shooting

Rendering interior cultural heritage scenes using physically based rendering with outdoor environment maps is computationally expensive using ray tracing methods, and currently difficult for interactive applications without significant precomputation of lighting. In this paper, we present a novel approach to relight synthetic interior scenes by extending image-based lighting to generate fast high-quality interactive previews of these environments. Interior light probes are acquired from a real scene, then used to shoot light onto the virtual scene geometry to accelerate image synthesis by assuming the light sources shot act as the correct solution of light transport for that particular intersection point. We term this approach Image-Based Shooting. It is demonstrated in this paper with an approach inspired by Irradiance Cache Splatting. The methodology is well-suited for interior scenes in which light enters through narrow windows and doors, common at cultural heritage sites. Our implementation generates high-quality interactive preview renditions of these sites and can significantly aid documentation, 3D model validation and predictive rendering. The method can easily be integrated with existing cultural heritage reconstruction pipelines, especially ray tracing based renderers.

[1]  James Arvo,et al.  A framework for realistic image synthesis , 1997, SIGGRAPH.

[2]  Henrik Wann Jensen,et al.  Global Illumination using Photon Maps , 1996, Rendering Techniques.

[3]  Jassim Happa,et al.  Illuminating the past: state of the art , 2010, Virtual Reality.

[4]  Elizabeth S. Bolman,et al.  Late Antique Aesthetics, Chromophobia and the Red Monastery, Sohag, Egypt , 2006 .

[5]  James T. Kajiya,et al.  The rendering equation , 1986, SIGGRAPH.

[6]  Matthias Zwicker,et al.  Surface splatting , 2001, SIGGRAPH.

[7]  Sumanta N. Pattanaik,et al.  Radiance cache splatting: a GPU-friendly global illumination algorithm , 2005, EGSR '05.

[8]  Mark Segal,et al.  Fast shadows and lighting effects using texture mapping , 1992, SIGGRAPH.

[9]  Paul Debevec Rendering synthetic objects into real scenes: bridging traditional and image-based graphics with global illumination and high dynamic range photography , 2008, SIGGRAPH Classes.

[10]  James F. Blinn,et al.  Texture and reflection in computer generated images , 1998 .

[11]  Samuli Laine,et al.  Sampling Precomputed Volumetric Lighting , 2006, J. Graph. Tools.

[12]  Mark Ollila,et al.  A Real Time Light Probe , 2004, Eurographics.

[13]  Paul E. Debevec,et al.  Rendering synthetic objects into real scenes: bridging traditional and image-based graphics with global illumination and high dynamic range photography , 1998, SIGGRAPH '08.

[14]  Donald P. Greenberg,et al.  The Irradiance Volume , 1998, IEEE Computer Graphics and Applications.

[15]  Joseph O'Rourke,et al.  Computational Geometry in C. , 1995 .

[16]  Pierre Poulin,et al.  Compact Structures for Interactive Global Illumination on Large Cultural Objects , 2008 .

[17]  Paolo Cignoni,et al.  Stereo Light Probe , 2008, Comput. Graph. Forum.

[18]  Paul E. Debevec,et al.  Image-based modeling, rendering, and lighting in Fiat Lux , 1999, SIGGRAPH '99.

[19]  Carsten Dachsbacher,et al.  Reflective shadow maps , 2005, I3D '05.

[20]  Jassim Happa,et al.  High Dynamic Range Video for Cultural Heritage Documentation and Experimental Archaeology , 2010, VAST.

[21]  Donald P. Greenberg,et al.  Modeling the interaction of light between diffuse surfaces , 1984, SIGGRAPH.