Rapid Shadow Generation in Real-World Lighting Environments

We propose a new algorithm that uses consumer-level graphics hardware to render shadows cast by synthetic objects and a real lighting environment. This has immediate benefit for interactive Augmented Reality applications, where synthetic objects must be accurately merged with real images. We show how soft shadows cast by direct and indirect illumination sources may be generated and composited into a background image at interactive rates. We describe how the sources of light (and hence shadow) affecting each point in an image can be efficiently encoded using a hierarchical shaft-based subdivision of line-space. This subdivision is then used to determine the sources of light that are occluded by synthetic objects, and we show how the contributions from these sources may be removed from a background image using facilities available on modern graphics hardware. A trade-off may be made at run-time between shadow accuracy and rendering cost, converging towards a result that is subjectively similar to that obtained using ray-tracing based differential rendering algorithms. Examples of the proposed technique are given for a variety of different lighting environments, and the visual fidelity of images generated by our algorithm is compared to both real photographs and synthetic images generated using non-real-time techniques.

[1]  Pierre Poulin,et al.  Interactive Virtual Relighting and Remodeling of Real Scenes , 1999, Rendering Techniques.

[2]  Pierre Poulin,et al.  A survey of shadow algorithms , 1990, IEEE Computer Graphics and Applications.

[3]  Jan Kautz,et al.  Precomputed radiance transfer for real-time rendering in dynamic, low-frequency lighting environments , 2002 .

[4]  George Drettakis,et al.  Interactive Common Illumination for Computer Augmented Reality , 1997, Rendering Techniques.

[5]  Andreas Kolb,et al.  Homomorphic factorization of BRDF-based lighting computation , 2002, ACM Trans. Graph..

[6]  Michael F. Cohen,et al.  Radiosity and realistic image synthesis , 1993 .

[7]  Alexander Keller,et al.  Instant radiosity , 1997, SIGGRAPH.

[8]  S. Hecht,et al.  THE VISUAL DISCRIMINATION OF INTENSITY AND THE WEBER-FECHNER LAW , 1924, The Journal of general physiology.

[9]  Pat Hanrahan,et al.  Frequency space environment map rendering , 2002, SIGGRAPH.

[10]  Paul E. Debevec,et al.  Rendering synthetic objects into real scenes: bridging traditional and image-based graphics with global illumination and high dynamic range photography , 1998, SIGGRAPH '08.

[11]  A. Fournier,et al.  Common Illumination between Real and Computer Generated Scenes , 1992 .

[12]  Donald P. Greenberg,et al.  The Irradiance Volume , 1998, IEEE Computer Graphics and Applications.

[13]  Claude Puech,et al.  Radiosity and global illumination , 1994 .

[14]  Norman I. Badler,et al.  Generating soft shadows with a depth buffer algorithm , 1984, IEEE Computer Graphics and Applications.

[15]  Eric Haines A Shaft Culling Tool , 2000, J. Graphics, GPU, & Game Tools.

[16]  Michael Garland,et al.  Surface simplification using quadric error metrics , 1997, SIGGRAPH.

[17]  Simon Gibson,et al.  Interactive Rendering with Real-World Illumination , 2000, Rendering Techniques.

[18]  Paul Debevec,et al.  Inverse global illumination: Recovering re?ectance models of real scenes from photographs , 1998 .

[19]  Donald P. Greenberg,et al.  Interactive global illumination in dynamic scenes , 2002, SIGGRAPH.

[20]  François X. Sillion,et al.  Fast calculation of soft shadow textures using convolution , 1998, SIGGRAPH.

[21]  Lance Williams,et al.  Casting curved shadows on curved surfaces , 1978, SIGGRAPH.

[22]  Peter Shirley,et al.  Visual cues for imminent object contact in realistic virtual environments , 2000 .

[23]  Donald P. Greenberg,et al.  Perceiving spatial relationships in computer-generated images , 1992, IEEE Computer Graphics and Applications.

[24]  Toby Howard,et al.  Interactive reconstruction of virtual environments from video sequences , 2003, Computers & graphics.

[25]  George Drettakis,et al.  Interactive update of global illumination using a line-space hierarchy , 1997, SIGGRAPH.

[26]  Paul S. Heckbert,et al.  Simulating Soft Shadows with Graphics Hardware , 1997 .

[27]  Hans-Peter Seidel,et al.  Single Sample Soft Shadows Using Depth Maps , 2002, Graphics Interface.

[28]  Edward Cutrell,et al.  Measuring the Perception of Visual Realism in Images , 2001, Rendering Techniques.

[29]  Katsushi Ikeuchi,et al.  Acquiring a Radiance Distribution to Superimpose Virtual Objects onto Real Scene , 2001, MVA.

[30]  André Gagalowicz,et al.  Image-based rendering of diffuse, specular and glossy surfaces from a single image , 2001, SIGGRAPH.

[31]  Pat Hanrahan,et al.  An efficient representation for irradiance environment maps , 2001, SIGGRAPH.

[32]  George Drettakis,et al.  Incremental Updates for Rapid Glossy Global Illumination , 2001, Comput. Graph. Forum.