A first-order analysis of lighting, shading, and shadows

The shading in a scene depends on a combination of many factors---how the lighting varies spatially across a surface, how it varies along different directions, the geometric curvature and reflectance properties of objects, and the locations of soft shadows. In this article, we conduct a complete first-order or gradient analysis of lighting, shading, and shadows, showing how each factor separately contributes to scene appearance, and when it is important. Gradients are well-suited to analyzing the intricate combination of appearance effects, since each gradient term corresponds directly to variation in a specific factor. First, we show how the spatial and directional gradients of the light field change as light interacts with curved objects. This extends the recent frequency analysis of Durand et al. [2005] to gradients, and has many advantages for operations, like bump mapping, that are difficult to analyze in the Fourier domain. Second, we consider the individual terms responsible for shading gradients, such as lighting variation, convolution with the surface BRDF, and the object's curvature. This analysis indicates the relative importance of various terms, and shows precisely how they combine in shading. Third, we understand the effects of soft shadows, computing accurate visibility gradients, and generalizing previous work to arbitrary curved occluders. As one practical application, our visibility gradients can be directly used with conventional ray-tracing methods in practical gradient interpolation methods for efficient rendering. Moreover, our theoretical framework can be used to adaptively sample images in high-gradient regions for efficient rendering.

[1]  Kun Zhou,et al.  Precomputed shadow fields for dynamic scenes , 2005, ACM Trans. Graph..

[2]  Pat Hanrahan,et al.  Textures and radiosity: controlling emission and reflection with texture maps , 1994, SIGGRAPH.

[3]  Rui Wang,et al.  Efficient wavelet rotation for environment map rendering , 2006, EGSR '06.

[4]  Homan Igehy,et al.  Tracing ray differentials , 1999, SIGGRAPH.

[5]  John Hart,et al.  ACM Transactions on Graphics , 2004, SIGGRAPH 2004.

[6]  Serge J. Belongie,et al.  Structured importance sampling of environment maps , 2003, ACM Trans. Graph..

[7]  Laurent Moll,et al.  Efficient image-based methods for rendering soft shadows , 2000, SIGGRAPH.

[8]  Baining Guo,et al.  Progressive radiance evaluation using directional coherence maps , 1998, SIGGRAPH.

[9]  Pat Hanrahan,et al.  A signal-processing framework for inverse rendering , 2001, SIGGRAPH.

[10]  Frédo Durand,et al.  The 3D visibility complex , 2002, TOGS.

[11]  Pat Hanrahan,et al.  Wavelet radiosity , 1993, SIGGRAPH.

[12]  Tom Lyche,et al.  Computing exact shadow irradiance using splines , 1999, SIGGRAPH.

[13]  Ravi Ramamoorthi,et al.  A Fourier theory for cast shadows , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Maneesh Agrawala,et al.  Efficient Shadows for Sampled Environment Maps , 2006, J. Graph. Tools.

[15]  H. Jensen,et al.  Wavelet importance sampling: efficiently evaluating products of complex functions , 2005, SIGGRAPH 2005.

[16]  David W. Jacobs,et al.  In search of illumination invariants , 2001, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[17]  François X. Sillion,et al.  Fast calculation of soft shadow textures using convolution , 1998, SIGGRAPH.

[18]  F. Durand,et al.  A frequency analysis of light transport , 2005, ACM Trans. Graph..

[19]  Szymon Rusinkiewicz,et al.  Estimating curvatures and their derivatives on triangle meshes , 2004, Proceedings. 2nd International Symposium on 3D Data Processing, Visualization and Transmission, 2004. 3DPVT 2004..

[20]  Paul S. Heckbert,et al.  Irradiance gradients , 2008, SIGGRAPH '08.

[21]  Ren Ng Fourier slice photography , 2005, ACM Trans. Graph..

[22]  Frédo Durand,et al.  A frequency analysis of light transport , 2005, SIGGRAPH '05.

[23]  James Arvo,et al.  The irradiance Jacobian for partially occluded polyhedral sources , 1994, SIGGRAPH.

[24]  Harry Shum,et al.  Plenoptic sampling , 2000, SIGGRAPH.

[25]  Pat Hanrahan,et al.  Triple product wavelet integrals for all-frequency relighting , 2004, ACM Trans. Graph..

[26]  Donald P. Greenberg,et al.  Combining edges and points for interactive high-quality rendering , 2003, ACM Trans. Graph..

[27]  Pat Hanrahan,et al.  Shadow silhouette maps , 2003, ACM Trans. Graph..

[28]  Pat Hanrahan,et al.  A signal-processing framework for reflection , 2004, ACM Trans. Graph..

[29]  Min Chen,et al.  Theory and application of specular path perturbation , 2000, TOGS.

[30]  Tomas Akenine-Möller,et al.  Wavelet importance sampling: efficiently evaluating products of complex functions , 2005, ACM Trans. Graph..

[31]  François X. Sillion,et al.  An Exhaustive Error‐Bounding Algorithm for Hierarchical Radiosity , 1998, Comput. Graph. Forum.

[32]  Ronen Basri,et al.  Lambertian reflectance and linear subspaces , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[33]  S. Rusinkiewicz Estimating curvatures and their derivatives on triangle meshes , 2004 .

[34]  Hans-Peter Seidel,et al.  Spherical harmonic gradients for mid-range illumination , 2004 .