Analytic spherical harmonic gradients for real-time rendering with many polygonal area lights

Recent work has developed analytic formulae for spherical harmonic (SH) coefficients from uniform polygonal lights, enabling near-field area lights to be included in Precomputed Radiance Transfer (PRT) systems, and in offline rendering. However, the method is inefficient since coefficients need to be recomputed at each vertex or shading point, for each light, even though the SH coefficients vary smoothly in space. The complexity scales linearly with the number of lights, making many-light rendering difficult. In this paper, we develop a novel analytic formula for the spatial gradients of the spherical harmonic coefficients for uniform polygonal area lights. The result is a significant generalization, involving the Reynolds transport theorem to reduce the problem to a boundary integral for which we derive a new analytic formula, showing how to reduce a key term to an earlier recurrence for SH coefficients. The implementation requires only minor additions to existing code for SH coefficients. The results also hold implications for recent efforts on differentiable rendering. We show that SH gradients enable very sparse spatial sampling, followed by accurate Hermite interpolation. This enables scaling PRT to hundreds of area lights with minimal overhead and real-time frame rates. Moreover, the SH gradient formula is a new mathematical result that potentially enables many other graphics applications.

[1]  J. Zára,et al.  Making radiance and irradiance caching practical: adaptive caching and neighbor clamping , 2006, EGSR '06.

[2]  Jaakko Lehtinen,et al.  Anisotropic Gaussian mutations for metropolis light transport through Hessian-Hamiltonian dynamics , 2015, ACM Trans. Graph..

[3]  Min Chen,et al.  A Closed-Form Solution for the Irradiance due to Linearly-Varying Luminaires , 2000, Rendering Techniques.

[4]  Okan Arikan,et al.  LECTURERS , 1948, Statistics for Astrophysics.

[5]  Gregory J. Ward,et al.  A ray tracing solution for diffuse interreflection , 2008, SIGGRAPH '08.

[6]  Sumanta N. Pattanaik,et al.  Radiance caching for efficient global illumination computation , 2008, IEEE Transactions on Visualization and Computer Graphics.

[7]  Jaakko Lehtinen,et al.  A framework for precomputed and captured light transport , 2007, TOGS.

[8]  Jan Kautz,et al.  Precomputed radiance transfer for real-time rendering in dynamic, low-frequency lighting environments , 2002 .

[9]  Wenzel Jakob,et al.  Reparameterizing discontinuous integrands for differentiable rendering , 2019, ACM Trans. Graph..

[10]  Hans-Peter Seidel,et al.  Spherical harmonic gradients for mid-range illumination , 2004 .

[11]  Pat Hanrahan,et al.  All-frequency shadows using non-linear wavelet lighting approximation , 2003, ACM Trans. Graph..

[12]  Jean-Eudes Marvie,et al.  Analytic Approximations for Real-Time Area Light Shading , 2017, IEEE Transactions on Visualization and Computer Graphics.

[13]  Leif Kobbelt,et al.  Theory, analysis and applications of 2D global illumination , 2012, TOGS.

[14]  Derek Nowrouzezahrai,et al.  Sparse zonal harmonic factorization for efficient SH rotation , 2012, TOGS.

[15]  L. G. Leal,et al.  Advanced Transport Phenomena: Fluid Mechanics and Convective Transport Processes , 2007 .

[16]  Kun Zhou,et al.  Real-time soft shadows in dynamic scenes using spherical harmonic exponentiation , 2006, ACM Trans. Graph..

[17]  Min Chen,et al.  Simulating Non-Lambertian Phenomena Involving Linearly-Varying Luminaires , 2001, Rendering Techniques.

[18]  François X. Sillion,et al.  An Exhaustive Error‐Bounding Algorithm for Hierarchical Radiosity , 1998, Comput. Graph. Forum.

[19]  Diego Gutierrez,et al.  Second-Order Occlusion-Aware Volumetric Radiance Caching , 2018, ACM Trans. Graph..

[20]  John Snyder Area Light Sources for Real-Time Graphics , 1996 .

[21]  Matthias Zwicker,et al.  Irradiance Gradients in the Presence of Participating Media and Occlusions , 2008, Comput. Graph. Forum.

[22]  James Arvo,et al.  The irradiance Jacobian for partially occluded polyhedral sources , 1994, SIGGRAPH.

[23]  Pat Hanrahan,et al.  Triple product wavelet integrals for all-frequency relighting , 2004, ACM Trans. Graph..

[24]  DurandFrédo,et al.  Differentiable Monte Carlo ray tracing through edge sampling , 2018 .

[25]  Ravi Ramamoorthi,et al.  A first-order analysis of lighting, shading, and shadows , 2007, TOGS.

[26]  Donald P. Greenberg,et al.  The Irradiance Volume , 1998, IEEE Computer Graphics and Applications.

[27]  François X. Sillion,et al.  Accurate Computation of the Radiosity Gradient for Constant and Linear Emitters , 1995, Rendering Techniques.

[28]  Jingwen Wang,et al.  Analytic spherical harmonic coefficients for polygonal area lights , 2018, ACM Trans. Graph..

[29]  Ravi Ramamoorthi,et al.  A differential theory of radiative transfer , 2019, ACM Trans. Graph..

[30]  Peter-Pike J. Sloan,et al.  Irradiance rigs , 2010, SIGGRAPH '10.

[31]  Paul S. Heckbert,et al.  Irradiance gradients , 2008, SIGGRAPH '08.

[32]  Kun Zhou,et al.  Precomputed shadow fields for dynamic scenes , 2005, ACM Trans. Graph..

[33]  Matthias Zwicker,et al.  Radiance caching for participating media , 2008, TOGS.

[34]  Sumanta N. Pattanaik,et al.  Improved radiance gradient computation , 2005, SCCG '05.

[35]  L. M. M.-T. Spherical Harmonics: an Elementary Treatise on Harmonic Functions, with Applications , 1928, Nature.

[36]  Bo Sun,et al.  Affine double- and triple-product wavelet integrals for rendering , 2009, TOGS.

[37]  CabralBrian,et al.  Bidirectional reflection functions from surface bump maps , 1987 .

[38]  Timo Aila,et al.  PantaRay: fast ray-traced occlusion caching of massive scenes , 2010, ACM Trans. Graph..

[39]  Nelson L. Max,et al.  Bidirectional reflection functions from surface bump maps , 1987, SIGGRAPH.

[40]  Charles Van Loan,et al.  Introduction to Scientific Computing: A Matrix-Vector Approach Using MATLAB , 1996 .

[41]  T. MacRobert Spherical harmonics : an elementary treatise on harmonic functions , 1927 .

[42]  Eric Heitz,et al.  Real-time polygonal-light shading with linearly transformed cosines , 2016, ACM Trans. Graph..

[43]  Mark Meyer,et al.  Integrating Clipped Spherical Harmonics Expansions , 2018, ACM Trans. Graph..

[44]  James Arvo,et al.  Applications of irradiance tensors to the simulation of non-Lambertian phenomena , 1995, SIGGRAPH.

[45]  Henrik Wann Jensen,et al.  Practical Hessian-based error control for irradiance caching , 2012, ACM Trans. Graph..