Fast, realistic lighting and material design using nonlinear cut approximation

We present an efficient computational algorithm for functions represented by a nonlinear piecewise constant approximation called cuts. Our main contribution is a single traversal algorithm for merging cuts that allows for arbitrary pointwise computation, such as addition, multiplication, linear interpolation, and multi-product integration. A theoretical error bound of this approach can be proved using a statistical interpretation of cuts. Our algorithm extends naturally to computation with many cuts and maps easily to modern GPUs, leading to significant advantages over existing methods based on wavelet approximation. We apply this technique to the problem of realistic lighting and material design under complex illumination with arbitrary BRDFs. Our system smoothly integrates all-frequency relighting of shadows and reflections with dynamic per-pixel shading effects, such as bump mapping and spatially varying BRDFs. This combination of capabilities is typically missing in current systems. We represent illumination and precomputed visibility as nonlinear sparse vectors; we then use our cut merging algorithm to simultaneously interpolate visibility cuts at each pixel, and compute the triple product integral of the illumination, interpolated visibility, and dynamic BRDF samples. Finally, we present a two-pass, data-driven approach that exploits pilot visibility samples to optimize the construction of the light tree, leading to more efficient cuts and reduced datasets.

[1]  A. Goldberger,et al.  On the Exact Covariance of Products of Random Variables , 1969 .

[2]  Gregory J. Ward,et al.  Adaptive Shadow Testing for Ray Tracing , 1994 .

[3]  Peter Shirley,et al.  Monte Carlo techniques for direct lighting calculations , 1996, TOGS.

[4]  Marc Olano,et al.  Reflection space image based rendering , 1999, SIGGRAPH.

[5]  Jan Kautz,et al.  Precomputed radiance transfer for real-time rendering in dynamic, low-frequency lighting environments , 2002 .

[6]  Pat Hanrahan,et al.  Frequency space environment map rendering , 2002, SIGGRAPH.

[7]  Jan Kautz,et al.  Fast Arbitrary BRDF Shading for Low-Frequency Lighting Using Spherical Harmonics , 2002, Rendering Techniques.

[8]  Serge J. Belongie,et al.  Structured importance sampling of environment maps , 2003, ACM Trans. Graph..

[9]  Jaakko Lehtinen,et al.  Matrix radiance transfer , 2003, I3D '03.

[10]  Pat Hanrahan,et al.  All-frequency shadows using non-linear wavelet lighting approximation , 2003, ACM Trans. Graph..

[11]  Harry Shum,et al.  Bi-scale radiance transfer , 2003, ACM Trans. Graph..

[12]  Hans-Peter Seidel,et al.  Spherical harmonic gradients for mid-range illumination , 2004 .

[13]  P. Hanrahan,et al.  Triple product wavelet integrals for all-frequency relighting , 2004, SIGGRAPH 2004.

[14]  R. Ramamoorthi,et al.  Efficient BRDF importance sampling using a factored representation , 2004, ACM Trans. Graph..

[15]  Rui Wang,et al.  Eurographics Symposium on Rendering (2004) All-frequency Relighting of Non-diffuse Objects Using Separable Brdf Approximation , 2022 .

[16]  Harry Shum,et al.  Eurographics Symposium on Rendering (2004) All-frequency Precomputed Radiance Transfer for Glossy Objects , 2022 .

[17]  K. Bala,et al.  Lightcuts: a scalable approach to illumination , 2005, SIGGRAPH 2005.

[18]  Sumanta N. Pattanaik,et al.  Real-Time Global Illumination on GPUs , 2005, J. Graph. Tools.

[19]  H. Jensen,et al.  Wavelet importance sampling: efficiently evaluating products of complex functions , 2005, SIGGRAPH 2005.

[20]  Sumanta N. Pattanaik,et al.  Radiance cache splatting: a GPU-friendly global illumination algorithm , 2005, EGSR '05.

[21]  Kun Zhou,et al.  Precomputed shadow fields for dynamic scenes , 2005, SIGGRAPH 2005.

[22]  Weifeng Sun,et al.  Generalized wavelet product integral for rendering dynamic glossy objects , 2006, SIGGRAPH 2006.

[23]  Ravi Ramamoorthi,et al.  Real-time BRDF editing in complex lighting , 2006, SIGGRAPH 2006.

[24]  Sumanta N. Pattanaik,et al.  BRDF-Shop: creating physically correct bidirectional reflectance distribution functions , 2006, IEEE Computer Graphics and Applications.

[25]  K. Bala,et al.  Multidimensional lightcuts , 2006, SIGGRAPH 2006.

[26]  Paul E. Debevec,et al.  A median cut algorithm for light probe sampling , 2005, SIGGRAPH Courses.

[27]  Miloš Hašan,et al.  Direct-to-indirect transfer for cinematic relighting , 2006, SIGGRAPH 2006.

[28]  Frédo Durand,et al.  Interactive editing and modeling of bidirectional texture functions , 2007, SIGGRAPH 2007.

[29]  Jaakko Lehtinen,et al.  A framework for precomputed and captured light transport , 2007, TOGS.

[30]  Jan Kautz,et al.  Interactive Illumination with Coherent Shadow Maps , 2007, Rendering Techniques.

[31]  K. Bala,et al.  Matrix row-column sampling for the many-light problem , 2007, ACM Trans. Graph..

[32]  Jaakko Lehtinen,et al.  Incremental Instant Radiosity for Real-Time Indirect Illumination , 2007, Rendering Techniques.

[33]  Frédo Durand,et al.  Implicit visibility and antiradiance for interactive global illumination , 2007, SIGGRAPH 2007.

[34]  Rui Wang,et al.  Precomputed Visibility Cuts for Interactive Relighting with Dynamic BRDFs , 2007 .

[35]  Kun Zhou,et al.  Interactive relighting with dynamic BRDFs , 2007, SIGGRAPH 2007.

[36]  Frédo Durand,et al.  A precomputed polynomial representation for interactive BRDF editing with global illumination , 2008, TOGS.

[37]  Adam Arbree,et al.  Single‐pass Scalable Subsurface Rendering with Lightcuts , 2008, Comput. Graph. Forum.