Fast, realistic lighting and material design using nonlinear cut approximation

We present an efficient computational algorithm for functions represented by a nonlinear piecewise constant approximation called cuts. Our main contribution is a single traversal algorithm for merging cuts that allows for arbitrary pointwise computation, such as addition, multiplication, linear interpolation, and multi-product integration. A theoretical error bound of this approach can be proved using a statistical interpretation of cuts. Our algorithm extends naturally to computation with many cuts and maps easily to modern GPUs, leading to significant advantages over existing methods based on wavelet approximation. We apply this technique to the problem of realistic lighting and material design under complex illumination with arbitrary BRDFs. Our system smoothly integrates all-frequency relighting of shadows and reflections with dynamic per-pixel shading effects, such as bump mapping and spatially varying BRDFs. This combination of capabilities is typically missing in current systems. We represent illumination and precomputed visibility as nonlinear sparse vectors; we then use our cut merging algorithm to simultaneously interpolate visibility cuts at each pixel, and compute the triple product integral of the illumination, interpolated visibility, and dynamic BRDF samples. Finally, we present a two-pass, data-driven approach that exploits pilot visibility samples to optimize the construction of the light tree, leading to more efficient cuts and reduced datasets.

[1]  Frédo Durand,et al.  A precomputed polynomial representation for interactive BRDF editing with global illumination , 2008, TOGS.

[2]  Jaakko Lehtinen,et al.  A framework for precomputed and captured light transport , 2007, TOGS.

[3]  K. Bala,et al.  Lightcuts: a scalable approach to illumination , 2005, SIGGRAPH 2005.

[4]  Harry Shum,et al.  Eurographics Symposium on Rendering (2004) All-frequency Precomputed Radiance Transfer for Glossy Objects , 2022 .

[5]  Harry Shum,et al.  Bi-scale radiance transfer , 2003, ACM Trans. Graph..

[6]  Jan Kautz,et al.  Precomputed radiance transfer for real-time rendering in dynamic, low-frequency lighting environments , 2002 .

[7]  Gregory J. Ward,et al.  Adaptive Shadow Testing for Ray Tracing , 1994 .

[8]  A. Goldberger,et al.  On the Exact Covariance of Products of Random Variables , 1969 .

[9]  P. Hanrahan,et al.  Triple product wavelet integrals for all-frequency relighting , 2004, SIGGRAPH 2004.

[10]  Sumanta N. Pattanaik,et al.  Radiance cache splatting: a GPU-friendly global illumination algorithm , 2005, EGSR '05.

[11]  Rui Wang,et al.  Eurographics Symposium on Rendering (2004) All-frequency Relighting of Non-diffuse Objects Using Separable Brdf Approximation , 2022 .

[12]  Sumanta N. Pattanaik,et al.  BRDF-Shop: creating physically correct bidirectional reflectance distribution functions , 2006, IEEE Computer Graphics and Applications.

[13]  Paul E. Debevec,et al.  A median cut algorithm for light probe sampling , 2005, SIGGRAPH Courses.

[14]  Jaakko Lehtinen,et al.  Incremental Instant Radiosity for Real-Time Indirect Illumination , 2007, Rendering Techniques.

[15]  Sumanta N. Pattanaik,et al.  Real-Time Global Illumination on GPUs , 2005, J. Graph. Tools.

[16]  K. Bala,et al.  Matrix row-column sampling for the many-light problem , 2007, ACM Trans. Graph..

[17]  Rui Wang,et al.  Precomputed Visibility Cuts for Interactive Relighting with Dynamic BRDFs , 2007 .

[18]  Weifeng Sun,et al.  Generalized wavelet product integral for rendering dynamic glossy objects , 2006, SIGGRAPH 2006.

[19]  Jan Kautz,et al.  Interactive Illumination with Coherent Shadow Maps , 2007, Rendering Techniques.

[20]  Ravi Ramamoorthi,et al.  Real-time BRDF editing in complex lighting , 2006, SIGGRAPH 2006.

[21]  Hans-Peter Seidel,et al.  Spherical harmonic gradients for mid-range illumination , 2004 .

[22]  Pat Hanrahan,et al.  All-frequency shadows using non-linear wavelet lighting approximation , 2003, ACM Trans. Graph..

[23]  Szymon Rusinkiewicz,et al.  Efficient BRDF importance sampling using a factored representation , 2004, SIGGRAPH 2004.

[24]  Frédo Durand,et al.  Interactive editing and modeling of bidirectional texture functions , 2007, ACM Trans. Graph..

[25]  Serge J. Belongie,et al.  Structured importance sampling of environment maps , 2003, ACM Trans. Graph..

[26]  Jaakko Lehtinen,et al.  Matrix radiance transfer , 2003, I3D '03.

[27]  Miloš Hašan,et al.  Direct-to-indirect transfer for cinematic relighting , 2006, SIGGRAPH 2006.

[28]  Peter Shirley,et al.  Monte Carlo techniques for direct lighting calculations , 1996, TOGS.

[29]  Kun Zhou,et al.  Interactive relighting with dynamic BRDFs , 2007, SIGGRAPH 2007.

[30]  Adam Arbree,et al.  Single‐pass Scalable Subsurface Rendering with Lightcuts , 2008, Comput. Graph. Forum.

[31]  H. Jensen,et al.  Wavelet importance sampling: efficiently evaluating products of complex functions , 2005, SIGGRAPH 2005.

[32]  Frédo Durand,et al.  Implicit visibility and antiradiance for interactive global illumination , 2007, ACM Trans. Graph..

[33]  Marc Olano,et al.  Reflection space image based rendering , 1999, SIGGRAPH.

[34]  Kun Zhou,et al.  Precomputed shadow fields for dynamic scenes , 2005, SIGGRAPH 2005.

[35]  K. Bala,et al.  Multidimensional lightcuts , 2006, SIGGRAPH 2006.

[36]  Jan Kautz,et al.  Fast Arbitrary BRDF Shading for Low-Frequency Lighting Using Spherical Harmonics , 2002, Rendering Techniques.

[37]  Pat Hanrahan,et al.  Frequency space environment map rendering , 2002, SIGGRAPH.