Sparsely Precomputing The Light Transport Matrix for Real‐Time Rendering

Precomputation‐based methods have enabled real‐time rendering with natural illumination, all‐frequency shadows, and global illumination. However, a major bottleneck is the precomputation time, that can take hours to days. While the final real‐time data structures are typically heavily compressed with clustered principal component analysis and/or wavelets, a full light transport matrix still needs to be precomputed for a synthetic scene, often by exhaustive sampling and raytracing. This is expensive and makes rapid prototyping of new scenes prohibitive. In this paper, we show that the precomputation can be made much more efficient by adaptive and sparse sampling of light transport. We first select a small subset of “dense vertices”, where we sample the angular dimensions more completely (but still adaptively). The remaining “sparse vertices” require only a few angular samples, isolating features of the light transport. They can then be interpolated from nearby dense vertices using locally low rank approximations. We demonstrate sparse sampling and precomputation 5 × faster than previous methods.

[1]  Rui Wang,et al.  All-frequency relighting of glossy objects , 2006, TOGS.

[2]  Rui Wang,et al.  Eurographics Symposium on Rendering (2004) All-frequency Relighting of Non-diffuse Objects Using Separable Brdf Approximation , 2022 .

[3]  Julie Dorsey,et al.  Effic ient Re-rendering of Naturally Illuminated Environments , 1994 .

[4]  Ravi Ramamoorthi,et al.  A theory of locally low dimensional light transport , 2007, SIGGRAPH 2007.

[5]  Jaakko Lehtinen,et al.  A meshless hierarchical representation for light transport , 2008, ACM Trans. Graph..

[6]  James Arvo,et al.  Interactive design of complex time dependent lighting , 1995, IEEE Computer Graphics and Applications.

[7]  Janne Kontkanen,et al.  Wavelet radiance transport for interactive indirect lighting , 2006, EGSR '06.

[8]  Stephen P. Boyd,et al.  An Interior-Point Method for Large-Scale $\ell_1$-Regularized Least Squares , 2007, IEEE Journal of Selected Topics in Signal Processing.

[9]  Emmanuel J. Candès,et al.  Near-Optimal Signal Recovery From Random Projections: Universal Encoding Strategies? , 2004, IEEE Transactions on Information Theory.

[10]  Maneesh Agrawala,et al.  Efficient Shadows for Sampled Environment Maps , 2006, J. Graph. Tools.

[11]  Okan Arikan,et al.  LECTURERS , 1948, Statistics for Astrophysics.

[12]  Jan Kautz,et al.  Precomputed radiance transfer for real-time rendering in dynamic, low-frequency lighting environments , 2002 .

[13]  Kavita Bala,et al.  Direct-to-indirect transfer for cinematic relighting , 2006, ACM Trans. Graph..

[14]  Jirí Zára,et al.  Adaptive mesh subdivision for precomputed radiance transfer , 2004, SCCG '04.

[15]  Harry Shum,et al.  Eurographics Symposium on Rendering (2004) All-frequency Precomputed Radiance Transfer for Glossy Objects , 2022 .

[16]  Ira Kemelmacher-Shlizerman,et al.  A theory of locally low dimensional light transport , 2007, ACM Trans. Graph..

[17]  K. Bala,et al.  Matrix row-column sampling for the many-light problem , 2007, ACM Trans. Graph..

[18]  Pat Hanrahan,et al.  All-frequency shadows using non-linear wavelet lighting approximation , 2003, ACM Trans. Graph..

[19]  Peter-Pike J. Sloan,et al.  Clustered principal components for precomputed radiance transfer , 2003, ACM Trans. Graph..

[20]  Sunil Arya,et al.  An optimal algorithm for approximate nearest neighbor searching fixed dimensions , 1998, JACM.

[21]  E. Candès,et al.  Stable signal recovery from incomplete and inaccurate measurements , 2005, math/0503066.

[22]  Eitan Grinspun,et al.  Exploiting temporal coherence for incremental all-frequency relighting , 2006, EGSR '06.

[23]  Jaroslav Kriv,et al.  Adaptive Mesh Subdivision for Precomputed Radiance Transfer , 2004 .

[24]  Kavita Bala,et al.  Matrix row-column sampling for the many-light problem , 2007, ACM Trans. Graph..

[25]  Soheil Darabi,et al.  Compressive Dual Photography , 2009, Comput. Graph. Forum.

[26]  S. Muthukrishnan,et al.  Relative-Error CUR Matrix Decompositions , 2007, SIAM J. Matrix Anal. Appl..

[27]  Zhouchen Lin,et al.  Kernel Nyström method for light transport , 2009, ACM Trans. Graph..

[28]  Pat Hanrahan,et al.  Triple product wavelet integrals for all-frequency relighting , 2004, ACM Trans. Graph..

[29]  Baining Guo,et al.  Progressive radiance evaluation using directional coherence maps , 1998, SIGGRAPH.

[30]  Ravi Ramamoorthi,et al.  An Analysis of the In‐Out BRDF Factorization for View‐Dependent Relighting , 2008, Comput. Graph. Forum.

[31]  P. Hanrahan,et al.  Triple product wavelet integrals for all-frequency relighting , 2004, SIGGRAPH 2004.

[32]  Pieter Peers,et al.  Compressive light transport sensing , 2009, ACM Trans. Graph..

[33]  David A. Forsyth,et al.  Generalizing motion edits with Gaussian processes , 2009, ACM Trans. Graph..

[34]  Miloš Hašan,et al.  Direct-to-indirect transfer for cinematic relighting , 2006, SIGGRAPH 2006.

[35]  Jaroslav Krivánek,et al.  Practical Global Illumination with Irradiance Caching , 2009, Practical Global Illumination with Irradiance Caching.