A theory of locally low dimensional light transport

Blockwise or Clustered Principal Component Analysis (CPCA) is commonly used to achieve real-time rendering of shadows and glossy reflections with precomputed radiance transfer (PRT). The vertices or pixels are partitioned into smaller coherent regions, and light transport in each region is approximated by a locally low-dimensional subspace using PCA. Many earlier techniques such as surface light field and reflectance field compression use a similar paradigm. However, there has been no clear theoretical understanding of how light transport dimensionality increases with local patch size, nor of the optimal block size or number of clusters. In this paper, we develop a theory of locally low dimensional light transport, by using Szego's eigenvalue theorem to analytically derive the eigenvalues of the covariance matrix for canonical cases. We show mathematically that for symmetric patches of area A, the number of basis functions for glossy reflections increases linearly with A, while for simple cast shadows, it often increases as √A. These results are confirmed numerically on a number of test scenes. Next, we carry out an analysis of the cost of rendering, trading off local dimensionality and the number of patches, deriving an optimal block size. Based on this analysis, we provide useful practical insights for setting parameters in CPCA and also derive a new adaptive subdivision algorithm. Moreover, we show that rendering time scales sub-linearly with the resolution of the image, allowing for interactive all-frequency relighting of 1024 x 1024 images.

[1]  Harry Shum,et al.  Eurographics Symposium on Rendering (2004) All-frequency Precomputed Radiance Transfer for Glossy Objects , 2022 .

[2]  Marc Levoy,et al.  Symmetric photography: exploiting data-sparseness in reflectance fields , 2006, EGSR '06.

[3]  Ravi Ramamoorthi,et al.  Analytic PCA Construction for Theoretical Analysis of Lighting Variability in Images of a Lambertian Object , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Robert M. Gray,et al.  Toeplitz and Circulant Matrices: A Review , 2005, Found. Trends Commun. Inf. Theory.

[5]  Peter-Pike J. Sloan,et al.  Clustered principal components for precomputed radiance transfer , 2003, ACM Trans. Graph..

[6]  Ronen Basri,et al.  Lambertian reflectance and linear subspaces , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[7]  Jan Kautz,et al.  Precomputed radiance transfer for real-time rendering in dynamic, low-frequency lighting environments , 2002 .

[8]  David W. Jacobs,et al.  Non-negative lighting and specular object recognition , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[9]  Wei-Chao Chen,et al.  Light field mapping: efficient representation and hardware rendering of surface light fields , 2002, SIGGRAPH.

[10]  Rui Wang,et al.  All-frequency relighting of glossy objects , 2006, TOGS.

[11]  Ravi Ramamoorthi,et al.  A Fourier theory for cast shadows , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Julie Dorsey,et al.  Effic ient Re-rendering of Naturally Illuminated Environments , 1994 .

[13]  Wojciech Matusik,et al.  Inverse shade trees for non-parametric material representation and editing , 2006, SIGGRAPH 2006.

[14]  Paul A. Beardsley,et al.  Image-based 3D photography using opacity hulls , 2002, ACM Trans. Graph..

[15]  Pat Hanrahan,et al.  All-frequency shadows using non-linear wavelet lighting approximation , 2003, ACM Trans. Graph..

[16]  François X. Sillion,et al.  Fast calculation of soft shadow textures using convolution , 1998, SIGGRAPH.

[17]  Kate Okikiolu,et al.  The analogue of the strong Szegö limit theorem on the 2- and 3-dimensional spheres , 1996 .

[18]  James Arvo,et al.  Interactive design of complex time dependent lighting , 1995, IEEE Computer Graphics and Applications.

[19]  Katsushi Ikeuchi,et al.  Eigen-Texture Method: Appearance Compression and Synthesis Based on a 3D Model , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  Shree K. Nayar,et al.  Lighting sensitive display , 2004, ACM Trans. Graph..

[21]  F. Durand,et al.  A frequency analysis of light transport , 2005, ACM Trans. Graph..

[22]  U. Grenander,et al.  Toeplitz Forms And Their Applications , 1958 .

[23]  Pat Hanrahan,et al.  A signal-processing framework for reflection , 2004, ACM Trans. Graph..

[24]  Shree K. Nayar,et al.  Clustered blockwise PCA for representing visual data , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.