Geometry Independent Surface Light Fields for Real Time Rendering of Precomputed Global Illumination

We present a framework for generating, compressing and rendering of Surface Light Field (SLF) data. Our method is based on radiance data generated using physically based rendering methods. Thus the SLF data is generated directly instead of re-sampling digital photographs. Our SLF representation decouples spatial resolution from geometric complexity. We achieve this by uniform sampling of spatial dimension of the SLF function. For compression, we use Clustered Principal Component Analysis (CPCA). The SLF matrix is first clustered to low frequency groups of points across all directions. Then we apply PCA to each cluster. The clustering ensures that the withincluster frequency of data is low, allowing for projection using a few principal components. Finally we reconstruct the CPCA encoded data using an efficient rendering algorithm. Our reconstruction technique ensures seamless reconstruction of discrete SLF data. We applied our rendering method for fast, high quality off-line rendering and real-time illumination of static scenes. The proposed framework is not limited to complexity of materials or light sources, enabling us to render high quality images describing the full global illumination in a scene.

[1]  Yin Baocai,et al.  Non-uniform light field compression: a geometry-based method for image processing , 2003, International Conference on Neural Networks and Signal Processing, 2003. Proceedings of the 2003.

[2]  Gavin S. P. Miller,et al.  Lazy Decompression of Surface Light Fields for Precomputed Global Illumination , 1998, Rendering Techniques.

[3]  Michael Elad,et al.  Compression of facial images using the K-SVD algorithm , 2008, J. Vis. Commun. Image Represent..

[4]  Tomas Akenine-Möller,et al.  Precomputed local radiance transfer for real-time lighting design , 2005, SIGGRAPH 2005.

[5]  Ira Kemelmacher-Shlizerman,et al.  A theory of locally low dimensional light transport , 2007, ACM Trans. Graph..

[6]  David Salesin,et al.  Surface light fields for 3D photography , 2000, SIGGRAPH.

[7]  Jaakko Lehtinen,et al.  Precomputed radiance transfer: theory and practice , 2005, SIGGRAPH Courses.

[8]  Christopher M. Bishop,et al.  Mixtures of Probabilistic Principal Component Analyzers , 1999, Neural Computation.

[9]  Greg Humphreys,et al.  Physically Based Rendering: From Theory to Implementation , 2004 .

[10]  Reinhard Klein,et al.  BTF Compression via Sparse Tensor Decomposition , 2009, Comput. Graph. Forum.

[11]  Jean-Daniel Deschênes,et al.  A Sampling Criterion for Optimizing a Surface Light Field , 2007, Sixth International Conference on 3-D Digital Imaging and Modeling (3DIM 2007).

[12]  Yu-Ting Tsai,et al.  All-frequency precomputed radiance transfer using spherical radial basis functions and clustered tensor approximation , 2006, ACM Trans. Graph..

[13]  Wei-Chao Chen,et al.  Light field mapping: efficient representation and hardware rendering of surface light fields , 2002, SIGGRAPH.

[14]  Erik Reinhard,et al.  High Dynamic Range Imaging: Acquisition, Display, and Image-Based Lighting , 2010 .

[15]  Zen-Chung Shih,et al.  All-frequency precomputed radiance transfer using spherical radial basis functions and clustered tensor approximation , 2006, ACM Trans. Graph..

[16]  E. Adelson,et al.  The Plenoptic Function and the Elements of Early Vision , 1991 .

[17]  Nanda Kambhatla,et al.  Dimension Reduction by Local Principal Component Analysis , 1997, Neural Computation.

[18]  Peter-Pike J. Sloan,et al.  Clustered principal components for precomputed radiance transfer , 2003, ACM Trans. Graph..