Noise-resistant fitting for spherical harmonics

Spherical harmonic (SH) basis functions have been widely used for representing spherical functions in modeling various illumination properties. They can compactly represent low-frequency spherical functions. However, when the unconstrained least square method is used for estimating the SH coefficients of a hemispherical function, the magnitude of these SH coefficients could be very large. Hence, the rendering result is very sensitive to quantization noise (introduced by modern texture compression like S3TC, IEEE half float data type on GPU, or other lossy compression methods) in these SH coefficients. Our experiments show that, as the precision of SH coefficients are reduced, the rendered images may exhibit annoying visual artifacts. To reduce the noise sensitivity of the SH coefficients, this paper first discusses how the magnitude of SH coefficients affects the rendering result when there is quantization noise. Then, two fast fitting methods for estimating the noise-resistant SH coefficients are proposed. They can effectively control the magnitude of the estimated SH coefficients and, hence, suppress the rendering artifacts. Both statistical and visual results confirm our theory.

[1]  Jan Kautz,et al.  Fast Arbitrary BRDF Shading for Low-Frequency Lighting Using Spherical Harmonics , 2002, Rendering Techniques.

[2]  Peter No,et al.  Digital Coding of Waveforms , 1986 .

[3]  Pat Hanrahan,et al.  Frequency space environment map rendering , 2002, SIGGRAPH.

[4]  Ravi Ramamoorthi,et al.  Analytic PCA Construction for Theoretical Analysis of Lighting Variability in Images of a Lambertian Object , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Steve Marschner,et al.  Image-Based BRDF Measurement Including Human Skin , 1999, Rendering Techniques.

[6]  Michael W. Marcellin,et al.  Comparison of different methods of classification in subband coding of images , 1997, IEEE Trans. Image Process..

[7]  Tomas Akenine-Möller,et al.  Real-time rendering , 1997 .

[8]  Chi-Wing Fu,et al.  Interactive Relighting of Panoramas , 2001, IEEE Computer Graphics and Applications.

[9]  Andrew Chi-Sing Leung,et al.  Two regularizers for recursive least squared algorithms in feedforward multilayered neural networks , 2001, IEEE Trans. Neural Networks.

[10]  Peter-Pike J. Sloan,et al.  Clustered principal components for precomputed radiance transfer , 2003, ACM Trans. Graph..

[11]  William A. Pearlman,et al.  A new, fast, and efficient image codec based on set partitioning in hierarchical trees , 1996, IEEE Trans. Circuits Syst. Video Technol..

[12]  Jerome M. Shapiro,et al.  Embedded image coding using zerotrees of wavelet coefficients , 1993, IEEE Trans. Signal Process..

[13]  Sumanta N. Pattanaik,et al.  Eurographics Symposium on Rendering (2004) a Novel Hemispherical Basis for Accurate and Efficient Rendering , 2022 .

[14]  Stephen H. Westin,et al.  A global illumination solution for general reflectance distributions , 1991, SIGGRAPH.

[15]  Ravi Ramamoorthi ravir Analytic PCA construction for theoretical analysis of lighting variability , including attached shadows , in a single image of a convex Lambertian object , 2001 .

[16]  L. M. M.-T. Spherical Harmonics: an Elementary Treatise on Harmonic Functions, with Applications , 1928, Nature.

[17]  Dipl.-Ing,et al.  Real-time Rendering , 2022 .

[18]  J. F. Murray-Coleman,et al.  The Automated Measurement of BRDFs and their Application to Luminaire Modeling , 1990 .

[19]  Dr. M. G. Worster Methods of Mathematical Physics , 1947, Nature.

[20]  Stephen H. Westin,et al.  Predicting reflectance functions from complex surfaces , 1992, SIGGRAPH.

[21]  S. Haykin,et al.  Adaptive Filter Theory , 1986 .

[22]  David Salesin,et al.  Global illumination of glossy environments using wavelets and importance , 1996, TOGS.

[23]  K. Evans The Spherical Harmonics Discrete Ordinate Method for Three-Dimensional Atmospheric Radiative Transfer , 1998 .

[24]  K. H. Barratt Digital Coding of Waveforms , 1985 .

[25]  Allen Gersho,et al.  Vector quantization and signal compression , 1991, The Kluwer international series in engineering and computer science.

[26]  Steven J. Gortler,et al.  Geometry images , 2002, SIGGRAPH.

[27]  James T. Kajiya,et al.  The rendering equation , 1998 .

[28]  Andrew Chi-Sing Leung,et al.  The plenoptic illumination function , 2002, IEEE Trans. Multim..

[29]  Jan Kautz,et al.  Precomputed radiance transfer for real-time rendering in dynamic, low-frequency lighting environments , 2002 .

[30]  Tien-Tsin Wong,et al.  Image-based Rendering with Controllable Illumination , 1997, Rendering Techniques.

[31]  Nelson L. Max,et al.  Bidirectional reflection functions from surface bump maps , 1987, SIGGRAPH.

[32]  Andrew Chi-Sing Leung,et al.  Compressing the illumination-adjustable images with principal component analysis , 2005, IEEE Trans. Circuits Syst. Video Technol..

[33]  Harry Shum,et al.  Bi-scale radiance transfer , 2003, ACM Trans. Graph..

[34]  Krzysztof M. Gorski On determining the spectrum of primordial inhomogeneity from the COBE DMR sky maps: Method , 1994 .

[35]  Bryan Usevitch,et al.  A tutorial on modern lossy wavelet image compression: foundations of JPEG 2000 , 2001, IEEE Signal Process. Mag..

[36]  Andrew Chi-Sing Leung,et al.  Compression of illumination-adjustable images , 2003, IEEE Trans. Circuits Syst. Video Technol..

[37]  David Salesin,et al.  Interactive multiresolution surface viewing , 1996, SIGGRAPH.