Fast and accurate spherical harmonics products

Spherical Harmonics (SH) have been proven as a powerful tool for rendering, especially in real-time applications such as Precomputed Radiance Transfer (PRT). Spherical harmonics are orthonormal basis functions and are efficient in computing dot products. However, computations of triple product and multiple product operations are often the bottlenecks that prevent moderately high-frequency use of spherical harmonics. Specifically state-of-the-art methods for accurate SH triple products of order n have a time complexity of O(n5), which is a heavy burden for most real-time applications. Even worse, a brute-force way to compute k-multiple products would take O(n2k) time. In this paper, we propose a fast and accurate method for spherical harmonics triple products with the time complexity of only O(n3), and further extend it for computing k-multiple products with the time complexity of O(kn3 + k2n2 log(kn)). Our key insight is to conduct the triple and multiple products in the Fourier space, in which the multiplications can be performed much more efficiently. To our knowledge, our method is theoretically the fastest for accurate spherical harmonics triple and multiple products. And in practice, we demonstrate the efficiency of our method in rendering applications including mid-frequency relighting and shadow fields.

[1]  What is a Constructive Theory ? , 2010 .

[2]  Nathanaël Schaeffer,et al.  Efficient spherical harmonic transforms aimed at pseudospectral numerical simulations , 2012, ArXiv.

[3]  Pratul P. Srinivasan,et al.  NeRF , 2020, ECCV.

[4]  Jaakko Lehtinen,et al.  Precomputed radiance transfer: theory and practice , 2005, SIGGRAPH Courses.

[5]  Timo Aila,et al.  PantaRay: fast ray-traced occlusion caching of massive scenes , 2010, ACM Trans. Graph..

[6]  Peter-Pike J. Sloan,et al.  Local, deformable precomputed radiance transfer , 2005, SIGGRAPH 2005.

[7]  Kun Zhou,et al.  Real-time soft shadows in dynamic scenes using spherical harmonic exponentiation , 2006, ACM Trans. Graph..

[8]  Teemu Mäki-Patola,et al.  Precomputed Radiance Transfer , 2003 .

[9]  Yu-Ting Tsai,et al.  All-frequency precomputed radiance transfer using spherical radial basis functions and clustered tensor approximation , 2006, ACM Trans. Graph..

[10]  Yusuke Tokuyoshi,et al.  Real-time rendering of layered materials with anisotropic normal distributions , 2020, Computational Visual Media.

[11]  M. Potters,et al.  Table of Fourier coefficients of associated Legendre functions : repr. from Proceedings of the KNAW, ser. A 63(1960)5, pp. 460-480 , 1960 .

[12]  Baining Guo,et al.  All-frequency rendering of dynamic, spatially-varying reflectance , 2009, ACM Trans. Graph..

[13]  Yusuke Tokuyoshi,et al.  Real-time rendering of layered materials with anisotropic normal distributions , 2019, Computational Visual Media.

[14]  Timo Aila,et al.  PantaRay: fast ray-traced occlusion caching of massive scenes , 2010, SIGGRAPH 2010.

[15]  John M. Snyder,et al.  All-frequency rendering of dynamic, spatially-varying reflectance , 2009, SIGGRAPH 2009.

[16]  Jaakko Lehtinen,et al.  A framework for precomputed and captured light transport , 2007, TOGS.

[17]  Peter D. Welch,et al.  The Fast Fourier Transform and Its Applications , 1969 .

[18]  Pat Hanrahan,et al.  All-frequency shadows using non-linear wavelet lighting approximation , 2003, ACM Trans. Graph..

[19]  Justus Thies,et al.  Deferred Neural Rendering: Image Synthesis using Neural Textures , 2019 .

[20]  Bo Ren,et al.  Interactive hair rendering and appearance editing under environment lighting , 2011, ACM Trans. Graph..

[21]  Jan Kautz,et al.  Precomputed radiance transfer for real-time rendering in dynamic, low-frequency lighting environments , 2002 .

[22]  N. Sneeuw,et al.  Global spherical harmonic computation by two-dimensional Fourier methods , 1996 .

[23]  Peter-Pike J. Sloan,et al.  Local, deformable precomputed radiance transfer , 2005, ACM Trans. Graph..

[24]  Derek Nowrouzezahrai,et al.  Sparse zonal harmonic factorization for efficient SH rotation , 2012, TOGS.

[25]  Amitabh Varshney,et al.  Real-time rendering of translucent meshes , 2004, TOGS.

[26]  Bo Sun,et al.  Affine double- and triple-product wavelet integrals for rendering , 2009, TOGS.

[27]  Rui Wang,et al.  Accurate Translucent Material Rendering under Spherical Gaussian Lights , 2012, Comput. Graph. Forum.

[28]  Harry Shum,et al.  Bi-scale radiance transfer , 2003, ACM Trans. Graph..

[29]  Jingwen Wang,et al.  Analytic spherical harmonic coefficients for polygonal area lights , 2018, ACM Trans. Graph..

[30]  Weifeng Sun,et al.  Generalized wavelet product integral for rendering dynamic glossy objects , 2006, SIGGRAPH '06.

[31]  Pat Hanrahan,et al.  An efficient representation for irradiance environment maps , 2001, SIGGRAPH.

[32]  Max Welling,et al.  Spherical CNNs , 2018, ICLR.

[33]  John Snyder,et al.  Code Generation and Factoring for Fast Evaluation of Low-order Spherical Harmonic Products and Squares , 2006 .

[34]  Jaakko Lehtinen,et al.  Matrix radiance transfer , 2003, I3D '03.

[35]  Ravi Ramamoorthi,et al.  Analytic spherical harmonic gradients for real-time rendering with many polygonal area lights , 2020, ACM Trans. Graph..

[36]  Jan Kautz,et al.  Fast Arbitrary BRDF Shading for Low-Frequency Lighting Using Spherical Harmonics , 2002, Rendering Techniques.

[37]  Pat Hanrahan,et al.  Triple product wavelet integrals for all-frequency relighting , 2004, ACM Trans. Graph..

[38]  Kostas Daniilidis,et al.  Learning SO(3) Equivariant Representations with Spherical CNNs , 2017, International Journal of Computer Vision.

[39]  Peter-Pike J. Sloan,et al.  Clustered principal components for precomputed radiance transfer , 2003, ACM Trans. Graph..

[40]  Maks Ovsjanikov,et al.  Effective Rotation-Invariant Point CNN with Spherical Harmonics Kernels , 2019, 2019 International Conference on 3D Vision (3DV).

[41]  Yue Gao,et al.  Real‐time homogenous translucent material editing , 2007, Comput. Graph. Forum.

[42]  Shi-Min Hu,et al.  Anisotropic spherical Gaussians , 2013, ACM Trans. Graph..

[43]  Justus Thies,et al.  Deferred neural rendering , 2019, ACM Trans. Graph..

[44]  Mathieu Desbrun,et al.  A constructive theory of sampling for image synthesis using reproducing Kernel bases , 2014, ACM Trans. Graph..

[45]  Harry Shum,et al.  Eurographics Symposium on Rendering (2004) All-frequency Precomputed Radiance Transfer for Glossy Objects , 2022 .

[46]  Kun Zhou,et al.  Precomputed shadow fields for dynamic scenes , 2005, ACM Trans. Graph..

[47]  Jonathan T. Barron,et al.  NeRF: representing scenes as neural radiance fields for view synthesis , 2022, Commun. ACM.