Interactive relighting with dynamic BRDFs

We present a technique for interactive relighting in which source radiance, viewing direction, and BRDFs can all be changed on the fly. In handling dynamic BRDFs, our method efficiently accounts for the effects of BRDF modification on the reflectance and incident radiance at a surface point. For reflectance, we develop a BRDF tensor representation that can be factorized into adjustable terms for lighting, viewing, and BRDF parameters. For incident radiance, there exists a non-linear relationship between indirect lighting and BRDFs in a scene, which makes linear light transport frameworks such as PRT unsuitable. To overcome this problem, we introduce precomputed transfer tensors (PTTs) which decompose indirect lighting into precomputable components that are each a function of BRDFs in the scene, and can be rapidly combined at run time to correctly determine incident radiance. We additionally describe a method for efficient handling of high-frequency specular reflections by separating them from the BRDF tensor representation and processing them using precomputed visibility information. With relighting based on PTTs, interactive performance with indirect lighting is demonstrated in applications to BRDF animation and material tuning.

[1]  James F. Blinn,et al.  Models of light reflection for computer synthesized pictures , 1977, SIGGRAPH.

[2]  Yu-Ting Tsai,et al.  All-frequency precomputed radiance transfer using spherical radial basis functions and clustered tensor approximation , 2006, ACM Trans. Graph..

[3]  Pat Hanrahan,et al.  A fast relighting engine for interactive cinematic lighting design , 2000, SIGGRAPH.

[4]  P. Hanrahan,et al.  Triple product wavelet integrals for all-frequency relighting , 2004, SIGGRAPH 2004.

[5]  Peter-Pike J. Sloan,et al.  Clustered principal components for precomputed radiance transfer , 2003, ACM Trans. Graph..

[6]  Robert L. Cook,et al.  A Reflectance Model for Computer Graphics , 1987, TOGS.

[7]  M. Alex O. Vasilescu,et al.  TensorTextures: multilinear image-based rendering , 2004, SIGGRAPH 2004.

[8]  Pat Hanrahan,et al.  A hierarchical illumination algorithm for surfaces with glossy reflection , 1993, SIGGRAPH.

[9]  Wojciech Matusik,et al.  A data-driven reflectance model , 2003, ACM Trans. Graph..

[10]  James Arvo,et al.  Interactive design of complex time dependent lighting , 1995, IEEE Computer Graphics and Applications.

[11]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[12]  Ravi Ramamoorthi,et al.  Real-time BRDF editing in complex lighting , 2006, SIGGRAPH 2006.

[13]  Wojciech Matusik,et al.  Efficient Isotropic BRDF Measurement , 2003, Rendering Techniques.

[14]  Pat Hanrahan,et al.  All-frequency shadows using non-linear wavelet lighting approximation , 2003, ACM Trans. Graph..

[15]  Michael D. McCool,et al.  Homomorphic factorization of BRDFs for high-performance rendering , 2001, SIGGRAPH.

[16]  Rui Wang,et al.  Eurographics Symposium on Rendering (2004) All-frequency Relighting of Non-diffuse Objects Using Separable Brdf Approximation , 2022 .

[17]  Frédo Durand,et al.  View-dependent precomputed light transport using nonlinear Gaussian function approximations , 2006, I3D '06.

[18]  Jan Kautz,et al.  Interactive rendering with arbitrary BRDFs using separable approximations , 1999, SIGGRAPH '99.

[19]  Mark Meyer,et al.  Statistical acceleration for animated global illumination , 2006, SIGGRAPH 2006.

[20]  Miloš Hašan,et al.  Direct-to-indirect transfer for cinematic relighting , 2006, SIGGRAPH 2006.

[21]  Frédo Durand,et al.  Experimental analysis of BRDF models , 2005, EGSR '05.

[22]  Gregory J. Ward,et al.  Measuring and modeling anisotropic reflection , 1992, SIGGRAPH.

[23]  James T. Kajiya,et al.  Anisotropic reflection models , 1985, SIGGRAPH.

[24]  Peter Shirley,et al.  A microfacet-based BRDF generator , 2000, SIGGRAPH.

[25]  Arnauld Lamorlette,et al.  An approximate global illumination system for computer generated films , 2004, SIGGRAPH 2004.

[26]  Jan Kautz,et al.  Precomputed radiance transfer for real-time rendering in dynamic, low-frequency lighting environments , 2002 .

[27]  Tomas Akenine-Möller,et al.  Precomputed local radiance transfer for real-time lighting design , 2005, SIGGRAPH 2005.

[28]  Shree K. Nayar,et al.  Reflectance and texture of real-world surfaces , 1999, TOGS.

[29]  Harry Shum,et al.  Eurographics Symposium on Rendering (2004) All-frequency Precomputed Radiance Transfer for Glossy Objects , 2022 .

[30]  N. Ahuja,et al.  Out-of-core tensor approximation of multi-dimensional matrices of visual data , 2005, SIGGRAPH 2005.

[31]  Kiril Vidimce,et al.  Lpics: a hybrid hardware-accelerated relighting engine for computer cinematography , 2005, SIGGRAPH 2005.

[32]  Takafumi Saito,et al.  Comprehensible rendering of 3-D shapes , 1990, SIGGRAPH.

[33]  Shree K. Nayar,et al.  Generalization of Lambert's reflectance model , 1994, SIGGRAPH.

[34]  Rui Wang,et al.  All-frequency relighting of glossy objects , 2006, TOGS.

[35]  Joos Vandewalle,et al.  On the Best Rank-1 and Rank-(R1 , R2, ... , RN) Approximation of Higher-Order Tensors , 2000, SIAM J. Matrix Anal. Appl..

[36]  David A. Forsyth,et al.  Reflections on Shading , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[37]  James T. Kajiya,et al.  The rendering equation , 1986, SIGGRAPH.