Real-time BRDF editing in complex lighting

Current systems for editing BRDFs typically allow users to adjust analytic parameters while visualizing the results in a simplified setting (e.g. unshadowed point light). This paper describes a real-time rendering system that enables interactive edits of BRDFs, as rendered in their final placement on objects in a static scene, lit by direct, complex illumination. All-frequency effects (ranging from near-mirror reflections and hard shadows to diffuse shading and soft shadows) are rendered using a precomputation-based approach. Inspired by real-time relighting methods, we create a linear system that fixes lighting and view to allow real-time BRDF manipulation. In order to linearize the image's response to BRDF parameters, we develop an intermediate curve-based representation, which also reduces the rendering and precomputation operations to 1D while maintaining accuracy for a very general class of BRDFs. Our system can be used to edit complex analytic BRDFs (including anisotropic models), as well as measured reflectance data. We improve on the standard precomputed radiance transfer (PRT) rendering computation by introducing an incremental rendering algorithm that takes advantage of frame-to-frame coherence. We show that it is possible to render reference-quality images while only updating 10% of the data at each frame, sustaining frame-rates of 25-30fps.

[1]  J. Beard,et al.  Bidirectional Reflectance Model Validation and Utilization. , 1973 .

[2]  Bui Tuong Phong Illumination for computer generated pictures , 1975, Commun. ACM.

[3]  James F. Blinn,et al.  Models of light reflection for computer synthesized pictures , 1977, SIGGRAPH.

[4]  Robert L. Cook,et al.  A Reflectance Model for Computer Graphics , 1987, TOGS.

[5]  I. Daubechies Orthonormal bases of compactly supported wavelets , 1988 .

[6]  Gregory J. Ward,et al.  Measuring and modeling anisotropic reflection , 1992, SIGGRAPH.

[7]  Christophe Schlick,et al.  An Inexpensive BRDF Model for Physically‐based Rendering , 1994, Comput. Graph. Forum.

[8]  Shree K. Nayar,et al.  Generalization of Lambert's reflectance model , 1994, SIGGRAPH.

[9]  Julie Dorsey,et al.  Effic ient Re-rendering of Naturally Illuminated Environments , 1994 .

[10]  Donald P. Greenberg,et al.  Non-linear approximation of reflectance functions , 1997, SIGGRAPH.

[11]  Paul Lalonde,et al.  A Wavelet Representation of Reflectance Functions , 1997, IEEE Trans. Vis. Comput. Graph..

[12]  James F. Blinn,et al.  Models of light reflection for computer synthesized pictures , 1998 .

[13]  Szymon Rusinkiewicz,et al.  A New Change of Variables for Efficient BRDF Representation , 1998, Rendering Techniques.

[14]  Shree K. Nayar,et al.  Reflectance and texture of real-world surfaces , 1999, TOGS.

[15]  Jan Kautz,et al.  Interactive rendering with arbitrary BRDFs using separable approximations , 1999, SIGGRAPH '99.

[16]  Peter Shirley,et al.  An Anisotropic Phong BRDF Model , 2000, J. Graphics, GPU, & Game Tools.

[17]  Peter Shirley,et al.  A microfacet-based BRDF generator , 2000, SIGGRAPH.

[18]  Michael D. McCool,et al.  Homomorphic factorization of BRDFs for high-performance rendering , 2001, SIGGRAPH.

[19]  Karol Myszkowski,et al.  Rendering Pearlescent Appearance Based On Paint‐Composition Modelling , 2001, Comput. Graph. Forum.

[20]  Anselmo Lastra,et al.  Efficient rendering of spatial bi-directional reflectance distribution functions , 2002, HWWS '02.

[21]  Jan Kautz,et al.  Precomputed radiance transfer for real-time rendering in dynamic, low-frequency lighting environments , 2002 .

[22]  Pat Hanrahan,et al.  Frequency space environment map rendering , 2002, SIGGRAPH.

[23]  Serge J. Belongie,et al.  Structured importance sampling of environment maps , 2003, ACM Trans. Graph..

[24]  Michael D. McCool,et al.  Fast Extraction of BRDFs and Material Maps from Images , 2003, Graphics Interface.

[25]  Tomas Akenine-Möller,et al.  A geometry-based soft shadow volume algorithm using graphics hardware , 2003, ACM Trans. Graph..

[26]  Pat Hanrahan,et al.  All-frequency shadows using non-linear wavelet lighting approximation , 2003, ACM Trans. Graph..

[27]  Peter-Pike J. Sloan,et al.  Clustered principal components for precomputed radiance transfer , 2003, ACM Trans. Graph..

[28]  Wojciech Matusik,et al.  A data-driven reflectance model , 2003, ACM Trans. Graph..

[29]  R. Ramamoorthi,et al.  Efficient BRDF importance sampling using a factored representation , 2004, ACM Trans. Graph..

[30]  Pat Hanrahan,et al.  Triple product wavelet integrals for all-frequency relighting , 2004, ACM Trans. Graph..

[31]  Rui Wang,et al.  Eurographics Symposium on Rendering (2004) All-frequency Relighting of Non-diffuse Objects Using Separable Brdf Approximation , 2022 .

[32]  Harry Shum,et al.  Eurographics Symposium on Rendering (2004) All-frequency Precomputed Radiance Transfer for Glossy Objects , 2022 .

[33]  Andrew Chi-Sing Leung,et al.  Spherical Q2-tree for sampling dynamic environment sequences , 2005, EGSR '05.

[34]  Aaron E. Lefohn,et al.  Lpics: a hybrid hardware-accelerated relighting engine for computer cinematography , 2005, ACM Trans. Graph..

[35]  Kun Zhou,et al.  Precomputed shadow fields for dynamic scenes , 2005, SIGGRAPH 2005.

[36]  Peter-Pike J. Sloan,et al.  Local, deformable precomputed radiance transfer , 2005, ACM Trans. Graph..

[37]  Frédo Durand,et al.  Experimental analysis of BRDF models , 2005, EGSR '05.

[38]  Maneesh Agrawala,et al.  Efficient Shadows for Sampled Environment Maps , 2006, J. Graph. Tools.

[39]  Wojciech Matusik,et al.  Inverse shade trees for non-parametric material representation and editing , 2006, ACM Trans. Graph..