LECTURERS

Since its invention 20 years ago, irradiance caching has been successfully used to accelerate global illumination computation in the Radiance lighting simulation system. Its widespread use had to wait until computers became fast enough to consider global illumination in production rendering. Since then, its use is ubiquitous. Virtually all commercial and open-source rendering software base the global illumination computation upon irradiance caching. Although elegant and powerful, the algorithm often fails to produce artifact-free images. Unfortunately, practical information on implementing the algorithm is scarce. The objective of the class is twofold. The first and main objective is to expose the irradiance caching algorithm along with all the details and tricks upon which the success of its practical implementation is dependent. Various image artifacts that the basic algorithm can produce will be shown along with a recipe to suppress them. We will also put strong emphasis on practical aspects of irradiance caching integration in production environments and discuss the particularities used in two big production houses, namely PDI/DreamWorks and Pixar. The second objective is to acquaint the audience with the recent research results that increase the speed and extend the functionality of basic irradiance caching. Those include: exploiting temporal coherence to suppress temporal flickering; extending the caching mechanism to rendering glossy surfaces; accelerating the algorithm by porting it to the GPU. Advantages and disadvantages of those methods will be discussed.

[1]  Robin Green,et al.  Spherical Harmonic Lighting: The Gritty Details , 2003 .

[2]  Kadi Bouatouch,et al.  Haar Wavelet: A Solution to Global Illumination With General Surface Properties , 1995 .

[3]  Adam Arbree,et al.  To appear in the ACM SIGGRAPH conference proceedings Lightcuts: A Scalable Approach to Illumination , 2022 .

[4]  Dani Lischinski,et al.  Combining hierarchical radiosity and discontinuity meshing , 1993, SIGGRAPH.

[5]  Xavier Pueyo,et al.  Frame-to-Frame Coherent Animation with Two-Pass Radiosity , 2003, IEEE Trans. Vis. Comput. Graph..

[6]  Lance Williams,et al.  Casting curved shadows on curved surfaces , 1978, SIGGRAPH.

[7]  Xavier Pueyo,et al.  Radiosity for dynamic environments , 1997, Comput. Animat. Virtual Worlds.

[8]  Bent Dalgaard Larsen,et al.  Simulating Photon Mapping for Real-time Applications , 2004, Rendering Techniques.

[9]  Tim Foley,et al.  KD-tree acceleration structures for a GPU raytracer , 2005, HWWS '05.

[10]  P. Hanrahan,et al.  Wavelet Methods for Radiance Computations , 1995 .

[11]  Arnauld Lamorlette,et al.  An approximate global illumination system for computer generated films , 2004, ACM Trans. Graph..

[12]  David A. Forsyth,et al.  Fast and detailed approximate global illumination by irradiance decomposition , 2005, ACM Trans. Graph..

[13]  Peter Schröder,et al.  Spherical wavelets: efficiently representing functions on the sphere , 1995, SIGGRAPH.

[14]  Claude Puech,et al.  A general two-pass method integrating specular and diffuse reflection , 1989, SIGGRAPH '89.

[15]  Baining Guo,et al.  Progressive radiance evaluation using directional coherence maps , 1998, SIGGRAPH.

[16]  Donald P. Greenberg,et al.  Modeling the interaction of light between diffuse surfaces , 1984, SIGGRAPH.

[17]  Karol Myszkowski,et al.  Temporally Coherent Irradiance Caching for High Quality Animation Rendering , 2005, Comput. Graph. Forum.

[18]  Hans-Peter Seidel,et al.  Localizing the Final Gathering for Dynamic Scenes using the Photon Map , 2002, VMV.

[19]  Karol Myszkowski,et al.  QUALITY IMPROVEMENT FOR INDIRECT ILLUMINATION INTERPOLATION , 2002 .

[20]  Pat Hanrahan,et al.  An efficient representation for irradiance environment maps , 2001, SIGGRAPH.

[21]  Anselmo Lastra,et al.  Radiosity on graphics hardware , 2004, Graphics Interface.

[22]  Peter Shirley,et al.  Direct Lighting Calculation by Monte Carlo Integration , 1994 .

[23]  J. Zára,et al.  Making radiance and irradiance caching practical: adaptive caching and neighbor clamping , 2006, EGSR '06.

[24]  Hans-Peter Seidel,et al.  Progressive path tracing with lightweight local error estimation , 2004, VMV.

[25]  Paul S. Heckbert,et al.  Irradiance gradients , 2008, SIGGRAPH '08.

[26]  J. Wyant,et al.  Basic Wavefront Aberration Theory for Optical Metrology , 1992 .

[27]  Maryann Simmons,et al.  The holodeck ray cache: an interactive rendering system for global illumination in nondiffuse environments , 1999, TOGS.

[28]  Oleg A. Makhotkin.  Analysis of radiative transfer between surfaces by hemispherical harmonics , 1996 .

[29]  Donald P. Greenberg,et al.  The back-buffer algorithm: An extension of the radiosity method to dynamic environments , 2005, The Visual Computer.

[30]  Benjamin Watson,et al.  Adaptive frameless rendering , 2005, EGSR '05.

[31]  P. Hanrahan,et al.  On the relationship between radiance and irradiance: determining the illumination from images of a convex Lambertian object. , 2001, Journal of the Optical Society of America. A, Optics, image science, and vision.

[32]  Philipp Slusallek,et al.  Realtime Caustics using Distributed Photon Mapping , 2004, Rendering Techniques.

[33]  Xavier Pueyo,et al.  Animating radiosity environments through the Multi-Frame Lighting Method , 2001, Comput. Animat. Virtual Worlds.

[34]  David Salesin,et al.  Clustering for glossy global illumination , 1997, TOGS.

[35]  Frédo Durand,et al.  A frequency analysis of light transport , 2005, SIGGRAPH '05.

[36]  Frank Suykens.  On robust Monte Carlo algorithms for multi-pass global illumination , 2002 .

[37]  George Drettakis,et al.  Efficient Glossy Global Illumination with Interactive Viewing , 1999, Comput. Graph. Forum.

[38]  Philippe Bekaert,et al.  Advanced global illumination , 2006 .

[39]  Sumanta N. Pattanaik,et al.  Radiance caching for efficient global illumination computation , 2008, IEEE Transactions on Visualization and Computer Graphics.

[40]  Hans-Peter Seidel,et al.  Spherical harmonic gradients for mid-range illumination , 2004 .

[41]  K. Ruedenberg,et al.  Rotation Matrices for Real Spherical Harmonics. Direct Determination by Recursion , 1998 .

[42]  Jirí Zára,et al.  Fast approximation to spherical harmonic rotation , 2006, SCCG.

[43]  Hans-Peter Seidel,et al.  Exploiting temporal coherence in final gathering for dynamic scenes , 2004, Proceedings Computer Graphics International, 2004..

[44]  Seth J. Teller,et al.  Radiance interpolants for accelerated bounded-error ray tracing , 1999, TOGS.

[45]  Xavier Pueyo,et al.  An Image-Space Refinement Criterion for Linear Hierarchical Radiosity , 1997, Graphics Interface.

[46]  Peter Shirley,et al.  A Two-Pass Realistic Image Synthesis Method for Complex Scenes , 2007 .

[47]  Hans-Peter Seidel,et al.  Fast Final Gathering via Reverse Photon Mapping , 2005, Comput. Graph. Forum.

[48]  Jan Kautz,et al.  Precomputed radiance transfer for real-time rendering in dynamic, low-frequency lighting environments , 2002 .

[49]  Harry Shum,et al.  Eurographics Symposium on Rendering (2004) All-frequency Precomputed Radiance Transfer for Glossy Objects , 2022 .

[50]  Ravi Ramamoorthi,et al.  A first-order analysis of lighting, shading, and shadows , 2007, TOGS.

[51]  Michael F. Cohen,et al.  Radiosity and realistic image synthesis , 1993 .

[52]  Mateu Sbert,et al.  The Multi-Frame Lighting Method: A Monte Carlo Based Solution for Radiosity in Dynamic Environments , 1996, Rendering Techniques.

[53]  Kadi Bouatouch,et al.  Nested radiosity for plant canopies , 1998, The Visual Computer.

[54]  Yves D. Willems,et al.  Final radiosity gather step using a Monte Carlo technique with optimal importance sampling , 1998 .

[55]  Holly Rushmeier,et al.  Realistic image synthesis for scenes with radiatively participating media , 1988 .

[56]  Pat Hanrahan,et al.  Photon mapping on programmable graphics hardware , 2003, HWWS '03.

[57]  Hans-Peter Seidel,et al.  Realistic, hardware-accelerated shading and lighting , 1999, SIGGRAPH.

[58]  Claude Puech,et al.  Radiosity and global illumination , 1994 .

[59]  George Drettakis,et al.  Interactive Rendering using the Render Cache , 1999, Rendering Techniques.

[60]  Philipp Slusallek,et al.  Interactive Global Illumination in Complex and Highly Occluded Environments , 2003, Rendering Techniques.

[61]  John C. Hart,et al.  GPU algorithms for radiosity and subsurface scattering , 2003, HWWS '03.

[62]  Andrea J. van Doorn,et al.  Bidirectional Reflection Distribution Function Expressed in Terms of Surface Scattering Modes , 1996, ECCV.

[63]  François X. Sillion,et al.  Space‐Time Hierarchical Radiosity with Clustering and Higher‐Order Wavelets , 2004, Comput. Graph. Forum.

[64]  Bernard Péroche,et al.  A Vector Approach for Global Illumination in Ray Tracing , 1998, Comput. Graph. Forum.

[65]  Bernard Péroche,et al.  An Adaptive Method for Indirect Illumination Using Light Vectors , 2001, Comput. Graph. Forum.

[66]  Michael D. McCool,et al.  Low latency photon mapping using block hashing , 2002, HWWS '02.

[67]  Donald P. Greenberg,et al.  The hemi-cube: a radiosity solution for complex environments , 1985, SIGGRAPH.

[68]  Stephen H. Westin,et al.  Predicting reflectance functions from complex surfaces , 1992, SIGGRAPH.

[69]  Alain Fournier,et al.  Light-Driven Global Illumination with a Wavelet Representation of Light Transport , 1996, Rendering Techniques.

[70]  Pat Hanrahan,et al.  Ray tracing on a connection machine , 1988, ICS '88.

[71]  Henry Fuchs,et al.  Frameless rendering: double buffering considered harmful , 1994, SIGGRAPH.

[72]  Sumanta N. Pattanaik,et al.  Improved radiance gradient computation , 2005, SCCG '05.

[73]  P. Heckbert.  Simulating Global Illumination Using Adaptive Meshing , 1991 .

[74]  Gregory J. Ward,et al.  A ray tracing solution for diffuse interreflection , 2008, SIGGRAPH '08.

[75]  Donald P. Greenberg,et al.  Interactive global illumination in dynamic scenes , 2002, SIGGRAPH.

[76]  Sumanta N. Pattanaik,et al.  Radiance cache splatting: a GPU-friendly global illumination algorithm , 2005, EGSR '05.

[77]  A. Rathsfeld.  Edge asymptotics for the radiosity equation over polyhedral boundaries , 1999 .

[78]  Werner Purgathofer,et al.  Coherence in Computer Graphics , 1992 .

[79]  Donald P. Greenberg,et al.  A perceptually based physical error metric for realistic image synthesis , 1999, SIGGRAPH.

[80]  Stephen H. Westin,et al.  A global illumination solution for general reflectance distributions , 1991, SIGGRAPH.

[81]  George Drettakis,et al.  A Clustering Algorithm for Radiance Calculation in General Environments , 1995, Rendering Techniques.

[82]  Pat Hanrahan,et al.  A signal-processing framework for forward and inverse rendering , 2002 .

[83]  George Drettakis,et al.  Interactive update of global illumination using a line-space hierarchy , 1997, SIGGRAPH.

[84]  Pat Hanrahan,et al.  A hierarchical illumination algorithm for surfaces with glossy reflection , 1993, SIGGRAPH.

[85]  Wolfgang Straßer,et al.  Real‐Time Caustics , 2003, Comput. Graph. Forum.

[86]  Donald P. Greenberg,et al.  The Irradiance Volume , 1998, IEEE Computer Graphics and Applications.

[87]  François X. Sillion,et al.  Accurate Computation of the Radiosity Gradient for Constant and Linear Emitters , 1995, Rendering Techniques.

[88]  Wolfgang Stuerzlinger,et al.  Interactive Rendering of Globally Illuminated Glossy Scenes , 1997, Rendering Techniques.

[89]  George Drettakis,et al.  Perspective shadow maps , 2002, ACM Trans. Graph..

[90]  Frédo Durand,et al.  Experimental analysis of BRDF models , 2005, EGSR '05.

[91]  Roger J. Hubbold,et al.  Perceptually‐Driven Radiosity , 1997, Comput. Graph. Forum.

[92]  Sumanta N. Pattanaik,et al.  Temporal Radiance Caching , 2007, IEEE Trans. Vis. Comput. Graph..

[93]  James Arvo,et al.  The irradiance Jacobian for partially occluded polyhedral sources , 1994, SIGGRAPH.

[94]  Donald P. Greenberg,et al.  Combining edges and points for interactive high-quality rendering , 2003, ACM Trans. Graph..

[95]  Bui Tuong Phong.  Illumination for computer generated pictures , 1975, Commun. ACM.

[96]  Roland W Fleming,et al.  Real-world illumination and the perception of surface reflectance properties. , 2003, Journal of vision.

[97]  Hans-Peter Seidel,et al.  Interactive Global Illumination using Selective Photon Tracing , 2002, Rendering Techniques.

[98]  Jaroslav Křivánek,et al.  Radiance caching for global illumination computation on glossy surfaces , 2005 .

[99]  David Salesin,et al.  Rendering antialiased shadows with depth maps , 1987, SIGGRAPH.

[100]  Ronen Basri,et al.  Lambertian reflectance and linear subspaces , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[101]  Carlo H. Séquin,et al.  Tapestry: A Dynamic Mesh-based Display Representation for Interactive Rendering , 2000, Rendering Techniques.

[102]  Hans-Peter Seidel,et al.  Thrifty Final Gather for Radiosity , 2001, Rendering Techniques.

[103]  Sumanta N. Pattanaik,et al.  Interactive global illumination in dynamic environments using commodity graphics hardware , 2003, 11th Pacific Conference onComputer Graphics and Applications, 2003. Proceedings..

[104]  Donald P. Greenberg,et al.  Non-linear approximation of reflectance functions , 1997, SIGGRAPH.

[105]  Dani Lischinski,et al.  Discontinuity meshing for accurate radiosity , 1992, IEEE Computer Graphics and Applications.

[106]  Peter-Pike J. Sloan,et al.  Clustered principal components for precomputed radiance transfer , 2003, ACM Trans. Graph..

[107]  Sumanta N. Pattanaik,et al.  Eurographics Symposium on Rendering (2004) a Novel Hemispherical Basis for Accurate and Efficient Rendering , 2022 .

[108]  Kendall E. Atkinson,et al.  The planar radiosity equation and its numerical solution , 2000 .

[109]  Jan Kautz,et al.  Fast Arbitrary BRDF Shading for Low-Frequency Lighting Using Spherical Harmonics , 2002, Rendering Techniques.

[110]  James T. Kajiya,et al.  The rendering equation , 1986, SIGGRAPH.

[111]  Pat Hanrahan,et al.  Frequency space environment map rendering , 2002, SIGGRAPH.

[112]  George Drettakis,et al.  A final reconstruction approach for a unified global illumination algorithm , 2004, TOGS.

[113]  Michael Wimmer,et al.  Coherent Hierarchical Culling: Hardware Occlusion Queries Made Useful , 2004, Comput. Graph. Forum.

[114]  H. Jensen.  Realistic Image Synthesis Using Photon Mapping , 2001 .

[115]  Mathias Paulin,et al.  Scalable photon splatting for global illumination , 2003, GRAPHITE '03.

[116]  Karol Myszkowski,et al.  Global Illumination for Interactive Applications and High-Quality Animations , 2002, Eurographics.

[117]  G. W. Larson,et al.  Rendering with radiance - the art and science of lighting visualization , 2004, Morgan Kaufmann series in computer graphics and geometric modeling.

[118]  George Drettakis,et al.  Enhancing and Optimizing the Render Cache , 2002, Rendering Techniques.

[119]  Donald P. Greenberg,et al.  Global illumination using local linear density estimation , 1997, TOGS.

[120]  Gregory J. Ward,et al.  The RADIANCE lighting simulation and rendering system , 1994, SIGGRAPH.

[121]  Shree K. Nayar,et al.  Reflectance and texture of real-world surfaces , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[122]  John C. Hart,et al.  The ray engine , 2002, HWWS '02.

[123]  Hans-Peter Seidel,et al.  Grid Based Final Gather for Radiosity on Complex Scenes , 2002 .

[124]  Nelson L. Max,et al.  Bidirectional reflection functions from surface bump maps , 1987, SIGGRAPH.

[125]  Carsten Dachsbacher,et al.  Reflective shadow maps , 2005, I3D '05.

[126]  Gregory J. Ward,et al.  Measuring and modeling anisotropic reflection , 1992, SIGGRAPH.

[127]  Hans-Peter Seidel,et al.  Radiance maps: an image-based approach to global illumination , 1998, SIGGRAPH '98.

[128]  Rui Wang,et al.  Eurographics Symposium on Rendering (2004) All-frequency Relighting of Non-diffuse Objects Using Separable Brdf Approximation , 2022 .

[129]  Pat Hanrahan,et al.  A rapid hierarchical radiosity algorithm , 1991, SIGGRAPH.