Factored axis-aligned filtering for rendering multiple distribution effects

Monte Carlo (MC) ray-tracing for photo-realistic rendering often requires hours to render a single image due to the large sampling rates needed for convergence. Previous methods have attempted to filter sparsely sampled MC renders but these methods have high reconstruction overheads. Recent work has shown fast performance for individual effects, like soft shadows and indirect illumination, using axis-aligned filtering. While some components of light transport such as indirect or area illumination are smooth, they are often multiplied by high-frequency components such as texture, which prevents their sparse sampling and reconstruction. We propose an approach to adaptively sample and filter for simultaneously rendering primary (defocus blur) and secondary (soft shadows and indirect illumination) distribution effects, based on a multi-dimensional frequency analysis of the direct and indirect illumination light fields. We describe a novel approach of factoring texture and irradiance in the presence of defocus blur, which allows for pre-filtering noisy irradiance when the texture is not noisy. Our approach naturally allows for different sampling rates for primary and secondary effects, further reducing the overall ray count. While the theory considers only Lambertian surfaces, we obtain promising results for moderately glossy surfaces. We demonstrate 30x sampling rate reduction compared to equal quality noise-free MC. Combined with a GPU implementation and low filtering over-head, we can render scenes with complex geometry and diffuse and glossy BRDFs in a few seconds.

[1]  Jaakko Lehtinen,et al.  Temporal light field reconstruction for rendering distribution effects Citation , 2011 .

[2]  Pradeep Sen,et al.  Removing the Noise in Monte Carlo Rendering with General Image Denoising Algorithms , 2013, Comput. Graph. Forum.

[3]  F. Durand A Frequency Analysis of Light Transport , 2011 .

[4]  John Hart,et al.  ACM Transactions on Graphics , 2004, SIGGRAPH 2004.

[5]  Frédo Durand,et al.  5D Covariance tracing for efficient defocus and motion blur , 2013, TOGS.

[6]  K. Bala,et al.  Multidimensional lightcuts , 2006, SIGGRAPH 2006.

[7]  Jaakko Lehtinen,et al.  Reconstructing the indirect light field for global illumination , 2012, ACM Trans. Graph..

[8]  Matthias Zwicker,et al.  Multidimensional adaptive sampling and reconstruction for ray tracing , 2008, ACM Trans. Graph..

[9]  Robert L. Cook,et al.  Distributed ray tracing , 1998 .

[10]  Soheil Darabi,et al.  On filtering the noise from the random parameters in Monte Carlo rendering , 2012, TOGS.

[11]  Jean-Michel Morel,et al.  Boosting monte carlo rendering by ray histogram fusion , 2014, ACM Trans. Graph..

[12]  Timo Aila,et al.  A local image reconstruction algorithm for stochastic rendering , 2011, SI3D.

[13]  Lei Xiao,et al.  Compressive Rendering of Multidimensional Scenes , 2010, Video Processing and Computational Video.

[14]  Nelson L. Max,et al.  A two-and-a-half-D motion-blur algorithm , 1985, SIGGRAPH '85.

[15]  Peter Shirley,et al.  Realistic ray tracing , 2000 .

[16]  James T. Kajiya,et al.  The rendering equation , 1998 .

[17]  Yung-Yu Chuang,et al.  SURE-based optimization for adaptive sampling and reconstruction , 2012, ACM Trans. Graph..

[18]  Richard Peter Weistroffer,et al.  Multidimensional adaptive sampling and reconstruction for ray tracing , 2008, SIGGRAPH 2008.

[19]  Alessandro Foi,et al.  Image Denoising by Sparse 3-D Transform-Domain Collaborative Filtering , 2007, IEEE Transactions on Image Processing.

[20]  Pat Hanrahan,et al.  A signal-processing framework for inverse rendering , 2001, SIGGRAPH.

[21]  Frédo Durand,et al.  Frequency analysis and sheared filtering for shadow light fields of complex occluders , 2011, TOGS.

[22]  Paul S. Heckbert,et al.  Irradiance gradients , 2008, SIGGRAPH '08.

[23]  Michael Potmesil,et al.  A lens and aperture camera model for synthetic image generation , 1981, SIGGRAPH '81.

[24]  Matthias Zwicker,et al.  Adaptive sampling and reconstruction using greedy error minimization , 2011, ACM Trans. Graph..

[25]  Harry Shum,et al.  Plenoptic sampling , 2000, SIGGRAPH.

[26]  Tomas Akenine-Möller,et al.  Layered Reconstruction for Defocus and Motion Blur , 2014, Comput. Graph. Forum.

[27]  Ravi Ramamoorthi,et al.  Axis-aligned filtering for interactive sampled soft shadows , 2012, ACM Trans. Graph..

[28]  Karthikeyan Vaidyanathan,et al.  Layered Light Field Reconstruction for Defocus Blur , 2015, TOGS.

[29]  Frédo Durand,et al.  Frequency analysis and sheared reconstruction for rendering motion blur , 2009, SIGGRAPH 2009.

[30]  Don P. Mitchell,et al.  Spectrally optimal sampling for distribution ray tracing , 1991, SIGGRAPH.

[31]  Hans-Peter Seidel,et al.  DACHSBACHER C.: Micro-rendering for scalable, parallel final gathering , 2022 .

[32]  Matthias Zwicker,et al.  Adaptive rendering with non-local means filtering , 2012, ACM Trans. Graph..

[33]  R. Ramamoorthi,et al.  Adaptive wavelet rendering , 2009, SIGGRAPH 2009.

[34]  Pat Hanrahan,et al.  Textures and radiosity: controlling emission and reflection with texture maps , 1994, SIGGRAPH.

[35]  Frédo Durand,et al.  Axis-aligned filtering for interactive physically-based diffuse indirect lighting , 2013, ACM Trans. Graph..

[36]  Frédo Durand,et al.  Fourier depth of field , 2009, TOGS.

[37]  Hendrik P. A. Lensch,et al.  Edge-avoiding À-Trous wavelet transform for fast global illumination filtering , 2010, HPG '10.