Fast 4D Sheared Filtering for Interactive Rendering of Distribution Effects

Soft shadows, depth of field, and diffuse global illumination are common distribution effects, usually rendered by Monte Carlo ray tracing. Physically correct, noise-free images can require hundreds or thousands of ray samples per pixel, and take a long time to compute. Recent approaches have exploited sparse sampling and filtering; the filtering is either fast (axis-aligned), but requires more input samples, or needs fewer input samples but is very slow (sheared). We present a new approach for fast sheared filtering on the GPU. Our algorithm factors the 4D sheared filter into four 1D filters. We derive complexity bounds for our method, showing that the per-pixel complexity is reduced from O(n2 l2) to O(nl), where n is the linear filter width (filter size is O(n2)) and l is the (usually very small) number of samples for each dimension of the light or lens per pixel (spp is l2). We thus reduce sheared filtering overhead dramatically. We demonstrate rendering of depth of field, soft shadows and diffuse global illumination at interactive speeds. We reduce the number of samples needed by 5-8×, compared to axis-aligned filtering, and framerates are 4× faster for equal quality.

[1]  Jaakko Lehtinen,et al.  Soft shadow volumes for ray tracing , 2005, ACM Trans. Graph..

[2]  Rui Wang,et al.  Real‐time Depth of Field Rendering via Dynamic Light Field Generation and Filtering , 2010, Comput. Graph. Forum.

[3]  Ravi Ramamoorthi,et al.  Axis-aligned filtering for interactive sampled soft shadows , 2012, ACM Trans. Graph..

[4]  Karthikeyan Vaidyanathan,et al.  Layered Light Field Reconstruction for Defocus Blur , 2015, TOGS.

[5]  Don P. Mitchell,et al.  Spectrally optimal sampling for distribution ray tracing , 1991, SIGGRAPH.

[6]  Hans-Peter Seidel,et al.  Real-time, all-frequency shadows in dynamic scenes , 2008, SIGGRAPH 2008.

[7]  Yung-Yu Chuang,et al.  SURE-based optimization for adaptive sampling and reconstruction , 2012, ACM Trans. Graph..

[8]  F. Durand,et al.  A frequency analysis of light transport , 2005, ACM Trans. Graph..

[9]  Richard Szeliski,et al.  Digital photography with flash and no-flash image pairs , 2004, ACM Trans. Graph..

[10]  Matthias Zwicker,et al.  Multidimensional adaptive sampling and reconstruction for ray tracing , 2008, ACM Trans. Graph..

[11]  Mark Meyer,et al.  A theory of monte carlo visibility sampling , 2012, TOGS.

[12]  Hans-Peter Seidel,et al.  DACHSBACHER C.: Micro-rendering for scalable, parallel final gathering , 2022 .

[13]  Hans-Peter Seidel,et al.  Real-time lens blur effects and focus control , 2010, SIGGRAPH 2010.

[14]  Matthias Zwicker,et al.  Adaptive rendering with non-local means filtering , 2012, ACM Trans. Graph..

[15]  Elmar Eisemann,et al.  Interactive Indirect Illumination Using Voxel Cone Tracing , 2011, Comput. Graph. Forum.

[16]  Michael F. Cohen,et al.  Digital photography with flash and no-flash image pairs , 2004, ACM Trans. Graph..

[17]  Frédo Durand,et al.  Factored axis-aligned filtering for rendering multiple distribution effects , 2014, ACM Trans. Graph..

[18]  Frédo Durand,et al.  Axis-aligned filtering for interactive physically-based diffuse indirect lighting , 2013, ACM Trans. Graph..

[19]  Hans-Peter Seidel,et al.  Real-time, all-frequency shadows in dynamic scenes , 2008, ACM Trans. Graph..

[20]  MunkbergJacob,et al.  Layered Light Field Reconstruction for Defocus Blur , 2015 .

[21]  John F. Hughes,et al.  Approximate depth of field effects using few samples per pixel , 2013, I3D '13.

[22]  Frédo Durand,et al.  A Fast Approximation of the Bilateral Filter Using a Signal Processing Approach , 2006, ECCV.

[23]  Pradeep Sen,et al.  Removing the Noise in Monte Carlo Rendering with General Image Denoising Algorithms , 2013, Comput. Graph. Forum.

[24]  Pat Hanrahan,et al.  A signal-processing framework for inverse rendering , 2001, SIGGRAPH.

[25]  Frédo Durand,et al.  Frequency analysis and sheared filtering for shadow light fields of complex occluders , 2011, TOGS.

[26]  Harry Shum,et al.  Plenoptic sampling , 2000, SIGGRAPH.

[27]  Rui Wang,et al.  Importance Point Projection for GPU‐based Final Gathering , 2011, EGSR '11.

[28]  Loïc Barthe,et al.  High‐Quality Adaptive Soft Shadow Mapping , 2007, Comput. Graph. Forum.

[29]  Tomas Akenine-Möller,et al.  Layered Reconstruction for Defocus and Motion Blur , 2014, Comput. Graph. Forum.

[30]  William R. Mark,et al.  Soft irregular shadow mapping: fast, high-quality, and robust soft shadows , 2009, I3D '09.

[31]  Jan Kautz,et al.  The State of the Art in Interactive Global Illumination , 2012, Comput. Graph. Forum.

[32]  Jacob Munkberg,et al.  Deep shading buffers on commodity GPUs , 2014, ACM Trans. Graph..

[33]  Tomas Akenine-Möller,et al.  A geometry-based soft shadow volume algorithm using graphics hardware , 2003, ACM Trans. Graph..

[34]  Franklin C. Crow,et al.  Shadow algorithms for computer graphics , 1977, SIGGRAPH.

[35]  Jean-Michel Morel,et al.  Boosting monte carlo rendering by ray histogram fusion , 2014, ACM Trans. Graph..

[36]  Michael Potmesil,et al.  A lens and aperture camera model for synthetic image generation , 1981, SIGGRAPH '81.

[37]  John Hart,et al.  ACM Transactions on Graphics , 2004, SIGGRAPH 2004.

[38]  Frédo Durand,et al.  5D Covariance tracing for efficient defocus and motion blur , 2013, TOGS.

[39]  Richard Peter Weistroffer,et al.  Multidimensional adaptive sampling and reconstruction for ray tracing , 2008, SIGGRAPH 2008.

[40]  Jaakko Lehtinen,et al.  Reconstructing the indirect light field for global illumination , 2012, ACM Trans. Graph..

[41]  Hans-Peter Seidel,et al.  Micro-rendering for scalable, parallel final gathering , 2009, ACM Trans. Graph..

[42]  F. Durand,et al.  Temporal light field reconstruction for rendering distribution effects , 2011, ACM Trans. Graph..

[43]  R. Ramamoorthi,et al.  Adaptive wavelet rendering , 2009, SIGGRAPH 2009.

[44]  François X. Sillion,et al.  Fast calculation of soft shadow textures using convolution , 1998, SIGGRAPH.

[45]  Loïc Barthe,et al.  Real-time soft shadow mapping by backprojection , 2006, EGSR '06.

[46]  Soheil Darabi,et al.  On filtering the noise from the random parameters in Monte Carlo rendering , 2012, TOGS.

[47]  H. Seidel,et al.  Real-time lens blur effects and focus control , 2010, ACM Trans. Graph..

[48]  Frédo Durand,et al.  Practical filtering for efficient ray-traced directional occlusion , 2011, ACM Trans. Graph..

[49]  François X. Sillion,et al.  A survey of real-time soft-shadow algorithms , 2003 .

[50]  Frédo Durand,et al.  A Fast Approximation of the Bilateral Filter Using a Signal Processing Approach , 2006, International Journal of Computer Vision.

[51]  Jan Kautz,et al.  Precomputed radiance transfer for real-time rendering in dynamic, low-frequency lighting environments , 2002 .

[52]  Timo Aila,et al.  A local image reconstruction algorithm for stochastic rendering , 2011, SI3D.

[53]  Jaakko Lehtinen,et al.  Soft shadow volumes for ray tracing , 2005, SIGGRAPH 2005.

[54]  Frédo Durand,et al.  A frequency analysis of light transport , 2005, SIGGRAPH '05.

[55]  Holly E. Rushmeier,et al.  Energy preserving non-linear filters , 1994, SIGGRAPH.

[56]  Frédo Durand,et al.  Fourier depth of field , 2009, TOGS.

[57]  Hendrik P. A. Lensch,et al.  Edge-avoiding À-Trous wavelet transform for fast global illumination filtering , 2010, HPG '10.

[58]  Frédo Durand,et al.  Frequency analysis and sheared reconstruction for rendering motion blur , 2009, ACM Trans. Graph..

[59]  Michael D. McCool,et al.  Anisotropic diffusion for Monte Carlo noise reduction , 1999, TOGS.