Adaptive sampling and reconstruction using greedy error minimization

We introduce a novel approach for image space adaptive sampling and reconstruction in Monte Carlo rendering. We greedily minimize relative mean squared error (MSE) by iterating over two steps. First, given a current sample distribution, we optimize over a discrete set of filters at each pixel and select the filter that minimizes the pixel error. Next, given the current filter selection, we distribute additional samples to further reduce MSE. The success of our approach hinges on a robust technique to select suitable per pixel filters. We develop a novel filter selection procedure that robustly solves this problem even with noisy input data. We evaluate our approach using effects such as motion blur, depth of field, interreflections, etc. We provide a comparison to a state-of-the-art algorithm based on wavelet shrinkage and show that we achieve significant improvements in numerical error and visual image quality. Our approach is simple to implement, requires a single user parameter, and is compatible with standard Monte Carlo rendering.

[1]  Vladimir Katkovnik,et al.  A new method for varying adaptive bandwidth selection , 1999, IEEE Trans. Signal Process..

[2]  Radomír Mech,et al.  Realistic modeling and rendering of plant ecosystems , 1998, SIGGRAPH.

[3]  Frédo Durand,et al.  Fourier depth of field , 2009, TOGS.

[4]  Hendrik P. A. Lensch,et al.  Edge-avoiding À-Trous wavelet transform for fast global illumination filtering , 2010, HPG '10.

[5]  Greg Humphreys,et al.  Physically Based Rendering, Second Edition: From Theory To Implementation , 2010 .

[6]  I. Johnstone,et al.  Ideal spatial adaptation by wavelet shrinkage , 1994 .

[7]  R. Ramamoorthi,et al.  Adaptive wavelet rendering , 2009, SIGGRAPH 2009.

[8]  Martin J. Wainwright,et al.  Image denoising using scale mixtures of Gaussians in the wavelet domain , 2003, IEEE Trans. Image Process..

[9]  Frédo Durand,et al.  Frequency analysis and sheared filtering for shadow light fields of complex occluders , 2011, TOGS.

[10]  Jong-Sen Lee,et al.  Digital Image Enhancement and Noise Filtering by Use of Local Statistics , 1980, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Matthias Zwicker,et al.  Multidimensional adaptive sampling and reconstruction for ray tracing , 2008, ACM Trans. Graph..

[12]  A. Goldenshluger On Spatial Adaptive Estimation of Nonparametric Regression , 2004 .

[13]  Hans-Peter Seidel,et al.  DACHSBACHER C.: Micro-rendering for scalable, parallel final gathering , 2022 .

[14]  C. D. Kemp,et al.  Density Estimation for Statistics and Data Analysis , 1987 .

[15]  E. Mammen,et al.  Optimal spatial adaptation to inhomogeneous smoothness: an approach based on kernel estimates with variable bandwidth selectors , 1997 .

[16]  Donald P. Greenberg,et al.  Combining edges and points for interactive high-quality rendering , 2003, ACM Trans. Graph..

[17]  Don P. Mitchell,et al.  Generating antialiased images at low sampling densities , 1987, SIGGRAPH.

[18]  Alexander Keller,et al.  Efficient Multidimensional Sampling , 2002, Comput. Graph. Forum.

[19]  Gary W. Meyer,et al.  A perceptually based adaptive sampling algorithm , 1998, SIGGRAPH.

[20]  Bernard Péroche,et al.  A Progressive Rendering Algorithm Using an Adaptive Perceptually Based Image Metric , 2004, Comput. Graph. Forum.

[21]  Timo Aila,et al.  A local image reconstruction algorithm for stochastic rendering , 2011, SI3D.

[22]  Jaakko Lehtinen,et al.  Temporal light field reconstruction for rendering distribution effects Citation , 2011 .

[23]  Jun-Hai Yong,et al.  Efficient Depth‐of‐Field Rendering with Adaptive Sampling and Multiscale Reconstruction , 2011, Comput. Graph. Forum.

[24]  Frédo Durand,et al.  Frequency analysis and sheared reconstruction for rendering motion blur , 2009, SIGGRAPH 2009.

[25]  B. Silverman Density estimation for statistics and data analysis , 1986 .