Density‐based Outlier Rejection in Monte Carlo Rendering

The problem of noise in Monte‐Carlo rendering arising from estimator variance is well‐known and well‐studied. In this work, we concentrate on identifying individual light paths as outliers that lead to significant spikes of noise and represent a challenge for existing filtering methods. Most noise‐reduction methods, such as importance sampling and stratification, attempt to generate samples that are expected a priori to have lower variance, but do not take into account actual sample values. While these methods are essential to decrease overall noise, we show that filtering samples a posteriori allows for greater reduction of spiked noise. In particular, given evaluated sample values, outliers can be identified and removed. Conforming with conventions in statistics, we emphasize that the term “outlier” should not be taken as synonymous with “incorrect”, but as referring to samples that distort the empirically‐observed distribution of energy relative to the true underlying distribution. By expressing a path distribution in joint image and color space, we show how outliers can be characterized by their density across the set of all nearby paths in this space. We show that removing these outliers leads to significant improvements in rendering quality.

[1]  Holly E. Rushmeier,et al.  Energy preserving non-linear filters , 1994, SIGGRAPH.

[2]  T. Hesterberg,et al.  Weighted Average Importance Sampling and Defensive Mixture Distributions , 1995 .

[3]  R. Redner,et al.  A note on the use of nonlinear filtering in computer graphics , 1990, IEEE Computer Graphics and Applications.

[4]  Jiawen Chen,et al.  Real-time edge-aware image processing with the bilateral grid , 2007, ACM Trans. Graph..

[5]  Roberto Manduchi,et al.  Bilateral filtering for gray and color images , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[6]  H. Jensen Realistic Image Synthesis Using Photon Mapping , 2001 .

[7]  Bobby Bodenheimer,et al.  Synthesis and evaluation of linear motion transitions , 2008, TOGS.

[8]  Werner A. Stahel,et al.  Robust Statistics: The Approach Based on Influence Functions , 1987 .

[9]  T KajiyaJames The rendering equation , 1986 .

[10]  Henrik Wann Jensen,et al.  State of the Art in Monte Carlo Ray Tracing for Realistic Image Synthesis , 2001 .

[11]  Leonidas J. Guibas,et al.  Optimally combining sampling techniques for Monte Carlo rendering , 1995, SIGGRAPH.

[12]  Greg Humphreys,et al.  Physically Based Rendering: From Theory to Implementation , 2004 .

[13]  A. Owen,et al.  Safe and Effective Importance Sampling , 2000 .

[14]  James T. Kajiya,et al.  The rendering equation , 1986, SIGGRAPH.

[15]  Sunil Arya,et al.  An optimal algorithm for approximate nearest neighbor searching fixed dimensions , 1998, JACM.

[16]  M. Braga,et al.  Exploratory Data Analysis , 2018, Encyclopedia of Social Network Analysis and Mining. 2nd Ed..

[17]  Matthias Zwicker,et al.  Multidimensional adaptive sampling and reconstruction for ray tracing , 2008, ACM Trans. Graph..

[18]  Michael D. McCool,et al.  Anisotropic diffusion for Monte Carlo noise reduction , 1999, TOGS.

[19]  D. Ruppert Robust Statistics: The Approach Based on Influence Functions , 1987 .