Fourier Analysis of Correlated Monte Carlo Importance Sampling

Fourier analysis is gaining popularity in image synthesis as a tool for the analysis of error in Monte Carlo (MC) integration. Still, existing tools are only able to analyse convergence under simplifying assumptions (such as randomized shifts) which are not applied in practice during rendering. We reformulate the expressions for bias and variance of sampling‐based integrators to unify non‐uniform sample distributions [importance sampling (IS)] as well as correlations between samples while respecting finite sampling domains. Our unified formulation hints at fundamental limitations of Fourier‐based tools in performing variance analysis for MC integration. At the same time, it reveals that, when combined with correlated sampling, IS can impact convergence rate by introducing or inhibiting discontinuities in the integrand. We demonstrate that the convergence of multiple importance sampling (MIS) is determined by the strategy which converges slowest and propose several simple approaches to overcome this limitation. We show that smoothing light boundaries (as commonly done in production to reduce variance) can improve (M)IS convergence (at a cost of introducing a small amount of bias) since it removes C0 discontinuities within the integration domain. We also propose practical integrand‐ and sample‐mirroring approaches which cancel the impact of boundary discontinuities on the convergence rate of estimators.

[1]  Mark Meyer,et al.  A theory of monte carlo visibility sampling , 2012, TOGS.

[2]  Gurprit Singh,et al.  Variance and Convergence Analysis of Monte Carlo Line and Segment Sampling , 2017, Comput. Graph. Forum.

[3]  Frédo Durand,et al.  A Frequency Analysis of Monte-Carlo and other Numerical Integration Schemes , 2011 .

[4]  Anton Alstes Wang Tiles for Image and Texture Generation , 2004 .

[5]  Mark A. Z. Dippé,et al.  Antialiasing through stochastic sampling , 1985, SIGGRAPH.

[6]  J. Neyman On the Two Different Aspects of the Representative Method: the Method of Stratified Sampling and the Method of Purposive Selection , 1934 .

[7]  Leonidas J. Guibas,et al.  Robust Monte Carlo methods for light transport simulation , 1997 .

[8]  Gurprit Singh,et al.  Convergence analysis for anisotropic monte carlo sampling spectra , 2017, ACM Trans. Graph..

[9]  A. Cengiz Öztireli Integration with Stochastic Point Processes , 2016, ACM Trans. Graph..

[10]  A. Owen,et al.  Safe and Effective Importance Sampling , 2000 .

[11]  Greg Humphreys,et al.  Physically Based Rendering: From Theory to Implementation , 2004 .

[12]  BelongieSerge,et al.  Structured importance sampling of environment maps , 2003 .

[13]  P MitchellDon Spectrally optimal sampling for distribution ray tracing , 1991 .

[14]  Eric Heitz,et al.  Importance Sampling Microfacet‐Based BSDFs using the Distribution of Visible Normals , 2014, Comput. Graph. Forum.

[15]  Pramod K. Varshney,et al.  Stair blue noise sampling , 2016, ACM Trans. Graph..

[16]  Dani Lischinski,et al.  Recursive Wang tiles for real-time blue noise , 2006, ACM Trans. Graph..

[17]  Gurprit Singh,et al.  Fourier analysis of numerical integration in Monte Carlo rendering: theory and practice: understanding estimation error in Monte Carlo image synthesis , 2016, SIGGRAPH Courses.

[18]  S. K. Zaremba Applications of number theory to numerical analysis = Applications de la théorie des nombres à l'analyse numérique , 1972 .

[19]  Oliver Deussen,et al.  Wang Tiles for image and texture generation , 2003, ACM Trans. Graph..

[20]  Serge J. Belongie,et al.  Structured importance sampling of environment maps , 2003, ACM Trans. Graph..

[21]  Li-Yi Wei,et al.  Differential domain analysis for non-uniform sampling , 2011, ACM Trans. Graph..

[22]  Tomas Akenine-Möller,et al.  Practical Product Importance Sampling for Direct Illumination , 2008, Comput. Graph. Forum.

[23]  H. Jensen,et al.  Wavelet importance sampling: efficiently evaluating products of complex functions , 2005, SIGGRAPH 2005.

[24]  Gurprit Singh,et al.  Fast tile-based adaptive sampling with user-specified Fourier spectra , 2014, ACM Trans. Graph..

[25]  Eugene Fiume,et al.  On numerical solutions to one-dimensional integration problems with applications to linear light sources , 2001, TOGS.

[26]  Peter Shirley,et al.  Discrepancy as a Quality Measure for Sample Distributions , 1991, Eurographics.

[27]  Jan Kautz,et al.  Fourier analysis of stochastic sampling strategies for assessing bias and variance in integration , 2013, ACM Trans. Graph..

[28]  A Z DippéMark,et al.  Antialiasing through stochastic sampling , 1985 .

[29]  J. G. Mauldon,et al.  General principles of antithetic variates , 1956, Mathematical Proceedings of the Cambridge Philosophical Society.

[30]  R. Cranley,et al.  Randomization of Number Theoretic Methods for Multiple Integration , 1976 .

[31]  O. Deussen,et al.  Capacity-constrained point distributions: a variant of Lloyd's method , 2009, SIGGRAPH 2009.

[32]  Michael Balzer,et al.  Capacity-constrained point distributions: a variant of Lloyd's method , 2009, ACM Trans. Graph..

[33]  A. W. Wymore,et al.  Numerical Evaluation of Multiple Integrals I , 2010 .

[34]  Hui Huang,et al.  AA patterns for point sets with controlled spectral properties , 2015, ACM Trans. Graph..

[35]  Chaman L. Sabharwal,et al.  Progress in computer graphics (vol. 1) , 1992 .

[36]  Mathieu Desbrun,et al.  Blue noise through optimal transport , 2012, ACM Trans. Graph..

[37]  Gurprit Singh,et al.  Variance analysis for Monte Carlo integration , 2015, ACM Trans. Graph..

[38]  Mark A. Z. Dippé,et al.  Stochastic sampling: theory and application , 1992 .

[39]  L. Hörmander,et al.  The Analysis of Linear Partial Differential Operators I: Distribution Theory and Fourier Analysis , 1983 .

[40]  D. Stoyan,et al.  Statistical Analysis and Modelling of Spatial Point Patterns , 2008 .

[41]  Christian Lessig Controlling and Sampling Visibility Information on the Image Plane , 2017, EGSR.

[42]  J. Hammersley,et al.  A new Monte Carlo technique: antithetic variates , 1956, Mathematical Proceedings of the Cambridge Philosophical Society.

[43]  Don P. Mitchell,et al.  Spectrally optimal sampling for distribution ray tracing , 1991, SIGGRAPH.

[44]  Kenny Mitchell,et al.  Error analysis of estimators that use combinations of stochastic sampling strategies for direct illumination , 2014, Comput. Graph. Forum.

[45]  Derek Nowrouzezahrai,et al.  Joint importance sampling of low-order volumetric scattering , 2013, ACM Trans. Graph..

[46]  Alexander Keller,et al.  Advanced (quasi) Monte Carlo methods for image synthesis , 2012, SIGGRAPH '12.

[47]  James Arvo,et al.  Statistical Hypothesis Testing for Assessing Monte Carlo Estimators: Applications to Image Synthesis , 2007 .

[48]  I. Sloan Lattice Methods for Multiple Integration , 1994 .

[49]  Jaroslav Krivánek,et al.  Real-time shading with filtered importance sampling , 2007, SIGGRAPH '07.

[50]  H. Niederreiter Quasi-Monte Carlo methods and pseudo-random numbers , 1978 .

[51]  Markus Gross,et al.  Analysis and synthesis of point distributions based on pair correlation , 2012, ACM Trans. Graph..

[52]  C. Lemieux Monte Carlo and Quasi-Monte Carlo Sampling , 2009 .

[53]  Don P. Mitchell,et al.  Consequences of stratified sampling in graphics , 1996, SIGGRAPH.

[54]  Robert L. Cook,et al.  Stochastic sampling in computer graphics , 1988, TOGS.

[55]  Henrik Wann Jensen,et al.  Importance Sampling Spherical Harmonics , 2009, Comput. Graph. Forum.

[56]  Bharath H Aithal Modelling Spatial Patterns of Landsacape Dynamics , 2014 .

[57]  Ares Lagae,et al.  A Comparison of Methods for Generating Poisson Disk Distributions , 2008, Comput. Graph. Forum.