Multidimensional adaptive sampling and reconstruction for ray tracing

We present a new adaptive sampling strategy for ray tracing. Our technique is specifically designed to handle multidimensional sample domains, and it is well suited for efficiently generating images with effects such as soft shadows, motion blur, and depth of field. These effects are problematic for existing image based adaptive sampling techniques as they operate on pixels, which are possibly noisy results of a Monte Carlo ray tracing process. Our sampling technique operates on samples in the multidimensional space given by the rendering equation and as a consequence the value of each sample is noise-free. Our algorithm consists of two passes. In the first pass we adaptively generate samples in the multidimensional space, focusing on regions where the local contrast between samples is high. In the second pass we reconstruct the image by integrating the multidimensional function along all but the image dimensions. We perform a high quality anisotropic reconstruction by determining the extent of each sample in the multidimensional space using a structure tensor. We demonstrate our method on scenes with a 3 to 5 dimensional space, including soft shadows, motion blur, and depth of field. The results show that our method uses fewer samples than Mittchell's adaptive sampling technique while producing images with less noise.

[1]  H. Pollak,et al.  Prolate spheroidal wave functions, fourier analysis and uncertainty — III: The dimension of the space of essentially time- and band-limited signals , 1962 .

[2]  Turner Whitted,et al.  An improved illumination model for shaded display , 1979, CACM.

[3]  Don P. Mitchell,et al.  Generating antialiased images at low sampling densities , 1987, SIGGRAPH.

[4]  William H. Press,et al.  Recursive stratified sampling for multidimensional Monte Carlo integration , 1990 .

[5]  Terje O. Espelid,et al.  An adaptive algorithm for the approximate calculation of multiple integrals , 1991, TOMS.

[6]  James Arvo,et al.  Unbiased sampling techniques for image synthesis , 1991, SIGGRAPH.

[7]  Don P. Mitchell,et al.  Spectrally optimal sampling for distribution ray tracing , 1991, SIGGRAPH.

[8]  Andrew S. Glassner,et al.  Principles of Digital Image Synthesis , 1995 .

[9]  Leonidas J. Guibas,et al.  Metropolis light transport , 1997, SIGGRAPH.

[10]  Piotr Indyk,et al.  Approximate nearest neighbors: towards removing the curse of dimensionality , 1998, STOC '98.

[11]  James T. Kajiya,et al.  The rendering equation , 1998 .

[12]  Gary W. Meyer,et al.  A perceptually based adaptive sampling algorithm , 1998, SIGGRAPH.

[13]  Robert L. Cook,et al.  Distributed ray tracing , 1998 .

[14]  Don P. Mitchell,et al.  The Antialiasing Problem in Ray Tracing , 2000 .

[15]  Harry Shum,et al.  Plenoptic sampling , 2000, SIGGRAPH.

[16]  H. Jensen Realistic Image Synthesis Using Photon Mapping , 2001 .

[17]  Csaba Kelemen,et al.  Simple and Robust Mutation Strategy for Metropolis Light Transport Algorithm , 2001 .

[18]  Isaac Amidror,et al.  Scattered data interpolation methods for electronic imaging systems: a survey , 2002, J. Electronic Imaging.

[19]  Philippe Bekaert,et al.  Advanced global illumination , 2006 .

[20]  William Leeson Rendering with adaptive integration , 2003 .

[21]  Mateu Sbert,et al.  Refinement Criteria Based on f-Divergences , 2003, Rendering Techniques.

[22]  John Hart,et al.  ACM Transactions on Graphics , 2004, SIGGRAPH 2004.

[23]  R. Ramamoorthi,et al.  Efficient BRDF importance sampling using a factored representation , 2004, ACM Trans. Graph..

[24]  Greg Humphreys,et al.  Physically Based Rendering: From Theory to Implementation , 2004 .

[25]  H. Jensen,et al.  Wavelet importance sampling: efficiently evaluating products of complex functions , 2005, SIGGRAPH 2005.

[26]  Frédo Durand,et al.  A frequency analysis of light transport , 2005, SIGGRAPH '05.

[27]  K. Bala,et al.  Multidimensional lightcuts , 2006, SIGGRAPH 2006.

[28]  A ray tracing solution for diffuse interreflection , 1988, SIGGRAPH '07.

[29]  Ravi Ramamoorthi,et al.  A first-order analysis of lighting, shading, and shadows , 2007, TOGS.

[30]  Paul S. Heckbert,et al.  Irradiance gradients , 2008, SIGGRAPH '08.