Gradient-domain metropolis light transport

We introduce a novel Metropolis rendering algorithm that directly computes image gradients, and reconstructs the final image from the gradients by solving a Poisson equation. The reconstruction is aided by a low-fidelity approximation of the image computed during gradient sampling. As an extension of path-space Metropolis light transport, our algorithm is well suited for difficult transport scenarios. We demonstrate that our method outperforms the state-of-the-art in several well-known test scenes. Additionally, we analyze the spectral properties of gradient-domain sampling, and compare it to the traditional image-domain sampling.

[1]  W. K. Hastings,et al.  Monte Carlo Sampling Methods Using Markov Chains and Their Applications , 1970 .

[2]  Matthias Zwicker,et al.  Multidimensional adaptive sampling and reconstruction for ray tracing , 2008, ACM Trans. Graph..

[3]  Parris K. Egbert,et al.  Energy redistribution path tracing , 2005, SIGGRAPH 2005.

[4]  Frédo Durand,et al.  Fourier depth of field , 2009, TOGS.

[5]  Ramesh Raskar,et al.  Why I Want a Gradient Camera , 2022 .

[6]  Todor Georgiev,et al.  Image Reconstruction Invariant to Relighting , 2005, Eurographics.

[7]  Ravi Ramamoorthi,et al.  A first-order analysis of lighting, shading, and shadows , 2007, TOGS.

[8]  John C. Hart,et al.  Arbitrary Importance Functions for Metropolis Light Transport , 2010, Comput. Graph. Forum.

[9]  Steve Marschner,et al.  Manifold exploration , 2012, ACM Trans. Graph..

[10]  Matthias Zwicker,et al.  Adaptive sampling and reconstruction using greedy error minimization , 2011, ACM Trans. Graph..

[11]  R. Ramamoorthi,et al.  Adaptive wavelet rendering , 2009, SIGGRAPH 2009.

[12]  D. Ruderman.  The statistics of natural images , 1994 .

[13]  Csaba Kelemen,et al.  Simple and Robust Mutation Strategy for Metropolis Light Transport Algorithm , 2001 .

[14]  Justin Talbot,et al.  Energy redistribution path tracing , 2005, ACM Trans. Graph..

[15]  Shmuel Peleg,et al.  Seamless Image Stitching in the Gradient Domain , 2004, ECCV.

[16]  Frédo Durand,et al.  Frequency analysis and sheared reconstruction for rendering motion blur , 2009, ACM Trans. Graph..

[17]  David J. C. MacKay,et al.  Information Theory, Inference, and Learning Algorithms , 2004, IEEE Transactions on Information Theory.

[18]  Benjamin Watson,et al.  Adaptive frameless rendering , 2005, EGSR '05.

[19]  Michael F. Cohen,et al.  GradientShop: A gradient-domain optimization framework for image and video filtering , 2010, TOGS.

[20]  Patrick Pérez,et al.  Poisson image editing , 2003, ACM Trans. Graph..

[21]  N. Metropolis,et al.  Equation of State Calculations by Fast Computing Machines , 1953, Resonance.

[22]  Leonidas J. Guibas,et al.  Metropolis light transport , 1997, SIGGRAPH.

[23]  Gary W. Meyer,et al.  A frequency based ray tracer , 1995, SIGGRAPH.

[24]  Richard Peter Weistroffer,et al.  Multidimensional adaptive sampling and reconstruction for ray tracing , 2008, SIGGRAPH 2008.

[25]  Paul S. Heckbert,et al.  Irradiance gradients , 2008, SIGGRAPH '08.