Solving Inverse PDE Problems using Grid-Free Monte Carlo Estimators

Modeling physical phenomena like heat transport and diffusion is crucially dependent on the numerical solution of partial differential equations (PDEs). A PDE solver finds the solution given coefficients and a boundary condition, whereas an inverse PDE solver goes the opposite way and reconstructs these inputs from an existing solution. In this article, we investigate techniques for solving inverse PDE problems using a gradient-based methodology. Conventional PDE solvers based on the finite element method require a domain meshing step that can be fragile and costly. Grid-free Monte Carlo methods instead stochastically sample paths using variations of the walk on spheres algorithm to construct an unbiased estimator of the solution. The uncanny similarity of these methods to physically-based rendering algorithms has been observed by several recent works. In the area of rendering, recent progress has led to the development of efficient unbiased derivative estimators. They solve an adjoint form of the problem and exploit arithmetic invertibility to compute gradients using a constant amount of memory and linear time complexity. Could these two lines of work be combined to compute cheap parametric derivatives of a grid-free PDE solver? We investigate this question and present preliminary results.

[1]  Wojciech Jarosz,et al.  A bidirectional formulation for Walk on Spheres , 2022, Comput. Graph. Forum.

[2]  Keenan Crane,et al.  Grid-free Monte Carlo for PDEs with spatially varying coefficients , 2022, ACM Trans. Graph..

[3]  Iliyan Georgiev,et al.  Monte Carlo estimators for differential light transport , 2021, ACM Transactions on Graphics.

[4]  Frédo Durand,et al.  Unbiased warped-area sampling for differentiable rendering , 2020, ACM Trans. Graph..

[5]  Cheng Zhang,et al.  Path-space differentiable rendering , 2020, ACM Trans. Graph..

[6]  Pratul P. Srinivasan,et al.  NeRF , 2020, ECCV.

[7]  Wenzel Jakob,et al.  Reparameterizing discontinuous integrands for differentiable rendering , 2019, ACM Trans. Graph..

[8]  Jaakko Lehtinen,et al.  Differentiable Monte Carlo ray tracing through edge sampling , 2018, ACM Trans. Graph..

[9]  Shuang Zhao,et al.  Inverse volume rendering with material dictionaries , 2013, ACM Trans. Graph..

[10]  J. Gautrais,et al.  Integral formulation of null-collision Monte Carlo algorithms , 2013 .

[11]  David Isaacson,et al.  Electrical Impedance Tomography , 1999, SIAM Rev..

[12]  L. A. Romero,et al.  A Monte Carlo method for Poisson's equation , 1990 .

[13]  William Rundell,et al.  Inverse Problems in Partial Differential Equations , 1990 .

[14]  James T. Kajiya,et al.  The rendering equation , 1986, SIGGRAPH.

[15]  J. Cannon Determination of certain parameters in heat conduction problems , 1964 .

[16]  M. E. Muller Some Continuous Monte Carlo Methods for the Dirichlet Problem , 1956 .

[17]  Delio Vicini Path Replay Backpropagation: Differentiating Light Paths using Constant Memory and Linear Time , 2021 .

[18]  Merlin Nimier-David Radiative Backpropagation: An Adjoint Method for Lightning-Fast Di erentiable Rendering , 2020 .

[19]  Keenan Crane,et al.  Monte Carlo geometry processing , 2020, ACM Trans. Graph..

[20]  G. Mikhailov,et al.  Solution of the dirichlet problem for the equation Δu-cu = −q by a model of “walks on spheres” , 1969 .