Inversion Based on Computational Simulations

A standard approach to solving inversion problems that involve many parameters uses gradient-based optimization to find the parameters that best match the data. The authors discuss enabling techniques that facilitate application of this approach to large-scale computational simulations, which are the only way to investigate many complex physical phenomena. Such simulations may not seem to lend themselves to calculation of the gradient with respect to numerous parameters. However, adjoint differentiation allows one to efficiently compute the gradient of an objective function with respect to all the variables of a simulation. When combined with advanced gradient-based optimization algorithms, adjoint differentiation permits one to solve very large problems of optimization or parameter estimation. These techniques will be illustrated through the simulation of the time-dependent diffusion of infrared light through tissue, which has been used to perform optical tomography. The techniques discussed have a wide range of applicability to modeling including the optimization of models to achieve a desired design goal.

[1]  J. Besag,et al.  Bayesian Computation and Stochastic Systems , 1995 .

[2]  R. J. McKee,et al.  Uncertainty assessment for reconstructions based on deformable geometry , 1997 .

[3]  Ken D. Sauer,et al.  ML parameter estimation for Markov random fields with applications to Bayesian tomography , 1998, IEEE Trans. Image Process..

[4]  R. J. Henninger,et al.  Accuracy of differential sensitivity for one-dimensional shock problems , 1998 .

[5]  R. J. Henninger,et al.  Differential sensitivity theory applied to the MESA2D code for multi-material problems , 1995 .

[6]  Kenneth M. Hanson,et al.  Kinky tomographic reconstruction , 1996, Medical Imaging.

[7]  Ken D. Sauer,et al.  A generalized Gaussian image model for edge-preserving MAP estimation , 1993, IEEE Trans. Image Process..

[8]  Geoffrey E. Hinton,et al.  Bayesian Learning for Neural Networks , 1995 .

[9]  K. Hanson,et al.  Three dimensional reconstructions from low-count SPECT data using deformable models , 1997, 1997 IEEE Nuclear Science Symposium Conference Record.

[10]  Kenneth M. Hanson,et al.  Posterior sampling with improved efficiency , 1998, Medical Imaging.

[11]  S. Nash.  Preconditioning of Truncated-Newton Methods , 1985 .

[12]  Peter Green,et al.  Markov chain Monte Carlo in Practice , 1996 .

[14]  William C. Davidon,et al.  Variable Metric Method for Minimization , 1959, SIAM J. Optim..

[15]  William L. Oberkampf,et al.  Guide for the verification and validation of computational fluid dynamics simulations , 1998 .

[16]  John Skilling,et al.  Maximum Entropy and Bayesian Methods , 1989 .

[17]  Christian Bischof,et al.  The ADIFOR 2.0 system for the automatic differentiation of Fortran 77 programs , 1997 .

[18]  Kenneth M. Hanson,et al.  Model-based image reconstruction from time-resolved diffusion data , 1997, Medical Imaging.

[19]  Thomas S. Huang,et al.  Image processing , 1971 .

[20]  M. Hanson,et al.  Posterior Sampling with Improved Eeciency , 1998 .

[21]  D. Harville.  Matrix Algebra From a Statistician's Perspective , 1998 .

[22]  Jorge Nocedal,et al.  On the limited memory BFGS method for large scale optimization , 1989, Math. Program..

[23]  R. Fletcher,et al.  A New Approach to Variable Metric Algorithms , 1970, Comput. J..

[24]  Jorge Nocedal,et al.  A Numerical Study of the Limited Memory BFGS Method and the Truncated-Newton Method for Large Scale Optimization , 1991, SIAM J. Optim..

[25]  Kenneth M. Hanson,et al.  Improved convergence of gradient-based reconstructions using multiscale models , 1996, Medical Imaging.

[26]  A. Griewank,et al.  Automatic differentiation of algorithms : theory, implementation, and application , 1994 .

[27]  Andreas H. Hielscher.  Model-based iterative image reconstruction for photon migration tomography , 1997, Optics & Photonics.

[28]  R. Giering.  Tangent linear and adjoint model compiler users manual , 1996 .

[29]  Kenneth M. Hanson,et al.  3D tomographic reconstruction using geometrical models , 1997, Medical Imaging.