PETAL: Physics Emulation Through Averaged Linearizations for Solving Inverse Problems

Inverse problems describe the task of recovering an underlying signal of interest given observables. Typically, the observables are related via some non-linear forward model applied to the underlying unknown signal. Inverting the non-linear forward model can be computationally expensive, as it often involves computing and inverting a linearization at a series of estimates. Rather than inverting the physics-based model, we instead train a surrogate forward model (emulator) and leverage modern auto-grad libraries to solve for the input within a classical optimization framework. Current methods to train emulators are done in a black box supervised machine learning fashion and fail to take advantage of any existing knowledge of the forward model. In this article, we propose a simple learned weighted average model that embeds linearizations of the forward model around various reference points into the model itself, explicitly incorporating known physics. Grounding the learned model with physics based linearizations improves the forward modeling accuracy and provides richer physics based gradient information during the inversion process leading to more accurate signal recovery. We demonstrate the efficacy on an ocean acoustic tomography (OAT) example that aims to recover ocean sound speed profile (SSP) variations from acoustic observations (e.g. eigenray arrival times) within simulation of ocean dynamics in the Gulf of Mexico.

[1]  J. Romberg,et al.  Machine learning approaches for ray-based ocean acoustic tomography. , 2022, The Journal of the Acoustical Society of America.

[2]  J. Romberg,et al.  Loop Unrolled Shallow Equilibrium Regularizer (LUSER) - A Memory-Efficient Inverse Problem Solver , 2022, ArXiv.

[3]  M. Soltanolkotabi,et al.  HUMUS-Net: Hybrid unrolled multi-scale network architecture for accelerated MRI reconstruction , 2022, NeurIPS.

[4]  Chaopeng Shen,et al.  Bathymetry Inversion using a Deep-Learning-Based Surrogate for Shallow Water Equations Solvers , 2022, ArXiv.

[5]  J. Romberg,et al.  Data driven source localization using a library of nearby shipping sources of opportunity. , 2021, JASA express letters.

[6]  A. Geer,et al.  Building Tangent‐Linear and Adjoint Models for Data Assimilation With Neural Networks , 2021 .

[7]  A. Bracco,et al.  Submesoscale Mixing Across the Mixed Layer in the Gulf of Mexico , 2021, Frontiers in Marine Science.

[8]  Matthew Chantry,et al.  Machine Learning Emulation of Gravity Wave Drag in Numerical Weather Forecasting , 2021, Journal of advances in modeling earth systems.

[9]  Jordan M. Malof,et al.  Neural-adjoint method for the inverse design of all-dielectric metasurfaces. , 2020, Optics express.

[10]  Yonggui Dong,et al.  FISTA-Net: Learning a Fast Iterative Shrinkage Thresholding Network for Inverse Problems in Imaging , 2020, IEEE Transactions on Medical Imaging.

[11]  A. Wills,et al.  Physics-informed machine learning , 2021, Nature Reviews Physics.

[12]  Bo Wang,et al.  FBP-Net for direct reconstruction of dynamic PET images , 2020, Physics in medicine and biology.

[13]  Jordan M. Malof,et al.  Benchmarking deep inverse models over time, and the neural-adjoint method , 2020, NeurIPS.

[14]  Jordan M. Malof,et al.  Deep learning for accelerated all-dielectric metasurface design. , 2019, Optics express.

[15]  Paris Perdikaris,et al.  Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations , 2019, J. Comput. Phys..

[16]  Yongmin Liu,et al.  Deep-Learning-Enabled On-Demand Design of Chiral Metamaterials. , 2018, ACS nano.

[17]  Yonghong Yan,et al.  Source localization using deep neural networks in a shallow water environment. , 2018, The Journal of the Acoustical Society of America.

[18]  Hua Peng,et al.  Underwater acoustic source localization using generalized regression neural network. , 2018, The Journal of the Acoustical Society of America.

[19]  Li Jing,et al.  Nanophotonic particle simulation and inverse design using artificial neural networks , 2017, Science Advances.

[20]  Jonas Adler,et al.  Learned Primal-Dual Reconstruction , 2017, IEEE Transactions on Medical Imaging.

[21]  A. Bracco,et al.  The influence of mesoscale and submesoscale circulation on sinking particles in the northern Gulf of Mexico , 2018 .

[22]  Peter Gerstoft,et al.  Ship localization in Santa Barbara Channel using machine learning classifiers. , 2017, The Journal of the Acoustical Society of America.

[23]  Luca Antiga,et al.  Automatic differentiation in PyTorch , 2017 .

[24]  Bernard Ghanem,et al.  ISTA-Net: Iterative Shrinkage-Thresholding Algorithm Inspired Deep Network for Image Compressive Sensing , 2017, ArXiv.

[25]  Lukasz Kaiser,et al.  Attention is All you Need , 2017, NIPS.

[26]  Ali Mousavi,et al.  Learning to invert: Signal recovery via Deep Convolutional Networks , 2017, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[27]  Jian Sun,et al.  Deep ADMM-Net for Compressive Sensing MRI , 2016, NIPS.

[28]  Marcin Andrychowicz,et al.  Learning to learn by gradient descent by gradient descent , 2016, NIPS.

[29]  Karim G. Sabra,et al.  Acoustic Remote Sensing , 2015 .

[30]  M. Taroudakis Ocean Acoustic Tomography , 2006 .

[31]  Gerassimos A. Athanassoulis,et al.  Ocean acoustic tomography based on peak arrivals , 1996 .

[32]  T. Birdsall,et al.  A demonstration of ocean acoustic tomography , 1982, Nature.

[33]  Carl Wunsch,et al.  Ocean acoustic tomography: a scheme for large scale monitoring , 1979 .

[34]  D. Marquardt An Algorithm for Least-Squares Estimation of Nonlinear Parameters , 1963 .

[35]  Kenneth Levenberg A METHOD FOR THE SOLUTION OF CERTAIN NON – LINEAR PROBLEMS IN LEAST SQUARES , 1944 .