Fourier Neural Operator Networks: A Fast and General Solver for the Photoacoustic Wave Equation

Simulation tools for photoacoustic wave propagation have played a key role in advancing photoacoustic imaging by providing quantitative and qualitative insights into parameters affecting image quality. Classical methods for numerically solving the photoacoustic wave equation relies on a fine discretization of space and can become computationally expensive for large computational grids. In this work, we apply Fourier Neural Operator (FNO) networks as a fast data-driven deep learning method for solving the 2D photoacoustic wave equation in a homogeneous medium. Comparisons between the FNO network and pseudospectral time domain approach demonstrated that the FNO network generated comparable simulations with small errors and was several orders of magnitude faster. Moreover, the FNO network was generalizable and can generate simulations not observed in the training data.

[1]  Linh V. Nguyen,et al.  Reconstruction and time reversal in thermoacoustic tomography in acoustically homogeneous and inhomogeneous media , 2008 .

[2]  Didier Vray,et al.  Analytical model of optical fluence inside multiple cylindrical inhomogeneities embedded in an otherwise homogeneous turbid medium for quantitative photoacoustic imaging. , 2014, Optics express.

[3]  Minghua Xu,et al.  Time-domain reconstruction algorithms and numerical simulations for thermoacoustic tomography in various geometries , 2003, IEEE Transactions on Biomedical Engineering.

[4]  Jonas Adler,et al.  Solving ill-posed inverse problems using iterative deep neural networks , 2017, ArXiv.

[5]  T. D. Mast,et al.  A k-space method for large-scale models of wave propagation in tissue , 2001, IEEE Transactions on Ultrasonics, Ferroelectrics and Frequency Control.

[6]  Jie Pan,et al.  A practical examination of the errors arising in the direct collocation boundary element method for acoustic scattering , 2009 .

[7]  Alistair P. Rendell,et al.  Modeling nonlinear ultrasound propagation in heterogeneous media with power law absorption using a k-space pseudospectral method. , 2012, The Journal of the Acoustical Society of America.

[8]  T. V. van Leeuwen,et al.  An optimized ultrasound detector for photoacoustic breast tomography. , 2012, Medical physics.

[9]  E Weinan,et al.  The Deep Ritz Method: A Deep Learning-Based Numerical Algorithm for Solving Variational Problems , 2017, Communications in Mathematics and Statistics.

[10]  Paris Perdikaris,et al.  Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations , 2019, J. Comput. Phys..

[11]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[12]  E. Tadmor.  A review of numerical methods for nonlinear partial differential equations , 2012 .

[13]  Jun Xia,et al.  Photoacoustic imaging of breast cancer: a mini review of system design and image features , 2019, Journal of biomedical optics.

[14]  Yuqi Tang,et al.  Photoacoustic tomography of blood oxygenation: A mini review , 2018, Photoacoustics.

[15]  S. Jacques,et al.  Iterative reconstruction algorithm for optoacoustic imaging. , 2002, The Journal of the Acoustical Society of America.

[16]  P. Beard.  Biomedical photoacoustic imaging , 2011, Interface Focus.

[17]  Mark A. Anastasio,et al.  Joint Reconstruction of Absorbed Optical Energy Density and Sound Speed Distributions in Photoacoustic Computed Tomography: A Numerical Investigation , 2015, IEEE Transactions on Computational Imaging.

[18]  Steven Guan,et al.  Limited-View and Sparse Photoacoustic Tomography for Neuroimaging with Deep Learning , 2020, Scientific Reports.

[19]  Jesse V. Jokerst,et al.  Strategies for Image-Guided Therapy, Surgery, and Drug Delivery Using Photoacoustic Imaging , 2019, Theranostics.

[20]  Lexing Ying,et al.  Solving parametric PDE problems with artificial neural networks , 2017, European Journal of Applied Mathematics.

[21]  Stephan Antholzer,et al.  Deep learning for photoacoustic tomography from sparse data , 2017, Inverse problems in science and engineering.

[22]  Kamyar Azizzadenesheli,et al.  Fourier Neural Operator for Parametric Partial Differential Equations , 2021, ICLR.

[23]  M. Wolff,et al.  Finite element calculation of photoacoustic signals. , 2007, Applied optics.

[24]  Andreas Hauptmann,et al.  Model-Based Learning for Accelerated, Limited-View 3-D Photoacoustic Tomography , 2017, IEEE Transactions on Medical Imaging.

[25]  Rui Li,et al.  Photoacoustic tomography of intact human prostates and vascular texture analysis identify prostate cancer biopsy targets , 2018, Photoacoustics.

[26]  Bradley E. Treeby,et al.  Artifact Trapping During Time Reversal Photoacoustic Imaging for Acoustically Heterogeneous Media , 2010, IEEE Transactions on Medical Imaging.

[27]  Lihong V Wang,et al.  Universal back-projection algorithm for photoacoustic computed tomography , 2005, SPIE BiOS.

[28]  Steven Guan,et al.  Fully Dense UNet for 2-D Sparse Photoacoustic Tomography Artifact Removal , 2018, IEEE Journal of Biomedical and Health Informatics.

[29]  Marta Betcke,et al.  Accelerated high-resolution photoacoustic tomography via compressed sensing , 2016, Physics in medicine and biology.

[30]  Lihong V. Wang,et al.  Small-Animal Whole-Body Photoacoustic Tomography: A Review , 2014, IEEE Transactions on Biomedical Engineering.

[31]  Ronen Basri,et al.  Learning to Optimize Multigrid PDE Solvers , 2019, ICML.

[32]  Lihong V. Wang,et al.  Photoacoustic tomography: principles and advances. , 2016, Electromagnetic waves.

[33]  B T Cox,et al.  k-Wave: MATLAB toolbox for the simulation and reconstruction of photoacoustic wave fields. , 2010, Journal of biomedical optics.

[34]  Frank W. Samuelson,et al.  Evaluation of Digital Breast Tomosynthesis as Replacement of Full-Field Digital Mammography Using an In Silico Imaging Trial , 2018, JAMA network open.

[35]  George Em Karniadakis,et al.  DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operators , 2019, ArXiv.

[36]  Lihong V. Wang,et al.  Prospects of photoacoustic tomography. , 2008, Medical physics.