Model-Based Reconstruction of Large Three-Dimensional Optoacoustic Datasets

Iterative model-based algorithms are known to enable more accurate and quantitative optoacoustic (photoacoustic) tomographic reconstructions than standard back-projection methods. However, three-dimensional (3D) model-based inversion is often hampered by high computational complexity and memory overhead. Parallel implementations on a graphics processing unit (GPU) have been shown to efficiently reduce the memory requirements by on-the-fly calculation of the actions of the optoacoustic model matrix, but the high complexity still makes these approaches impractical for large 3D optoacoustic datasets. Herein, we show that the computational complexity of 3D model-based iterative inversion can be significantly reduced by splitting the model matrix into two parts: one maximally sparse matrix containing only one entry per voxel-transducer pair and a second matrix corresponding to cyclic convolution. We further suggest reconstructing the images by multiplying the transpose of the model matrix calculated in this manner with the acquired signals, which is equivalent to using a very large regularization parameter in the iterative inversion method. The performance of these two approaches is compared to that of standard back-projection and a recently introduced GPU-based model-based method using datasets from in vivo experiments. The reconstruction time was accelerated by approximately an order of magnitude with the new iterative method, while multiplication with the transpose of the matrix is shown to be as fast as standard back-projection.

[1]  Linh V. Nguyen,et al.  Reconstruction and time reversal in thermoacoustic tomography in acoustically homogeneous and inhomogeneous media , 2008 .

[2]  Lihong V Wang,et al.  Universal back-projection algorithm for photoacoustic computed tomography , 2005, SPIE BiOS.

[3]  Daniel Razansky,et al.  Characterization of Cardiac Dynamics in an Acute Myocardial Infarction Model by Four-Dimensional Optoacoustic and Magnetic Resonance Imaging , 2017, Theranostics.

[4]  Vasilis Ntziachristos,et al.  Model-based optoacoustic inversion with arbitrary-shape detectors. , 2011, Medical physics.

[5]  Xosé Luís Deán-Ben,et al.  Optoacoustic imaging at kilohertz volumetric frame rates. , 2018, Optica.

[6]  Edward Z. Zhang,et al.  Deep in vivo photoacoustic imaging of mammalian tissues using a tyrosinase-based genetic reporter , 2015, Nature Photonics.

[7]  Vasilis Ntziachristos,et al.  Three-dimensional optoacoustic reconstruction using fast sparse representation. , 2017, Optics letters.

[8]  Patrick J. La Riviere,et al.  Photoacoustic image reconstruction in an attenuating medium using singular-value decomposition , 2008, 2008 IEEE Nuclear Science Symposium Conference Record.

[9]  B. Cox,et al.  Photoacoustic tomography in absorbing acoustic media using time reversal , 2010 .

[10]  Anne Gelb,et al.  Sparsity-based photoacoustic image reconstruction with a linear array transducer and direct measurement of the forward model , 2018, Journal of biomedical optics.

[11]  Joemini Poudel,et al.  A survey of computational frameworks for solving the acoustic inverse problem in three-dimensional photoacoustic computed tomography , 2019, Physics in medicine and biology.

[12]  Vasilis Ntziachristos,et al.  Functional optoacoustic neuro-tomography for scalable whole-brain monitoring of calcium indicators , 2016, Light: Science & Applications.

[13]  Mark A. Anastasio,et al.  A Forward-Adjoint Operator Pair Based on the Elastic Wave Equation for Use in Transcranial Photoacoustic Computed Tomography , 2017, SIAM J. Imaging Sci..

[14]  Lu Ding,et al.  Efficient 3-D Model-Based Reconstruction Scheme for Arbitrary Optoacoustic Acquisition Geometries , 2017, IEEE Transactions on Medical Imaging.

[15]  Ling He,et al.  Three-dimensional photoacoustic tomography based on graphics-processing-unit-accelerated finite element method. , 2013, Applied optics.

[16]  Muyinatu A. Lediju Bell,et al.  Photoacoustic Source Detection and Reflection Artifact Removal Enabled by Deep Learning , 2018, IEEE Transactions on Medical Imaging.

[17]  Yiqiu Dong,et al.  An algorithm for total variation regularized photoacoustic imaging , 2015, Adv. Comput. Math..

[18]  Sanjiv S Gambhir,et al.  Quantitative photoacoustic image reconstruction improves accuracy in deep tissue structures. , 2016, Biomedical optics express.

[19]  G. Turin,et al.  An introduction to matched filters , 1960, IRE Trans. Inf. Theory.

[20]  Daniel Kolditz,et al.  Iterative reconstruction methods in X-ray CT. , 2012, Physica medica : PM : an international journal devoted to the applications of physics to medicine and biology : official journal of the Italian Association of Biomedical Physics.

[21]  Richard Su,et al.  Whole-body three-dimensional optoacoustic tomography system for small animals. , 2009, Journal of biomedical optics.

[22]  F. M. van den Engh,et al.  Visualizing breast cancer using the Twente photoacoustic mammoscope: what do we learn from twelve new patient measurements? , 2012, Optics express.

[23]  M. Vannier,et al.  Why do commercial CT scanners still employ traditional, filtered back-projection for image reconstruction? , 2009, Inverse problems.

[24]  Xosé Luís Deán-Ben,et al.  Expediting model-based optoacoustic reconstructions with tomographic symmetries. , 2013, Medical physics.

[25]  Eldon Ng,et al.  Analysis of a photoacoustic imaging system by the crosstalk matrix and singular value decomposition. , 2010, Optics express.

[26]  Linh V. Nguyen,et al.  Analysis of Iterative Methods in Photoacoustic Tomography with Variable Sound Speed , 2016, SIAM J. Imaging Sci..

[27]  Time Reversal in Photoacoustic or Thermoacoustic Tomography , 2017 .

[28]  Doreen Steed,et al.  Dedicated 3D photoacoustic breast imaging. , 2013, Medical physics.

[29]  Daniel Razansky,et al.  Correlation between volumetric oxygenation responses and electrophysiology identifies deep thalamocortical activity during epileptic seizures , 2016, Neurophotonics.

[30]  S. Jacques,et al.  Iterative reconstruction algorithm for optoacoustic imaging. , 2002, The Journal of the Acoustical Society of America.

[31]  S Shoham,et al.  Advanced optoacoustic methods for multiscale imaging of in vivo dynamics. , 2017, Chemical Society reviews.

[32]  Thomas P. Matthews,et al.  Joint reconstruction of the initial pressure and speed of sound distributions from combined photoacoustic and ultrasound tomography measurements , 2017, Inverse problems.

[33]  Xosé Luís Deán-Ben,et al.  Deep learning optoacoustic tomography with sparse data , 2019, Nature Machine Intelligence.

[34]  Shy Shoham,et al.  Functional optoacoustic neuro-tomography of calcium fluxes in adult zebrafish brain in vivo. , 2017, Optics letters.

[35]  Junjie Yao,et al.  Single-impulse Panoramic Photoacoustic Computed Tomography of Small-animal Whole-body Dynamics at High Spatiotemporal Resolution , 2017, Nature Biomedical Engineering.

[36]  Simon R. Arridge,et al.  On the adjoint operator in photoacoustic tomography , 2016, 1602.02027.

[37]  Lei Xing,et al.  GPU computing in medical physics: a review. , 2011, Medical physics.

[38]  Lu Ding,et al.  Real-Time Model-Based Inversion in Cross-Sectional Optoacoustic Tomography , 2016, IEEE Transactions on Medical Imaging.

[39]  Mark A. Anastasio,et al.  Investigation of the far-field approximation for modeling a transducer's spatial impulse response in photoacoustic computed tomography , 2013, Photoacoustics.

[40]  Vasilis Ntziachristos,et al.  Efficient non-negative constrained model-based inversion in optoacoustic tomography , 2015, Physics in medicine and biology.

[41]  Vasilis Ntziachristos,et al.  Accurate Model-Based Reconstruction Algorithm for Three-Dimensional Optoacoustic Tomography , 2012, IEEE Transactions on Medical Imaging.

[42]  Daniel Razansky,et al.  Portable spherical array probe for volumetric real-time optoacoustic imaging at centimeter-scale depths. , 2013, Optics express.

[43]  Dimple Modgil,et al.  Image reconstruction in photoacoustic tomography with variable speed of sound using a higher-order geometrical acoustics approximation. , 2010, Journal of biomedical optics.

[44]  Huabei Jiang,et al.  GPU-based acceleration and mesh optimization of finite-element-method-based quantitative photoacoustic tomography: a step towards clinical applications. , 2017, Applied optics.

[45]  Mark A. Anastasio,et al.  Full-Wave Iterative Image Reconstruction in Photoacoustic Tomography With Acoustically Inhomogeneous Media , 2013, IEEE Transactions on Medical Imaging.

[46]  Stefan Morscher,et al.  Semi-quantitative Multispectral Optoacoustic Tomography (MSOT) for volumetric PK imaging of gastric emptying , 2014, Photoacoustics.

[47]  Vasilis Ntziachristos,et al.  Efficient Framework for Model-Based Tomographic Image Reconstruction Using Wavelet Packets , 2012, IEEE Transactions on Medical Imaging.

[48]  Vasilis Ntziachristos,et al.  Weighted model-based optoacoustic reconstruction in acoustic scattering media. , 2013, Physics in medicine and biology.

[49]  Daniel Razansky,et al.  Spiral volumetric optoacoustic tomography visualizes multi-scale dynamics in mice , 2016, Light: Science & Applications.

[50]  Linh V. Nguyen,et al.  Full Field Inversion in Photoacoustic Tomography with Variable Sound Speed , 2018, Applied Sciences.

[51]  Mark A. Anastasio,et al.  Discrete Imaging Models for Three-Dimensional Optoacoustic Tomography Using Radially Symmetric Expansion Functions , 2013, IEEE Transactions on Medical Imaging.

[52]  Vasilis Ntziachristos,et al.  Frequency domain optoacoustic tomography using amplitude and phase , 2014, Photoacoustics.

[53]  Tao Zhang,et al.  Noninvasive High-Speed Photoacoustic Tomography of Cerebral Hemodynamics in Awake-Moving Rats , 2015, Journal of cerebral blood flow and metabolism : official journal of the International Society of Cerebral Blood Flow and Metabolism.

[54]  Roger J. Zemp,et al.  Sparsity-based reconstruction for super-resolved limited-view photoacoustic computed tomography deep in a scattering medium. , 2018, Optics letters.

[55]  G. Hounsfield Computerized transverse axial scanning (tomography). 1. Description of system. , 1973, The British journal of radiology.

[56]  Xosé Luís Deán-Ben,et al.  Volumetric Optoacoustic Temperature Mapping in Photothermal Therapy , 2017, Scientific Reports.

[57]  Mark A. Anastasio,et al.  A Constrained Variable Projection Reconstruction Method for Photoacoustic Computed Tomography Without Accurate Knowledge of Transducer Responses , 2015, IEEE Transactions on Medical Imaging.

[58]  Vasilis Ntziachristos,et al.  Optoacoustic image reconstruction and system analysis for finite-aperture detectors under the wavelet-packet framework , 2016, Journal of biomedical optics.

[59]  R. A. Brooks,et al.  Principles of computer assisted tomography (CAT) in radiographic and radioisotopic imaging , 1976, Physics in medicine and biology.

[60]  Michael A. Saunders,et al.  LSQR: An Algorithm for Sparse Linear Equations and Sparse Least Squares , 1982, TOMS.

[61]  Daniel Razansky,et al.  In vivo whole-body optoacoustic scanner with real-time volumetric imaging capacity , 2016 .

[62]  Otmar Scherzer,et al.  A direct method for photoacoustic tomography with inhomogeneous sound speed , 2015, 1507.01741.

[63]  Jianwen Luo,et al.  End-to-end deep neural network for optical inversion in quantitative photoacoustic imaging. , 2018, Optics letters.

[64]  Lihong V. Wang,et al.  Photoacoustic imaging of voltage responses beyond the optical diffusion limit , 2017, Scientific Reports.

[65]  J. Leipsic,et al.  State of the Art: Iterative CT Reconstruction Techniques. , 2015, Radiology.

[66]  Andreas Hauptmann,et al.  Model-Based Learning for Accelerated, Limited-View 3-D Photoacoustic Tomography , 2017, IEEE Transactions on Medical Imaging.

[67]  Daniel Razansky,et al.  Visual Quality Enhancement in Optoacoustic Tomography Using Active Contour Segmentation Priors , 2015, IEEE Transactions on Medical Imaging.

[68]  Neal C. Burton,et al.  Measures of kidney function by minimally invasive techniques correlate with histological glomerular damage in SCID mice with adriamycin-induced nephropathy , 2015, Scientific Reports.

[69]  Vasilis Ntziachristos,et al.  Modeling the shape of cylindrically focused transducers in three-dimensional optoacoustic tomography , 2013, Journal of biomedical optics.

[70]  Xosé Luís Deán-Ben,et al.  On the link between the speckle free nature of optoacoustics and visibility of structures in limited-view tomography , 2016, Photoacoustics.

[71]  Thomas Berer,et al.  Three-dimensional photoacoustic imaging using fiber-based line detectors. , 2010, Journal of biomedical optics.

[72]  M. Anastasio,et al.  Investigation of iterative image reconstruction in three-dimensional optoacoustic tomography , 2012, Physics in medicine and biology.

[73]  Stephan Antholzer,et al.  Deep learning for photoacoustic tomography from sparse data , 2017, Inverse problems in science and engineering.

[74]  V. Ntziachristos,et al.  Model-based optoacoustic inversions with incomplete projection data. , 2011, Medical physics.

[75]  G. Hounsfield Computerized transverse axial scanning (tomography): Part I. Description of system. 1973. , 1973, The British journal of radiology.

[76]  Tanja Tarvainen,et al.  Quantitative photoacoustic tomography using illuminations from a single direction , 2015, Journal of biomedical optics.

[77]  Lihong V. Wang,et al.  A practical guide to photoacoustic tomography in the life sciences , 2016, Nature Methods.