Deep learning optoacoustic tomography with sparse data

The rapidly evolving field of optoacoustic (photoacoustic) imaging and tomography is driven by a constant need for better imaging performance in terms of resolution, speed, sensitivity, depth and contrast. In practice, data acquisition strategies commonly involve sub-optimal sampling of the tomographic data, resulting in inevitable performance trade-offs and diminished image quality. We propose a new framework for efficient recovery of image quality from sparse optoacoustic data based on a deep convolutional neural network and demonstrate its performance with whole body mouse imaging in vivo. To generate accurate high-resolution reference images for optimal training, a full-view tomographic scanner capable of attaining superior cross-sectional image quality from living mice was devised. When provided with images reconstructed from substantially undersampled data or limited-view scans, the trained network was capable of enhancing the visibility of arbitrarily oriented structures and restoring the expected image quality. Notably, the network also eliminated some reconstruction artefacts present in reference images rendered from densely sampled data. No comparable gains were achieved when the training was performed with synthetic or phantom data, underlining the importance of training with high-quality in vivo images acquired by full-view scanners. The new method can benefit numerous optoacoustic imaging applications by mitigating common image artefacts, enhancing anatomical contrast and image quantification capacities, accelerating data acquisition and image reconstruction approaches, while also facilitating the development of practical and affordable imaging systems. The suggested approach operates solely on image-domain data and thus can be seamlessly applied to artefactual images reconstructed with other modalities.Optoacoustic imaging can achieve high spatial and temporal resolution but image quality is often compromised by suboptimal data acquisition. A new method employing deep learning to recover high-quality images from sparse or limited-view optoacoustic scans has been developed and demonstrated for whole-body mouse imaging in vivo.

[1]  Jin Keun Seo,et al.  Deep learning for undersampled MRI reconstruction , 2017, Physics in medicine and biology.

[2]  Andreas K. Maier,et al.  A Deep Learning Architecture for Limited-Angle Computed Tomography Reconstruction , 2017, Bildverarbeitung für die Medizin.

[3]  Daniel Razansky,et al.  Virtual craniotomy for high-resolution optoacoustic brain microscopy , 2018, Scientific Reports.

[4]  V. Ntziachristos,et al.  Acoustic Inversion in Optoacoustic Tomography: A Review , 2013, Current medical imaging reviews.

[5]  Muyinatu A. Lediju Bell,et al.  A machine learning approach to identifying point source locations in photoacoustic data , 2017, BiOS.

[6]  V. Ntziachristos,et al.  Optical imaging of post-embryonic zebrafish using multi orientation raster scan optoacoustic mesoscopy , 2016, Light: Science & Applications.

[7]  Vasilis Ntziachristos,et al.  Fast Semi-Analytical Model-Based Acoustic Inversion for Quantitative Optoacoustic Tomography , 2010, IEEE Transactions on Medical Imaging.

[8]  Xosé Luís Deán-Ben,et al.  Transmission–reflection optoacoustic ultrasound (TROPUS) computed tomography of small animals , 2019, Light, science & applications.

[9]  Lihong V. Wang,et al.  A practical guide to photoacoustic tomography in the life sciences , 2016, Nature Methods.

[10]  Wolfgang Uter,et al.  Multispectral Optoacoustic Tomography for Assessment of Crohn's Disease Activity. , 2017, The New England journal of medicine.

[11]  Muyinatu A. Lediju Bell,et al.  Photoacoustic Source Detection and Reflection Artifact Removal Enabled by Deep Learning , 2018, IEEE Transactions on Medical Imaging.

[12]  Lena Maier-Hein,et al.  Context encoding enables machine learning-based quantitative photoacoustics , 2017, Journal of biomedical optics.

[13]  Vasilis Ntziachristos,et al.  Advances in real-time multispectral optoacoustic imaging and its applications , 2015, Nature Photonics.

[14]  Muyinatu A. Lediju Bell,et al.  A Fully Convolutional Neural Network for Beamforming Ultrasound Images , 2018, 2018 IEEE International Ultrasonics Symposium (IUS).

[15]  Lihong V. Wang,et al.  Reconstructions in limited-view thermoacoustic tomography. , 2004, Medical physics.

[16]  Vasilis Ntziachristos,et al.  Accurate Model-Based Reconstruction Algorithm for Three-Dimensional Optoacoustic Tomography , 2012, IEEE Transactions on Medical Imaging.

[17]  Guenther Paltauf,et al.  64-line-sensor array: fast imaging system for photoacoustic tomography , 2014, Photonics West - Biomedical Optics.

[18]  E. Rummeny,et al.  Multispectral Optoacoustic Tomography (MSOT) of Human Breast Cancer , 2017, Clinical Cancer Research.

[19]  Stephan Antholzer,et al.  Deep learning for photoacoustic tomography from sparse data , 2017, Inverse problems in science and engineering.

[20]  Dirk Schadendorf,et al.  Metastatic status of sentinel lymph nodes in melanoma determined noninvasively with multispectral optoacoustic imaging , 2015, Science Translational Medicine.

[21]  Andreas Hauptmann,et al.  Model-Based Learning for Accelerated, Limited-View 3-D Photoacoustic Tomography , 2017, IEEE Transactions on Medical Imaging.

[22]  Meng Zhou,et al.  Photoacoustic Image Classification and Segmentation of Breast Cancer: A Feasibility Study , 2019, IEEE Access.

[23]  Manojit Pramanik,et al.  Deep neural network-based bandwidth enhancement of photoacoustic data , 2017, Journal of biomedical optics.

[24]  Daniel Razansky,et al.  Optoacoustic Imaging and Tomography: Reconstruction Approaches and Outstanding Challenges in Image Performance and Quantification , 2013, Sensors.

[25]  Liang Song,et al.  High-speed, sparse-sampling three-dimensional photoacoustic computed tomography in vivo based on principal component analysis , 2016, Journal of biomedical optics.

[26]  Lihong V Wang,et al.  Compressed sensing in photoacoustic tomography in vivo. , 2010, Journal of biomedical optics.

[27]  Vasilis Ntziachristos,et al.  Acceleration of Optoacoustic Model-Based Reconstruction Using Angular Image Discretization , 2012, IEEE Transactions on Medical Imaging.

[28]  Vasilis Ntziachristos,et al.  Effects of small variations of speed of sound in optoacoustic tomographic imaging. , 2014, Medical physics.

[29]  Lihong V. Wang,et al.  Universal back-projection algorithm for photoacoustic computed tomography. , 2005 .

[30]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[31]  Huabei Jiang,et al.  Wearable scanning photoacoustic brain imaging in behaving rats , 2016, Journal of biophotonics.

[32]  Vasilis Ntziachristos,et al.  Modeling the shape of cylindrically focused transducers in three-dimensional optoacoustic tomography , 2013, Journal of biomedical optics.

[33]  Bruce R. Rosen,et al.  Image reconstruction by domain-transform manifold learning , 2017, Nature.

[34]  Xosé Luís Deán-Ben,et al.  On the link between the speckle free nature of optoacoustics and visibility of structures in limited-view tomography , 2016, Photoacoustics.

[35]  Markus Haltmeier,et al.  A Novel Compressed Sensing Scheme for Photoacoustic Tomography , 2015, SIAM J. Appl. Math..

[36]  Daniel Razansky,et al.  In vivo whole-body optoacoustic scanner with real-time volumetric imaging capacity , 2016 .

[37]  Jianwen Luo,et al.  End-to-end deep neural network for optical inversion in quantitative photoacoustic imaging. , 2018, Optics letters.

[38]  Bo Ning,et al.  Dictionary learning-based reverberation removal enables depth-resolved photoacoustic microscopy of cortical microvasculature in the mouse brain , 2018, Scientific Reports.

[39]  Xosé Luís Deán-Ben,et al.  Optoacoustic imaging at kilohertz volumetric frame rates. , 2018, Optica.

[40]  Edward Z. Zhang,et al.  Deep in vivo photoacoustic imaging of mammalian tissues using a tyrosinase-based genetic reporter , 2015, Nature Photonics.

[41]  Marta Betcke,et al.  Accelerated high-resolution photoacoustic tomography via compressed sensing , 2016, Physics in medicine and biology.

[42]  Vasilis Ntziachristos,et al.  Functional optoacoustic neuro-tomography for scalable whole-brain monitoring of calcium indicators , 2016, Light: Science & Applications.

[43]  Lihong V. Wang,et al.  High-speed label-free functional photoacoustic microscopy of mouse brain in action , 2015, Nature Methods.

[44]  Daniel Razansky,et al.  Characterization of Cardiac Dynamics in an Acute Myocardial Infarction Model by Four-Dimensional Optoacoustic and Magnetic Resonance Imaging , 2017, Theranostics.

[45]  Janek Gröhl,et al.  Reconstruction of initial pressure from limited view photoacoustic images using deep learning , 2018, BiOS.

[46]  Vasilis Ntziachristos,et al.  Performance of a Multispectral Optoacoustic Tomography (MSOT) System equipped with 2D vs. 3D Handheld Probes for Potential Clinical Translation , 2015, Photoacoustics.

[47]  S Shoham,et al.  Advanced optoacoustic methods for multiscale imaging of in vivo dynamics. , 2017, Chemical Society reviews.

[48]  Rui Li,et al.  Photoacoustic tomography of intact human prostates and vascular texture analysis identify prostate cancer biopsy targets , 2018, Photoacoustics.

[49]  Lihong V. Wang,et al.  Single-breath-hold photoacoustic computed tomography of the breast , 2018, Nature Communications.

[50]  Junjie Yao,et al.  Single-impulse Panoramic Photoacoustic Computed Tomography of Small-animal Whole-body Dynamics at High Spatiotemporal Resolution , 2017, Nature Biomedical Engineering.

[51]  Steven Guan,et al.  Fully Dense UNet for 2-D Sparse Photoacoustic Tomography Artifact Removal , 2018, IEEE Journal of Biomedical and Health Informatics.

[52]  Sarah E Bohndiek,et al.  Contrast agents for molecular photoacoustic imaging , 2016, Nature Methods.