Deep-Learning-Based Electrical Noise Removal Enables High Spectral Optoacoustic Contrast in Deep Tissue

Image contrast in multispectral optoacoustic tomography (MSOT) can be severely reduced by electrical noise and interference in the acquired optoacoustic signals. Signal processing techniques have proven insufficient to remove the effects of electrical noise because they typically rely on simplified models and fail to capture complex characteristics of signal and noise. Moreover, they often involve time-consuming processing steps that are unsuited for real-time imaging applications. In this work, we develop and demonstrate a discriminative deep learning (DL) approach to separate electrical noise from optoacoustic signals prior to image reconstruction. The proposed DL algorithm is based on two key features. First, it learns spatiotemporal correlations in both noise and signal by using the entire optoacoustic sinogram as input. Second, it employs training based on a large dataset of experimentally acquired pure noise and synthetic optoacoustic signals. We validated the ability of the trained model to accurately remove electrical noise on synthetic data and on optoacoustic images of a phantom and the human breast. We demonstrate significant enhancements of morphological and spectral optoacoustic images reaching 19% higher blood vessel contrast and localized spectral contrast at depths of more than 2 cm for images acquired in vivo. We discuss how the proposed denoising framework is applicable to clinical multispectral optoacoustic tomography and suitable for real-time operation. This work has been submitted to the IEEE for possible publication. Copyright may be transferred without notice, after which this version may no longer be accessible.

[1]  V. Ntziachristos,et al.  Multispectral optoacoustic tomography of muscle perfusion and oxygenation under arterial and venous occlusion: A human pilot study , 2020, Journal of biophotonics.

[2]  Lihong V. Wang,et al.  Photoacoustic endoscopy. , 2009, Optics letters.

[3]  Bram van Ginneken,et al.  A survey on deep learning in medical image analysis , 2017, Medical Image Anal..

[4]  L. Xiang,et al.  High antinoise photoacoustic tomography based on a modified filtered backprojection algorithm with combination wavelet. , 2007, Medical physics.

[5]  Jaya Prakash,et al.  Soft ultrasound priors in optoacoustic reconstruction: Improving clinical vascular imaging , 2020, Photoacoustics.

[6]  Andreas Hauptmann,et al.  Deep learning in photoacoustic tomography: current approaches and future directions , 2020, Journal of Biomedical Optics.

[7]  Naftali Tishby,et al.  Machine learning and the physical sciences , 2019, Reviews of Modern Physics.

[8]  Xiaochun Cao,et al.  Single Image Dehazing via Multi-scale Convolutional Neural Networks , 2016, ECCV.

[9]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[10]  Ronald M. Summers,et al.  Deep Learning in Medical Imaging: Overview and Future Promise of an Exciting New Technique , 2016 .

[11]  M. Uder,et al.  Detection of collagens by multispectral optoacoustic tomography as an imaging biomarker for Duchenne muscular dystrophy , 2019, Nature Medicine.

[12]  Janek Gröhl,et al.  Deep learning for biomedical photoacoustic imaging: A review , 2020, ArXiv.

[13]  Jan Kautz,et al.  Loss Functions for Image Restoration With Neural Networks , 2017, IEEE Transactions on Computational Imaging.

[14]  Vasilis Ntziachristos,et al.  A Synthetic Total Impulse Response Characterization Method for Correction of Hand-Held Optoacoustic Images , 2020, IEEE Transactions on Medical Imaging.

[15]  R. Harder,et al.  Coherent X-ray diffraction imaging of strain at the nanoscale. , 2009, Nature materials.

[16]  T. Nelson,et al.  Three-dimensional ultrasound imaging. , 1998, Ultrasound in medicine & biology.

[17]  John A Viator,et al.  Automated wavelet denoising of photoacoustic signals for circulating melanoma cell detection and burn image reconstruction , 2008, Physics in medicine and biology.

[18]  Enhong Chen,et al.  Image Denoising and Inpainting with Deep Neural Networks , 2012, NIPS.

[19]  Vasilis Ntziachristos,et al.  Advances in real-time multispectral optoacoustic imaging and its applications , 2015, Nature Photonics.

[20]  S. Emelianov,et al.  Intravascular photoacoustic imaging using an IVUS imaging catheter , 2007, IEEE Transactions on Ultrasonics, Ferroelectrics and Frequency Control.

[21]  Nassir Navab,et al.  X-Ray In-Depth Decomposition: Revealing the Latent Structures , 2016, MICCAI.

[22]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[23]  Vasilis Ntziachristos,et al.  Multispectral Optoacoustic Tomography of Benign and Malignant Thyroid Disorders: A Pilot Study , 2019, The Journal of Nuclear Medicine.

[24]  V. Ntziachristos,et al.  Molecular imaging by means of multispectral optoacoustic tomography (MSOT). , 2010, Chemical reviews.

[25]  S. Arridge,et al.  Quantitative spectroscopic photoacoustic imaging: a review. , 2012, Journal of biomedical optics.

[26]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[27]  M. Brezinski Optical Coherence Tomography: Principles and Applications , 2006 .

[28]  V. Ntziachristos,et al.  Precision assessment of label-free psoriasis biomarkers with ultra-broadband optoacoustic mesoscopy , 2017, Nature Biomedical Engineering.

[29]  Vasilis Ntziachristos,et al.  Individual transducer impulse response characterization method to improve image quality of array-based handheld optoacoustic tomography. , 2020, Optics letters.

[30]  V. Ntziachristos,et al.  Label-free metabolic imaging by mid-infrared optoacoustic microscopy in living cells , 2019, Nature Biotechnology.

[31]  Vasilis Ntziachristos,et al.  Spatiospectral denoising framework for multispectral optoacoustic imaging based on sparse signal representation. , 2014, Medical physics.

[32]  P. Beard Biomedical photoacoustic imaging , 2011, Interface Focus.

[33]  Yu-Bin Yang,et al.  Image Restoration Using Very Deep Convolutional Encoder-Decoder Networks with Symmetric Skip Connections , 2016, NIPS.

[34]  Wolfgang Uter,et al.  Multispectral Optoacoustic Tomography for Assessment of Crohn's Disease Activity. , 2017, The New England journal of medicine.

[35]  H. Sebastian Seung,et al.  Algorithms for Non-negative Matrix Factorization , 2000, NIPS.

[36]  Benjamin A. Rockwell,et al.  A procedure for multiple-pulse maximum permissible exposure determination under the Z136.1-2000 American National Standard for Safe Use of Lasers , 2001 .

[37]  Lei Zhang,et al.  Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoising , 2016, IEEE Transactions on Image Processing.

[38]  M. Anastasio,et al.  Investigation of iterative image reconstruction in three-dimensional optoacoustic tomography , 2012, Physics in medicine and biology.

[39]  V. Ntziachristos,et al.  Model-based optoacoustic inversions with incomplete projection data. , 2011, Medical physics.