Deep-Learning-Enabled Microwave-Induced Thermoacoustic Tomography Based on Sparse Data for Breast Cancer Detection

As a rapidly developing novel electromagnetic imaging technique, microwave-induced thermoacoustic tomography (MITAT) has found many applications and attracted tremendous research interest. Using sparse data to reconstruct images is very challenging for MITAT. This work proposes a novel deep-learning-enabled MITAT (DL-MITAT) modality to address the sparse data reconstruction problem and applies it in breast cancer detection. The applied network is a domain transform network called feature projection network (FPNet) + ResU-Net. Detailed structure and implementation method of the network is described. We conduct both simulation and ex vivo experiments with breast phantoms to test the validity of the DL-MITAT approach. The obtained images given by the trained network exhibit much better quality and have much less artifacts than those obtained by a traditional imaging algorithm. We show that only 15 measurements can still reliably recover an image of the breast tumor for both full-view and limited-view configurations in ex vivo experiments. We also provide detailed discussions on the capability and limitations of the proposed scheme. This work presents a new paradigm for MITAT based on sparse data and can be applied in all related applications of MITAT, including biomedical imaging, nondestructive testing, and therapy guidance.

[1]  S. Kidera,et al.  Deep Learning Enhanced Contrast Source Inversion for Microwave Breast Cancer Imaging Modality , 2022, IEEE Journal of Electromagnetics, RF and Microwaves in Medicine and Biology.

[2]  James C. Lin The Microwave Auditory Effect , 2022, IEEE Journal of Electromagnetics, RF and Microwaves in Medicine and Biology.

[3]  Xiong Wang,et al.  2-D Noninvasive Temperature Measurement of Biological Samples Based on Compressive Thermoacoustic Tomography , 2021, IEEE Journal of Electromagnetics, RF and Microwaves in Medicine and Biology.

[4]  Xiong Wang,et al.  A Low-Cost Compressive Thermoacoustic Tomography System for Hot and Cold Foreign Bodies Detection , 2021, IEEE Sensors Journal.

[5]  Qiwen Xu,et al.  Deep learning for image reconstruction in thermoacoustic tomography , 2021, Chinese Physics B.

[6]  Lin Huang,et al.  Technical Note: Compact thermoacoustic imaging system based on a low-cost and miniaturized microwave generator for in vivo biomedical imaging. , 2021, Medical physics.

[7]  Baosheng Wang,et al.  A Preclinical System Prototype for Focused Microwave Breast Hyperthermia Guided by Compressive Thermoacoustic Tomography , 2021, IEEE Transactions on Biomedical Engineering.

[8]  Lu Zhang,et al.  Learning-Based Quantitative Microwave Imaging With a Hybrid Input Scheme , 2020, IEEE Sensors Journal.

[9]  Hua-bei Jiang,et al.  Detection and Monitoring of Osteoporosis in a Rat Model by Thermoacoustic Tomography , 2020, IEEE Journal of Electromagnetics, RF and Microwaves in Medicine and Biology.

[10]  Feng Gao,et al.  Y-Net: Hybrid deep learning image reconstruction for photoacoustic tomography in vivo , 2020, Photoacoustics.

[11]  Xiuzhu Ye,et al.  Deep Learning-Based Inversion Methods for Solving Inverse Scattering Problems With Phaseless Data , 2020, IEEE Transactions on Antennas and Propagation.

[12]  D. Xing,et al.  Real-Time Thermoacoustic Imaging-Guidance for Breast Tumor Resection , 2020, IEEE Photonics Journal.

[13]  Xiong Wang,et al.  Focused Microwave Breast Hyperthermia Monitored by Thermoacoustic Imaging: A Computational Feasibility Study Applying Realistic Breast Phantoms , 2020, IEEE Journal of Electromagnetics, RF and Microwaves in Medicine and Biology.

[14]  Tong Tong,et al.  Domain Transform Network for Photoacoustic Tomography from Limited-view and Sparsely Sampled Data , 2020, Photoacoustics.

[15]  Changfeng Wu,et al.  Thermoacoustic endoscopy , 2020, Applied Physics Letters.

[16]  Yifei Sun,et al.  Three-Dimensional Microwave-Induced Thermoacoustic Imaging Based on Compressive Sensing Using an Analytically Constructed Dictionary , 2020, IEEE Transactions on Microwave Theory and Techniques.

[17]  Qing Huo Liu,et al.  Reducing Acoustic Inhomogeneity Based on Speed of Sound Autofocus in Microwave Induced Thermoacoustic Tomography , 2019, IEEE Transactions on Biomedical Engineering.

[18]  Xosé Luís Deán-Ben,et al.  Deep learning optoacoustic tomography with sparse data , 2019, Nature Machine Intelligence.

[19]  Xudong Chen,et al.  Physics-Inspired Convolutional Neural Network for Solving Full-Wave Inverse Scattering Problems , 2019, IEEE Transactions on Antennas and Propagation.

[20]  Guang Zhang,et al.  Thermoacoustic Tomography of In Vivo Human Finger Joints , 2019, IEEE Transactions on Biomedical Engineering.

[21]  Hao Nan,et al.  Beamforming Microwave-Induced Thermoacoustic Imaging for Screening Applications , 2019, IEEE Transactions on Microwave Theory and Techniques.

[22]  Qing Huo Liu,et al.  Microwave induced thermoacoustic tomography based on probabilistic reconstruction , 2018, Applied Physics Letters.

[23]  Jong Hoon Kim,et al.  Penalized PET Reconstruction Using Deep Learning Prior and Local Linear Fitting , 2018, IEEE Transactions on Medical Imaging.

[24]  Yaoqin Xie,et al.  A Sparse-View CT Reconstruction Method Based on Combination of DenseNet and Deconvolution , 2018, IEEE Transactions on Medical Imaging.

[25]  Andreas Hauptmann,et al.  Model-Based Learning for Accelerated, Limited-View 3-D Photoacoustic Tomography , 2017, IEEE Transactions on Medical Imaging.

[26]  Victor Alves,et al.  Brain Tumor Segmentation Using Convolutional Neural Networks in MRI Images , 2016, IEEE Transactions on Medical Imaging.

[27]  W. See,et al.  Toward Quantitative Whole Organ Thermoacoustics With a Clinical Array Plus One Very Low-Frequency Channel Applied to Prostate Cancer Imaging , 2016, IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control.

[28]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[29]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[30]  Tao Qin,et al.  Computational Feasibility Study of Contrast-Enhanced Thermoacoustic Imaging for Breast Cancer Detection Using Realistic Numerical Breast Phantoms , 2015, IEEE Transactions on Microwave Theory and Techniques.

[31]  R. Witte,et al.  Quality Improvement of Thermoacoustic Imaging Based on Compressive Sensing , 2015, IEEE Antennas and Wireless Propagation Letters.

[32]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[33]  Guenther Paltauf,et al.  64-line-sensor array: fast imaging system for photoacoustic tomography , 2014, Photonics West - Biomedical Optics.

[34]  Sihua Yang,et al.  MICROWAVE-INDUCED THERMOACOUSTIC IMAGING FOR EARLY BREAST CANCER DETECTION , 2013 .

[35]  Huabei Jiang,et al.  Quantitative thermoacoustic tomography: Recovery of conductivity maps of heterogeneous media , 2012 .

[36]  Mark A. Anastasio,et al.  An Imaging Model Incorporating Ultrasonic Transducer Properties for Three-Dimensional Optoacoustic Tomography , 2011, IEEE Transactions on Medical Imaging.

[37]  B T Cox,et al.  k-Wave: MATLAB toolbox for the simulation and reconstruction of photoacoustic wave fields. , 2010, Journal of biomedical optics.

[38]  G Paltauf,et al.  Weight factors for limited angle photoacoustic tomography , 2009, Physics in medicine and biology.

[39]  S. Hagness,et al.  Toward contrast-enhanced microwave-induced thermoacoustic imaging of breast cancer: an experimental study of the effects of microbubbles on simple thermoacoustic targets , 2009, Physics in medicine and biology.

[40]  M. Haltmeier,et al.  Temporal back-projection algorithms for photoacoustic tomography with integrating line detectors , 2007 .

[41]  Lihong V Wang,et al.  Universal back-projection algorithm for photoacoustic computed tomography , 2005, SPIE BiOS.

[42]  Kevin Hughes,et al.  Gauging the impact of breast carcinoma screening in terms of tumor size and death rate , 2003, Cancer.

[43]  Minghua Xu,et al.  Time-domain reconstruction algorithms and numerical simulations for thermoacoustic tomography in various geometries , 2003, IEEE Transactions on Biomedical Engineering.

[44]  F. D. de Mul,et al.  Image reconstruction for photoacoustic scanning of tissue structures. , 2000, Applied optics.

[45]  R. Kruger,et al.  Breast cancer in vivo: contrast enhancement with thermoacoustic CT at 434 MHz-feasibility study. , 2000, Radiology.

[46]  James C. Lin,et al.  Microwave thermoelastic tissue imaging - System design , 1984, IEEE Transactions on Microwave Theory and Techniques.

[47]  F. Caspers,et al.  Measurement of Power Density in a Lossy Material by Means of Electro-Magnetically Induced Acoustic Signals for Non-Invasive Determination of Spatial Thermal Absorption in Connection with Pulsed Hyperthermia , 1982, 1982 12th European Microwave Conference.

[48]  A. Bell On the production and reproduction of sound by light , 1880, American Journal of Science.

[49]  E. Neufeld,et al.  IT’IS Database for Thermal and Electromagnetic Parameters of Biological Tissues , 2012 .

[50]  Gitta Kutyniok Compressed Sensing , 2012 .

[51]  T. Bowen Radiation-Induced Thermoacoustic Soft Tissue Imaging , 1981 .