Deep Learning Diffuse Optical Tomography

Diffuse optical tomography (DOT) has been investigated as an alternative imaging modality for breast cancer detection thanks to its excellent contrast to hemoglobin oxidization level. However, due to the complicated non-linear photon scattering physics and ill-posedness, the conventional reconstruction algorithms are sensitive to imaging parameters such as boundary conditions. To address this, here we propose a novel deep learning approach that learns non-linear photon scattering physics and obtains an accurate three dimensional (3D) distribution of optical anomalies. In contrast to the traditional black-box deep learning approaches, our deep network is designed to invert the Lippman-Schwinger integral equation using the recent mathematical theory of deep convolutional framelets. As an example of clinical relevance, we applied the method to our prototype DOT system. We show that our deep neural network, trained with only simulation data, can accurately recover the location of anomalies within biomimetic phantoms and live animals without the use of an exogenous contrast agent.

[1]  Jong Chul Ye,et al.  Understanding Geometry of Encoder-Decoder CNNs , 2019, ICML.

[2]  Ulugbek Kamilov,et al.  Efficient and accurate inversion of multiple scattering with deep learning , 2018, Optics express.

[3]  Jong Chul Ye,et al.  Efficient B-Mode Ultrasound Image Reconstruction From Sub-Sampled RF Data Using Deep Learning , 2017, IEEE Transactions on Medical Imaging.

[4]  Jong Chul Ye,et al.  Beyond Born-Rytov limit for super-resolution optical diffraction tomography. , 2017, Optics express.

[5]  Jong Chul Ye,et al.  Deep Learning for Accelerated Ultrasound Imaging , 2017, 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[6]  Baiyu Chen,et al.  Low‐dose CT for the detection and classification of metastatic liver lesions: Results of the 2016 Low Dose CT Grand Challenge , 2017, Medical physics.

[7]  J. C. Ye,et al.  Deep Convolutional Framelets: A General Deep Learning Framework for Inverse Problems , 2017, SIAM J. Imaging Sci..

[8]  Jong Chul Ye,et al.  Deep Convolutional Framelets: A General Deep Learning for Inverse Problems , 2017, ArXiv.

[9]  Bruce R. Rosen,et al.  Image reconstruction by domain-transform manifold learning , 2017, Nature.

[10]  Stephan Antholzer,et al.  Deep learning for photoacoustic tomography from sparse data , 2017, Inverse problems in science and engineering.

[11]  Jong Chul Ye,et al.  Deep Residual Learning for Compressed Sensing CT Reconstruction via Persistent Homology Analysis , 2016, ArXiv.

[12]  Michael Unser,et al.  Deep Convolutional Neural Network for Inverse Problems in Imaging , 2016, IEEE Transactions on Image Processing.

[13]  Jong Chul Ye,et al.  A deep convolutional neural network using directional wavelets for low‐dose X‐ray CT reconstruction , 2016, Medical physics.

[14]  Jong Chul Ye,et al.  A Joint Sparse Recovery Framework for Accurate Reconstruction of Inclusions in Elastic Media , 2016, SIAM J. Imaging Sci..

[15]  Yue Lu,et al.  A Tale of Two Bases: Local-Nonlocal Regularization on Image Patches with Convolution Framelets , 2016, SIAM J. Imaging Sci..

[16]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[17]  Jong Chul Ye,et al.  Compressive Sampling Using Annihilating Filter-Based Low-Rank Interpolation , 2015, IEEE Transactions on Information Theory.

[18]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[19]  Josselin Garnier,et al.  Mathematical Methods in Elasticity Imaging , 2015 .

[20]  Michael Unser,et al.  Learning approach to optical tomography , 2015, 1502.01914.

[21]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[22]  J. C. Ye,et al.  A non-iterative method for the electrical impedance tomography based on joint sparse recovery , 2014, 1411.0516.

[23]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[24]  Martin Schweiger,et al.  The Toast++ software suite for forward and inverse modeling in optical tomography , 2014, Journal of biomedical optics.

[25]  Phaneendra K. Yalavarthy,et al.  Sparse Recovery Methods Hold Promise for Diffuse Optical Tomographic Image Reconstruction , 2014, IEEE Journal of Selected Topics in Quantum Electronics.

[26]  J. C. Ye,et al.  Joint sparsity-driven non-iterative simultaneous reconstruction of absorption and scattering in diffuse optical tomography. , 2013, Optics Express.

[27]  Hee-Joung Kim,et al.  Effect of acquisition parameters on digital breast tomosynthesis: Total angular range and number of projection views , 2012 .

[28]  Wouter Van den Broek,et al.  Method for retrieval of the three-dimensional object potential by inversion of dynamical electron scattering. , 2012, Physical review letters.

[29]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[30]  Jong Chul Ye,et al.  Compressive Diffuse Optical Tomography: Noniterative Exact Reconstruction Using Joint Sparsity , 2011, IEEE Transactions on Medical Imaging.

[31]  Geoffrey E. Hinton,et al.  Rectified Linear Units Improve Restricted Boltzmann Machines , 2010, ICML.

[32]  Hamid Dehghani,et al.  Near infrared optical tomography using NIRFAST: Algorithm for numerical model and image reconstruction. , 2009, Communications in numerical methods in engineering.

[33]  Jong Chul Ye,et al.  Exact reconstruction formula for diffuse optical tomography using simultaneous sparse representation , 2008, 2008 5th IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[34]  Jong Chul Ye,et al.  Non-iterative exact inverse scattering using simultaneous orthogonal matching pursuit (S-OMP) , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[35]  Tor D Tosteson,et al.  Digital breast tomosynthesis: initial experience in 98 women with abnormal digital screening mammography. , 2007, AJR. American journal of roentgenology.

[36]  D. Boas,et al.  Non-invasive neuroimaging using near-infrared light , 2002, Biological Psychiatry.

[37]  Thierry Blu,et al.  Sampling signals with finite rate of innovation , 2002, IEEE Trans. Signal Process..

[38]  Eric L. Miller,et al.  Imaging the body with diffuse optical tomography , 2001, IEEE Signal Process. Mag..

[39]  R. Weissleder,et al.  Experimental three-dimensional fluorescence reconstruction of diffuse media by use of a normalized Born approximation. , 2001, Optics letters.

[40]  Vadim A. Markel,et al.  Inverse problem in optical diffusion tomography. I. Fourier-Laplace inversion formulas. , 2001, Journal of the Optical Society of America. A, Optics, image science, and vision.

[41]  K D Paulsen,et al.  Calibration of near-infrared frequency-domain tissue spectroscopy for absolute absorption coefficient quantitation in neonatal head-simulating phantoms. , 2000, Journal of biomedical optics.

[42]  V. Ntziachristos,et al.  Concurrent MRI and diffuse optical tomography of breast after indocyanine green enhancement. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[43]  Charles A. Bouman,et al.  Optical diffusion tomography by iterative- coordinate-descent optimization in a Bayesian framework , 1999 .

[44]  S. Arridge Optical tomography in medical imaging , 1999 .

[45]  B. Pogue,et al.  Optical image reconstruction using frequency-domain data: simulations and experiments , 1996 .

[46]  K. Paulsen,et al.  Spatially varying optical property reconstruction using a finite element diffusion equation approximation. , 1995, Medical physics.

[47]  B. Chance,et al.  Spectroscopy and Imaging with Diffusing Light , 1995 .

[48]  A. Welch,et al.  A review of the optical properties of biological tissues , 1990 .

[49]  E. Miller,et al.  Combined optical and X-ray tomosynthesis breast imaging. , 2011, Radiology.

[50]  C. C. Law,et al.  ParaView: An End-User Tool for Large-Data Visualization , 2005, The Visualization Handbook.

[51]  R. Barbour,et al.  Frequency-domain optical imaging of absorption and scattering distributions by a Born iterative method. , 1997, Journal of the Optical Society of America. A, Optics, image science, and vision.

[52]  R. Kress,et al.  Integral equation methods in scattering theory , 1983 .