Deep Learning Diffuse Optical Tomography

Diffuse optical tomography (DOT) has been investigated as an alternative imaging modality for breast cancer detection thanks to its excellent contrast to hemoglobin oxidization level. However, due to the complicated non-linear photon scattering physics and ill-posedness, the conventional reconstruction algorithms are sensitive to imaging parameters such as boundary conditions. To address this, here we propose a novel deep learning approach that learns non-linear photon scattering physics and obtains an accurate three dimensional (3D) distribution of optical anomalies. In contrast to the traditional black-box deep learning approaches, our deep network is designed to invert the Lippman-Schwinger integral equation using the recent mathematical theory of deep convolutional framelets. As an example of clinical relevance, we applied the method to our prototype DOT system. We show that our deep neural network, trained with only simulation data, can accurately recover the location of anomalies within biomimetic phantoms and live animals without the use of an exogenous contrast agent.

[1]  B. Chance,et al.  Spectroscopy and Imaging with Diffusing Light , 1995 .

[2]  V. Ntziachristos,et al.  Concurrent MRI and diffuse optical tomography of breast after indocyanine green enhancement. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[3]  Jong Chul Ye,et al.  A deep convolutional neural network using directional wavelets for low‐dose X‐ray CT reconstruction , 2016, Medical physics.

[4]  Jong Chul Ye,et al.  Joint sparsity-driven non-iterative simultaneous reconstruction of absorption and scattering in diffuse optical tomography. , 2013, Optics express.

[5]  A. Welch,et al.  A review of the optical properties of biological tissues , 1990 .

[6]  E. Miller,et al.  Combined optical and X-ray tomosynthesis breast imaging. , 2011, Radiology.

[7]  Michael Unser,et al.  Deep Convolutional Neural Network for Inverse Problems in Imaging , 2016, IEEE Transactions on Image Processing.

[8]  Jong Chul Ye,et al.  Beyond Born-Rytov limit for super-resolution optical diffraction tomography. , 2017, Optics express.

[9]  Jong Chul Ye,et al.  Efficient B-Mode Ultrasound Image Reconstruction From Sub-Sampled RF Data Using Deep Learning , 2017, IEEE Transactions on Medical Imaging.

[10]  Bruce R. Rosen,et al.  Image reconstruction by domain-transform manifold learning , 2017, Nature.

[11]  Hamid Dehghani,et al.  Near infrared optical tomography using NIRFAST: Algorithm for numerical model and image reconstruction. , 2009, Communications in numerical methods in engineering.

[12]  Hee-Joung Kim,et al.  Effect of acquisition parameters on digital breast tomosynthesis: Total angular range and number of projection views , 2012 .

[13]  Eric L. Miller,et al.  Imaging the body with diffuse optical tomography , 2001, IEEE Signal Process. Mag..

[14]  C. C. Law,et al.  ParaView: An End-User Tool for Large-Data Visualization , 2005, The Visualization Handbook.

[15]  Martin Schweiger,et al.  The Toast++ software suite for forward and inverse modeling in optical tomography , 2014, Journal of biomedical optics.

[16]  Michael Unser,et al.  Learning approach to optical tomography , 2015, 1502.01914.

[17]  S. Arridge Optical tomography in medical imaging , 1999 .

[18]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[19]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[20]  Stephan Antholzer,et al.  Deep learning for photoacoustic tomography from sparse data , 2017, Inverse problems in science and engineering.

[21]  Wouter Van den Broek,et al.  Method for retrieval of the three-dimensional object potential by inversion of dynamical electron scattering. , 2012, Physical review letters.

[22]  Jong Chul Ye,et al.  Compressive Diffuse Optical Tomography: Noniterative Exact Reconstruction Using Joint Sparsity , 2011, IEEE Transactions on Medical Imaging.

[23]  Ulugbek Kamilov,et al.  Efficient and accurate inversion of multiple scattering with deep learning , 2018, Optics express.

[24]  Jong Chul Ye,et al.  Deep Convolutional Framelets: A General Deep Learning Framework for Inverse Problems , 2017, SIAM J. Imaging Sci..

[25]  Vadim A. Markel,et al.  Inverse problem in optical diffusion tomography. I. Fourier-Laplace inversion formulas. , 2001, Journal of the Optical Society of America. A, Optics, image science, and vision.

[26]  K. Paulsen,et al.  Spatially varying optical property reconstruction using a finite element diffusion equation approximation. , 1995, Medical physics.

[27]  B. Pogue,et al.  Optical image reconstruction using frequency-domain data: simulations and experiments , 1996 .

[28]  Jong Chul Ye,et al.  Understanding Geometry of Encoder-Decoder CNNs , 2019, ICML.

[29]  Phaneendra K. Yalavarthy,et al.  Sparse Recovery Methods Hold Promise for Diffuse Optical Tomographic Image Reconstruction , 2014, IEEE Journal of Selected Topics in Quantum Electronics.