Learnable Douglas-Rachford iteration and its applications in DOT imaging

How to overcome the ill-posed nature of inverse problems is a pervasive problem in medical imaging. Most existing solutions are based on regularization techniques. This paper proposed a deep neural network (DNN) based image reconstruction method, the so-called DR-Net, that leverages the interpretability of existing regularization methods and adaptive modeling capacity of DNN. Motivated by a Douglas-Rachford fixed-point iteration for solving \begin{document}$ \ell_1 $\end{document} -norm relating regularization model, the proposed DR-Net learns the prior of the solution via a U-Net based network, as well as other important regularization parameters. The DR-Net is applied to solve image reconstruction problem in diffusion optical tomography (DOT), a non-invasive imaging technique with many applications in medical imaging. The experiments on both simulated and experimental data showed that the proposed DNN based image reconstruction method significantly outperforms existing regularization methods.

[1]  Tom Goldstein,et al.  The Split Bregman Method for L1-Regularized Problems , 2009, SIAM J. Imaging Sci..

[2]  Marc Niethammer,et al.  Quicksilver: Fast predictive image registration – A deep learning approach , 2017, NeuroImage.

[3]  Stephen P. Boyd,et al.  Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers , 2011, Found. Trends Mach. Learn..

[4]  P. Lions,et al.  Splitting Algorithms for the Sum of Two Nonlinear Operators , 1979 .

[5]  Jong Chul Ye,et al.  A deep convolutional neural network using directional wavelets for low‐dose X‐ray CT reconstruction , 2016, Medical physics.

[6]  Jian Sun,et al.  Deep ADMM-Net for Compressive Sensing MRI , 2016, NIPS.

[7]  Jian-Feng Cai,et al.  Data-driven tight frame construction and image denoising , 2014 .

[8]  S. Osher,et al.  Image restoration: Total variation, wavelet frames, and beyond , 2012 .

[9]  Sebastian Nowozin,et al.  f-GAN: Training Generative Neural Samplers using Variational Divergence Minimization , 2016, NIPS.

[10]  Damek Davis,et al.  A Three-Operator Splitting Scheme and its Optimization Applications , 2015, 1504.01032.

[11]  George Barbastathis,et al.  Low Photon Count Phase Retrieval Using Deep Learning. , 2018, Physical review letters.

[12]  S Arridge,et al.  Recovery of piecewise constant coefficients in optical diffusion tomography. , 2000, Optics express.

[13]  Arye Nehorai,et al.  Image reconstruction for diffuse optical tomography using sparsity regularization and expectation-maximization algorithm. , 2007, Optics express.

[14]  Xiaoqun Zhang,et al.  Image Reconstruction by Splitting Deep Learning Regularization from Iterative Inversion , 2018, MICCAI.

[15]  Enhong Chen,et al.  Image Denoising and Inpainting with Deep Neural Networks , 2012, NIPS.

[16]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[17]  Xiaoqun Zhang,et al.  TICMR: Total Image Constrained Material Reconstruction via Nonlocal Total Variation Regularization for Spectral CT , 2016, IEEE Transactions on Medical Imaging.

[18]  A Tikhonov,et al.  Solution of Incorrectly Formulated Problems and the Regularization Method , 1963 .

[19]  Michael Unser,et al.  Deep Convolutional Neural Network for Inverse Problems in Imaging , 2016, IEEE Transactions on Image Processing.

[20]  Carola-Bibiane Schönlieb,et al.  Rethinking Medical Image Reconstruction via Shape Prior, Going Deeper and Faster: Deep Joint Indirect Registration and Reconstruction , 2019, Medical Image Anal..

[21]  Thomas Pock,et al.  Learning a variational network for reconstruction of accelerated MRI data , 2017, Magnetic resonance in medicine.

[22]  G. G. Stokes "J." , 1890, The New Yale Book of Quotations.

[23]  Dacheng Tao,et al.  Large-Cone Nonnegative Matrix Factorization , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[24]  Jin Liu,et al.  3D Feature Constrained Reconstruction for Low-Dose CT Imaging , 2018, IEEE Transactions on Circuits and Systems for Video Technology.

[25]  Yoshua Bengio,et al.  Extracting and composing robust features with denoising autoencoders , 2008, ICML '08.

[26]  Karen O. Egiazarian,et al.  Image denoising with block-matching and 3D filtering , 2006, Electronic Imaging.

[27]  Jonas Adler,et al.  Solving ill-posed inverse problems using iterative deep neural networks , 2017, ArXiv.

[28]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[29]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[30]  Nanguang Chen,et al.  Design of an Advanced Time-Domain Diffuse Optical Tomography System , 2010, IEEE Journal of Selected Topics in Quantum Electronics.

[31]  Michael Möller,et al.  Learning Proximal Operators: Using Denoising Networks for Regularizing Inverse Imaging Problems , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).