Learned Experts' Assessment-based Reconstruction Network ("LEARN") for Sparse-data CT

Compressive sensing (CS) has proved effective for tomographic reconstruction from sparsely collected data or under-sampled measurements, which are practically important for few-view CT, tomosynthesis, interior tomography, and so on. To perform sparse-data CT, the iterative reconstruction commonly use regularizers in the CS framework. Currently, how to choose the parameters adaptively for regularization is a major open problem. In this paper, inspired by the idea of machine learning especially deep learning, we unfold a state-of-the-art “fields of experts” based iterative reconstruction scheme up to a number of iterations for data-driven training, construct a Learned Experts’ Assessment-based Reconstruction Network (“LEARN”) for sparse-data CT, and demonstrate the feasibility and merits of our LEARN network. The experimental results with our proposed LEARN network produces a superior performance with the well-known Mayo Clinic Low-Dose Challenge Dataset relative to several state-ofthe-art methods, in terms of artifact reduction, feature preservation, and computational speed. This is consistent to our insight that because all the regularization terms and parameters used in the iterative reconstruction are now learned from the training data, our LEARN network utilizes application-oriented knowledge more effectively and recovers underlying images more favorably than competing algorithms. Also, the number of layers in the LEARN network is only 50, reducing the computational complexity of typical iterative algorithms by orders of magnitude.

[1]  Jiliu Zhou,et al.  Few-view image reconstruction with fractional-order total variation. , 2014, Journal of the Optical Society of America. A, Optics, image science, and vision.

[2]  Otto Zhou,et al.  Stationary chest tomosynthesis using a CNT x-ray source array , 2013, Medical Imaging.

[3]  Jong Chul Ye,et al.  Deep Residual Learning for Compressed Sensing CT Reconstruction via Persistent Homology Analysis , 2016, ArXiv.

[4]  Enhong Chen,et al.  Image Denoising and Inpainting with Deep Neural Networks , 2012, NIPS.

[5]  Pingkun Yan,et al.  CT Image Denoising with Perceptive Deep Neural Networks , 2017, ArXiv.

[6]  Max A. Viergever,et al.  Generative Adversarial Networks for Noise Reduction in Low-Dose CT , 2017, IEEE Transactions on Medical Imaging.

[7]  Jong Chul Ye,et al.  A deep convolutional neural network using directional wavelets for low‐dose X‐ray CT reconstruction , 2016, Medical physics.

[8]  Yann LeCun,et al.  Learning Fast Approximations of Sparse Coding , 2010, ICML.

[9]  Ge Wang,et al.  Quest for the ultimate cardiac CT scanner , 2017, Medical physics.

[10]  Yunjin Chen,et al.  Trainable Nonlinear Reaction Diffusion: A Flexible Framework for Fast and Effective Image Restoration , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Andreas K. Maier,et al.  Deep Learning Computed Tomography , 2016, MICCAI.

[12]  Ge Wang,et al.  Machine learning will transform radiology significantly within the next 5 years. , 2017, Medical physics.

[13]  E. Sidky,et al.  Accurate image reconstruction from few-views and limited-angle data in divergent-beam CT , 2009, 0904.4495.

[14]  Stephen P. Boyd,et al.  Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers , 2011, Found. Trends Mach. Learn..

[15]  Jianzhong Wu,et al.  Stacked Sparse Autoencoder (SSAE) for Nuclei Detection on Breast Cancer Histopathology Images , 2016, IEEE Transactions on Medical Imaging.

[16]  Hengyong Yu,et al.  A scheme for multisource interior tomography. , 2009, Medical physics.

[17]  S. Schafer,et al.  Mobile C-arm cone-beam CT for guidance of spine surgery: Image quality, radiation dose, and integration with interventional guidance. , 2011, Medical physics.

[18]  Michael J. Black,et al.  Fields of Experts , 2009, International Journal of Computer Vision.

[19]  Leslie Ying,et al.  Accelerating magnetic resonance imaging via deep learning , 2016, 2016 IEEE 13th International Symposium on Biomedical Imaging (ISBI).

[20]  Steve B. Jiang,et al.  Cine Cone Beam CT Reconstruction Using Low-Rank Matrix Factorization: Algorithm and a Proof-of-Principle Study , 2012, IEEE Transactions on Medical Imaging.

[21]  Ge Wang,et al.  Few-view image reconstruction with dual dictionaries , 2012, Physics in medicine and biology.

[22]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[23]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[24]  Hu Chen,et al.  Low-dose CT via convolutional neural network. , 2017, Biomedical optics express.

[25]  Michael Unser,et al.  Deep Convolutional Neural Network for Inverse Problems in Imaging , 2016, IEEE Transactions on Image Processing.

[26]  E. Sidky,et al.  Image reconstruction in circular cone-beam computed tomography by constrained, total-variation minimization , 2008, Physics in medicine and biology.

[27]  Pierre Baldi,et al.  Learning Activation Functions to Improve Deep Neural Networks , 2014, ICLR.

[28]  Simon J. Doran,et al.  Stacked Autoencoders for Unsupervised Feature Learning and Multiple Organ Detection in a Pilot Study Using 4D Patient Data , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[29]  Jian Sun,et al.  Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[30]  David L Donoho,et al.  Compressed sensing , 2006, IEEE Transactions on Information Theory.

[31]  Cong Nie,et al.  Bayesian statistical reconstruction for low-dose X-ray computed tomography using an adaptive-weighting nonlocal prior , 2009, Comput. Medical Imaging Graph..

[32]  Feng Lin,et al.  Low-Dose CT With a Residual Encoder-Decoder Convolutional Neural Network , 2017, IEEE Transactions on Medical Imaging.

[33]  Hengyong Yu,et al.  Compressed sensing based interior tomography , 2009, Physics in medicine and biology.

[34]  Thomas Pock,et al.  Learning a variational network for reconstruction of accelerated MRI data , 2017, Magnetic resonance in medicine.

[35]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[36]  Jian Sun,et al.  Deep ADMM-Net for Compressive Sensing MRI , 2016, NIPS.

[37]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[38]  Andrea Vedaldi,et al.  MatConvNet: Convolutional Neural Networks for MATLAB , 2014, ACM Multimedia.

[39]  S. Osher,et al.  Multi-energy CT based on a prior rank, intensity and sparsity model (PRISM) , 2011, Inverse problems.

[40]  Yan Wang,et al.  Statistical iterative reconstruction using adaptive fractional order regularization. , 2016, Biomedical optics express.

[41]  Jeffrey A. Fessler,et al.  Low dose CT image reconstruction with learned sparsifying transform , 2016, 2016 IEEE 12th Image, Video, and Multidimensional Signal Processing Workshop (IVMSP).

[42]  Quoc V. Le,et al.  On optimization methods for deep learning , 2011, ICML.

[43]  Yoram Bresler,et al.  Learning Sparsifying Transforms , 2013, IEEE Transactions on Signal Processing.

[44]  Hengyong Yu,et al.  A soft-threshold filtering approach for reconstruction from a limited number of projections , 2010, Physics in medicine and biology.

[45]  Xiaoou Tang,et al.  Image Super-Resolution Using Deep Convolutional Networks , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[46]  Gabor T. Herman Algebraic Reconstruction Techniques , 2009 .

[47]  H. Sebastian Seung,et al.  Natural Image Denoising with Convolutional Networks , 2008, NIPS.

[48]  Hengyong Yu,et al.  Approximate and exact cone-beam reconstruction with standard and non-standard spiral scanning , 2006, SPIE Optics + Photonics.

[49]  Xin Jin,et al.  A limited-angle CT reconstruction method based on anisotropic TV minimization , 2013, Physics in medicine and biology.

[50]  L. Xing,et al.  4D cone beam CT via spatiotemporal tensor framelet. , 2012, Medical physics.

[51]  Ge Wang,et al.  Spectral CT Reconstruction With Image Sparsity and Spectral Mean , 2016, IEEE Transactions on Computational Imaging.

[52]  A. Kak,et al.  Simultaneous Algebraic Reconstruction Technique (SART): A Superior Implementation of the Art Algorithm , 1984, Ultrasonic imaging.

[53]  Ge Wang,et al.  A Perspective on Deep Imaging , 2016, IEEE Access.

[54]  Ce Liu,et al.  Deep Convolutional Neural Network for Image Deconvolution , 2014, NIPS.

[55]  Li Zhang,et al.  Total Variation Based Iterative Image Reconstruction , 2005, CVBIA.

[56]  Gaohang Yu,et al.  Sparse-view x-ray CT reconstruction via total generalized variation regularization , 2014, Physics in medicine and biology.

[57]  Bram van Ginneken,et al.  Pulmonary Nodule Detection in CT Images: False Positive Reduction Using Multi-View Convolutional Networks , 2016, IEEE Transactions on Medical Imaging.

[58]  Jiliu Zhou,et al.  Accurate Sparse-Projection Image Reconstruction via Nonlocal TV Regularization , 2014, TheScientificWorldJournal.