LEARN: Learned Experts’ Assessment-Based Reconstruction Network for Sparse-Data CT

Compressive sensing (CS) has proved effective for tomographic reconstruction from sparsely collected data or under-sampled measurements, which are practically important for few-view computed tomography (CT), tomosynthesis, interior tomography, and so on. To perform sparse-data CT, the iterative reconstruction commonly uses regularizers in the CS framework. Currently, how to choose the parameters adaptively for regularization is a major open problem. In this paper, inspired by the idea of machine learning especially deep learning, we unfold the state-of-the-art “fields of experts”-based iterative reconstruction scheme up to a number of iterations for data-driven training, construct a learned experts’ assessment-based reconstruction network (LEARN) for sparse-data CT, and demonstrate the feasibility and merits of our LEARN network. The experimental results with our proposed LEARN network produces a superior performance with the well-known Mayo Clinic low-dose challenge data set relative to the several state-of-the-art methods, in terms of artifact reduction, feature preservation, and computational speed. This is consistent to our insight that because all the regularization terms and parameters used in the iterative reconstruction are now learned from the training data, our LEARN network utilizes application-oriented knowledge more effectively and recovers underlying images more favorably than competing algorithms. Also, the number of layers in the LEARN network is only 50, reducing the computational complexity of typical iterative algorithms by orders of magnitude.

[1]  Jin Liu,et al.  Discriminative Feature Representation to Improve Projection Data Inconsistency for Low Dose CT Imaging , 2017, IEEE Transactions on Medical Imaging.

[2]  Steve B. Jiang,et al.  Cine Cone Beam CT Reconstruction Using Low-Rank Matrix Factorization: Algorithm and a Proof-of-Principle Study , 2012, IEEE Transactions on Medical Imaging.

[3]  Ge Wang,et al.  Few-view image reconstruction with dual dictionaries , 2012, Physics in medicine and biology.

[4]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[5]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[6]  Mila Nikolova,et al.  Fast Nonconvex Nonsmooth Minimization Methods for Image Restoration and Reconstruction , 2010, IEEE Transactions on Image Processing.

[7]  Jianzhong Wu,et al.  Stacked Sparse Autoencoder (SSAE) for Nuclei Detection on Breast Cancer Histopathology Images , 2016, IEEE Transactions on Medical Imaging.

[8]  Quanzheng Li,et al.  Iterative Low-Dose CT Reconstruction With Priors Trained by Artificial Neural Network , 2017, IEEE Transactions on Medical Imaging.

[9]  Joseph Y. Cheng,et al.  Deep Generative Adversarial Networks for Compressed Sensing ( GANCS ) Automates MRI , 2017 .

[10]  Song Han,et al.  Deep Generative Adversarial Networks for Compressed Sensing Automates MRI , 2017, ArXiv.

[11]  L. Xing,et al.  4D cone beam CT via spatiotemporal tensor framelet. , 2012, Medical physics.

[12]  Jin Keun Seo,et al.  Deep learning for undersampled MRI reconstruction , 2017, Physics in medicine and biology.

[13]  Huazhong Shu,et al.  Gamma regularization based reconstruction for low dose CT , 2015, Physics in medicine and biology.

[14]  Xuanqin Mou,et al.  Low-Dose CT Image Denoising Using a Generative Adversarial Network With Wasserstein Distance and Perceptual Loss , 2017, IEEE Transactions on Medical Imaging.

[15]  Yann LeCun,et al.  Learning Fast Approximations of Sparse Coding , 2010, ICML.

[16]  Enhong Chen,et al.  Image Denoising and Inpainting with Deep Neural Networks , 2012, NIPS.

[17]  T. Hebert,et al.  A generalized EM algorithm for 3-D Bayesian reconstruction from Poisson data using Gibbs priors. , 1989, IEEE transactions on medical imaging.

[18]  S. Schafer,et al.  Mobile C-arm cone-beam CT for guidance of spine surgery: Image quality, radiation dose, and integration with interventional guidance. , 2011, Medical physics.

[19]  Ce Liu,et al.  Deep Convolutional Neural Network for Image Deconvolution , 2014, NIPS.

[20]  Li Zhang,et al.  Total Variation Based Iterative Image Reconstruction , 2005, CVBIA.

[21]  Jian Sun,et al.  Deep ADMM-Net for Compressive Sensing MRI , 2016, NIPS.

[22]  Xin Jin,et al.  A limited-angle CT reconstruction method based on anisotropic TV minimization , 2013, Physics in medicine and biology.

[23]  Jian Yang,et al.  Sparse-view X-ray CT reconstruction with Gamma regularization , 2017, Neurocomputing.

[24]  Huazhong Shu,et al.  Artifact Suppressed Dictionary Learning for Low-Dose CT Image Processing , 2014, IEEE Transactions on Medical Imaging.

[25]  Gaohang Yu,et al.  Sparse-view x-ray CT reconstruction via total generalized variation regularization , 2014, Physics in medicine and biology.

[26]  Bram van Ginneken,et al.  Pulmonary Nodule Detection in CT Images: False Positive Reduction Using Multi-View Convolutional Networks , 2016, IEEE Transactions on Medical Imaging.

[27]  Jiliu Zhou,et al.  Accurate Sparse-Projection Image Reconstruction via Nonlocal TV Regularization , 2014, TheScientificWorldJournal.

[28]  Jin Liu,et al.  3D Feature Constrained Reconstruction for Low-Dose CT Imaging , 2018, IEEE Transactions on Circuits and Systems for Video Technology.

[29]  G. Herman,et al.  Algebraic reconstruction techniques (ART) for three-dimensional electron microscopy and x-ray photography. , 1970, Journal of theoretical biology.

[30]  Jiliu Zhou,et al.  Few-view image reconstruction with fractional-order total variation. , 2014, Journal of the Optical Society of America. A, Optics, image science, and vision.

[31]  Jong Chul Ye,et al.  Deep Residual Learning Approach for Sparse-view CT Reconstruction , 2017 .

[32]  Jong Chul Ye,et al.  A deep convolutional neural network using directional wavelets for low‐dose X‐ray CT reconstruction , 2016, Medical physics.

[33]  Lei Zhang,et al.  Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoising , 2016, IEEE Transactions on Image Processing.

[34]  Jong Chul Ye,et al.  Wavelet Domain Residual Network (WavResNet) for Low-Dose X-ray CT Reconstruction , 2017, ArXiv.

[35]  Ge Wang,et al.  Quest for the ultimate cardiac CT scanner , 2017, Medical physics.

[36]  Michael J. Black,et al.  Fields of Experts , 2009, International Journal of Computer Vision.

[37]  Leslie Ying,et al.  Accelerating magnetic resonance imaging via deep learning , 2016, 2016 IEEE 13th International Symposium on Biomedical Imaging (ISBI).

[38]  Andrea Vedaldi,et al.  MatConvNet: Convolutional Neural Networks for MATLAB , 2014, ACM Multimedia.

[39]  Cong Nie,et al.  Bayesian statistical reconstruction for low-dose X-ray computed tomography using an adaptive-weighting nonlocal prior , 2009, Comput. Medical Imaging Graph..

[40]  Klaus Mueller,et al.  Low-Dose CT Streak Artifacts Removal using Deep Residual Neural Network , 2017 .

[41]  S. Osher,et al.  Multi-energy CT based on a prior rank, intensity and sparsity model (PRISM) , 2011, Inverse problems.

[42]  Yan Wang,et al.  Statistical iterative reconstruction using adaptive fractional order regularization. , 2016, Biomedical optics express.

[43]  Jeffrey A. Fessler,et al.  Low dose CT image reconstruction with learned sparsifying transform , 2016, 2016 IEEE 12th Image, Video, and Multidimensional Signal Processing Workshop (IVMSP).

[44]  Hengyong Yu,et al.  Compressed sensing based interior tomography , 2009, Physics in medicine and biology.

[45]  Thomas Pock,et al.  Learning a variational network for reconstruction of accelerated MRI data , 2017, Magnetic resonance in medicine.

[46]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[47]  Yunjin Chen,et al.  Trainable Nonlinear Reaction Diffusion: A Flexible Framework for Fast and Effective Image Restoration , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[48]  Ge Wang,et al.  Spectral CT Reconstruction With Image Sparsity and Spectral Mean , 2016, IEEE Transactions on Computational Imaging.

[49]  A. Kak,et al.  Simultaneous Algebraic Reconstruction Technique (SART): A Superior Implementation of the Art Algorithm , 1984, Ultrasonic imaging.

[50]  Ge Wang,et al.  A Perspective on Deep Imaging , 2016, IEEE Access.

[51]  Ge Wang,et al.  Machine learning will transform radiology significantly within the next 5 years. , 2017, Medical physics.

[52]  E. Sidky,et al.  Accurate image reconstruction from few-views and limited-angle data in divergent-beam CT , 2009, 0904.4495.

[53]  Xiaoou Tang,et al.  Image Super-Resolution Using Deep Convolutional Networks , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[54]  Hengyong Yu,et al.  Approximate and exact cone-beam reconstruction with standard and non-standard spiral scanning , 2006, SPIE Optics + Photonics.

[55]  Jong Chul Ye,et al.  Multi-Scale Wavelet Domain Residual Learning for Limited-Angle CT Reconstruction , 2017, ArXiv.

[56]  Yoram Bresler,et al.  Learning Sparsifying Transforms , 2013, IEEE Transactions on Signal Processing.

[57]  Simon J. Doran,et al.  Stacked Autoencoders for Unsupervised Feature Learning and Multiple Organ Detection in a Pilot Study Using 4D Patient Data , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[58]  Kyoung Mu Lee,et al.  Enhanced Deep Residual Networks for Single Image Super-Resolution , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[59]  David L Donoho,et al.  Compressed sensing , 2006, IEEE Transactions on Information Theory.

[60]  Feng Lin,et al.  Low-Dose CT With a Residual Encoder-Decoder Convolutional Neural Network , 2017, IEEE Transactions on Medical Imaging.

[61]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[62]  Hu Chen,et al.  Low-dose CT via convolutional neural network. , 2017, Biomedical optics express.

[63]  E. Sidky,et al.  Image reconstruction in circular cone-beam computed tomography by constrained, total-variation minimization , 2008, Physics in medicine and biology.

[64]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[65]  Michael Unser,et al.  Deep Convolutional Neural Network for Inverse Problems in Imaging , 2016, IEEE Transactions on Image Processing.

[66]  H. Sebastian Seung,et al.  Natural Image Denoising with Convolutional Networks , 2008, NIPS.

[67]  Hengyong Yu,et al.  A scheme for multisource interior tomography. , 2009, Medical physics.

[68]  Andreas K. Maier,et al.  Deep Learning Computed Tomography , 2016, MICCAI.

[69]  Otto Zhou,et al.  Stationary chest tomosynthesis using a CNT x-ray source array , 2013, Medical Imaging.

[70]  Jong Chul Ye,et al.  Deep Residual Learning for Compressed Sensing CT Reconstruction via Persistent Homology Analysis , 2016, ArXiv.

[71]  Max A. Viergever,et al.  Generative Adversarial Networks for Noise Reduction in Low-Dose CT , 2017, IEEE Transactions on Medical Imaging.