Do CNNs Solve the CT Inverse Problem?

OBJECTIVE This work examines the claim made in the literature that the inverse problem associ- ated with image reconstruction in sparse-view computed tomography (CT) can be solved with a convolutional neural network (CNN). METHODS Training and testing image/data pairs are gener- ated in a dedicated breast CT simulation for sparse-view sampling, using two different object models. The trained CNN is tested to see if images can be accurately recovered from their corresponding sparse-view data. For reference, the same sparse-view CT data is reconstructed by the use of constrained total-variation (TV) minimization (TVmin), which exploits sparsity in the gradient magnitude image (GMI). RESULTS There is a significant discrepancy between the image obtained with the CNN and the image that generated the data. TVmin is able to accurately reconstruct the test images. CONCLUSION We find that the sparse-view CT inverse prob- lem cannot be solved for the particular published CNN- based methodology that we chose and the particular object model that we tested. SIGNIFICANCE The inability of the CNN to solve the inverse problem associated with sparse-view CT, for the specific conditions of the presented simulation, draws into question similar unsupported claims being made for the use of CNNs to solve inverse problems in medical imaging.

[1]  Michael Unser,et al.  Deep Convolutional Neural Network for Inverse Problems in Imaging , 2016, IEEE Transactions on Image Processing.

[2]  Emmanuel J. Candès,et al.  Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information , 2004, IEEE Transactions on Information Theory.

[3]  Antonin Chambolle,et al.  A First-Order Primal-Dual Algorithm for Convex Problems with Applications to Imaging , 2011, Journal of Mathematical Imaging and Vision.

[4]  Jong Chul Ye,et al.  Framing U-Net via Deep Convolutional Framelets: Application to Sparse-View CT , 2017, IEEE Transactions on Medical Imaging.

[5]  Yoshua Bengio,et al.  Understanding the difficulty of training deep feedforward neural networks , 2010, AISTATS.

[6]  Emil Y. Sidky,et al.  Quantifying Admissible Undersampling for Sparsity-Exploiting Iterative Image Reconstruction in X-Ray CT , 2011, IEEE Transactions on Medical Imaging.

[7]  Jakob S Jørgensen,et al.  Few-view single photon emission computed tomography (SPECT) reconstruction based on a blurred piecewise constant object model. , 2013, Physics in medicine and biology.

[8]  J. Boone,et al.  Dedicated breast CT: radiation dose and image quality evaluation. , 2001, Radiology.

[9]  Geoffrey E. Hinton,et al.  Learning representations by back-propagating errors , 1986, Nature.

[10]  Bruce R. Rosen,et al.  Image reconstruction by domain-transform manifold learning , 2017, Nature.

[11]  Andrea Vedaldi,et al.  MatConvNet: Convolutional Neural Networks for MATLAB , 2014, ACM Multimedia.

[12]  E. Y. Sidky,et al.  How little data is enough? Phase-diagram analysis of sparsity-regularized X-ray computed tomography , 2014, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[13]  Emil Y. Sidky,et al.  Optimization-Based Image Reconstruction From Low-Count, List-Mode TOF-PET Data , 2018, IEEE Transactions on Biomedical Engineering.

[14]  Emil Y. Sidky,et al.  Accurate image reconstruction in CT from projection data taken at few-views , 2006, SPIE Medical Imaging.

[15]  E. Sidky,et al.  Convex optimization problem prototyping for image reconstruction in computed tomography with the Chambolle–Pock algorithm , 2011, Physics in medicine and biology.

[16]  D. Donoho,et al.  Sparse nonnegative solution of underdetermined linear equations by linear programming. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[17]  Xiaoming Yuan,et al.  Adaptive Primal-Dual Hybrid Gradient Methods for Saddle-Point Problems , 2013, 1305.0546.

[18]  R M Nishikawa,et al.  Task-based assessment of breast tomosynthesis: effect of acquisition parameters and quantum noise. , 2010, Medical physics.

[19]  Kyle J. Myers,et al.  Foundations of Image Science , 2003, J. Electronic Imaging.

[20]  Mohamed Jaoua,et al.  Introduction to inverse problems , 2010 .

[21]  E.J. Candes,et al.  An Introduction To Compressive Sampling , 2008, IEEE Signal Processing Magazine.

[22]  Alessandro Freddi,et al.  Introduction to Inverse Problems , 2015 .

[23]  E. Sidky,et al.  Image reconstruction in circular cone-beam computed tomography by constrained, total-variation minimization , 2008, Physics in medicine and biology.

[24]  J. Hiriart-Urruty,et al.  Convex analysis and minimization algorithms , 1993 .

[25]  S. Frick,et al.  Compressed Sensing , 2014, Computer Vision, A Reference Guide.

[26]  E. Sidky,et al.  Accurate image reconstruction from few-views and limited-angle data in divergent-beam CT , 2009, 0904.4495.

[27]  Antonin Chambolle,et al.  Diagonal preconditioning for first order primal-dual algorithms in convex optimization , 2011, 2011 International Conference on Computer Vision.