Deep learning based dictionary learning and tomographic image reconstruction

This work presents an approach for image reconstruction in clinical low-dose tomography that combines principles from sparse signal processing with ideas from deep learning. First, we describe sparse signal representation in terms of dictionaries from a statistical perspective and interpret dictionary learning as a process of aligning distribution that arises from a generative model with empirical distribution of true signals. As a result we can see that sparse coding with learned dictionaries resembles a specific variational autoencoder, where the decoder is a linear function and the encoder is a sparse coding algorithm. Next, we show that dictionary learning can also benefit from computational advancements introduced in the context of deep learning, such as parallelism and as stochastic optimization. Finally, we show that regularization by dictionaries achieves competitive performance in computed tomography (CT) reconstruction comparing to state-of-the-art model based and data driven approaches.

[1]  Sanjeev Arora,et al.  New Algorithms for Learning Incoherent and Overcomplete Dictionaries , 2013, COLT.

[2]  M. Glas,et al.  Principles of Computerized Tomographic Imaging , 2000 .

[3]  Amir Beck,et al.  First-Order Methods in Optimization , 2017 .

[4]  Hu Chen,et al.  LEARN: Learned Experts’ Assessment-Based Reconstruction Network for Sparse-Data CT , 2017, IEEE Transactions on Medical Imaging.

[5]  Liyi Dai,et al.  Deep Dictionary Learning: A PARametric NETwork Approach , 2018, IEEE Transactions on Image Processing.

[6]  Tomasz J. Kozubowski,et al.  A folded Laplace distribution , 2015 .

[7]  Terrence J. Sejnowski,et al.  Learning Overcomplete Representations , 2000, Neural Computation.

[8]  D. Brenner,et al.  Computed tomography--an increasing source of radiation exposure. , 2007, The New England journal of medicine.

[9]  Dong Liang,et al.  Image reconstruction from few-view CT data by gradient-domain dictionary learning. , 2016, Journal of X-ray science and technology.

[10]  A. Bruckstein,et al.  K-SVD : An Algorithm for Designing of Overcomplete Dictionaries for Sparse Representation , 2005 .

[11]  D. Donoho For most large underdetermined systems of linear equations the minimal 𝓁1‐norm solution is also the sparsest solution , 2006 .

[12]  Peng Bao,et al.  Convolutional Sparse Coding for Compressed Sensing CT Reconstruction , 2019, IEEE Transactions on Medical Imaging.

[13]  V. FABER,et al.  Inversion of cone-beam data and helical tomography , 1995 .

[14]  Thomas Köhler,et al.  The radon-split method for helical cone-beam CT and its application to nongated reconstruction , 2006, IEEE Transactions on Medical Imaging.

[15]  Bahareh Tolooshams,et al.  Deep Residual Autoencoders for Expectation Maximization-Inspired Dictionary Learning , 2020, IEEE Transactions on Neural Networks and Learning Systems.

[16]  Kristian Bredies,et al.  A TGV-Based Framework for Variational Image Decompression, Zooming, and Reconstruction. Part I: Analytics , 2015, SIAM J. Imaging Sci..

[17]  A. Chambolle,et al.  A Convex Variational Model for Learning Convolutional Image Atoms from Incomplete Data , 2018, Journal of Mathematical Imaging and Vision.

[18]  Marc Teboulle,et al.  A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems , 2009, SIAM J. Imaging Sci..

[19]  Jeffrey A. Fessler,et al.  Statistical image reconstruction algorithms using paraboloidal surrogates for pet transmission scans , 1999 .

[20]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[21]  Bruno A. Olshausen,et al.  PROBABILISTIC FRAMEWORK FOR THE ADAPTATION AND COMPARISON OF IMAGE CODES , 1999 .

[22]  XianYu Zhao,et al.  Low-dose CT Image Reconstruction via Total Variation and Dictionary Learning , 2019, 2019 IEEE 9th International Conference on Electronics Information and Emergency Communication (ICEIEC).

[23]  Karl Kunisch,et al.  Total Generalized Variation , 2010, SIAM J. Imaging Sci..

[24]  Anima Anandkumar,et al.  Exact Recovery of Sparsely Used Overcomplete Dictionaries , 2013, ArXiv.

[25]  Joel A. Tropp,et al.  Signal Recovery From Random Measurements Via Orthogonal Matching Pursuit , 2007, IEEE Transactions on Information Theory.

[26]  Frank Natterer,et al.  A Sobolev Space Analysis of Picture Reconstruction , 1980 .

[27]  Frédéric Noo,et al.  Exact helical reconstruction using native cone-beam geometries. , 2003, Physics in medicine and biology.

[28]  Maximilian Schmidt,et al.  Computed tomography reconstruction using deep image prior and learned reconstruction methods , 2020, Inverse Problems.

[29]  Michael Elad,et al.  On Multi-Layer Basis Pursuit, Efficient Algorithms and Convolutional Neural Networks , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  E. Candès,et al.  Stable signal recovery from incomplete and inaccurate measurements , 2005, math/0503066.

[31]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[32]  Baiyu Chen,et al.  Low‐dose CT for the detection and classification of metastatic liver lesions: Results of the 2016 Low Dose CT Grand Challenge , 2017, Medical physics.

[33]  Edoardo Amaldi,et al.  On the Approximability of Minimizing Nonzero Variables or Unsatisfied Relations in Linear Systems , 1998, Theor. Comput. Sci..

[34]  Carola-Bibiane Schönlieb,et al.  Adversarial Regularizers in Inverse Problems , 2018, NeurIPS.

[35]  Akira Hirabayashi,et al.  Low-Dose CT Reconstruction with Multiclass Orthogonal Dictionaries , 2019, 2019 IEEE International Conference on Image Processing (ICIP).

[36]  Alexander Katsevich 3PI algorithms for helical computer tomography , 2006, Adv. Appl. Math..

[37]  Radford M. Neal Pattern Recognition and Machine Learning , 2007, Technometrics.

[38]  Michael Elad,et al.  Multilayer Convolutional Sparse Modeling: Pursuit and Dictionary Learning , 2017, IEEE Transactions on Signal Processing.

[39]  David Völgyes,et al.  Image quality with iterative reconstruction techniques in CT of the lungs—A phantom study , 2018, European journal of radiology open.

[40]  Michael Unser,et al.  Deep Convolutional Neural Network for Inverse Problems in Imaging , 2016, IEEE Transactions on Image Processing.

[41]  M. Vannier,et al.  Why do commercial CT scanners still employ traditional, filtered back-projection for image reconstruction? , 2009, Inverse problems.

[42]  Johannes Schwab,et al.  Deep synthesis regularization of inverse problems , 2020, ArXiv.

[43]  Joel G Fletcher,et al.  State of the Art in Abdominal CT: The Limits of Iterative Reconstruction Algorithms. , 2019, Radiology.

[44]  Lei Zhang,et al.  Low-Dose X-ray CT Reconstruction via Dictionary Learning , 2012, IEEE Transactions on Medical Imaging.

[45]  Michael Elad,et al.  Rethinking the CSC Model for Natural Images , 2019, NeurIPS.

[46]  Hengyong Yu,et al.  Numerical studies on Feldkamp-type and Katsevich-type algorithms for cone-beam scanning along nonstandard spirals , 2004, SPIE Optics + Photonics.

[47]  Karl Kunisch,et al.  Variational Networks: An Optimal Control Approach to Early Stopping Variational Methods for Image Restoration , 2020, Journal of Mathematical Imaging and Vision.

[48]  Jeffrey A. Fessler,et al.  Image Reconstruction: From Sparsity to Data-Adaptive Methods and Machine Learning , 2019, Proceedings of the IEEE.

[49]  Michael Elad,et al.  Dictionaries for Sparse Representation Modeling , 2010, Proceedings of the IEEE.

[50]  A. Katsevich A GENERAL SCHEME FOR CONSTRUCTING INVERSION ALGORITHMS FOR CONE BEAM CT , 2003 .

[51]  Qiang Du,et al.  Smoothed L0-Constraint Dictionary Learning for Low-Dose X-Ray CT Reconstruction , 2020, IEEE Access.

[52]  Emmanuel J. Candès,et al.  Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information , 2004, IEEE Transactions on Information Theory.

[53]  Y. Nesterov A method for solving the convex programming problem with convergence rate O(1/k^2) , 1983 .

[54]  Jonas Adler,et al.  Learned Primal-Dual Reconstruction , 2017, IEEE Transactions on Medical Imaging.

[55]  Jeffrey A. Fessler,et al.  Statistical image reconstruction for polyenergetic X-ray computed tomography , 2002, IEEE Transactions on Medical Imaging.

[56]  T. Blumensath,et al.  Iterative Thresholding for Sparse Approximations , 2008 .

[57]  Ming Li,et al.  Low-dose CT reconstruction via L1 dictionary learning regularization using iteratively reweighted least-squares , 2016, BioMedical Engineering OnLine.

[58]  Andreas M. Tillmann On the Computational Intractability of Exact and Approximate Dictionary Learning , 2014, IEEE Signal Processing Letters.

[59]  S. Stevens,et al.  Radiation and chest CT scan examinations: what do we know? , 2012, Chest.

[60]  Andrea Vedaldi,et al.  Deep Image Prior , 2017, International Journal of Computer Vision.

[61]  P. Noël,et al.  The evolution of image reconstruction for CT—from filtered back projection to artificial intelligence , 2018, European radiology.

[62]  Hengyong Yu,et al.  Studies on Palamodov's algorithm for cone-beam CT along a general curve , 2006 .

[63]  Natalie N. Braun,et al.  Strategies for reducing radiation dose in CT. , 2009, Radiologic clinics of North America.

[64]  J. Leipsic,et al.  State of the Art: Iterative CT Reconstruction Techniques. , 2015, Radiology.

[65]  Frank Natterer,et al.  Mathematical methods in image reconstruction , 2001, SIAM monographs on mathematical modeling and computation.

[66]  Emmanuel J. Candès,et al.  Near-Optimal Signal Recovery From Random Projections: Universal Encoding Strategies? , 2004, IEEE Transactions on Information Theory.

[67]  David J. Field,et al.  Sparse coding with an overcomplete basis set: A strategy employed by V1? , 1997, Vision Research.

[68]  Huazhong Shu,et al.  Artifact Suppressed Dictionary Learning for Low-Dose CT Image Processing , 2014, IEEE Transactions on Medical Imaging.

[69]  B. F. Logan,et al.  The Fourier reconstruction of a head section , 1974 .

[70]  Jonas Adler,et al.  Accelerated Forward-Backward Optimization using Deep Learning , 2021, 2105.05210.

[71]  M. Kalra,et al.  Strategies for CT radiation dose optimization. , 2004, Radiology.

[72]  Michael Elad,et al.  Convolutional Neural Networks Analyzed via Convolutional Sparse Coding , 2016, J. Mach. Learn. Res..

[73]  Mark A. Girolami,et al.  A Variational Method for Learning Sparse and Overcomplete Representations , 2001, Neural Computation.

[74]  Karl Kunisch,et al.  Total Deep Variation for Linear Inverse Problems , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[75]  A. C. Riddle,et al.  Inversion of Fan-Beam Scans in Radio Astronomy , 1967 .

[76]  Denis Tack,et al.  Radiation dose from adult and pediatric multidetector computed tomography , 2007 .

[77]  L. Feldkamp,et al.  Practical cone-beam algorithm , 1984 .