Shearlet-based regularization in statistical inverse learning with an application to x-ray tomography

Statistical inverse learning theory, a field that lies at the intersection of inverse problems and statistical learning, has lately gained more and more attention. In an effort to steer this interplay more towards the variational regularization framework, convergence rates have recently been proved for a class of convex, p-homogeneous regularizers with p ∈ (1, 2], in the symmetric Bregman distance. Following this path, we take a further step towards the study of sparsity-promoting regularization and extend the aforementioned convergence rates to work with `p-norm regularization, with p ∈ (1, 2), for a special class of non-tight Banach frames, called shearlets, and possibly constrained to some convex set. The p = 1 case is approached as the limit case (1, 2) 3 p → 1, by complementing numerical evidence with a (partial) theoretical analysis, based on arguments from Γ-convergence theory. We numerically demonstrate our theoretical results in the context of X-ray tomography, under random sampling of the imaging angles, using both simulated and measured data.

[1]  J. Borwein,et al.  Two-Point Step Size Gradient Methods , 1988 .

[2]  H. Feichtinger,et al.  Banach spaces related to integrable group representations and their atomic decompositions. Part II , 1989 .

[3]  Gabriele Steidl,et al.  Shearlet Coorbit Spaces: Compactly Supported Analyzing Shearlets, Traces and Embeddings , 2011 .

[4]  S. Osher,et al.  Convergence rates of convex variational regularization , 2004 .

[5]  Martin Burger,et al.  Convex regularization in statistical inverse learning problems , 2021, Inverse Problems and Imaging.

[6]  Barbara Kaltenbacher,et al.  Regularization Methods in Banach Spaces , 2012, Radon Series on Computational and Applied Mathematics.

[7]  Glenn R. Easley,et al.  Radon Transform Inversion using the Shearlet Representation , 2010 .

[8]  E. Y. Sidky,et al.  How little data is enough? Phase-diagram analysis of sparsity-regularized X-ray computed tomography , 2014, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[9]  J. S. Jørgensena,et al.  Testable uniqueness conditions for empirical assessment of undersampling levels in total variation-regularized X-ray CT , 2015 .

[10]  David L. Donoho,et al.  Curvelets and reconstruction of images from noisy radon data , 2000, SPIE Optics + Photonics.

[11]  Jurgen Frikel,et al.  Sparse regularization in limited angle tomography , 2011, 1109.0385.

[12]  Jan Sijbers,et al.  The ASTRA Toolbox: A platform for advanced algorithm development in electron tomography. , 2015, Ultramicroscopy.

[13]  Gabriele Steidl,et al.  The Continuous Shearlet Transform in Arbitrary Space Dimensions , 2009, Structured Decompositions and Efficient Algorithms.

[14]  Martin Burger,et al.  Large noise in variational regularization , 2016, Transactions of Mathematics and Its Applications.

[15]  Jan Sijbers,et al.  Fast and flexible X-ray tomography using the ASTRA toolbox. , 2016, Optics express.

[16]  Yiqiu Dong,et al.  Limited-data x-ray CT for underwater pipeline inspection , 2018 .

[17]  Xiaochuan Pan,et al.  EMPIRICAL AVERAGE-CASE RELATION BETWEEN UNDERSAMPLING AND SPARSITY IN X-RAY CT. , 2012, Inverse problems and imaging.

[18]  Lin He,et al.  Error estimation for Bregman iterations and inverse scale space methods in image restoration , 2007, Computing.

[19]  Gitta Kutyniok,et al.  Introduction to Shearlets , 2012 .

[20]  Markus Haltmeier Stable Signal Reconstruction via $\ell^1$-Minimization in Redundant, Non-Tight Frames , 2013, IEEE Transactions on Signal Processing.

[21]  Samuli Siltanen,et al.  Sparse dynamic tomography : A shearlet-based approach for iodine perfusion in plant stems , 2019 .

[22]  慧 廣瀬 A Mathematical Introduction to Compressive Sensing , 2015 .

[23]  L. Zanni,et al.  A scaled gradient projection method for constrained image deblurring , 2008 .

[24]  Lawrence Carin,et al.  Compressed sampling strategies for tomography. , 2014, Journal of the Optical Society of America. A, Optics, image science, and vision.

[25]  Emmanuel J. Candès,et al.  Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information , 2004, IEEE Transactions on Information Theory.

[26]  Christoph Schnörr,et al.  Average Case Recovery Analysis of Tomographic Compressive Sensing , 2012, ArXiv.

[27]  I. Daubechies,et al.  An iterative thresholding algorithm for linear inverse problems with a sparsity constraint , 2003, math/0307152.

[28]  Matti Lassas. Eero Saksman,et al.  Discretization-invariant Bayesian inversion and Besov space priors , 2009, 0901.4220.

[29]  Gabriele Steidl,et al.  Shearlet coorbit spaces and associated Banach frames , 2009 .

[30]  Federica Porta,et al.  Variable Metric Inexact Line-Search-Based Methods for Nonsmooth Optimization , 2015, SIAM J. Optim..

[31]  I. Daubechies,et al.  Tomographic inversion using L1-norm regularization of wavelet coefficients , 2006, physics/0608094.

[32]  E. T. Quinto,et al.  Wavelet methods for a weighted sparsity penalty for region of interest tomography , 2015 .

[33]  E. D. Vito,et al.  DISCRETIZATION ERROR ANALYSIS FOR TIKHONOV REGULARIZATION , 2006 .

[34]  Trevor Hastie,et al.  Statistical Learning with Sparsity: The Lasso and Generalizations , 2015 .

[35]  Lorenzo Rosasco,et al.  Iterative regularization for convex regularizers , 2021, AISTATS.

[36]  Gitta Kutyniok,et al.  Shearlets: Multiscale Analysis for Multivariate Data , 2012 .

[37]  Markus Grasmair,et al.  Linear convergence rates for Tikhonov regularization with positively homogeneous functionals , 2011 .

[38]  Emil Y. Sidky,et al.  Quantifying Admissible Undersampling for Sparsity-Exploiting Iterative Image Reconstruction in X-Ray CT , 2011, IEEE Transactions on Medical Imaging.

[39]  Federica Porta,et al.  A nonsmooth regularization approach based on shearlets for Poisson noise removal in ROI tomography , 2018, Appl. Math. Comput..

[40]  D. Lorenz,et al.  Convergence rates and source conditions for Tikhonov regularization with sparsity constraints , 2008, 0801.1774.

[41]  O. Scherzer,et al.  Necessary and sufficient conditions for linear convergence of ℓ1‐regularization , 2011 .

[42]  Martin Burger,et al.  Modern regularization methods for inverse problems , 2018, Acta Numerica.

[43]  L. Zanni,et al.  New adaptive stepsize selections in gradient methods , 2008 .

[44]  Gilles Blanchard,et al.  Optimal Rates for Regularization of Statistical Inverse Learning Problems , 2016, Found. Comput. Math..

[45]  Peter G. Casazza,et al.  FRAMES FOR BANACH SPACES , 1977 .

[46]  A. Caponnetto,et al.  Optimal Rates for the Regularized Least-Squares Algorithm , 2007, Found. Comput. Math..

[47]  Holger Rauhut,et al.  A Mathematical Introduction to Compressive Sensing , 2013, Applied and Numerical Harmonic Analysis.

[48]  Lea Fleischer,et al.  Regularization of Inverse Problems , 1996 .

[49]  Zongben Xu,et al.  Characteristic inequalities of uniformly convex and uniformly smooth Banach spaces , 1991 .