Coupled regularization with multiple data discrepancies

We consider a class of regularization methods for inverse problems where a coupled regularization is employed for the simultaneous reconstruction of data from multiple sources. Applications for such a setting can be found in multi-spectral or multimodality inverse problems, but also in inverse problems with dynamic data. We consider this setting in a rather general framework and derive stability and convergence results, including convergence rates. In particular, we show how parameter choice strategies adapted to the interplay of different data channels allow to improve upon convergence rates that would be obtained by treating all channels equally. Motivated by concrete applications, our results are obtained under rather general assumptions that allow to include the Kullback-Leibler divergence as data discrepancy term. To simplify their application to concrete settings, we further elaborate several practically relevant special cases in detail. To complement the analytical results, we also provide an algorithmic framework and source code that allows to solve a class of jointly regularized inverse problems with any number of data discrepancies. As concrete applications, we show numerical results for multi-contrast MR and joint MR-PET reconstruction.

[1]  P. Boesiger,et al.  Advances in sensitivity encoding with arbitrary k‐space trajectories , 2001, Magnetic resonance in medicine.

[2]  Otmar Scherzer,et al.  Variational Methods in Imaging , 2008, Applied mathematical sciences.

[3]  K. Bredies,et al.  Infimal convolution of total generalized variation functionals for dynamic MRI , 2017, Magnetic resonance in medicine.

[4]  Sergei V. Pereverzev,et al.  Regularization Theory for Ill-Posed Problems: Selected Topics , 2013 .

[5]  Kristian Bredies,et al.  Recovering Piecewise Smooth Multichannel Images by Minimization of Convex Functionals with Total Generalized Variation Penalty , 2011, Efficient Algorithms for Global Optimization Methods in Computer Vision.

[6]  M. Grasmair,et al.  Conditions on optimal support recovery in unmixing problems by means of multi-penalty regularization , 2016, 1601.01461.

[7]  Kristian Bredies,et al.  Joint MR-PET Reconstruction Using a Multi-Channel Image Regularizer , 2017, IEEE Transactions on Medical Imaging.

[8]  Karl Kunisch,et al.  Total Generalized Variation , 2010, SIAM J. Imaging Sci..

[9]  Tobias Kluth,et al.  Improved image reconstruction in magnetic particle imaging using structural a priori information , 2017 .

[10]  Fernando Boada,et al.  Evaluation of Parallel Level Sets and Bowsher’s Method as Segmentation-Free Anatomical Priors for Time-of-Flight PET Reconstruction , 2018, IEEE Transactions on Medical Imaging.

[11]  Marta M. Betcke,et al.  Multicontrast MRI Reconstruction with Structure-Guided Total Variation , 2015, SIAM J. Imaging Sci..

[12]  E. Haber,et al.  Joint hydrogeophysical inversion: state estimation for seawater intrusion models in 3D , 2016, Computational Geosciences.

[13]  Patrick J La Rivière,et al.  Joint reconstruction of multi-channel, spectral CT data via constrained total nuclear variation minimization , 2014, Physics in medicine and biology.

[14]  Kristian Bredies,et al.  A TGV-Based Framework for Variational Image Decompression, Zooming, and Reconstruction. Part I: Analytics , 2015, SIAM J. Imaging Sci..

[15]  Markus Grasmair,et al.  Multi-parameter Tikhonov Regularisation in Topological Spaces , 2011, 1109.0364.

[16]  I. Ekeland,et al.  Convex analysis and variational problems , 1976 .

[17]  M. Hintermüller,et al.  A function space framework for structural total variation regularization with applications in inverse problems , 2017, 1710.01527.

[18]  Xiaoyi Jiang,et al.  Motion Correction in Dual Gated Cardiac PET Using Mass-Preserving Image Registration , 2012, IEEE Transactions on Medical Imaging.

[19]  K. Bredies,et al.  Regularization of linear inverse problems with total generalized variation , 2014 .

[20]  Shuai Lu,et al.  Multi-parameter regularization and its numerical realization , 2011, Numerische Mathematik.

[21]  D. Louis Collins,et al.  A new improved version of the realistic digital brain phantom , 2006, NeuroImage.

[22]  M. Burger,et al.  Joint reconstruction via coupled Bregman iterations with applications to PET-MR imaging , 2017, 1704.06073.

[23]  W. Kalender,et al.  Integrated Whole-Body PET/MR Hybrid Imaging: Clinical Experience , 2013, Investigative radiology.

[24]  Antonin Chambolle,et al.  A First-Order Primal-Dual Algorithm for Convex Problems with Applications to Imaging , 2011, Journal of Mathematical Imaging and Vision.

[25]  Pawel Markiewicz,et al.  PET Reconstruction With an Anatomical MRI Prior Using Parallel Level Sets , 2016, IEEE Transactions on Medical Imaging.

[26]  S. Mallat.  A wavelet tour of signal processing , 1998 .

[27]  Stéphane Mallat,et al.  A Wavelet Tour of Signal Processing - The Sparse Way, 3rd Edition , 2008 .

[28]  Christoph Brune,et al.  EM-TV Methods for Inverse Problems with Poisson Noise , 2013 .

[29]  L. Shepp,et al.  Maximum Likelihood Reconstruction for Emission Tomography , 1983, IEEE Transactions on Medical Imaging.

[30]  R. Anderssen,et al.  Joint additive Kullback–Leibler residual minimization and regularization for linear inverse problems , 2007 .

[31]  Massimo Fornasier,et al.  Parameter Choice Strategies for Multipenalty Regularization , 2014, SIAM J. Numer. Anal..

[32]  Daniel K Sodickson,et al.  Low‐rank plus sparse matrix decomposition for accelerated dynamic MRI with separation of background and dynamic components , 2015, Magnetic resonance in medicine.

[33]  M. Albu,et al.  Nanoscale voxel spectroscopy by simultaneous EELS and EDS tomography. , 2014, Nanoscale.

[34]  David Atkinson,et al.  Joint reconstruction of PET-MRI by exploiting structural similarity , 2014, Inverse Problems.

[35]  Anthonin Reilhac,et al.  Evaluation of Three MRI-Based Anatomical Priors for Quantitative PET Brain Imaging , 2012, IEEE Transactions on Medical Imaging.

[36]  H. Engl,et al.  Regularization of Inverse Problems , 1996 .

[37]  Kristian Bredies,et al.  Inverse problems with second-order Total Generalized Variation constraints , 2020, ArXiv.

[38]  Jonathan M. Borwein,et al.  Convergence of Best Entropy Estimates , 1991, SIAM J. Optim..

[39]  O. Scherzer,et al.  A convergence rates result for Tikhonov regularization in Banach spaces with non-smooth operators , 2007 .

[40]  Barbara Kaltenbacher,et al.  Regularization Methods in Banach Spaces , 2012, Radon Series on Computational and Applied Mathematics.

[41]  Valeriya Naumova,et al.  Multi-penalty regularization with a component-wise penalization , 2013 .