Joint reconstruction via coupled Bregman iterations with applications to PET-MR imaging

Joint reconstruction has recently attracted a lot of attention, especially in the field of medical multi-modality imaging such as PET-MRI. Most of the developed methods rely on the comparison of image gradients, or more precisely their location, direction and magnitude, to make use of structural similarities between the images. A challenge and still an open issue for most of the methods is to handle images in entirely different scales, i.e. different magnitudes of gradients that cannot be dealt with by a global scaling of the data. We propose the use of generalized Bregman distances and infimal convolutions thereof with regard to the well-known total variation functional. The use of a total variation subgradient respectively the involved vector field rather than an image gradient naturally excludes the magnitudes of gradients, which in particular solves the scaling behavior. Additionally, the presented method features a weighting that allows to control the amount of interaction between channels. We give insights into the general behavior of the method, before we further tailor it to a particular application, namely PET-MRI joint reconstruction. To do so, we compute joint reconstruction results from blurry Poisson data for PET and undersampled Fourier data from MRI and show that we can gain a mutual benefit for both modalities. In particular, the results are superior to the respective separate reconstructions and other joint reconstruction methods.

[1]  Samuel Kaplan The second dual of the space of continuous functions. II , 1957 .

[2]  I. Ekeland,et al.  Convex analysis and variational problems , 1976 .

[3]  L. Shepp,et al.  Maximum Likelihood Reconstruction for Emission Tomography , 1983, IEEE Transactions on Medical Imaging.

[4]  Richard M. Leahy,et al.  Incorporation of Anatomical MR Data for Improved Dunctional Imaging with PET , 1991, IPMI.

[5]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[6]  Ronald J. Jaszczak,et al.  Bayesian reconstruction and use of anatomical a priori information for emission tomography , 1996, IEEE Trans. Medical Imaging.

[7]  Alan C. Evans,et al.  BrainWeb: Online Interface to a 3D MRI Simulated Brain Database , 1997 .

[8]  E. Haber,et al.  Joint inversion: a structural approach , 1997 .

[9]  M. Gary Sayed,et al.  MRI BASIC PRINCIPLES AND APPLICATIONS , 1997 .

[10]  Walter Oberschelp,et al.  Expectation maximization reconstruction of positron emission tomography images using anatomical magnetic resonance information , 1997, IEEE Transactions on Medical Imaging.

[11]  E. Somersalo,et al.  Inverse problems with structural prior information , 1999 .

[12]  P. Lauterbur,et al.  Principles of magnetic resonance imaging : a signal processing perspective , 1999 .

[13]  L. Ambrosio,et al.  Functions of Bounded Variation and Free Discontinuity Problems , 2000 .

[14]  Ronald F. Gariepy FUNCTIONS OF BOUNDED VARIATION AND FREE DISCONTINUITY PROBLEMS (Oxford Mathematical Monographs) , 2001 .

[15]  Frank Natterer,et al.  Mathematical methods in image reconstruction , 2001, SIAM monographs on mathematical modeling and computation.

[16]  Paul C. Lauterbur,et al.  Principles of magnetic resonance imaging : a signal processing perspective , 1999 .

[17]  M. Meju,et al.  Characterization of heterogeneous near‐surface materials by joint 2D inversion of dc resistivity and seismic data , 2003 .

[18]  M. Meju,et al.  Joint two-dimensional DC resistivity and seismic travel time inversion with cross-gradients constraints , 2004 .

[19]  M. Wernick,et al.  Emission Tomography: The Fundamentals of PET and SPECT , 2004 .

[20]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[21]  E. Candès,et al.  Stable signal recovery from incomplete and inaccurate measurements , 2005, math/0503066.

[22]  Wotao Yin,et al.  An Iterative Regularization Method for Total Variation-Based Image Restoration , 2005, Multiscale Model. Simul..

[23]  Emmanuel J. Candès,et al.  Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information , 2004, IEEE Transactions on Information Theory.

[24]  David L Donoho,et al.  Compressed sensing , 2006, IEEE Transactions on Information Theory.

[25]  L. Gallardo Multiple cross‐gradient joint inversion for geospectral imaging , 2007 .

[26]  J. Nuyts The use of mutual information and joint entropy for anatomical priors in emission tomography , 2007, 2007 IEEE Nuclear Science Symposium Conference Record.

[27]  D. Donoho,et al.  Sparse MRI: The application of compressed sensing for rapid MR imaging , 2007, Magnetic resonance in medicine.

[28]  Anthonin Reilhac,et al.  Evaluation of different MRI-based anatomical priors for PET brain imaging , 2009, 2009 IEEE Nuclear Science Symposium Conference Record (NSS/MIC).

[29]  Daniel Cremers,et al.  An algorithm for minimizing the Mumford-Shah functional , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[30]  Steven Meikle,et al.  Regularized image reconstruction with an anatomically adaptive prior for positron emission tomography. , 2009, Physics in medicine and biology.

[31]  Tony F. Chan,et al.  A General Framework for a Class of First Order Primal-Dual Algorithms for Convex Optimization in Imaging Science , 2010, SIAM J. Imaging Sci..

[32]  S. Kaplan ON THE SECOND DUAL OF THE SPACE OF CONTINUOUS FUNCTIONS , 2010 .

[33]  Antonin Chambolle,et al.  A First-Order Primal-Dual Algorithm for Convex Problems with Applications to Imaging , 2011, Journal of Mathematical Imaging and Vision.

[34]  Karl Kunisch,et al.  Total Generalized Variation , 2010, SIAM J. Imaging Sci..

[35]  Antonin Chambolle,et al.  Diagonal preconditioning for first order primal-dual algorithms in convex optimization , 2011, 2011 International Conference on Computer Vision.

[36]  Thomas Kosters,et al.  EMRECON: An expectation maximization based image reconstruction framework for emission tomography data , 2011, 2011 IEEE Nuclear Science Symposium Conference Record.

[37]  G. Delso,et al.  Performance Measurements of the Siemens mMR Integrated Whole-Body PET/MR Scanner , 2011, The Journal of Nuclear Medicine.

[38]  Heinz H. Bauschke,et al.  Convex Analysis and Monotone Operator Theory in Hilbert Spaces , 2011, CMS Books in Mathematics.

[39]  Max A. Meju,et al.  Structure‐coupled multiphysics imaging in geophysical sciences , 2011 .

[40]  Valeria Ruggiero,et al.  An alternating extragradient method for total variation-based image restoration from Poisson data , 2011 .

[41]  Xiaoyi Jiang,et al.  Correction techniques in emission tomography , 2012 .

[42]  Anthonin Reilhac,et al.  Evaluation of Three MRI-Based Anatomical Priors for Quantitative PET Brain Imaging , 2012, IEEE Transactions on Medical Imaging.

[43]  Rebecca Willett,et al.  This is SPIRAL-TAP: Sparse Poisson Intensity Reconstruction ALgorithms—Theory and Practice , 2010, IEEE Transactions on Image Processing.

[44]  Correction Techniques in Emission Tomography, edited by Mohammad Dawood, Xiaoyi Jiang and Klaus Schäfers , 2013 .

[45]  K. Bredies,et al.  Inverse problems in spaces of measures , 2013 .

[46]  Eldad Haber,et al.  Model Fusion and Joint Inversion , 2013, Surveys in Geophysics.

[47]  Christoph Brune,et al.  EM-TV Methods for Inverse Problems with Poisson Noise , 2013 .

[48]  Michael Möller,et al.  Color Bregman TV , 2013, SIAM J. Imaging Sci..

[49]  Simon R. Arridge,et al.  Vector-Valued Image Processing by Parallel Level Sets , 2014, IEEE Transactions on Image Processing.

[50]  David Atkinson,et al.  Joint reconstruction of PET-MRI by exploiting structural similarity , 2014, Inverse Problems.

[51]  Martin Burger,et al.  Bregman Distances in Inverse Problems and Partial Differential Equations , 2015, 1505.05191.

[52]  Marta M. Betcke,et al.  Multicontrast MRI Reconstruction with Structure-Guided Total Variation , 2015, SIAM J. Imaging Sci..

[53]  Martin Burger,et al.  Bias Reduction in Variational Regularization , 2016, Journal of Mathematical Imaging and Vision.

[54]  Kristian Bredies,et al.  Joint MR-PET Reconstruction Using a Multi-Channel Image Regularizer , 2017, IEEE Transactions on Medical Imaging.