Variational approaches in image recovery and segmentation

Image recovery and segmentation are always the fundamental tasks in image processing field, because of their so many contributions in practical applications. As in the past ten years, variational methods have achieved a great success on these two issues, in this thesis, we continue to work on proposing several new variational approaches for restoring and segmenting an image. This thesis contains two parts. The first part addresses recovering an image and the second part emphasizes on segmenting. Along with the wide utilization of magnetic resonance imaging (MRI) technique, we particularly deal with blurry images corrupted by Rician noise. In chapter 1, two new convex variational models for recovering an image corrupted by Rician noise with blur are presented. These two models are motivated by the non-convex maximum-a-posteriori (MAP) model proposed in the prior papers. In the first method, we use an approximation item to the zero order of the modified Bessel function in the MAP model and add an entropylike item to obtain a convex model. Through studying on the statistical properties of Rician noise, we bring up a strictly convex model by adding an additional data-fidelity term in the MAP model in the second method. Primal-dual methods are applied to solve the models. The simulation outcomes show that our models outperform some existed effective models in both recovery image quality and computational time. Cone beam CT (CBCT) is routinely applied in image guided radiation therapy (IGRT) to help patient setup. Its imaging dose, however, is still a concern, limiting its wide applications. It has been an active research topic to develop novel technologies for radiation dose reduction. In chapter 2, we propose an improvement of practical CBCT dose control scheme temporal non-local means (TNLM) scheme for IGRT. We denoise the scanned image with low dose by using the previous images as prior knowledge. We combine deformation image registration and TNLM. Different from the TNLM, in the new method, for each pixel, the search range is not fixed, but based on the motion vector between the prior image and the obtained image. By doing this, it is easy to find the similar pixels in the previous images, but also can reduce the computational time since it does not need large search windows. The phantom and patient studies illuminate that the new method outperforms the original one in both image quality and computational time. In the second part, we present a two-stage method for segmenting an image corrupted by blur and Rician noise. The method is motivated by the two-stage segmentation method developed by the authors in 2013 and restoration method for images with Rician noise. First, based on the statistical properties of Rician noise, we present a new convex variant of the modified Mumford-Shah model to get the smooth cartoon part u of the image. Then, we cluster the cartoon u into different parts to obtain the final contour of different phases of the image. Moreover, u from the first stage is unique because of the convexity of the new model, and it needs to be computed only once whenever the thresholds and the number of the phases K in the second stage change. We implement the simulation on the synthetic and real images to show that our model outperforms some existed segmentation models in both precision and computational time.

[1]  Milton Abramowitz,et al.  Handbook of Mathematical Functions with Formulas, Graphs, and Mathematical Tables , 1964 .

[2]  Olivier Lezoray,et al.  Image Processing and Analysis With Graphs: theory and Practice , 2017 .

[3]  Steve B. Jiang,et al.  Progressive cone beam CT dose control in image-guided radiation therapy. , 2013, Medical physics.

[4]  Yiqiu Dong,et al.  An Efficient Primal-Dual Method for L1TV Image Restoration , 2009, SIAM J. Imaging Sci..

[5]  Guido Gerig,et al.  Nonlinear anisotropic filtering of MRI data , 1992, IEEE Trans. Medical Imaging.

[6]  Xavier Bresson,et al.  Fast Global Minimization of the Active Contour/Snake Model , 2007, Journal of Mathematical Imaging and Vision.

[7]  Jan A Snyman,et al.  Practical Mathematical Optimization: An Introduction to Basic Optimization Theory and Classical and New Gradient-Based Algorithms , 2005 .

[8]  Xue-Cheng Tai,et al.  A study on continuous max-flow and min-cut approaches , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[9]  Steve B Jiang,et al.  Implementation and evaluation of various demons deformable image registration algorithms on a GPU. , 2010, Physics in medicine and biology.

[10]  S. Osher,et al.  Image restoration: Total variation, wavelet frames, and beyond , 2012 .

[11]  M. Ng,et al.  EFFICIENT BOX-CONSTRAINED TV-TYPE-l^1 ALGORITHMS FOR RESTORING IMAGES WITH IMPULSE NOISE , 2013 .

[12]  R. Henkelman Measurement of signal intensities in the presence of noise in MR images. , 1985, Medical physics.

[13]  Guillermo Sapiro,et al.  Geodesic Active Contours , 1995, International Journal of Computer Vision.

[14]  Aichi Chien,et al.  Frame based segmentation for medical images , 2011 .

[15]  Djemel Ziou,et al.  Image Quality Metrics: PSNR vs. SSIM , 2010, 2010 20th International Conference on Pattern Recognition.

[16]  F. B. Introduction to Bessel Functions , 1939, Nature.

[17]  Aleksandra Pizurica,et al.  Removal of correlated Rician noise in Magnetic Resonance Imaging , 2008, 2008 16th European Signal Processing Conference.

[18]  A. Polyanin,et al.  Handbook of Exact Solutions for Ordinary Differential Equations , 1995 .

[19]  Xue-Cheng Tai,et al.  Global Minimization for Continuous Multiphase Partitioning Problems Using a Dual Approach , 2011, International Journal of Computer Vision.

[20]  L. Ambrosio,et al.  Functions of Bounded Variation and Free Discontinuity Problems , 2000 .

[21]  Daniel Cremers,et al.  A convex relaxation approach for computing minimal partitions , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[22]  N. Z. Shor The rate of convergence of the generalized gradient descent method , 1968 .

[23]  Alessandro Foi,et al.  Noise estimation and removal in MR imaging: The variance-stabilization approach , 2011, 2011 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[24]  Pierrick Coupé,et al.  Rician Noise Removal by Non-Local Means Filtering for Low Signal-to-Noise Ratio MRI: Applications to DT-MRI , 2008, MICCAI.

[25]  Tom Goldstein,et al.  The Split Bregman Method for L1-Regularized Problems , 2009, SIAM J. Imaging Sci..

[26]  Michael K. Ng,et al.  A New Total Variation Method for Multiplicative Noise Removal , 2009, SIAM J. Imaging Sci..

[27]  Otmar Scherzer,et al.  Handbook of Mathematical Methods in Imaging , 2015, Handbook of Mathematical Methods in Imaging.

[28]  Jian-Feng Cai,et al.  A framelet-based image inpainting algorithm , 2008 .

[29]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[30]  Tony F. Chan,et al.  Active contours without edges , 2001, IEEE Trans. Image Process..

[31]  Raymond H. Chan,et al.  Numerical Methods and Applications in Total Variation Image Restoration , 2015, Handbook of Mathematical Methods in Imaging.

[32]  Donald Geman,et al.  Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[33]  Michael Elad,et al.  Image Denoising Via Sparse and Redundant Representations Over Learned Dictionaries , 2006, IEEE Transactions on Image Processing.

[34]  Tony F. Chan,et al.  Image processing and analysis - variational, PDE, wavelet, and stochastic methods , 2005 .

[35]  Xue-Cheng Tai,et al.  A Continuous Max-Flow Approach to Potts Model , 2010, ECCV.

[36]  Ronald F. Boisvert,et al.  NIST Handbook of Mathematical Functions , 2010 .

[37]  Gang Liu,et al.  Total Variation with Overlapping Group Sparsity for Image Deblurring under Impulse Noise , 2013, PloS one.

[38]  M. Nikolova An Algorithm for Total Variation Minimization and Applications , 2004 .

[39]  Raymond H. Chan,et al.  A Two-Stage Image Segmentation Method for Blurry Images with Poisson or Multiplicative Gamma Noise , 2014, SIAM J. Imaging Sci..

[40]  Gilles Aubert,et al.  A Variational Approach to Removing Multiplicative Noise , 2008, SIAM J. Appl. Math..

[41]  H. Gudbjartsson,et al.  The rician distribution of noisy mri data , 1995, Magnetic resonance in medicine.

[42]  Hisashi Kobayashi,et al.  Probability, Random Processes, and Statistical Analysis: Moment-generating function and characteristic function , 2011 .

[43]  J. Sethian,et al.  FRONTS PROPAGATING WITH CURVATURE DEPENDENT SPEED: ALGORITHMS BASED ON HAMILTON-JACOB1 FORMULATIONS , 2003 .

[44]  Jean-Michel Morel,et al.  A non-local algorithm for image denoising , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[45]  Thomas J. Asaki,et al.  A Variational Approach to Reconstructing Images Corrupted by Poisson Noise , 2007, Journal of Mathematical Imaging and Vision.

[46]  Pierrick Coupé,et al.  Non-Local Means Variants for Denoising of Diffusion-Weighted and Diffusion Tensor MRI , 2007, MICCAI.

[47]  Antonin Chambolle,et al.  A First-Order Primal-Dual Algorithm for Convex Problems with Applications to Imaging , 2011, Journal of Mathematical Imaging and Vision.

[48]  Jan Sijbers,et al.  Estimation of signal and noise from Rician distributed data , 1998 .

[49]  Laurent D. Cohen,et al.  Non-local Regularization of Inverse Problems , 2008, ECCV.

[50]  Robert D. Nowak,et al.  Wavelet-based Rician noise removal for magnetic resonance imaging , 1999, IEEE Trans. Image Process..

[51]  Pierre Kornprobst,et al.  Mathematical problems in image processing - partial differential equations and the calculus of variations , 2010, Applied mathematical sciences.

[52]  Michael K. Ng,et al.  A Multiphase Image Segmentation Method Based on Fuzzy Region Competition , 2010, SIAM J. Imaging Sci..

[53]  Xue-Cheng Tai,et al.  Augmented Lagrangian Method, Dual Methods, and Split Bregman Iteration for ROF, Vectorial TV, and High Order Models , 2010, SIAM J. Imaging Sci..

[54]  Ron Kimmel,et al.  Fast Edge Integration , 2003 .

[55]  Tony F. Chan,et al.  A Multiphase Level Set Framework for Image Segmentation Using the Mumford and Shah Model , 2002, International Journal of Computer Vision.

[56]  H. Weinberger,et al.  An optimal Poincaré inequality for convex domains , 1960 .

[57]  Kevin M. Johnson,et al.  Wavelet packet denoising of magnetic resonance images: Importance of Rician noise at low SNR , 1999, Magnetic resonance in medicine.

[58]  Stephen J. Wright,et al.  Duality-based algorithms for total-variation-regularized image restoration , 2010, Comput. Optim. Appl..

[59]  Rachid Deriche,et al.  Image Sequence Analysis via Partial Differential Equations , 1999, Journal of Mathematical Imaging and Vision.

[60]  Pierrick Coupé,et al.  An Optimized Blockwise Nonlocal Means Denoising Filter for 3-D Magnetic Resonance Images , 2008, IEEE Transactions on Medical Imaging.

[61]  D. Mumford,et al.  Optimal approximations by piecewise smooth functions and associated variational problems , 1989 .

[62]  Jasjit S. Suri,et al.  Handbook of Biomedical Image Analysis , 2005 .

[63]  Liyuan Chen,et al.  A Convex Variational Model for Restoring Blurred Images with Large Rician Noise , 2014, Journal of Mathematical Imaging and Vision.

[64]  E. Giusti Minimal surfaces and functions of bounded variation , 1977 .

[65]  Ross T. Whitaker,et al.  Rician Noise Removal in Diffusion Tensor MRI , 2006, MICCAI.

[66]  V. R. Vijaykumar,et al.  Adaptive Window Based Efficient Algorithm for Removing Gaussian Noise in Gray Scale and Color Images , 2007, International Conference on Computational Intelligence and Multimedia Applications (ICCIMA 2007).

[67]  Xue-Cheng Tai,et al.  Image Denoising Using TV-Stokes Equation with an Orientation-Matching Minimization , 2009, SSVM.

[68]  Ke Chen,et al.  A Nonlinear Multigrid Method for Total Variation Minimization from Image Restoration , 2007, J. Sci. Comput..

[69]  Jian-Feng Cai,et al.  Two-phase approach for deblurring images corrupted by impulse plus gaussian noise , 2008 .

[70]  Neil A. Thacker,et al.  Multicomponent MR Image Denoising , 2009, Int. J. Biomed. Imaging.

[71]  Christopher V. Alvino,et al.  Reformulating and Optimizing the Mumford-Shah Functional on a Graph - A Faster, Lower Energy Solution , 2008, ECCV.

[72]  Lei Zhang,et al.  Noise Reduction for Magnetic Resonance Images via Adaptive Multiscale Products Thresholding , 2003, IEEE Trans. Medical Imaging.

[73]  Xue-Cheng Tai,et al.  A dual algorithm for minimization of the LLT model , 2009, Adv. Comput. Math..

[74]  Mila Nikolova,et al.  Algorithms for Finding Global Minimizers of Image Segmentation and Denoising Models , 2006, SIAM J. Appl. Math..

[75]  Raymond H. Chan,et al.  A Two-Stage Image Segmentation Method Using a Convex Variant of the Mumford-Shah Model and Thresholding , 2013, SIAM J. Imaging Sci..

[76]  Jian-Feng Cai,et al.  Split Bregman Methods and Frame Based Image Restoration , 2009, Multiscale Model. Simul..

[77]  Pascal Getreuer,et al.  A Variational Model for the Restoration of MR Images Corrupted by Blur and Rician Noise , 2011, ISVC.

[78]  Tieyong Zeng,et al.  A Convex Variational Model for Restoring Blurred Images with Multiplicative Noise , 2013, SIAM J. Imaging Sci..

[79]  Jitendra Malik,et al.  Scale-Space and Edge Detection Using Anisotropic Diffusion , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[80]  John G. Proakis,et al.  Probability, random variables and stochastic processes , 1985, IEEE Trans. Acoust. Speech Signal Process..

[81]  Mohamed-Jalal Fadili,et al.  Wavelets, Ridgelets, and Curvelets for Poisson Noise Removal , 2008, IEEE Transactions on Image Processing.