Semi-blind image restoration via Mumford-Shah regularization

Image restoration and segmentation are both classical problems, that are known to be difficult and have attracted major research efforts. This paper shows that the two problems are tightly coupled and can be successfully solved together. Mutual support of image restoration and segmentation processes within a joint variational framework is theoretically motivated, and validated by successful experimental results. The proposed variational method integrates semi-blind image deconvolution (parametric blur-kernel), and Mumford-Shah segmentation. The functional is formulated using the /spl Gamma/-convergence approximation and is iteratively optimized via the alternate minimization method. While the major novelty of this work is in the unified treatment of the semi-blind restoration and segmentation problems, the important special case of known blur is also considered and promising results are obtained.

[1]  Andrea Braides.  Approximation of Free-Discontinuity Problems , 1998 .

[2]  Tony F. Chan,et al.  Total variation blind deconvolution , 1998, IEEE Trans. Image Process..

[3]  Deepa Kundur,et al.  Blind image deconvolution revisited , 1996 .

[4]  Josiane Zerubia,et al.  Multiphase Evolution and Variational Image Classification , 1999 .

[5]  Alfred S. Carasso,et al.  Direct Blind Deconvolution , 2001, SIAM J. Appl. Math..

[6]  Gjlles Aubert,et al.  Mathematical problems in image processing , 2001 .

[7]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[8]  Michel Barlaud,et al.  Deterministic edge-preserving regularization in computed imaging , 1997, IEEE Trans. Image Process..

[9]  Stanley Osher,et al.  Total variation based image restoration with free local constraints , 1994, Proceedings of 1st International Conference on Image Processing.

[10]  Tony F. Chan,et al.  A Multiphase Level Set Framework for Image Segmentation Using the Mumford and Shah Model , 2002, International Journal of Computer Vision.

[11]  Donald Geman,et al.  Nonlinear image recovery with half-quadratic regularization , 1995, IEEE Trans. Image Process..

[12]  A. N. Tikhonov,et al.  Solutions of ill-posed problems , 1977 .

[13]  Mostafa Kaveh,et al.  A regularization approach to joint blur identification and image restoration , 1996, IEEE Trans. Image Process..

[14]  Nahum Kiryati,et al.  Variational Pairing of Image Segmentation and Blind Restoration , 2004, ECCV.

[15]  Jan Flusser,et al.  Multichannel blind iterative image restoration , 2003, IEEE Trans. Image Process..

[16]  Thomas Richardson,et al.  Approximation, Computation, and Distortion in the Variational Formulation , 1994, Geometry-Driven Diffusion in Computer Vision.

[17]  Alan S. Willsky,et al.  A curve evolution-based variational approach to simultaneous image restoration and segmentation , 2002, Proceedings. International Conference on Image Processing.

[18]  L. Ambrosio,et al.  Approximation of functional depending on jumps by elliptic functional via t-convergence , 1990 .

[19]  Curtis R. Vogel,et al.  Ieee Transactions on Image Processing Fast, Robust Total Variation{based Reconstruction of Noisy, Blurred Images , 2022 .

[20]  Milan Sonka,et al.  Image Processing, Analysis and Machine Vision , 1993, Springer US.

[21]  Aggelos K. Katsaggelos,et al.  A VQ-based blind image restoration algorithm , 2003, IEEE Trans. Image Process..

[22]  Antonin Chambolle,et al.  Image Segmentation by Variational Methods: Mumford and Shah Functional and the Discrete Approximations , 1995, SIAM J. Appl. Math..

[23]  D. Mumford,et al.  Optimal approximations by piecewise smooth functions and associated variational problems , 1989 .

[24]  E.E. Pissaloux,et al.  Image Processing , 1994, Proceedings. Second Euromicro Workshop on Parallel and Distributed Processing.