A curve evolution-based variational approach to simultaneous image restoration and segmentation

In this paper, we introduce a novel approach for simultaneous restoration and segmentation of blurred noisy images by approaching a variant of the Mumford-Shah functional from a curve evolution perspective. In particular, by viewing the active contour as the set of discontinuities in the image, we derive a gradient flow to minimize an extended Mumford-Shah functional where the known blurring function is incorporated as part of the data fidelity term. Each gradient step involves solving a discrete approximation of the corresponding partial differential equation to obtain a smooth and deblurred estimate of the observed image without blurring across the curve. The experimental results based on both synthetic and real images demonstrate that the proposed method segments and restores the blurred images effectively. We conclude that our work is an edge-preserving image restoration technique that couples segmentation, denoising, and deblurring within a single framework. In addition, this framework provides an intellectual connection between regularization theory (used to solve the deblurring inverse problem) and the theory of curve evolution.

[1]  Curtis R. Vogel,et al.  A Fast, Robust Algorithm for Total Variation Based Reconstruction of Noisy, Blurred Images , 1998 .

[2]  Anthony J. Yezzi,et al.  A curve evolution approach to smoothing and segmentation using the Mumford-Shah functional , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[3]  Baba C. Vemuri,et al.  Shape Modeling with Front Propagation: A Level Set Approach , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  James A. Sethian,et al.  Level Set Methods and Fast Marching Methods: Evolving Interfaces in Computational Geometry, Fluid , 2012 .

[5]  Rachid Deriche,et al.  Geodesic Active Regions and Level Set Methods for Supervised Texture Segmentation , 2002, International Journal of Computer Vision.

[6]  L. Vese,et al.  A level set algorithm for minimizing the Mumford-Shah functional in image processing , 2001, Proceedings IEEE Workshop on Variational and Level Set Methods in Computer Vision.

[7]  Tony F. Chan,et al.  Active contours without edges , 2001, IEEE Trans. Image Process..

[8]  Anthony J. Yezzi,et al.  A geometric snake model for segmentation of medical imagery , 1997, IEEE Transactions on Medical Imaging.

[9]  Dana H. Ballard,et al.  Computer Vision , 1982 .

[10]  D. Mumford,et al.  Optimal approximations by piecewise smooth functions and associated variational problems , 1989 .

[11]  Anthony J. Yezzi,et al.  A statistical approach to snakes for bimodal and trimodal imagery , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[12]  J. Sethian,et al.  Fronts propagating with curvature-dependent speed: algorithms based on Hamilton-Jacobi formulations , 1988 .

[13]  S. Osher Riemann Solvers, the Entropy Condition, and Difference , 1984 .

[14]  V. Caselles,et al.  A geometric model for active contours in image processing , 1993 .

[15]  J. Sethian Level set methods : evolving interfaces in geometry, fluid mechanics, computer vision, and materials science , 1996 .

[16]  A. N. Tikhonov,et al.  REGULARIZATION OF INCORRECTLY POSED PROBLEMS , 1963 .

[17]  Michel Barlaud,et al.  Deterministic edge-preserving regularization in computed imaging , 1997, IEEE Trans. Image Process..

[18]  S. Osher,et al.  Algorithms Based on Hamilton-Jacobi Formulations , 1988 .