Variational image segmentation using boundary functions

A general variational framework for image approximation and segmentation is introduced. By using a continuous "line-process" to represent edge boundaries, it is possible to formulate a variational theory of image segmentation and approximation in which the boundary function has a simple explicit form in terms of the approximation function. At the same time, this variational framework is general enough to include the most commonly used objective functions. Application is made to Mumford-Shah type functionals as well as those considered by Geman and others. Employing arbitrary Lp norms to measure smoothness and approximation allows the user to alternate between a least squares approach and one based on total variation, depending on the needs of a particular image. Since the optimal boundary function that minimizes the associated objective functional for a given approximation function can be found explicitly, the objective functional can be expressed in a reduced form that depends only on the approximating function. From this a partial differential equation (PDE) descent method, aimed at minimizing the objective functional, is derived. The method is fast and produces excellent results as illustrated by a number of real and synthetic image problems.

[1]  L. Rudin,et al.  Feature-oriented image enhancement using shock filters , 1990 .

[2]  L. Ambrosio,et al.  Approximation of functional depending on jumps by elliptic functional via t-convergence , 1990 .

[3]  D. Mumford,et al.  Optimal approximations by piecewise smooth functions and associated variational problems , 1989 .

[4]  Thomas Richardson,et al.  Approximation, Computation, and Distortion in the Variational Formulation , 1994, Geometry-Driven Diffusion in Computer Vision.

[5]  Alan L. Yuille,et al.  Scaling Theorems for Zero Crossings , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Donald Geman,et al.  Constrained Restoration and the Recovery of Discontinuities , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Andrew P. Witkin,et al.  Scale-Space Filtering , 1983, IJCAI.

[8]  Hui A Contour-Based Approach to Multisensor Image Registration , 1995 .

[9]  Jean-Michel Morel,et al.  Variational methods in image segmentation , 1995 .

[10]  Stanley Osher,et al.  Shocks and other nonlinear filtering applied to image processing , 1991, Optics & Photonics.

[11]  Andrew Blake,et al.  Visual Reconstruction , 1987, Deep Learning for EEG-Based Brain–Computer Interfaces.

[12]  Jayant Shah Segmentation by nonlinear diffusion , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[13]  Donald Geman,et al.  Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  OsherStanley,et al.  Feature-oriented image enhancement using shock filters , 1990 .

[15]  Luc Van Gool,et al.  Coupled Geometry-Driven Diffusion Equations for Low-Level Vision , 1994, Geometry-Driven Diffusion in Computer Vision.

[16]  Michael J. Black,et al.  The outlier process: unifying line processes and robust statistics , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[17]  Thomas J. Richardson,et al.  Scale independent piecewise smooth segmentation of images via variational methods , 1990 .

[18]  A. Rosenfeld,et al.  Edge and Curve Detection for Visual Scene Analysis , 1971, IEEE Transactions on Computers.

[19]  Andrew P. Witkin,et al.  Scale-space filtering: A new approach to multi-scale description , 1984, ICASSP.

[20]  D Marr,et al.  Theory of edge detection , 1979, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[21]  F. W. Warner Foundations of Differentiable Manifolds and Lie Groups , 1971 .

[22]  Donald Geman,et al.  Boundary Detection by Constrained Optimization , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[23]  Jayant Shah Segmentation by nonlinear diffusion. II , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[24]  Federico Girosi,et al.  Parallel and Deterministic Algorithms from MRFs: Surface Reconstruction , 1991, IEEE Trans. Pattern Anal. Mach. Intell..