Shape Modeling with Front Propagation: A Level Set Approach

Shape modeling is an important constituent of computer vision as well as computer graphics research. Shape models aid the tasks of object representation and recognition. This paper presents a new approach to shape modeling which retains some of the attractive features of existing methods and overcomes some of their limitations. The authors' techniques can be applied to model arbitrarily complex shapes, which include shapes with significant protrusions, and to situations where no a priori assumption about the object's topology is made. A single instance of the authors' model, when presented with an image having more than one object of interest, has the ability to split freely to represent each object. This method is based on the ideas developed by Osher and Sethian (1988) to model propagating solid/liquid interfaces with curvature-dependent speeds. The interface (front) is a closed, nonintersecting, hypersurface flowing along its gradient field with constant speed or a speed that depends on the curvature. It is moved by solving a "Hamilton-Jacobi" type equation written for a function in which the interface is a particular level set. A speed term synthesized from the image is used to stop the interface in the vicinity of object boundaries. The resulting equation of motion is solved by employing entropy-satisfying upwind finite difference schemes. The authors present a variety of ways of computing the evolving front, including narrow bands, reinitializations, and different stopping criteria. The efficacy of the scheme is demonstrated with numerical experiments on some synthesized images and some low contrast medical images. >

[1]  L. Schumaker Fitting surfaces to scattered data , 1976 .

[2]  S. Osher,et al.  Stable and entropy satisfying approximations for transonic flow calculations , 1980 .

[3]  J. Sethian Curvature and the evolution of fronts , 1985 .

[4]  Demetri Terzopoulos,et al.  Regularization of Inverse Visual Problems Involving Discontinuities , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Jake K. Aggarwal,et al.  Curvature-based representation of objects from range data , 1986, Image Vis. Comput..

[6]  John R. Kender,et al.  Visual Surface Reconstruction Using Sparse Depth Data , 1986, CVPR 1986.

[7]  Andrew Blake,et al.  Visual Reconstruction , 1987, Deep Learning for EEG-Based Brain–Computer Interfaces.

[8]  J. Sethian,et al.  Fronts propagating with curvature-dependent speed: algorithms based on Hamilton-Jacobi formulations , 1988 .

[9]  Demetri Terzopoulos,et al.  Constraints on Deformable Models: Recovering 3D Shape and Nonrigid Motion , 1988, Artif. Intell..

[10]  Demetri Terzopoulos,et al.  The Computation of Visible-Surface Representations , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  David Lee,et al.  One-Dimensional Regularization with Discontinuities , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  R. Samadani Changes in connectivity in active contour models , 1989, [1989] Proceedings. Workshop on Visual Motion.

[13]  Ramesh C. Jain,et al.  Using Dynamic Programming for Solving Variational Problems in Vision , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  J. Sethian Numerical algorithms for propagating interfaces: Hamilton-Jacobi equations and conservation laws , 1990 .

[15]  S. Zucker,et al.  Toward a computational theory of shape: an overview , 1990, eccv 1990.

[16]  Edward H. Adelson,et al.  Steerable filters for early vision, image analysis, and wavelet decomposition , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[17]  Alex Pentland,et al.  Closed-form solutions for physically-based shape modeling and recognition , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[18]  Ramin Samadani Adaptive snakes: control of damping and material parameters , 1991, Optics & Photonics.

[19]  Katsushi Ikeuchi,et al.  Shape representation and image segmentation using deformable surfaces , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[20]  L. Schumaker,et al.  Fitting scattered data on spherelike surfaces using tensor products of trigonometric and polynomial splines , 1991 .

[21]  L. Evans,et al.  Motion of level sets by mean curvature. II , 1992 .

[22]  Baba C. Vemuri,et al.  On Three-Dimensional Surface Reconstruction Methods , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[23]  Laurent D. Cohen,et al.  On active contour models and balloons , 1991, CVGIP Image Underst..

[24]  R. Malladi,et al.  Deformable models: canonical parameters for surface representation and multiple view integration , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[25]  Yuan-Fang Wang,et al.  Surface Reconstruction Using Deformable Models with Interior and Boundary Constraints , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[26]  S. Osher,et al.  Computing interface motion in compressible gas dynamics , 1992 .

[27]  J. Sethian,et al.  Projection methods coupled to level set interface techniques , 1992 .

[28]  Richard Szeliski,et al.  Surface modeling with oriented particle systems , 1992, SIGGRAPH.

[29]  J. Sethian,et al.  Crystal growth and dendritic solidification , 1992 .

[30]  Laurent D. Cohen,et al.  Deformable models for 3-D medical images using finite elements and balloons , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[31]  Baba C. Vemuri,et al.  Surface griding with intrinsic parameters , 1992, Pattern Recognit. Lett..

[32]  L. Evans,et al.  Motion of level sets by mean curvature. II , 1992 .

[33]  Baba C. Vemuri,et al.  Topology-independent shape modeling scheme , 1993, Optics & Photonics.

[34]  James A. Sethian,et al.  Flow under Curvature: Singularity Formation, Minimal Surfaces, and Geodesics , 1993, Exp. Math..

[35]  D. Chopp Computing Minimal Surfaces via Level Set Curvature Flow , 1993 .

[36]  Baba C. Vemuri,et al.  Constructing Intrinsic Parameters with Active Models for Invariant Surface Reconstruction , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[37]  V. Caselles,et al.  A geometric model for active contours in image processing , 1993 .

[38]  Baba C. Vemuri,et al.  Evolutionary Fronts for Topology-Independent Shape Modeling and Recoveery , 1994, ECCV.

[39]  S. Osher,et al.  Motion of multiple junctions: a level set approach , 1994 .

[40]  S. Osher,et al.  A level set approach for computing solutions to incompressible two-phase flow , 1994 .

[41]  R. Malladi,et al.  A Unified Framework for Shape Segmentation, Representation, and Recognition , 1994 .

[42]  J. Sethian,et al.  A Fast Level Set Method for Propagating Interfaces , 1995 .

[43]  J. Sethian,et al.  Dynamical behaviour of a premixed turbulent open V-flame , 1995 .