A Variational Model for Object Segmentation Using Boundary Information, Statistical Shape Prior and the Mumford-Shah Functional

In this paper, we propose a variational model to segment an object belonging to a given scale space using the active contour method, a geometric shape prior and the Mumford-Shah functional. We define an energy functional composed by three complementary terms. The first one detects object boundaries from image gradients. The second term constrains the active contour to get a shape compatible with a statistical shape model of the shape of interest. And the third part drives globally the shape prior and the active contour towards a homogeneous intensity region. The segmentation of the object of interest is given by the minimum of our energy functional. This minimum is computed with the calculus of variations and the gradient descent method that provide a system of evolution equations solved with the well-known level set method. We also prove the existence of this minimum in the space of functions with bounded variation. Applications of the proposed model are presented on synthetic and medical images.

[1]  E. Giusti.  Minimal surfaces and functions of bounded variation , 1977 .

[2]  M. Delfour,et al.  Shapes and Geometries: Analysis, Differential Calculus, and Optimization , 1987 .

[3]  Lawrence. Davis,et al.  Handbook Of Genetic Algorithms , 1990 .

[4]  J. Zolésio,et al.  Introduction to shape optimization : shape sensitivity analysis , 1992 .

[5]  L. Evans.  Measure theory and fine properties of functions , 1992 .

[6]  P. Lions,et al.  User’s guide to viscosity solutions of second order partial differential equations , 1992, math/9207212.

[7]  J. Sethian,et al.  A Fast Level Set Method for Propagating Interfaces , 1995 .

[8]  Anthony J. Yezzi,et al.  Gradient flows and geometric active contour models , 1995, Proceedings of IEEE International Conference on Computer Vision.

[9]  Jean-Michel Morel,et al.  Variational methods in image segmentation , 1995 .

[10]  P. Olver,et al.  Conformal curvature flows: From phase transitions to active vision , 1996, ICCV 1995.

[11]  J. Sethian,et al.  A geometric approach to segmentation and analysis of 3D medical images , 1996, Proceedings of the Workshop on Mathematical Methods in Biomedical Image Analysis.

[12]  T. Chan,et al.  A Variational Level Set Approach to Multiphase Motion , 1996 .

[13]  Anthony J. Yezzi,et al.  A geometric snake model for segmentation of medical imagery , 1997, IEEE Transactions on Medical Imaging.

[14]  J S Hyde,et al.  Contour‐based registration technique to differentiate between task‐activated and head motion‐induced signal variations in fMRI , 1997, Magnetic resonance in medicine.

[15]  Melanie Mitchell,et al.  L.D. Davis, Handbook of Genetic Algorithms* , 1998 .

[16]  Timothy F. Cootes,et al.  Statistical models of appearance for computer vision , 1999 .

[17]  Michael Unser,et al.  Splines: a perfect fit for signal and image processing , 1999, IEEE Signal Process. Mag..

[18]  Olivier D. Faugeras,et al.  Statistical shape influence in geodesic active contours , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[19]  Michael E. Leventon,et al.  Statistical models in medical image analysis , 2000 .

[20]  Alex M. Andrew,et al.  Level Set Methods and Fast Marching Methods: Evolving Interfaces in Computational Geometry, Fluid Mechanics, Computer Vision, and Materials Science (2nd edition) , 2000 .

[21]  Rachid Deriche,et al.  Geodesic Active Contours and Level Sets for the Detection and Tracking of Moving Objects , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[22]  Rachid Deriche,et al.  Coupled Geodesic Active Regions for Image Segmentation: A Level Set Approach , 2000, ECCV.

[23]  Anthony J. Yezzi,et al.  Curve evolution implementation of the Mumford-Shah functional for image segmentation, denoising, interpolation, and magnification , 2001, IEEE Trans. Image Process..

[24]  W. Eric L. Grimson,et al.  Model-based curve evolution technique for image segmentation , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[25]  Tony F. Chan,et al.  Active contours without edges , 2001, IEEE Trans. Image Process..

[26]  Yunmei Chen,et al.  On the incorporation of shape priors into geometric active contours , 2001, Proceedings IEEE Workshop on Variational and Level Set Methods in Computer Vision.

[27]  Nikos Paragios,et al.  Shape Priors for Level Set Representations , 2002, ECCV.

[28]  Daniel Cremers,et al.  Nonlinear Shape Statistics in Mumford-Shah Based Segmentation , 2002, ECCV.

[29]  Pierre Kornprobst,et al.  Mathematical problems in image processing - partial differential equations and the calculus of variations , 2010, Applied mathematical sciences.

[30]  Daniel Cremers,et al.  Statistical shape knowledge in variational image segmentation , 2002 .

[31]  Daniel Cremers,et al.  Statistical shape knowledge in variational motion segmentation , 2003, Image Vis. Comput..

[32]  Nikos Paragios,et al.  Non-rigid registration using distance functions , 2003, Comput. Vis. Image Underst..

[33]  Olivier D. Faugeras,et al.  Image Segmentation Using Active Contours: Calculus of Variations or Shape Gradients? , 2003, SIAM J. Appl. Math..

[34]  Xavier Bresson,et al.  White Matter Mapping in DT-MRI Using Geometric Flows , 2003, EUROCAST.

[35]  S. Osher,et al.  Geometric Level Set Methods in Imaging, Vision, and Graphics , 2011, Springer New York.

[36]  Marko Subasic,et al.  Level Set Methods and Fast Marching Methods , 2003 .

[37]  Xavier Bresson,et al.  A priori information in image segmentation: energy functional based on shape statistical model and image information , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[38]  J. Sethian,et al.  FRONTS PROPAGATING WITH CURVATURE DEPENDENT SPEED: ALGORITHMS BASED ON HAMILTON-JACOB1 FORMULATIONS , 2003 .

[39]  Olivier D. Faugeras,et al.  Shape metrics, warping and statistics , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[40]  Michel Barlaud,et al.  DREAM2S: Deformable Regions Driven by an Eulerian Accurate Minimization Method for Image and Video Segmentation , 2002, International Journal of Computer Vision.

[41]  Daniel Cremers,et al.  Diffusion Snakes: Introducing Statistical Shape Knowledge into the Mumford-Shah Functional , 2002, International Journal of Computer Vision.

[42]  Tony F. Chan,et al.  A Multiphase Level Set Framework for Image Segmentation Using the Mumford and Shah Model , 2002, International Journal of Computer Vision.

[43]  Guillermo Sapiro,et al.  Geodesic Active Contours , 1995, International Journal of Computer Vision.

[44]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[45]  Yunmei Chen,et al.  Using Prior Shapes in Geometric Active Contours in a Variational Framework , 2002, International Journal of Computer Vision.