Modified Gradient Search for Level Set Based Image Segmentation

Level set methods are a popular way to solve the image segmentation problem. The solution contour is found by solving an optimization problem where a cost functional is minimized. Gradient descent methods are often used to solve this optimization problem since they are very easy to implement and applicable to general nonconvex functionals. They are, however, sensitive to local minima and often display slow convergence. Traditionally, cost functionals have been modified to avoid these problems. In this paper, we instead propose using two modified gradient descent methods, one using a momentum term and one based on resilient propagation. These methods are commonly used in the machine learning community. In a series of 2-D/3-D-experiments using real and synthetic data with ground truth, the modifications are shown to reduce the sensitivity for local optima and to increase the convergence rate. The parameter sensitivity is also investigated. The proposed methods are very simple modifications of the basic method, and are directly compatible with any type of level set implementation. Downloadable reference code with examples is available online.

[1]  Yan Nei Law,et al.  A Multiresolution Stochastic Level Set Method for Mumford–Shah Image Segmentation , 2008, IEEE Transactions on Image Processing.

[2]  Reiner Lenz,et al.  Momentum Based Optimization Methods for Level Set Segmentation , 2009, SSVM.

[3]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[4]  D K Smith,et al.  Numerical Optimization , 2001, J. Oper. Res. Soc..

[5]  Laurent D. Cohen,et al.  On active contour models and balloons , 1991, CVGIP Image Underst..

[6]  Anthony J. Yezzi,et al.  Sobolev Active Contours , 2005, International Journal of Computer Vision.

[7]  Max A. Viergever,et al.  Ridge-based vessel segmentation in color images of the retina , 2004, IEEE Transactions on Medical Imaging.

[8]  Olivier D. Faugeras,et al.  Designing spatially coherent minimizing flows for variational problems based on active contours , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[9]  Guillermo Sapiro,et al.  Geodesic Active Contours , 1995, International Journal of Computer Vision.

[10]  Qing Yang,et al.  Modeling of Front Evolution with Graph Cut Optimization , 2007, 2007 IEEE International Conference on Image Processing.

[11]  Thorsteinn S. Rögnvaldsson On Langevin Updating in Multilayer Perceptrons , 1994, Neural Computation.

[12]  Martin A. Riedmiller,et al.  Rprop - Description and Implementation Details , 1994 .

[13]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[14]  D. Mumford,et al.  Optimal approximations by piecewise smooth functions and associated variational problems , 1989 .

[15]  D. M. Green,et al.  Signal detection theory and psychophysics , 1966 .

[16]  J. Sethian,et al.  Fronts propagating with curvature-dependent speed: algorithms based on Hamilton-Jacobi formulations , 1988 .

[17]  Hongkai Zhao,et al.  A fast sweeping method for Eikonal equations , 2004, Math. Comput..

[18]  Mila Nikolova,et al.  Algorithms for Finding Global Minimizers of Image Segmentation and Denoising Models , 2006, SIAM J. Appl. Math..

[19]  J A Sethian,et al.  A fast marching level set method for monotonically advancing fronts. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[20]  Christopher V. Alvino,et al.  The Piecewise Smooth Mumford–Shah Functional on an Arbitrary Graph , 2009, IEEE Transactions on Image Processing.

[21]  M. Nikolova An Algorithm for Total Variation Minimization and Applications , 2004 .

[22]  Ghassan Hamarneh,et al.  VascuSynth: Simulating vascular trees for generating volumetric image data with ground-truth segmentation and tree analysis , 2010, Comput. Medical Imaging Graph..

[23]  R. B. Kearfott Rigorous Global Search: Continuous Problems , 1996 .

[24]  Tony F. Chan,et al.  Active contours without edges , 2001, IEEE Trans. Image Process..

[25]  Guillaume Charpiat,et al.  Converting Level Set Gradients to Shape Gradients , 2010, ECCV.

[26]  S. Osher,et al.  Algorithms Based on Hamilton-Jacobi Formulations , 1988 .

[27]  Hans Knutsson,et al.  Signal processing for computer vision , 1994 .

[28]  S. Osher,et al.  Regular Article: A PDE-Based Fast Local Level Set Method , 1999 .

[29]  Magnus Borga,et al.  Blood vessel segmentation using multi-scale quadrature filtering , 2010, Pattern Recognit. Lett..

[30]  Vladimir Kolmogorov,et al.  Computing geodesics and minimal surfaces via graph cuts , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[31]  Reiner Lenz,et al.  A Fast Optimization Method for Level Set Segmentation , 2009, SCIA.

[32]  W. Youden,et al.  Index for rating diagnostic tests , 1950, Cancer.

[33]  L. Vese,et al.  A level set algorithm for minimizing the Mumford-Shah functional in image processing , 2001, Proceedings IEEE Workshop on Variational and Level Set Methods in Computer Vision.

[34]  J. Doye,et al.  Global Optimization by Basin-Hopping and the Lowest Energy Structures of Lennard-Jones Clusters Containing up to 110 Atoms , 1997, cond-mat/9803344.

[35]  Martin A. Riedmiller,et al.  A direct adaptive method for faster backpropagation learning: the RPROP algorithm , 1993, IEEE International Conference on Neural Networks.

[36]  Xavier Bresson,et al.  Fast Global Minimization of the Active Contour/Snake Model , 2007, Journal of Mathematical Imaging and Vision.

[37]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[38]  W. Gardner Learning characteristics of stochastic-gradient-descent algorithms: A general study, analysis, and critique , 1984 .

[39]  Bahram Parvin,et al.  Structural annotation of em images by graph cut , 2009, 2009 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[40]  N. Metropolis,et al.  Equation of State Calculations by Fast Computing Machines , 1953, Resonance.

[41]  Anthony J. Yezzi,et al.  Gradient flows and geometric active contour models , 1995, Proceedings of IEEE International Conference on Computer Vision.

[42]  Ghassan Hamarneh,et al.  VascuSynth: Vascular Tree Synthesis Software , 2011 .

[43]  Wolfram Schiffmann,et al.  Comparison of optimized backpropagation algorithms , 1993, ESANN.

[44]  Niels Chr. Overgaard,et al.  Fast Variational Segmentation using Partial Extremal Initialization , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).