A Real-Time Algorithm for the Approximation of Level-Set-Based Curve Evolution

In this paper, we present a complete and practical algorithm for the approximation of level-set-based curve evolution suitable for real-time implementation. In particular, we propose a two-cycle algorithm to approximate level-set-based curve evolution without the need of solving partial differential equations (PDEs). Our algorithm is applicable to a broad class of evolution speeds that can be viewed as composed of a data-dependent term and a curve smoothness regularization term. We achieve curve evolution corresponding to such evolution speeds by separating the evolution process into two different cycles: one cycle for the data-dependent term and a second cycle for the smoothness regularization. The smoothing term is derived from a Gaussian filtering process. In both cycles, the evolution is realized through a simple element switching mechanism between two linked lists, that implicitly represents the curve using an integer valued level-set function. By careful construction, all the key evolution steps require only integer operations. A consequence is that we obtain significant computation speedups compared to exact PDE-based approaches while obtaining excellent agreement with these methods for problems of practical engineering interest. In particular, the resulting algorithm is fast enough for use in real-time video processing applications, which we demonstrate through several image segmentation and video tracking experiments.

[1]  Alexis Gourdon,et al.  Computing the Differential Characteristics of Isointensity Surfaces , 1995, Comput. Vis. Image Underst..

[2]  Max A. Viergever,et al.  Efficient and reliable schemes for nonlinear diffusion filtering , 1998, IEEE Trans. Image Process..

[3]  Tony F. Chan,et al.  Active contours without edges , 2001, IEEE Trans. Image Process..

[4]  T. Chan,et al.  A fast algorithm for level set based optimization , 2002 .

[5]  O. Monga,et al.  Using partial Derivatives of 3D images to extract typical surface features , 1992, Proceedings of the Third Annual Conference of AI, Simulation, and Planning in High Autonomy Systems 'Integrating Perception, Planning and Action'..

[6]  Benoit M. Dawant,et al.  Morphometric analysis of white matter lesions in MR images: method and validation , 1994, IEEE Trans. Medical Imaging.

[7]  Frédéric Precioso,et al.  Smoothing B-spline active contour for fast and robust image and video segmentation , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[8]  Anthony J. Yezzi,et al.  Gradient flows and geometric active contour models , 1995, Proceedings of IEEE International Conference on Computer Vision.

[9]  Alex Pentland,et al.  LAFTER: lips and face real time tracker , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[10]  P. Souganidis,et al.  Threshold dynamics type approximation schemes for propagating fronts , 1999 .

[11]  R. Leahy,et al.  Magnetic Resonance Image Tissue Classification Using a Partial Volume Model , 2001, NeuroImage.

[12]  Michel Barlaud,et al.  Detection and Tracking of Moving Objects using a New Level Set Based Method , 2000, ICPR.

[13]  Peng Lin,et al.  Shape Recovery by Diffusion Generated Motion , 2002, J. Vis. Commun. Image Represent..

[14]  W. Clem Karl,et al.  Real-time tracking using level sets , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[15]  Alex M. Andrew,et al.  Level Set Methods and Fast Marching Methods: Evolving Interfaces in Computational Geometry, Fluid Mechanics, Computer Vision, and Materials Science (2nd edition) , 2000 .

[16]  S. Osher,et al.  Motion of multiple junctions: a level set approach , 1994 .

[17]  Ronald Fedkiw,et al.  Level set methods and dynamic implicit surfaces , 2002, Applied mathematical sciences.

[18]  Anthony J. Yezzi,et al.  Curve evolution implementation of the Mumford-Shah functional for image segmentation, denoising, interpolation, and magnification , 2001, IEEE Trans. Image Process..

[19]  Ross T. Whitaker,et al.  A streaming narrow-band algorithm: interactive computation and visualization of level sets , 2004, IEEE Transactions on Visualization and Computer Graphics.

[20]  L. R. Dice.  Measures of the Amount of Ecologic Association Between Species , 1945 .

[21]  Guillermo Sapiro,et al.  Geodesic Active Contours , 1995, International Journal of Computer Vision.

[22]  Tao Zhang,et al.  Active contours for tracking distributions , 2004, IEEE Transactions on Image Processing.

[23]  Ross T. Whitaker,et al.  A Level-Set Approach to 3D Reconstruction from Range Data , 1998, International Journal of Computer Vision.

[24]  J. Sethian,et al.  Fronts propagating with curvature-dependent speed: algorithms based on Hamilton-Jacobi formulations , 1988 .

[25]  Robert T. Schultz,et al.  Segmentation and Measurement of the Cortex from 3D MR Images , 1998, MICCAI.

[26]  David A. Rottenberg,et al.  Quantitative comparison of four brain extraction algorithms , 2004, NeuroImage.

[27]  Guillermo Sapiro,et al.  Morphing active contours: a geometric approach to topology-independent image segmentation and tracking , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[28]  Baba C. Vemuri,et al.  Shape Modeling with Front Propagation: A Level Set Approach , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[29]  James A. Sethian,et al.  Level Set Methods and Fast Marching Methods: Evolving Interfaces in Computational Geometry, Fluid , 2012 .

[30]  Roman Goldenberg,et al.  Fast Geodesic Active Contours , 1999, Scale-Space.

[31]  Abdol-Reza Mansouri,et al.  Region Tracking via Level Set PDEs without Motion Computation , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[32]  Dorin Comaniciu,et al.  Kernel-Based Object Tracking , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[33]  Scott T. Acton,et al.  Level set analysis for leukocyte detection and tracking , 2004, IEEE Transactions on Image Processing.

[34]  Xuecheng Tai,et al.  A parallel splitting-up method for partial differential equations and its applications to Navier-Stokes equations , 1992 .

[35]  Steven J. Ruuth.  Efficient Algorithms for Diffusion-Generated Motion by Mean Curvature , 1998 .

[36]  G. Barles,et al.  A Simple Proof of Convergence for an Approximation Scheme for Computing Motions by Mean Curvature , 1995 .

[37]  S. Osher,et al.  Algorithms Based on Hamilton-Jacobi Formulations , 1988 .

[38]  Michael Isard,et al.  ICONDENSATION: Unifying Low-Level and High-Level Tracking in a Stochastic Framework , 1998, ECCV.

[39]  S. Esedoglu,et al.  Threshold dynamics for the piecewise constant Mumford-Shah functional , 2006 .

[40]  Rachid Deriche,et al.  Geodesic Active Contours and Level Sets for the Detection and Tracking of Moving Objects , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[41]  L. Evans.  Convergence of an algorithm for mean curvature motion , 1993 .

[42]  Thomas S. Huang,et al.  JPDAF based HMM for real-time contour tracking , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[43]  Marie-Pierre Jolly,et al.  Interactive graph cuts for optimal boundary & region segmentation of objects in N-D images , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[44]  F. Gibou.  A fast hybrid k-means level set algorithm for segmentation , 2005 .

[45]  Stan Sclaroff,et al.  Skin color-based video segmentation under time-varying illumination , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[46]  S. Osher,et al.  Regular Article: A PDE-Based Fast Local Level Set Method , 1999 .

[47]  Alan L. Yuille,et al.  Region Competition: Unifying Snakes, Region Growing, and Bayes/MDL for Multiband Image Segmentation , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[48]  J. Tsitsiklis,et al.  Efficient algorithms for globally optimal trajectories , 1994, Proceedings of 1994 33rd IEEE Conference on Decision and Control.

[49]  Vladimir Kolmogorov,et al.  An experimental comparison of min-cut/max- flow algorithms for energy minimization in vision , 2001, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[50]  J A Sethian,et al.  A fast marching level set method for monotonically advancing fronts. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[51]  Xue-Cheng Tai,et al.  A binary level set model and some applications to Mumford-Shah image segmentation , 2006, IEEE Transactions on Image Processing.

[52]  Shaogang Gong,et al.  Tracking and segmenting people in varying lighting conditions using colour , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[53]  Lucas J. van Vliet,et al.  On curvature estimation of ISO surfaces in 3D gray-value images and the computation of shape descriptors , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[54]  W. Clem Karl,et al.  A curve evolution approach to object-based tomographic reconstruction , 2003, IEEE Trans. Image Process..

[55]  Harald Haas,et al.  Asilomar Conference on Signals, Systems, and Computers , 2006 .

[56]  S. Osher,et al.  A PDE-Based Fast Local Level Set Method 1 , 1998 .

[57]  Alexander H. Waibel,et al.  Skin-Color Modeling and Adaptation , 1998, ACCV.

[58]  D. Chopp.  Computing Minimal Surfaces via Level Set Curvature Flow , 1993 .

[59]  Xuecheng Tai,et al.  A parallel splitting up method and its application to Navier-Stokes equations , 1991 .

[60]  James A. Sethian,et al.  The Fast Construction of Extension Velocities in Level Set Methods , 1999 .

[61]  Azriel Rosenfeld,et al.  Digital topology: Introduction and survey , 1989, Comput. Vis. Graph. Image Process..

[62]  Xin Li,et al.  Contour-based object tracking with occlusion handling in video acquired using mobile cameras , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.