Real-time tracking using level sets

In this paper we propose a novel implementation of the level set method that achieves real-time level-set-based video tracking. In our fast algorithm, the evolution of the curve is realized by simple operations such as switching elements between two linked lists and there is no need to solve any partial differential equations. Furthermore, a novel procedure based on Gaussian filtering is introduced to incorporate boundary smoothness regularization. By replacing the standard curve length penalty with this new smoothing procedure, further speedups are obtained. Another advantage of our fast algorithm is that the topology of the curves can be controlled easily. For the tracking of multiple objects, we extend our fast algorithm to maintain the desired topology for multiple object boundaries based on ideas from discrete topology. With our fast algorithm, a real-time system has been implemented on a standard PC and only a small fraction of the CPU power is used for tracking. Results from standard test sequences and our realtime system are presented.

[1]  S. Osher,et al.  Regular Article: A PDE-Based Fast Local Level Set Method , 1999 .

[2]  Xin Li,et al.  Contour-based object tracking with occlusion handling in video acquired using mobile cameras , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Tony F. Chan,et al.  Active contours without edges , 2001, IEEE Trans. Image Process..

[4]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[5]  F. Gibou.  A fast hybrid k-means level set algorithm for segmentation , 2005 .

[6]  Xiao Han,et al.  A Topology Preserving Level Set Method for Geometric Deformable Models , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  S. Osher,et al.  Algorithms Based on Hamilton-Jacobi Formulations , 1988 .

[8]  Tao Zhang,et al.  Active contours for tracking distributions , 2004, IEEE Transactions on Image Processing.

[9]  Ross T. Whitaker,et al.  A Level-Set Approach to 3D Reconstruction from Range Data , 1998, International Journal of Computer Vision.

[10]  S. Osher,et al.  A PDE-Based Fast Local Level Set Method 1 , 1998 .

[11]  J. Sethian,et al.  A Fast Level Set Method for Propagating Interfaces , 1995 .

[12]  Frédéric Precioso,et al.  Smoothing B-spline active contour for fast and robust image and video segmentation , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[13]  W. Clem Karl,et al.  A curve evolution approach for image segmentation using adaptive flows , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[14]  Michel Barlaud,et al.  Detection and Tracking of Moving Objects using a New Level Set Based Method , 2000, ICPR.

[15]  Rachid Deriche,et al.  Geodesic Active Contours and Level Sets for the Detection and Tracking of Moving Objects , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  Thomas S. Huang,et al.  JPDAF based HMM for real-time contour tracking , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[17]  Guillermo Sapiro,et al.  Morphing active contours: a geometric approach to topology-independent image segmentation and tracking , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[18]  Dorin Comaniciu,et al.  Kernel-Based Object Tracking , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[19]  Michael Isard,et al.  ICONDENSATION: Unifying Low-Level and High-Level Tracking in a Stochastic Framework , 1998, ECCV.

[20]  Jitendra Malik,et al.  Scale-Space and Edge Detection Using Anisotropic Diffusion , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  Abdol-Reza Mansouri,et al.  Region Tracking via Level Set PDEs without Motion Computation , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[22]  Gilles Bertrand,et al.  Simple points, topological numbers and geodesic neighborhoods in cubic grids , 1994, Pattern Recognit. Lett..

[23]  J. Sethian,et al.  Fronts propagating with curvature-dependent speed: algorithms based on Hamilton-Jacobi formulations , 1988 .

[24]  Alan L. Yuille,et al.  Region Competition: Unifying Snakes, Region Growing, and Bayes/MDL for Multiband Image Segmentation , 1996, IEEE Trans. Pattern Anal. Mach. Intell..