A PDE-based level-set approach for detection and tracking of moving objects

This paper presents a framework for detecting and tracking moving objects in a sequence of images. Using a statistical approach, where the inter-frame difference is modeled by a mixture of two Laplacian or Gaussian distributions, and an energy minimization based approach, we reformulate the motion detection and tracking problem as a front propagation problem. The Euler-Lagrange equation of the designed energy functional is first derived and the flow minimizing the energy is then obtained. Following the work by Caselles et al. (1995) and Malladi et al. (1995), the contours to be detected and tracked are modeled as geodesic active contours evolving toward the minimum of the designed energy, under the influence of internal and external image dependent forces. Using the level set formulation scheme of Osher and Sethian (1988), complex curves can be detected and tracked and topological changes for the evolving curves are naturally managed. To reduce the computational cost required by a direct implementation, of the formulation scheme of Osher and Sethian (1988), a new approach exploiting aspects from the classical narrow band and fast marching methods is proposed and favorably compared to them. In order to further reduce the CPU time, a multi-scale approach has also been considered. Very promising experimental results are provided using real video sequences.

[1]  Ciro Cafforio,et al.  Methods for measuring small displacements of television images , 1976, IEEE Trans. Inf. Theory.

[2]  Rachid Deriche,et al.  Tracking complex primitives in an image sequence , 1994, Proceedings of 12th International Conference on Pattern Recognition.

[3]  V. Caselles,et al.  Snakes in Movement , 1996 .

[4]  Rachid Deriche,et al.  Region tracking through image sequences , 1995, Proceedings of IEEE International Conference on Computer Vision.

[5]  J A Sethian,et al.  A fast marching level set method for monotonically advancing fronts. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[6]  Demetri Terzopoulos,et al.  Regularization of Inverse Visual Problems Involving Discontinuities , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Hans-Hellmut Nagel,et al.  Motion Boundary Detection in Image Sequences by Local Stochastic Tests , 1994, ECCV.

[8]  David Malah,et al.  Change detection and texture analysis for image sequence coding , 1994, Signal Process. Image Commun..

[9]  Norbert Diehl,et al.  Object-oriented motion estimation and segmentation in image sequences , 1991, Signal Process. Image Commun..

[10]  Rachid Deriche,et al.  Recovering and characterizing image features using an efficient model based approach , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[11]  Martin Bichsel,et al.  Segmenting Simply Connected Moving Objects in a Static Scene , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Alex Pentland,et al.  Pfinder: Real-Time Tracking of the Human Body , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  R. Deriche,et al.  Les EDP en traitement des images et vision par ordinateur , 1995 .

[14]  Donald Geman,et al.  Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  E. Rouy,et al.  A viscosity solutions approach to shape-from-shading , 1992 .

[16]  Marie-Odile Berger How to track efficiently piecewise curved contours with a view to reconstructing 3D objects , 1994, Proceedings of 12th International Conference on Pattern Recognition.

[17]  Baba C. Vemuri,et al.  Shape Modeling with Front Propagation: A Level Set Approach , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  Ramesh C. Jain,et al.  Motion detection in spatio-temporal space , 1989, Comput. Vis. Graph. Image Process..

[19]  Richard O. Duda,et al.  Pattern classification and scene analysis , 1974, A Wiley-Interscience publication.

[20]  J. Sethian,et al.  Fronts propagating with curvature-dependent speed: algorithms based on Hamilton-Jacobi formulations , 1988 .

[21]  Patrick Bouthemy,et al.  Region-Based Tracking in an Image Sequence , 1992, ECCV.

[22]  Georgios Tziritas,et al.  Detection and location of moving objects using deterministic relaxation algorithms , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[23]  Alex Pentland,et al.  A Bayesian Computer Vision System for Modeling Human Interactions , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[24]  Rachid Deriche,et al.  Energy-based methods for 2D curve tracking, reconstruction, and refinement of 3D curves and applications , 1993, Optics & Photonics.

[25]  Patrick Pérez,et al.  Adaptive detection of moving objects using multiscale techniques , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[26]  J. Sethian,et al.  A Fast Level Set Method for Propagating Interfaces , 1995 .

[27]  Geoffrey J. McLachlan,et al.  Maximum likelihood clustering via normal mixture models , 1996, Signal Process. Image Commun..

[28]  Til Aach,et al.  Bayesian algorithms for adaptive change detection in image sequences using Markov random fields , 1995, Signal Process. Image Commun..

[29]  Jean-Marc Odobez,et al.  Robust Multiresolution Estimation of Parametric Motion Models , 1995, J. Vis. Commun. Image Represent..

[30]  Rachid Deriche,et al.  Tracking line segments , 1990, Image Vis. Comput..

[31]  Baba C. Vemuri,et al.  Topology-independent shape modeling scheme , 1993, Optics & Photonics.

[32]  Nicholas Ayache,et al.  Tracking Points on Deformable Objects Using Curvature Information , 1992, ECCV.

[33]  G. Tziritas,et al.  Motion Analysis for Image Sequence Coding , 1994 .

[34]  Peter E. Hart,et al.  Pattern classification and scene analysis , 1974, A Wiley-Interscience publication.