CONDENSATION—Conditional Density Propagation for Visual Tracking

The problem of tracking curves in dense visual clutter is challenging. Kalman filtering is inadequate because it is based on Gaussian densities which, being unimo dal, cannot represent simultaneous alternative hypotheses. The Condensation algorithm uses “factored sampling”, previously applied to the interpretation of static images, in which the probability distribution of possible interpretations is represented by a randomly generated set. Condensation uses learned dynamical models, together with visual observations, to propagate the random set over time. The result is highly robust tracking of agile motion. Notwithstanding the use of stochastic methods, the algorithm runs in near real-time.

[1]  Walter L. Smith Probability and Statistics , 1959, Nature.

[2]  N. L. Johnson,et al.  Linear Statistical Inference and Its Applications , 1966 .

[3]  R. S. Bucy,et al.  Bayes Theorem and Digital Realizations for Non-Linear Filters , 1969 .

[4]  H. Sorenson,et al.  Recursive bayesian estimation using gaussian sums , 1971 .

[5]  Martin A. Fischler,et al.  The Representation and Matching of Pictorial Structures , 1973, IEEE Transactions on Computers.

[6]  Calyampudi R. Rao,et al.  Linear Statistical Inference and Its Applications. , 1975 .

[7]  A.H. Haddad,et al.  Applied optimal estimation , 1976, Proceedings of the IEEE.

[8]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[9]  David C. Hogg Model-based vision: a program to see a walking person , 1983, Image Vis. Comput..

[10]  Donald Geman,et al.  Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Graham C. Goodwin,et al.  Adaptive filtering prediction and control , 1984 .

[12]  Brian D. Ripley,et al.  Stochastic Simulation , 2005 .

[13]  Y. Bar-Shalom Tracking and data association , 1988 .

[14]  D. Lowe Fitting Parameterized 3-D Models to Images , 1989 .

[15]  Michael A. Lachance,et al.  An introduction to splines for use in computer graphics and geometric modeling , 1990 .

[16]  Andrew Blake,et al.  The dynamic analysis of apparent contours , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[17]  Gregory D. Hager Task-Directed Sensor Fusion and Planning: A Computational Approach , 1990 .

[18]  Ulf Grenander,et al.  Hands: A Pattern Theoretic Study of Biological Shapes , 1990 .

[19]  A. L. Sutherland,et al.  Finding spiral structures in images of galaxies , 1990, Philosophical Transactions of the Royal Society of London. Series A: Physical and Engineering Sciences.

[20]  J J Koenderink,et al.  Affine structure from motion. , 1991, Journal of the Optical Society of America. A, Optics and image science.

[21]  Dimitris N. Metaxas,et al.  Dynamic 3D Models with Local and Global Deformations: Deformable Superquadrics , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[22]  David G. Lowe,et al.  Fitting Parameterized Three-Dimensional Models to Images , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[23]  Ronen Basri,et al.  Recognition by Linear Combinations of Models , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[24]  G. Sullivan Natural and artificial low-level seeing systems - Visual interpretation of known objects in constrained scenes , 1992 .

[25]  Daniel P. Huttenlocher,et al.  Tracking non-rigid objects in complex scenes , 1993, 1993 (4th) International Conference on Computer Vision.

[26]  N. Gordon,et al.  Novel approach to nonlinear/non-Gaussian Bayesian state estimation , 1993 .

[27]  Timothy F. Cootes,et al.  Building and using flexible models incorporating grey-level information , 1993, 1993 (4th) International Conference on Computer Vision.

[28]  Bobby Rao,et al.  Data association methods for tracking systems , 1993 .

[29]  Richard Szeliski,et al.  Tracking with Kalman snakes , 1993 .

[30]  Chris Harris,et al.  Tracking with rigid models , 1993 .

[31]  Biing-Hwang Juang,et al.  Fundamentals of speech recognition , 1993, Prentice Hall signal processing series.

[32]  Geir Storvik,et al.  A Bayesian Approach to Dynamic Contours Through Stochastic Sampling and Simulated Annealing , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[33]  Michael Isard,et al.  3D position, attitude and shape input using video tracking of hands and lips , 1994, SIGGRAPH.

[34]  David C. Hogg,et al.  Learning Flexible Models from Image Sequences , 1994, ECCV.

[35]  Takeo Kanade,et al.  Visual Tracking of High DOF Articulated Structures: an Application to Human Hand Tracking , 1994, ECCV.

[36]  Michael I. Miller,et al.  Conditional-mean estimation via jump-diffusion processes in multiple target tracking/recognition , 1995, IEEE Trans. Signal Process..

[37]  Petros G. Voulgaris,et al.  On optimal ℓ∞ to ℓ∞ filtering , 1995, Autom..

[38]  Michael Isard,et al.  Learning to Track the Visual Motion of Contours , 1995, Artif. Intell..

[39]  G. Kitagawa Monte Carlo Filter and Smoother for Non-Gaussian Nonlinear State Space Models , 1996 .

[40]  David C. Hogg,et al.  Generating Spatiotemporal Models from Examples , 1995, BMVC.

[41]  Michael Isard,et al.  Contour Tracking by Stochastic Propagation of Conditional Density , 1996, ECCV.

[42]  Andrew Blake,et al.  Statistical Feature Modelling for Active Contours , 1996, ECCV.

[43]  Andrew Blake,et al.  Learning Dynamics of Complex Motions from Image Sequences , 1996, ECCV.

[44]  William H. Press,et al.  Numerical recipes in C , 2002 .

[45]  Larry H. Matthies,et al.  Kalman filter-based algorithms for estimating depth from image sequences , 1989, International Journal of Computer Vision.

[46]  David G. Lowe,et al.  Robust model-based motion tracking through the integration of search and estimation , 1992, International Journal of Computer Vision.

[47]  Donald B. Gennery,et al.  Visual tracking of known three-dimensional objects , 1992, International Journal of Computer Vision.

[48]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[49]  Andrew Blake,et al.  A framework for spatiotemporal control in the tracking of visual contours , 1993, International Journal of Computer Vision.

[50]  Volker Graefe,et al.  Applications of dynamic monocular machine vision , 1988, Machine Vision and Applications.

[51]  Pedro F. Felzenszwalb Deformable Templates I , 2006 .

[52]  S. Ullman,et al.  Recognition by Linear Combinations of Models , 1991, IEEE Trans. Pattern Anal. Mach. Intell..