Visual data association for real‐time video tracking using genetic and estimation of distribution algorithms

In this article, an efficient and novel approach for video data association is developed. This new method is formulated as a search across the hypotheses space defined by the possible association among tracks and detections, carried out for each frame of a video sequence. The full data association problem in visual tracking is formulated as a combinatorial hypotheses search with a heuristic evaluation function taking into account structural and specific information such as distance, shape, color, etc. To guarantee real‐time performance, a time limit is set for the search process explore alternative solutions. This time limit defines the upper bound of the number of evaluations depending on search algorithm efficiency. Estimation distribution algorithms are proposed as an efficient evolutionary computation technique to search in this hypothesis space. Finally, an exhaustive comparison of the performance of alternative algorithms is carried out considering complex representative situations in real video sets. © 2009 Wiley Periodicals, Inc. Int J Imaging Syst Technol, 19, 208–220, 2009

[1]  Ingemar J. Cox,et al.  An Efficient Implementation of Reid's Multiple Hypothesis Tracking Algorithm and Its Evaluation for the Purpose of Visual Tracking , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Shumeet Baluja,et al.  A Method for Integrating Genetic Search Based Function Optimization and Competitive Learning , 1994 .

[3]  Y. Bar-Shalom,et al.  IMM estimation for multitarget-multisensor air traffic surveillance , 1995, Proceedings of 1995 34th IEEE Conference on Decision and Control.

[4]  S. Shams.  Neural network optimization for multi-target multi-sensor passive tracking , 1996 .

[5]  W. Eric L. Grimson,et al.  Adaptive background mixture models for real-time tracking , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[6]  D. B. Hillis,et al.  Using a genetic algorithm for multi-hypothesis tracking , 1997, Proceedings Ninth IEEE International Conference on Tools with Artificial Intelligence.

[7]  J. K. Aggarwal,et al.  3D structure reconstruction from an ego motion sequence using statistical estimation and detection theory , 1991, Proceedings of the IEEE Workshop on Visual Motion.

[8]  Luc Van Gool,et al.  Object Tracking with an Adaptive Color-Based Particle Filter , 2002, DAGM-Symposium.

[9]  Kuntal Sengupta,et al.  Co-operative Multi-target Tracking and Classification , 2004, ECCV.

[10]  Branko Ristic,et al.  Beyond the Kalman Filter: Particle Filters for Tracking Applications , 2004 .

[11]  Larry S. Davis,et al.  W4: Real-Time Surveillance of People and Their Activities , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Nino Ronetti,et al.  Railway Station Surveillance: The Italian Case , 2000 .

[13]  M P Gardner.  HIGHWAY TRAFFIC MONITORING , 2000 .

[14]  Eun Yi Kim,et al.  Automatic video segmentation using genetic algorithms , 2006, Pattern Recognit. Lett..

[15]  Christopher Nw Agboso.  User focused Surveillance Systems Integration for Intelligent Transport Systems , 1999 .

[16]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Dorin Comaniciu,et al.  Real-time tracking of non-rigid objects using mean shift , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[18]  Rita Cucchiara,et al.  Using computer vision techniques for dangerous situation detection in domotic applications , 2004 .

[19]  Jesús García,et al.  A Multitarget Tracking Video System Based on Fuzzy and Neuro-Fuzzy Techniques , 2005, EURASIP J. Adv. Signal Process..

[20]  Peter A. N. Bosman,et al.  Evolutionary algorithms for medical simulations: a case study in minimally-invasive vascular interventions , 2005, GECCO '05.

[21]  David E. Goldberg,et al.  The compact genetic algorithm , 1999, IEEE Trans. Evol. Comput..

[22]  P. Willett,et al.  Multiple model PMHT and its application to the benchmark radar tracking problem , 2004, IEEE Transactions on Aerospace and Electronic Systems.

[23]  Heinz Mühlenbein,et al.  The Equation for Response to Selection and Its Use for Prediction , 1997, Evolutionary Computation.

[24]  David E. Goldberg,et al.  Linkage Problem, Distribution Estimation, and Bayesian Networks , 2000, Evolutionary Computation.

[25]  Y. Bar-Shalom,et al.  A new relaxation algorithm and passive sensor data association , 1992 .

[26]  Bojan Cestnik,et al.  Estimating Probabilities: A Crucial Task in Machine Learning , 1990, ECAI.

[27]  Stephen J. Maybank,et al.  Visual Surveillance for Moving Vehicles , 1998, International Journal of Computer Vision.

[28]  Paul A. Viola,et al.  MIMIC: Finding Optima by Estimating Probability Densities , 1996, NIPS.

[29]  J. A. Lozano,et al.  Estimation of Distribution Algorithms: A New Tool for Evolutionary Computation , 2001 .

[30]  H. Muhlenbein,et al.  The Factorized Distribution Algorithm for additively decomposed functions , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).