Tracking features in image sequences with Kalman filtering, global optimization, mahalanobis distance and a management model

This work addresses the problem of tracking feature points along image sequences. In order to analyze the undergoing movement, an approach based on the Kalman filtering technique has been used, which basically carries out the estimation and correction of the features’ movement in every image frame. So as to integrate the measurements obtained from each image into the Kalman filter, a data optimization process has been adopted to achieve the best global correspondence set. The proposed criterion minimizes the cost of global matching, which is based on the Mahalanobis distance. A management model is employed to manage the features being tracked. This model adequately deals with problems related to the occlusion of the tracked features, the appearance of new features, as well as optimizing the computational resources used. Experimental results obtained through the use of the proposed tracking framework are presented.

[1]  Thomas S. Huang,et al.  Modeling, Analysis, and Visualization of Left Ventricle Shape and Motion by Hierarchical Decomposition , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  D. R. J. Owen,et al.  Numerical Simulations of Irregular Particle Transport in Turbulent Flows Using Coupled LBM-DEM , 2007 .

[3]  Oliver E. Drummond,et al.  Multiple target tracking with multiple frame, probabilistic data association , 1993, Defense, Security, and Sensing.

[4]  R. Cucchiara,et al.  Statistic and knowledge-based moving object detection in traffic scenes , 2000, ITSC2000. 2000 IEEE Intelligent Transportation Systems. Proceedings (Cat. No.00TH8493).

[5]  Andrea Cavallaro,et al.  Target Detection and Tracking With Heterogeneous Sensors , 2008, IEEE Journal of Selected Topics in Signal Processing.

[6]  Andrew Blake,et al.  Tracking through singularities and discontinuities by random sampling , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[7]  Mubarak Shah,et al.  A non-iterative greedy algorithm for multi-frame point correspondence , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[8]  William H. Press,et al.  Numerical recipes in C. The art of scientific computing , 1987 .

[9]  Andrew Blake,et al.  A framework for spatiotemporal control in the tracking of visual contours , 1993, International Journal of Computer Vision.

[10]  Sameer Singh,et al.  Video analysis of human dynamics - a survey , 2003, Real Time Imaging.

[11]  James W. Davis,et al.  Real-time closed-world tracking , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[12]  Mubarak Shah,et al.  Establishing motion correspondence , 1991, CVGIP Image Underst..

[13]  J. L. Roux.  An Introduction to the Kalman Filter , 2003 .

[14]  Neil J. Gordon,et al.  A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking , 2002, IEEE Trans. Signal Process..

[15]  Rama Chellappa,et al.  Ieee Transactions on Pattern Analysis and Machine Intelligence 1 Matching Shape Sequences in Video with Applications in Human Movement Analysis. Ieee Transactions on Pattern Analysis and Machine Intelligence 2 , 2022 .

[16]  R. M. Natal Jorge,et al.  Segmentation and simulation of objects represented in images using physical principles , 2008 .

[17]  Ishwar K. Sethi,et al.  Finding Trajectories of Feature Points in a Monocular Image Sequence , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Jake K. Aggarwal,et al.  Human Motion Analysis: A Review , 1999, Comput. Vis. Image Underst..

[19]  Rashid Ansari,et al.  Kernel particle filter for visual tracking , 2005, IEEE Signal Processing Letters.

[20]  F. A. Seiler,et al.  Numerical Recipes in C: The Art of Scientific Computing , 1989 .

[21]  Ian D. Reid,et al.  Articulated Body Motion Capture by Stochastic Search , 2005, International Journal of Computer Vision.

[22]  Shital A. Raut,et al.  Image Segmentation – A State-Of-Art Survey for Prediction , 2009, 2009 International Conference on Advanced Computer Control.

[23]  Hui Zhang,et al.  Image segmentation evaluation: A survey of unsupervised methods , 2008, Comput. Vis. Image Underst..

[24]  Huosheng Hu,et al.  Human motion tracking for rehabilitation - A survey , 2008, Biomed. Signal Process. Control..

[25]  Ingemar J. Cox,et al.  A review of statistical data association techniques for motion correspondence , 1993, International Journal of Computer Vision.

[26]  G C Dean,et al.  An Introduction to Kalman Filters , 1986 .

[27]  R. Faure,et al.  Introduction to operations research , 1968 .

[28]  Fachbereich Informatik.  Reliable Recognition and Tracking of Multiple Persons in Work Safety Relevant Environments , 2007 .

[29]  Oliver E. Drummond,et al.  Multiple sensor tracking with multiple frame, probabilistic data association , 1995, Optics & Photonics.

[30]  D. J. Salmond,et al.  A particle filter for track-before-detect , 2001, Proceedings of the 2001 American Control Conference. (Cat. No.01CH37148).

[31]  Stan Sclaroff,et al.  Improved Tracking of Multiple Humans with Trajectory Predcition and Occlusion Modeling , 1998 .

[32]  Ishwar K. Sethi,et al.  Feature Point Correspondence in the Presence of Occlusion , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[33]  João Manuel R. S. Tavares,et al.  Matching of objects nodal points improvement using optimization , 2006 .

[34]  Juan José Pantrigo,et al.  Combining Particle filter and Population-Based Metaheuristics for Visual Articulated Motion Tracking , 2005, Progress in Computer Vision and Image Analysis.

[35]  Jürgen Kurths,et al.  The Unscented Kalman Filter, a Powerful Tool for Data Analysis , 2004, Int. J. Bifurc. Chaos.

[36]  David Suter,et al.  Object tracking in image sequences using point features , 2005, Pattern Recognit..

[37]  Cor J. Veenman,et al.  Resolving Motion Correspondence for Densely Moving Points , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[38]  Yongjie Zhang,et al.  Kinematic Analysis of Lumbar Spine Undergoing Extension and Dynamic Neural Foramina Cross Section Measurement , 2008 .

[39]  Y. Boers,et al.  Interacting multiple model particle filter , 2003 .

[40]  D. Fish,et al.  Clinical Assessment of Human Gait , 1993 .

[41]  Étienne Mémin,et al.  Conditional filters for image sequence-based tracking - application to point tracking , 2005, IEEE Transactions on Image Processing.