Object tracking in image sequences using point features

This paper presents an object tracking technique based on the Bayesian multiple hypothesis tracking (MHT) approach. Two algorithms, both based on the MHT technique are combined to generate an object tracker. The first MHT algorithm is employed for contour segmentation. The segmentation of contours is based on an edge map. The segmented contours are then merged to form recognisable objects. The second MHT algorithm is used in the temporal tracking of a selected object from the initial frame. An object is represented by key feature points that are extracted from it. The key points (mostly corner points) are detected using information obtained from the edge map. These key points are then tracked through the sequence. To confirm the correctness of the tracked key points, the location of the key points on the trajectory are verified against the segmented object identified in each frame. If an acceptable number of key-points lie on or near the contour of the object in a particular frame (n-th frame), we conclude that the selected object has been tracked (identified) successfully in frame n.

[1]  David Suter,et al.  Assessing the performance of corner detectors for point feature tracking applications , 2004, Image Vis. Comput..

[2]  David G. Lowe,et al.  Robust model-based motion tracking through the integration of search and estimation , 1992, International Journal of Computer Vision.

[3]  David Suter,et al.  Performance Measures for Assessing Contour Trackers , 2002, Int. J. Image Graph..

[4]  Farzin Mokhtarian,et al.  Robust Image Corner Detection Through Curvature Scale Space , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Andrew Blake,et al.  Dynamic contours: real-time active splines , 1993 .

[6]  Jitendra Malik,et al.  Robust Multiple Car Tracking with Occlusion Reasoning , 1994, ECCV.

[7]  Heinrich Niemann,et al.  Adaptive Road Recognition and Ego-state Tracking in the Presence of Obstacles , 1998, International Journal of Computer Vision.

[8]  Ingemar J. Cox,et al.  On Finding Ranked Assignments With Application to Multi-Target Tracking and Motion Correspondence , 1995 .

[9]  Ingemar J. Cox,et al.  A review of statistical data association techniques for motion correspondence , 1993, International Journal of Computer Vision.

[10]  X. R. Li,et al.  Performance Prediction of the Interacting Multiple Model Algorithm , 1992, 1992 American Control Conference.

[11]  Andrew Blake,et al.  A framework for spatiotemporal control in the tracking of visual contours , 1993, International Journal of Computer Vision.

[12]  Ingemar J. Cox,et al.  TWO DIMENSIONAL OPTIMUM EDGE RECOGNITION USING MATCHED AND WIENER FILTERS FOR MACHINE VISION. , 1987 .

[13]  Kuo-Chu Chang,et al.  Performance evaluation of track initiation in dense target environments , 1994 .

[14]  Ingemar J. Cox,et al.  An Efficient Implementation of Reid's Multiple Hypothesis Tracking Algorithm and Its Evaluation for the Purpose of Visual Tracking , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Kuo-Chu Chang.  Multitarget tracking with adaptive detection thresholds , 1996 .

[16]  K. G. Murty.  An Algorithm for Ranking All the Assignment in Order of Increasing Cost , 1968 .

[17]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[18]  Michael Isard,et al.  CONDENSATION—Conditional Density Propagation for Visual Tracking , 1998, International Journal of Computer Vision.

[19]  David Suter,et al.  Visual tracking and motion determination using the IMM algorithm , 1998, Proceedings. Fourteenth International Conference on Pattern Recognition (Cat. No.98EX170).

[20]  Michael Isard,et al.  Active Contours , 2000, Springer London.

[21]  Ingemar J. Cox,et al.  A Bayesian multiple-hypothesis approach to edge grouping and contour segmentation , 1993, International Journal of Computer Vision.

[22]  David C. Hogg,et al.  An efficient method for contour tracking using active shape models , 1994, Proceedings of 1994 IEEE Workshop on Motion of Non-rigid and Articulated Objects.

[23]  Yaakov Bar-Shalom,et al.  Estimation and Tracking: Principles, Techniques, and Software , 1993 .

[24]  Yaakov Bar-Shalom,et al.  Performance prediction of tracking in clutter with nearest neighbor filters , 1994, Defense, Security, and Sensing.

[25]  Takeo Kanade,et al.  Visual Tracking of High DOF Articulated Structures: an Application to Human Hand Tracking , 1994, ECCV.

[26]  Y. Bar-Shalom.  Tracking and data association , 1988 .

[27]  K. Lai.  Deformable contours: modeling, extraction, detection and classification , 1995 .

[28]  Ingemar J. Cox,et al.  A Bayesian Multiple Hypothesis Approach to Contour Grouping , 1992, ECCV.

[29]  Chee-Yee Chong,et al.  Evaluating a multiple-hypothesis multitarget tracking algorithm , 1994 .

[30]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[31]  Ingemar J. Cox,et al.  Modeling a Dynamic Environment Using a Bayesian Multiple Hypothesis Approach , 1994, Artif. Intell..

[32]  Michael Isard,et al.  Learning to Track the Visual Motion of Contours , 1995, Artif. Intell..

[33]  David C. Hogg,et al.  Learning Flexible Models from Image Sequences , 1994, ECCV.

[34]  David Suter,et al.  Contour tracking with automatic motion model switching , 2003, Pattern Recognit..

[35]  Roland T. Chin,et al.  Deformable contours: modeling and extraction , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[36]  Daniel P. Huttenlocher,et al.  Tracking non-rigid objects in complex scenes , 1993, 1993 (4th) International Conference on Computer Vision.

[37]  Katta G. Murty,et al.  Letter to the Editor - An Algorithm for Ranking all the Assignments in Order of Increasing Cost , 1968, Oper. Res..

[38]  David Suter,et al.  Visual tracking with automatic motion model switching , 2001, Pattern Recognit..