Feature Association for Object Tracking

This paper addresses the problem of feature-based estimation of the 3D motion (rotational+translational) and structure of a rigid object from a sequence of 2D monocular images. A rigid object is represented by a set of junctions-groupings of line segments that meet at a single point-which has several advantages over other techniques. An overall scheme for 3D object tracking using enhanced junction detection via a modified Hough transform and state estimation using an un scented Kalman filter was developed in a previous paper. This paper focuses on a crucial part of the overall tracking scheme-the association (matching) of the predicted and observed junctions. The problem is formulated systematically as a general global assignment problem which allows for the treatment of uncertainties such as occlusion and appearance of new features. Appropriate assignment costs are proposed that account for junction topology and geometry. In addition, a general convex programming approach for two and multiple frame junction matching is also proposed. Simulation results illustrating the accuracy of the junction association algorithms as well as the over all object tracking scheme are provided. Overall, the approach demonstrates that well established data association methods developed for "point" multitarget tracking can, after appropriate adaptation, be very useful for tracking rigid objects

[1]  Steven D. Blostein,et al.  Three-dimensional trajectory estimation from image position and velocity , 2000, IEEE Trans. Aerosp. Electron. Syst..

[2]  Thiagalingam Kirubarajan,et al.  A convex minimization approach to data association with prior constraints , 2004, SPIE Defense + Commercial Sensing.

[3]  Thomas S. Huang,et al.  Motion and structure from feature correspondences: a review , 1994, Proc. IEEE.

[4]  Alex Pentland,et al.  Recursive Estimation of Motion, Structure, and Focal Length , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Yakov Bar-Shalom,et al.  Multitarget-Multisensor Tracking: Principles and Techniques , 1995 .

[6]  V.P. Jilkov,et al.  Enhanced image feature extraction for object tracking , 2005, 2005 7th International Conference on Information Fusion.

[7]  Jeffrey K. Uhlmann,et al.  Unscented filtering and nonlinear estimation , 2004, Proceedings of the IEEE.

[8]  Daniel P. Huttenlocher,et al.  Comparing Images Using the Hausdorff Distance , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  LI X.RONG,et al.  Survey of maneuvering target tracking. Part I. Dynamic models , 2003 .

[10]  Rama Chellappa,et al.  Estimating the Kinematics and Structure of a Rigid Object from a Sequence of Monocular Images , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Anil K. Jain,et al.  A modified Hausdorff distance for object matching , 1994, Proceedings of 12th International Conference on Pattern Recognition.

[12]  Narendra Ahuja,et al.  Optimal Motion and Structure Estimation , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  V. Jilkov,et al.  Survey of maneuvering target tracking. Part V. Multiple-model methods , 2005, IEEE Transactions on Aerospace and Electronic Systems.

[14]  Daniel P. Huttenlocher,et al.  A multi-resolution technique for comparing images using the Hausdorff distance , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[15]  Ian D. Reid,et al.  The Active Recovery of 3D Motion Trajectories and Their Use in Prediction , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  R. Chellappa,et al.  Recursive 3-D motion estimation from a monocular image sequence , 1990 .

[17]  Olivier D. Faugeras,et al.  Three-dimensional motion computation and object segmentation in a long sequence of stereo frames , 1992, International Journal of Computer Vision.

[18]  Rama Chellappa,et al.  Bayesian algorithms for simultaneous structure from motion estimation of multiple independently moving objects , 2005, IEEE Transactions on Image Processing.