Automatic feature point extraction and tracking in image sequences for arbitrary camera motion

An automatic egomotion compensation based point correspondence algorithm is presented. A basic problem in autonomous navigation and motion estimation is automatically detecting and tracking features in consecutive frames, a challenging problem when camera motion is significant. In general, feature displacements between consecutive frames can be approximately decomposed into two components: (i) displacements due to camera motion which can be approximately compensated by image rotation, scaling, and translation; (ii) displacements due to object motion and/or perspective projection. In this paper, we introduce a two-step approach: First, the motion of the camera is compensated using a computational vision based image registration algorithm. Then consecutive frames are transformed to the same coordinate system and the feature correspondence problem is solved as though tracking moving objects for a stationary camera. Methods of subpixel accuracy feature matching, tracking and error analysis are introduced. The approach results in a robust and efficient algorithm. Results on several real image sequences are presented.

[1]  Rachid Deriche,et al.  Tracking line segments , 1990, Image Vis. Comput..

[2]  Ishwar K. Sethi,et al.  Finding Trajectories of Feature Points in a Monocular Image Sequence , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Larry H. Matthies,et al.  Kalman filter-based algorithms for estimating depth from image sequences , 1989, International Journal of Computer Vision.

[4]  Azriel Rosenfeld,et al.  Point pattern matching by relaxation , 1980, Pattern Recognit..

[5]  Rama Chellappa,et al.  Estimation of Illuminant Direction, Albedo, and Shape from Shading , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Ramakant Nevatia,et al.  Matching Images Using Linear Features , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Y. J. Tejwani,et al.  Robot vision , 1989, IEEE International Symposium on Circuits and Systems,.

[8]  Banavar Sridhar,et al.  Vision-based range estimation using helicopter flight data , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[9]  Qi Tian,et al.  Algorithms for subpixel registration , 1986 .

[10]  Thomas S. Huang,et al.  Image sequence analysis , 1981 .

[11]  Thomas S. Huang,et al.  Some Experiments on Estimating the 3-D Motion Parameters of a Rigid Body from Two Consecutive Image Frames , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Rama Chellappa,et al.  Stereoscopic recovery of egomotion and structure: models, uniqueness and experimental results , 1994, Proceedings of 12th International Conference on Pattern Recognition.

[13]  R. Chellappa,et al.  Hierarchical feature based matching for motion correspondence , 1991, Proceedings of the IEEE Workshop on Visual Motion.

[14]  Rama Chellappa,et al.  A computational vision approach to image registration , 1993, IEEE Trans. Image Process..

[15]  James L. Crowley,et al.  Measuring Image Flow By Tracking Edge-lines , 1988, [1988 Proceedings] Second International Conference on Computer Vision.

[16]  Rama Chellappa,et al.  A feature based approach to face recognition , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[17]  William B. Thompson,et al.  TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE , 2009 .