Establishing motion-based feature point correspondence

Abstract Given a sequence of frames corresponding to a dynamic scene, multiframe correspondence of a set of selected image points, called feature or interest points, determine the motion trajectories of those points. This paper describes a new polynomial time algorithm for finding feature point trajectories from a large sequence of frames. The proposed approach utilizes a constraint, called motion uniformity constraint. According to the motion uniformity constraint, the changes in the motion characteristics of a point are small over a short period of time and are temporally continuous. This implies that the trajectory of a point over a given time interval is as “smooth” and “short” as possible. The proposed approach permits point trajectories to terminate and start at intermediate frames of the sequence. For a given sequence, the trajectory set is obtained by considering every set of three consecutive frames and finding the locally best local trajectories (in terms of motion uniformity) that extend some of the existing point trajectories and/or define new point trajectories. Experimental results are presented to demonstrate the effectiveness of the proposed approach.

[1]  R. Shepard,et al.  Mental Images and Their Transformations , 1982 .

[2]  V. S. Ramachandran,et al.  Extrapolation of motion path in human visual perception , 1983, Vision Research.

[3]  Ishwar K. Sethi,et al.  Feature Point Correspondence in the Presence of Occlusion , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Mubarak Shah,et al.  Establishing motion correspondence , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[5]  Nigel Goddard,et al.  The interpretation of visual motion: recognizing moving light displays , 1989, [1989] Proceedings. Workshop on Visual Motion.

[6]  Hans-Hellmut Nagel,et al.  Algorithmic characterization of vehicle trajectories from image sequences by motion verbs , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[7]  Dana H. Ballard,et al.  Computer Vision , 1982 .

[8]  John K. Tsotsos,et al.  Applying temporal constraints to the dynamic stereo problem , 1986, Comput. Vis. Graph. Image Process..

[9]  Ishwar K. Sethi,et al.  Finding Trajectories of Feature Points in a Monocular Image Sequence , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.