An Investigation of Smoothness Constraints for the Estimation of Displacement Vector Fields from Image Sequences

A mapping between one frame from an image sequence and the preceding or following frame can be represented as a displacement vector field. In most situations, the mere gray value variations do not provide sufficient information in order to estimate such a displacement vector field. Supplementary constraints are necessary, for example the postulate that a displacement vector field varies smoothly as a function of the image position. Taken as a general requirement, this creates difficulties at gray value transitions which correspond to occluding contours. Nagel therefore introduced the ``oriented smoothness'' requirement which restricts variations of the displacement vector field only in directions with small or no variation of gray values. This contribution reports results of an investigation about how such an ``oriented smoothness'' constraint may be formulated and evaluated.

[1]  Paul Beaudet,et al.  Rotationally invariant image operators , 1978 .

[2]  Larry S. Davis,et al.  Determining Velocities by Propagation , 1981 .

[3]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[4]  Hans-Hellmut Nagel,et al.  Volumetric model and 3D trajectory of a moving car derived from monocular TV frame sequences of a street scene , 1981, Comput. Graph. Image Process..

[5]  Hans-Hellmut Nagel On change detection and displacement vector estimation in image sequences , 1982, Pattern Recognit. Lett..

[6]  Larry S. Davis,et al.  Contour-based motion estimation , 1982, Comput. Vis. Graph. Image Process..

[7]  Masahiko Yachida Determining velocity maps by spatio-temporal neighborhoods from image sequences , 1983, Comput. Vis. Graph. Image Process..

[8]  H. Nagel,et al.  On the Selection of Critical Points and Local Curvature Extrema of Region Boundaries for Interframe Matching , 1983 .

[9]  Hans-Hellmut Nagel,et al.  Displacement vectors derived from second-order intensity variations in image sequences , 1983, Comput. Vis. Graph. Image Process..

[10]  Hans-Hellmut Nagel,et al.  Berechnung von Verschiebungsvektorfeldern in Bildbereichen mit linienhaften oder partiell homogenen Grauwertverteilungen , 1984, DAGM-Symposium.

[11]  H. Nagel On the estimation of dense displacement vector fields from image sequences (abstract only) , 1984, COMG.

[12]  Computing the velocity field along contours (abstract only) , 1984, COMG.

[13]  Ellen C. Hildreth,et al.  Computations Underlying the Measurement of Visual Motion , 1984, Artif. Intell..

[14]  Takeo Kanade,et al.  Adapting optical-flow to measure object motion in reflectance and x-ray image sequences (abstract only) , 1984, COMG.

[15]  Ellen C. Hildreth,et al.  Measurement of Visual Motion , 1984 .

[16]  Ellen C Hildreth,et al.  Computing the velocity field along contours , 1986, Workshop on Motion.