Multiscale Approach to Image Sequence Analysis

In optic flow based velocity estimation the image brightness constraint equation is used. However, for measurements performed at a certain scale, the brightness constraint equation does not apply. We therefore use a recently developed approach which reconciles optic flow and scale space theory. It specifically incorporates the scale (aperture) of image measurements, leading to a scheme which is essentially different from existing approaches. To obtain a unique velocity field, the data-derived information has to be augmented with physical knowledge. By keeping a strict separation between data-derived and external information, we can locally adapt or modify the user-supplied information without affecting the image-derived information. The two free scale parameters in time and space can be used for attentive vision (selecting particular velocities or objects) and to improve the reliability of velocity estimates.

[1]  L. Schwartz.  Théorie des distributions , 1966 .

[2]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[3]  Andrew P. Witkin,et al.  Scale-Space Filtering , 1983, IJCAI.

[4]  Ellen C. Hildreth,et al.  Computations Underlying the Measurement of Visual Motion , 1984, Artif. Intell..

[5]  Andrew P. Witkin,et al.  Uniqueness of the Gaussian Kernel for Scale-Space Filtering , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Hans-Hellmut Nagel,et al.  On the Estimation of Optical Flow: Relations between Different Approaches and Some New Results , 1987, Artif. Intell..

[7]  J. Michael Fitzpatrick,et al.  The existence of geometrical density-image transformations corresponding to object motion , 1988, Comput. Vis. Graph. Image Process..

[8]  A. Verri,et al.  Differential techniques for optical flow , 1990 .

[9]  Takeo Kanade,et al.  A locally adaptive window for signal matching , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[10]  R. Leahy,et al.  Computation of 3-D velocity fields from 3-D cine CT images of a human heart. , 1991, IEEE transactions on medical imaging.

[11]  J. Koenderink,et al.  Second-order optic flow , 1992 .

[12]  Hans-Hellmut Nagel,et al.  Direct Estimation of Optical Flow and of Its Derivatives , 1992 .

[13]  Berthold K. P. Horn,et al.  "Determining optical flow": A Retrospective , 1993, Artif. Intell..

[14]  Jens Arnspang,et al.  Motion constraint equations based on constant image irradiance , 1993, Image Vis. Comput..

[15]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[16]  Amir A. Amini.  A Scalar Function Formulation for Optical Flow , 1994, ECCV.

[17]  M. Nielsen,et al.  The Intrinsic Structure of the Optic Flow Field , 1994 .

[18]  Hans-Hellmut Nagel,et al.  Optical Flow Estimation: Advances and Comparisons , 1994, ECCV.

[19]  Massimo Tistarelli,et al.  Multiple Constraints for Optical Flow , 1994, ECCV.

[20]  James S. Duncan,et al.  Myocardial motion and function assessment using 4D images , 1994, Other Conferences.

[21]  Luc Florack.  Data, models, and images , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[22]  Tony Lindeberg,et al.  Edge Detection and Ridge Detection with Automatic Scale Selection , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[23]  Luc Florack,et al.  On the Duality of Scalar and Density Flows , 1997, Scale-Space.

[24]  Tony Lindeberg,et al.  Scale-Space Theory in Computer Vision , 1993, Lecture Notes in Computer Science.