Determining Optical Flow

Optical flow cannot be computed locally, since only one independent measurement is available from the image sequence at a point, while the flow velocity has two components. A second constraint is needed. A method for finding the optical flow pattern is presented which assumes that the apparent velocity of the brightness pattern varies smoothly almost everywhere in the image. An iterative implementation is shown which successfully computes the optical flow for a number of synthetic image sequences. The algorithm is robust in that it can handle image sequences that are quantized rather coarsely in space and time. It is also insensitive to quantization of brightness levels and additive noise. Examples are included where the assumption of smoothness is violated at singular points or along lines in the image.

[1]  Andrea J. van Doorn,et al.  Invariant Properties of the Motion Parallax Field due to the Movement of Rigid Bodies Relative to an Observer , 1975 .

[2]  Verzekeren Naar Sparen,et al.  Cambridge , 1969, Humphrey Burton: In My Own Time.

[3]  F. B. Hildebrand,et al.  Methods of applied mathematics , 1953 .

[4]  W. F. Clocksin,et al.  Determinig the Orientation of Surfaces from Optical Flow , 1978, AISB/GI.

[5]  R.M. Mersereau,et al.  The processing of hexagonally sampled two-dimensional signals , 1979, Proceedings of the IEEE.

[6]  J. Koenderink,et al.  Visual perception of rigidity of solid shape , 1976, Journal of mathematical biology.

[7]  D Marr,et al.  Directional selectivity and its use in early visual processing , 1981, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[8]  Berthold K. P. Horn,et al.  Hill shading and the reflectance map , 1981, Proceedings of the IEEE.

[9]  K. Prazdny,et al.  On the information in optical flows , 1983, Comput. Vis. Graph. Image Process..

[10]  J. Gibson.  On the analysis of change in the optic array. , 1977, Scandinavian journal of psychology.

[11]  J. Gibson.  Book Reviews: The Perception of the Visual World , 1950 .

[12]  Claude L. Fennema,et al.  Velocity determination in scenes containing several moving objects , 1979 .

[13]  H. C. Longuet-Higgins,et al.  The interpretation of a moving retinal image , 1980, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[14]  R. Hamming,et al.  Numerical Methods for Scientists and Engineers , 1962 .

[15]  K. Nakayama,et al.  Optical Velocity Patterns, Velocity-Sensitive Neurons, and Space Perception: A Hypothesis , 1974, Perception.

[16]  G Ishai,et al.  Visual stability and space perception in monocular vision: mathematical model. , 1980, Journal of the Optical Society of America.

[17]  Ramesh C. Jain,et al.  On the Analysis of Accumulative Difference Pictures from Image Sequences of Real World Scenes , 1979, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  W. E. Milne.  Numerical Solution of Differential Equations , 1953 .

[19]  Jake K. Aggarwal,et al.  Segmentation through the detection of changes due to motion , 1979 .

[20]  R. D. Richtmyer,et al.  Difference methods for initial-value problems , 1959 .

[21]  R. Hetherington.  The Perception of the Visual World , 1952 .

[22]  Ramesh C. Jain,et al.  Separating Non-Stationary from Stationary Scene Components in a Sequence of Real World TV Images , 1977, IJCAI.

[23]  David L. Russell,et al.  Calculus of variations and control theory : proceedings of a symposium conducted by the Mathematics Research Center, University of Wisconsin-Madison, September 22-24, 1975 , 1976 .

[24]  K. Prazdny,et al.  Computing Egomotion and Surface Slant From Optical Flow , 1979 .

[25]  R. Sillitto.  Variational principles in dynamics and quantum theory , 1961 .

[26]  Hans-Hellmut Nagel,et al.  Analysing Sequences of TV-Frames , 1977, IJCAI.

[27]  John B. Shoven,et al.  I , Edinburgh Medical and Surgical Journal.

[28]  Stephen B. Gray,et al.  Local Properties of Binary Images in Two Dimensions , 1971, IEEE Transactions on Computers.

[29]  J. D. Robbins,et al.  Motion-compensated television coding: Part I , 1979, The Bell System Technical Journal.

[30]  J. Gibson.  The Senses Considered As Perceptual Systems , 1967 .

[31]  L. A. G. Dresel,et al.  Elementary Numerical Analysis , 1966 .

[32]  J. Limb,et al.  Estimating the Velocity of Moving Images in Television Signals , 1975 .