Simple technique for optical flow estimation

A technique is proposed for the measurement of two-dimensional (2-D) image motion. The basic component is a 2-D motion sensor that is made up of 12 circularly symmetric second-derivative operators arranged around a similar central operator. The Laplacian of a Gaussian is used to achieve the second-derivative operation. The sensor therefore consists of 12 pairs of overlapping operators, arranged in a radial pattern, and is capable of measuring speed in 12 separate directions at any point in the image. When an edge crosses the sensor, since the distance between operators is known, its speed along a given direction is determined by the relative times of occurrence of the two zero crossings in the temporal outputs of the operator pair oriented in that direction. The low-pass spatial filtering produced by the operators, along with their close proximity, helps to prevent more than one edge from fitting between the operator pairs at any one time, and the correspondence problem is thus minimized. The direction of the edge normal and the speed can be found from the distribution of time differences in each of the 12 sensor directions. These edge velocities are passed onto a second stage, which uses directionally tuned patternmotion detectors to solve the aperture problem. The entire system involves a simple network of weighted connections and is potentially a fast method of obtaining a 2-D optical flow field from a sequence of images.

[1]  J. H. Rieger,et al.  Determining the instantaneous axis of translation from optic flow generated by arbitrary sensot motion , 1986, Workshop on Motion.

[2]  Tomaso Poggio,et al.  Computational vision and regularization theory , 1985, Nature.

[3]  K. Nakayama,et al.  The aperture problem—I. Perception of nonrigidity and motion direction in translating sinusoidal lines , 1988, Vision Research.

[4]  T. Poggio,et al.  A computational theory of human stereo vision , 1979, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[5]  E H Adelson,et al.  Spatiotemporal energy models for the perception of motion. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[6]  Michael S. Landy,et al.  HIPS: A unix-based image processing system , 1984, Comput. Vis. Graph. Image Process..

[7]  K. Nakayama,et al.  Optical Velocity Patterns, Velocity-Sensitive Neurons, and Space Perception: A Hypothesis , 1974, Perception.

[8]  Joseph K. Kearney,et al.  Optical Flow Estimation: An Error Analysis of Gradient-Based Methods with Local Optimization , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  D Marr,et al.  Directional selectivity and its use in early visual processing , 1981, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[10]  H. Barlow,et al.  The mechanism of directionally selective units in rabbit's retina. , 1965, The Journal of physiology.

[11]  D Marr,et al.  Theory of edge detection , 1979, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[12]  Andrea J. van Doorn,et al.  Invariant Properties of the Motion Parallax Field due to the Movement of Rigid Bodies Relative to an Observer , 1975 .

[13]  Lawrence G. Roberts,et al.  Machine Perception of Three-Dimensional Solids , 1963, Outstanding Dissertations in the Computer Sciences.

[14]  P. Burt,et al.  Time, distance, and feature trade-offs in visual apparent motion. , 1981 .

[15]  Andrew B. Watson,et al.  Detection and Recognition of Simple Spatial Forms , 1983 .

[16]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[17]  J. van Santen,et al.  Elaborated Reichardt detectors. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[18]  J. Limb,et al.  Estimating the Velocity of Moving Images in Television Signals , 1975 .

[19]  S Marcelja,et al.  Mathematical description of the responses of simple cortical cells. , 1980, Journal of the Optical Society of America.

[20]  J G Daugman,et al.  Pattern and motion vision without Laplacian zero crossings. , 1988, Journal of the Optical Society of America. A, Optics and image science.

[21]  A J Ahumada,et al.  Model of human visual-motion sensing. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[22]  E. Adelson,et al.  Phenomenal coherence of moving visual patterns , 1982, Nature.

[23]  Claude L. Fennema,et al.  Velocity determination in scenes containing several moving objects , 1979 .

[24]  Greg L. Zacharias,et al.  A visual cueing model for terrain-following applications , 1983 .

[25]  Philip Kahn,et al.  Local Determination of a Moving Contrast Edge , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  Hans Wallach Über visuell wahrgenommene Bewegungsrichtung , 1935 .

[27]  Ken Nakayama,et al.  Biological image motion processing: A review , 1985, Vision Research.

[28]  D J Heeger,et al.  Model for the extraction of image flow. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[29]  W. Reichardt,et al.  Autocorrelation, a principle for the evaluation of sensory information by the central nervous system , 1961 .

[30]  C. Koch,et al.  The analysis of visual motion: from computational theory to neuronal mechanisms. , 1986, Annual review of neuroscience.

[31]  Thomas S. Huang,et al.  Estimating three-dimensional motion parameters of a rigid planar patch , 1981 .

[32]  H. C. Longuet-Higgins,et al.  The interpretation of a moving retinal image , 1980, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[33]  J. Daugman Two-dimensional spectral analysis of cortical receptive field profiles , 1980, Vision Research.

[34]  Andrew B. Watson,et al.  A look at motion in the frequency domain , 1983 .