A parallel motion algorithm consistent with psychophysics and physiology

The authors describe a simple, parallel algorithm that successfully computes an optical flow from sequences of real images, is consistent with human psychophysics, and suggests a plausible physiological model. Regularizing optical flow computation leads to a formulation which minimizes matching error and, at the same time, maximizes smoothness of the optical flow. The authors develop an approximation to the full regularization computation in which corresponding points are found by comparing local patches of images. Selection among competing matches is performed using a winner-take-all scheme. The algorithm is independent of the types of features used for matching. Experiments with natural images show that the scheme is effective and robust against noise. The algorithm shows several of the same 'illusions' that humans perceive. A natural physiological implementation of the model is consistent with data from cortical areas V1 and MT.<<ETX>>

[1]  W. Daniel Hillis,et al.  The connection machine , 1985 .

[2]  Tomaso A. Poggio,et al.  On parallel stereo , 1986, Proceedings. 1986 IEEE International Conference on Robotics and Automation.

[3]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Daphna Weinshall,et al.  The MIT vision machine , 1988 .

[5]  D Marr,et al.  Directional selectivity and its use in early visual processing , 1981, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[6]  V. Ramachandran,et al.  The perception of apparent motion. , 1986, Scientific American.

[7]  V. Ramachandran,et al.  Spatial phase and frequency in motion capture of random-dot patterns. , 1985, Spatial vision.

[8]  K. Nakayama,et al.  The aperture problem—I. Perception of nonrigidity and motion direction in translating sinusoidal lines , 1988, Vision Research.

[9]  A. Verri,et al.  Analysis of differential and matching methods for optical flow , 1989, [1989] Proceedings. Workshop on Visual Motion.

[10]  W. Reichardt,et al.  Movement Detectors of the Correlation Type Provide Sufficient Information for Local Computation of the 2-D Velocity Field , 1988 .

[11]  Hans-Hellmut Nagel,et al.  Displacement vectors derived from second-order intensity variations in image sequences , 1983, Comput. Vis. Graph. Image Process..

[12]  Jin Luo,et al.  Computing motion using analog and binary resistive networks , 1988, Computer.

[13]  T. Poggio,et al.  The analysis of stereopsis. , 1984, Annual review of neuroscience.

[14]  E. Adelson,et al.  The analysis of moving visual patterns , 1985 .

[15]  T Poggio,et al.  Parallel integration of vision modules. , 1988, Science.

[16]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[17]  Heinrich H. Bülthoff,et al.  Parallel Motion Algorithm explains Barber Pole and Motion Capture Illusion without "Tricks'' , 1987 .

[18]  James J. Little,et al.  Parallel Optical Flow Computation , 1987 .

[19]  James J. Little,et al.  Parallel Optical Flow Using Local Voting , 1988, [1988 Proceedings] Second International Conference on Computer Vision.

[20]  E. Adelson,et al.  Phenomenal coherence of moving visual patterns , 1982, Nature.

[21]  Hh Bülthoff,et al.  Parallel Computation of Optical Flow , 1987 .

[22]  Norberto M. Grzywacz,et al.  A computational theory for the perception of coherent visual motion , 1988, Nature.

[23]  Alessandro Verri,et al.  Against Quantitative Optical Flow , 1987 .