Visual motion estimation and prediction: a probabilistic network model for temporal coherence

We develop a theory for the temporal integration of visual motion motivated by psychophysical experiments. The theory proposes that input data are temporally grouped and used to predict and estimate motion flows in the image sequences. Our theory is expressed in terms of the Bayesian generalization of standard Kalman filtering which allows us to solve temporal grouping in conjunction with prediction and estimation. As demonstrated for tracking isolated contours the Bayesian formulation is superior to approaches which use data association as a first stage followed by conventional Kalman filtering. Our computer simulations demonstrate that our theory qualitatively accounts for several psychophysical experiments on motion occlusion and motion outliers.

[1]  Scott N. J. Watamaniuk,et al.  Seeing motion behind occluders , 1995, Nature.

[2]  S. Watamaniuk,et al.  Visible Persistence is Reduced by Fixed-Trajectory Motion but Not by Random Motion , 1992, Perception.

[3]  K. Nakayama,et al.  Temporal and spatial characteristics of the upper displacement limit for motion in random dots , 1984, Vision Research.

[4]  Michael J. Black,et al.  Robust dynamic motion estimation over time , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[5]  R. E. Kalman,et al.  A New Approach to Linear Filtering and Prediction Problems , 2002 .

[6]  S. McKee,et al.  Sequential recruitment in the discrimination of velocity. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[7]  V. Ramachandran,et al.  Visual inertia in apparent motion , 1987, Vision Research.

[8]  S. McKee,et al.  Detecting a trajectory embedded in random-direction motion noise , 1995, Vision Research.

[9]  A. Yuille,et al.  A common theoretical framework for visual motion's spatial and temporal coherence , 1989, [1989] Proceedings. Workshop on Visual Motion.

[10]  S. McKee,et al.  Precise velocity discrimination despite random variations in temporal frequency and contrast , 1986, Vision Research.

[11]  Y. Bar-Shalom Tracking and data association , 1988 .

[12]  D. Burr,et al.  Seeing objects in motion , 1986, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[13]  A. Yuille,et al.  A model for the estimate of local image velocity by cells in the visual cortex , 1990, Proceedings of the Royal Society of London. B. Biological Sciences.

[14]  Y. Ho,et al.  A Bayesian approach to problems in stochastic estimation and control , 1964 .

[15]  V. S. Ramachandran,et al.  Extrapolation of motion path in human visual perception , 1983, Vision Research.

[16]  S. McKee,et al.  Temporal coherence theory for the detection and measurement of visual motion , 1995, Vision Research.

[17]  A. Yuille,et al.  A Theoretical Framework for Visual Motion , 1996 .

[18]  Michael Isard,et al.  Contour Tracking by Stochastic Propagation of Conditional Density , 1996, ECCV.