Coherent Compound Motion: Corners and Nonrigid Configurations

Consider two wire gratings, superimposed and moving across each other. Under certain conditions the two gratings will cohere into a single, compound pattern, which will appear to be moving in another direction. Such coherent motion patterns have been studied for sinusoidal component gratings, and give rise to percepts of rigid, planar motions. In this paper we show how to construct coherent motion displays that give rise to nonuniform, nonrigid, and nonplanar percepts. Most significantly, they also can define percepts with corners. Since these patterns are more consistent with the structure of natural scenes than rigid sinusoidal gratings, they stand as interesting stimuli for both computational and physiological studies. To illustrate, our display with sharp corners (tangent discontinuities or singularities) separating regions of coherent motion suggests that smoothing does not cross tangent discontinuities, a point that argues against existing (regularization) algorithms for computing motion. This leads us to consider how singularities can be confronted directly within optical flow computations, and we conclude with two hypotheses: (1) that singularities are represented within the motion system as multiple directions at the same retinotopic location; and (2) for component gratings to cohere, they must be at the same depth from the viewer. Both hypotheses have implications for the neural computation of coherent motion.

[1]  I. Shafarevich Basic algebraic geometry , 1974 .

[2]  E. Adelson,et al.  Phenomenal coherence of moving visual patterns , 1982, Nature.

[3]  J Allman,et al.  Direction- and Velocity-Specific Responses from beyond the Classical Receptive Field in the Middle Temporal Visual Area (MT) , 1985, Perception.

[4]  E. Adelson,et al.  The analysis of moving visual patterns , 1985 .

[5]  Steven W. Zucker,et al.  Two Stages of Curve Detection Suggest Two Styles of Visual Computation , 1989, Neural Computation.

[6]  T. Poggio,et al.  A parallel algorithm for real-time computation of optical flow , 1989, Nature.

[7]  Alan L. Yuille,et al.  The Motion Coherence Theory , 1988, [1988 Proceedings] Second International Conference on Computer Vision.

[8]  Steven W. Zucker,et al.  The Organization Of Curve Detection: Coarse Tangent Fields And Fine Spline Coverings , 1988, [1988 Proceedings] Second International Conference on Computer Vision.

[9]  Steven W. Zucker,et al.  From orientation selection to optical flow , 1987, Comput. Vis. Graph. Image Process..

[10]  John H. R. Maunsell,et al.  Functional properties of neurons in middle temporal visual area of the macaque monkey. II. Binocular interactions and sensitivity to binocular disparity. , 1983, Journal of neurophysiology.

[11]  R. Desimone,et al.  Columnar organization of directionally selective cells in visual area MT of the macaque. , 1984, Journal of neurophysiology.

[12]  Christof Koch,et al.  Computing Optical Flow in the Primate Visual System , 1989, Neural Computation.