PII: S0042-6989(98)00093-5

The perceived motion of two added sinusoidal gratings of similar amplitude and spatial frequency but different orientations is often coherent. However, when either relative grating contrast or frequency are varied, perception may transform to a motion transparency. For plaids, both multiplicative and additive transparent percepts are reported. To explain perception, several computational models of motion transparency are proposed. The most general model considered is, however, a quadratic form with five unknowns. To stabilize the transparent model, additional constraints are introduced so that two velocities may be detected from the motion of plaid patterns. It is shown how this model may be realised by a two-layer (linear) feedforward network and how network learning paradigms may be used to explain some facets of visual perception. To describe the motion of plaid patterns there is an ambiguity because computational models of both coherent and transparent motion may be used to detect image velocity. In view of this competition between models, the issue of model selection is addressed; especially for cases where two or more models fit the image measurements without a residual error. The computational approach that is proposed affords one explanation why perception selects transparency in favour of coherence for plaid patterns by adjustments of relative grating contrast and frequency.

[1]  P. McOwan,et al.  A computational model of the analysis of some first-order and second-order motion patterns by simple and complex cells , 1992, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[2]  A. Johnston,et al.  A second-order pattern reveals separate strategies for encoding Orientation in two-dimensional space and space-time , 1996, Vision Research.

[3]  Shmuel Peleg,et al.  Computing two motions from three frames , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[4]  A. Pantle,et al.  On the mechanism that encodes the movement of contrast variations: Velocity discrimination , 1989, Vision Research.

[5]  Leslie Welch,et al.  The perception of moving plaids reveals two motion-processing stages , 1989, Nature.

[6]  A. Rosenfeld,et al.  Perceptual motion transparency : the role of geometrical information , 1992 .

[7]  D. Heeger.  Normalization of cell responses in cat striate cortex , 1992, Visual Neuroscience.

[8]  Keith Langley,et al.  On Transparent Motion Computation , 1992, BMVC.

[9]  P. Thompson.  Perceived rate of movement depends on contrast , 1982, Vision Research.

[10]  David J. Fleet,et al.  Linear filtering precedes nonlinear processing in early vision , 1996, Current Biology.

[11]  Mark F. Bradshaw,et al.  Differences in Processing Time for Stereoscopic Inclination and Slant , 1997 .

[12]  P. Hibbard,et al.  Plaid slant and inclination thresholds can be predicted from components , 1998, Vision Research.

[13]  Keith Langley,et al.  Computational analysis of non-Fourier motion , 1994, Vision Research.

[14]  C.W.G. CLIFFORD,et al.  A Model of Temporal Adaptation in Fly Motion Vision , 1996, Vision Research.

[15]  Edward H. Adelson,et al.  Probability distributions of optical flow , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[16]  Peter W. McOwan,et al.  Motion transparency arises from perceptual grouping: evidence from luminance and contrast modulation motion displays , 1996, Current Biology.

[17]  Mary M. Conte,et al.  Nonlinear Preprocessing in Short-range Motion , 1997, Vision Research.

[18]  C. Clifford,et al.  Psychophysics of motion adaptation parallels insect electrophysiology , 1996, Current Biology.

[19]  Keith Langley,et al.  The Inference of Structure in Images Using Multi-local Quadrature Filters , 1991, BMVC.

[20]  K. F. Riley,et al.  Mathematical methods for the physical sciences , 1975 .

[21]  E. Adelson,et al.  Phenomenal coherence of moving visual patterns , 1982, Nature.

[22]  Keith Langley,et al.  Including direction repulsion into transparent plaids by motion adaptation , 1998 .

[23]  L. Mandel.  Interpretation of Instantaneous Frequencies , 1974 .

[24]  J. van Santen,et al.  Elaborated Reichardt detectors. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[25]  Refractor.  Vision , 2000, The Lancet.

[26]  David J. Heeger,et al.  Model of visual motion sensing , 1994 .

[27]  R A Andersen,et al.  Transparent motion perception as detection of unbalanced motion signals. I. Psychophysics , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[28]  A. B. Rami Shani,et al.  Matrices: Methods and Applications , 1992 .

[29]  S. Laughlin.  Matching coding, circuits, cells, and molecules to signals: General principles of retinal design in the fly's eye , 1994, Progress in Retinal and Eye Research.

[30]  W Reichardt,et al.  Autocorrelation, a principle for evaluation of sensory information by the central nervous system , 1961 .

[31]  Hans Wallach.  Über visuell wahrgenommene Bewegungsrichtung , 1935 .

[32]  G. Granlund,et al.  Estimation of velocity, acceleration and disparity in time sequences , 1991, Proceedings of the IEEE Workshop on Visual Motion.

[33]  A. Derrington,et al.  Separate detectors for simple and complex grating patterns? , 1985, Vision Research.

[34]  Eero P. Simoncelli,et al.  A model of neuronal responses in visual area MT , 1998, Vision Research.

[35]  J. Beck.  Perception of transparency in man and machine , 1985, Computer Vision Graphics and Image Processing.

[36]  A. Zinober.  Matrices: Methods and Applications , 1992 .

[37]  Jacob Beck,et al.  Perception of transparency in man and machine , 1985, Comput. Vis. Graph. Image Process..

[38]  Hibbard Pb,et al.  Linear and non-linear mechanisms in the perception of stereoscopic slant and transparency. , 1998 .

[39]  J. B. Mulligan,et al.  Effect of contrast on the perceived direction of a moving plaid , 1990, Vision Research.

[40]  L Welch,et al.  Coherence Determines Speed Discrimination , 1990, Perception.

[41]  M. V. von Grünau,et al.  Ambiguous plaids: switching between coherence and transparency. , 1993, Spatial vision.

[42]  David J. Fleet,et al.  Computation of normal velocity from local phase information , 1989, Proceedings CVPR '89: IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[43]  Keith Langley,et al.  Recursive Filters for Optical Flow , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[44]  H B Barlow,et al.  Measurements of the quantum efficiency of discrimination in human scotopic vision , 1962, The Journal of physiology.

[45]  David J. Fleet,et al.  Stability of phase information , 1991, Proceedings of the IEEE Workshop on Visual Motion.

[46]  H R Wilson,et al.  A model for motion coherence and transparency , 1994, Visual Neuroscience.

[47]  R. Haralick,et al.  The Facet Approach to Optic Flow , 1983 .

[48]  H. Wilson,et al.  A psychophysically motivated model for two-dimensional motion perception , 1992, Visual Neuroscience.

[49]  A. Johnston,et al.  Perceived motion of contrast-modulated gratings: Predictions of the multi-channel gradient model and the role of full-wave rectification , 1995, Vision Research.

[50]  Hugh R. Wilson,et al.  Perceived direction of moving two-dimensional patterns depends on duration, contrast and eccentricity , 1992, Vision Research.

[51]  Robert L. Taylor,et al.  Matrix computations for engineers and scientists, Aland Jennings, Wiley, Chichester, 1977. No. of pages 346, price £10.50 , 1979 .

[52]  David Mackay,et al.  Probable networks and plausible predictions - a review of practical Bayesian methods for supervised neural networks , 1995 .

[53]  Christof Koch,et al.  Computing Optical Flow in the Primate Visual System , 1989, Neural Computation.

[54]  K. N. GURNEY,et al.  A Model for the Spatial Integration and Differentiation of Velocity Signals , 1996, Vision Research.

[55]  Darren Burke,et al.  Determinants of two-dimensional motion aftereffects induced by simultaneously- and alternately-presented plaid components , 1993, Vision Research.

[56]  P. Wenderoth,et al.  The effect of interactions between one-dimensional component gratings on two-dimensional motion perception , 1993, Vision Research.

[57]  Jeounghoon Kim,et al.  Dependence of plaid motion coherence on component grating directions , 1993, Vision Research.

[58]  Eero P. Simoncelli,et al.  Local velocity representation: evidence from motion adaptation , 1998, Vision Research.

[59]  David J. Fleet,et al.  Linear and nonlinear transparencies in binocular vision , 1998, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[60]  Nancy J. Coletta,et al.  An oblique effect in parafoveal motion perception , 1993, Vision Research.

[61]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[62]  G. Sperling,et al.  Drift-balanced random stimuli: a general basis for studying non-Fourier motion perception. , 1988, Journal of the Optical Society of America. A, Optics and image science.

[63]  Mary M. Conte,et al.  Coherence and transparency of moving plaids composed of Fourier and non-Fourier gratings , 1992, Perception & psychophysics.

[64]  Hans Knutsson,et al.  Filtering and reconstruction in image processing , 1984 .

[65]  R A Andersen,et al.  Transparent motion perception as detection of unbalanced motion signals. III. Modeling , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[66]  T Poggio,et al.  Regularization Algorithms for Learning That Are Equivalent to Multilayer Networks , 1990, Science.

[67]  Keith Langley,et al.  A MODEL FOR COHERENT AND MULTIPLICATIVELY TRANSPARENT PLAIDS , 1995 .

[68]  Frans A. J. Verstraten,et al.  Monocular mechanisms determine plaid motion coherence , 1996, Visual Neuroscience.

[69]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[70]  D J Heeger,et al.  Model for the extraction of image flow. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[71]  T. D. Albright,et al.  Transparency and coherence in human motion perception , 1990, Nature.

[72]  W. Reichardt,et al.  Autocorrelation, a principle for the evaluation of sensory information by the central nervous system , 1961 .

[73]  R. Blake,et al.  Direction repulsion in motion transparency , 1996, Visual Neuroscience.

[74]  W. Hoffman.  The Lie algebra of visual perception , 1966 .

[75]  Johannes M. Zanker,et al.  Theta motion: a paradoxical stimulus to explore higher order motion extraction , 1993, Vision Research.

[76]  Kenji Mase,et al.  Unified computational theory for motion transparency and motion boundaries based on eigenenergy analysis , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[77]  Jeounghoon Kim,et al.  Direction repulsion between components in motion transparency , 1996, Vision Research.

[78]  E H Adelson,et al.  Spatiotemporal energy models for the perception of motion. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[79]  Keith Langley.  Degenerate Models of Additive and Multiplicative Motion Transparency , 1997, BMVC.

[80]  Takeo Watanabe,et al.  Propagation of local motion correspondence , 1995, Vision Research.

[81]  Eero P. Simoncelli.  Distributed representation and analysis of visual motion , 1993 .

[82]  K Langley.  Post-filtering logarithmic transformation applied to multiplicative transparency and motion discontinuities , 1994 .