Drift-balanced random stimuli: a general basis for studying non-Fourier motion perception.

To some degree, all current models of visual motion-perception mechanisms depend on the power of the visual signal in various spatiotemporal-frequency bands. Here we show how to construct counterexamples: visual stimuli that are consistently perceived as obviously moving in a fixed direction yet for which Fourier-domain power analysis yields no systematic motion components in any given direction. We provide a general theoretical framework for investigating non-Fourier motion-perception mechanisms; central are the concepts of drift-balanced and microbalanced random stimuli. A random stimulus S is drift balanced if its expected power in the frequency domain is symmetric with respect to temporal frequency, that is, if the expected power in S of every drifting sinusoidal component is equal to the expected power of the sinusoid of the same spatial frequency, drifting at the same rate in the opposite direction. Additionally, S is microbalanced if the result WS of windowing S by any space-time-separable function W is drift balanced. We prove that (i) any space-time-separable random (or nonrandom) stimulus is microbalanced; (ii) any linear combination of pairwise independent microbalanced (respectively, drift-balanced) random stimuli is microbalanced and drift balanced if the expectation of each component is uniformly zero; (iii) the convolution of independent microbalanced and drift-balanced random stimuli is microbalanced and drift balanced; (iv) the product of independent microbalanced random stimuli is microbalanced; and (v) the expected response of any Reichardt detector to any microbalanced random stimulus is zero at every instant in time. Examples are provided of classes of microbalanced random stimuli that display consistent and compelling motion in one direction. All the results and examples from the domain of motion perception are transposable to the space-domain problem of detecting orientation in a texture pattern.

[1]  G. A. Miller,et al.  The Perception of Repeated Bursts of Noise , 1948 .

[2]  William Feller,et al.  An Introduction to Probability Theory and Its Applications , 1951 .

[3]  W. Reichardt.  Autokorrelations-Auswertung als Funktionsprinzip des Zentralnervensystems , 1957 .

[4]  D. M. Green,et al.  Signal detection theory and psychophysics , 1966 .

[5]  William Feller,et al.  An Introduction to Probability Theory and Its Applications , 1967 .

[6]  A. Y. Maudarbocus,et al.  Non-linearity of visual signals in relation to shape-sensitive adaptation responses. , 1973, Vision research.

[7]  G. J. Burton,et al.  Evidence for non-linear response processes in the human visual system from measurements on the thresholds of spatial beat frequencies. , 1973, Vision research.

[8]  A Pantle,et al.  A multistable movement display: evidence for two separate motion systems in human vision. , 1976, Science.

[9]  G. Sperling.  Movement perception in computer-driven visual displays , 1976 .

[10]  A. Pantle,et al.  Apparent Movement of Successively Generated Subjective Figures , 1978, Perception.

[11]  Andrew B. Watson,et al.  A look at motion in the frequency domain , 1983 .

[12]  R. Watt,et al.  The recognition and representation of edge blur: Evidence for spatial primitives in human vision , 1983, Vision Research.

[13]  J. van Santen,et al.  Temporal covariance model of human motion perception. , 1984, Journal of the Optical Society of America. A, Optics and image science.

[14]  R. Watt,et al.  Spatial filters and the localization of luminance changes in human vision , 1984, Vision Research.

[15]  E H Adelson,et al.  Spatiotemporal energy models for the perception of motion. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[16]  A J Ahumada,et al.  Model of human visual-motion sensing. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[17]  A. Derrington,et al.  Separate detectors for simple and complex grating patterns? , 1985, Vision Research.

[18]  J. van Santen,et al.  Elaborated Reichardt detectors. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[19]  Ennio Mingolla,et al.  Neural dynamics of perceptual grouping: Textures, boundaries, and emergent segmentations , 1985 .

[20]  S. Grossberg,et al.  Neural dynamics of form perception: boundary completion, illusory figures, and neon color spreading. , 1985, Psychological review.

[21]  T. Caelli.  Three processing characteristics of visual texture segmentation. , 1985, Spatial vision.

[22]  R. Watt,et al.  A theory of the primitive spatial code in human vision , 1985, Vision Research.

[23]  Marc Green,et al.  What determines correspondence strength in apparent motion? , 1986, Vision Research.

[24]  Andrew B. Watson,et al.  Window of visibility: a psychophysical theory of fidelity in time-sampled visual motion displays , 1986 .

[25]  Eli Peli,et al.  Perception Of High-Pass Filtered Images , 1987, Other Conferences.

[26]  D J Heeger,et al.  Model for the extraction of image flow. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[27]  Andrew M. Derrington,et al.  Errors in direction-of-motion discrimination with complex stimuli , 1987, Vision Research.

[28]  David J. Fleet,et al.  Hierarchical Construction of Orientation and Velocity Selective Filters , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[29]  A. Pantle,et al.  On the mechanism that encodes the movement of contrast variations: Velocity discrimination , 1989, Vision Research.