Computational analysis of non-Fourier motion

Non-Fourier motion is now commonplace in research on visual motion perception, yet lacks a computational framework. This paper examines this issue based on the observation that many non-Fourier motion stimuli have a simple characterization in the frequency domain, in terms of oriented power distributions that lie along lines (or planes) that do not pass through the origin. This provides a unifying theoretical framework for a very diverse class of non-Fourier phenomena. It also allows us to examine some central issues concerning the computational nature of non-Fourier models, and naturally occurring sources of non-Fourier motion. For example, it is shown that the orientation of power in frequency domain corresponds to the velocity of a multiplicative envelope, and may arise as a restricted form of lighting effects, translucency or occlusion. We also show that both the location and orientation of spectral power may be extracted from the phase and amplitude output of band-pass filters, consonant with existing non-Fourier models.

[1]  J. van Santen,et al.  Elaborated Reichardt detectors. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[2]  D. Burr,et al.  Feature detection in human vision: a phase-dependent energy model , 1988, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[3]  G. Granlund,et al.  Estimation of velocity, acceleration and disparity in time sequences , 1991, Proceedings of the IEEE Workshop on Visual Motion.

[4]  David J. Fleet,et al.  Phase-based disparity measurement , 1991, CVGIP Image Underst..

[5]  Edward H. Adelson,et al.  Motion without movement , 1991, SIGGRAPH.

[6]  Wilson S. Geisler,et al.  Multichannel Texture Analysis Using Localized Spatial Filters , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Boualem Boashash,et al.  Estimating and interpreting the instantaneous frequency of a signal. II. A/lgorithms and applications , 1992, Proc. IEEE.

[8]  David J. Fleet,et al.  Phase singularities in scale-space , 1991, Image Vis. Comput..

[9]  I. Ohzawa,et al.  Stereoscopic depth discrimination in the visual cortex: neurons ideally suited as disparity detectors. , 1990, Science.

[10]  H. Wilson,et al.  A psychophysically motivated model for two-dimensional motion perception , 1992, Visual Neuroscience.

[11]  Johannes M. Zanker,et al.  Theta motion: a paradoxical stimulus to explore higher order motion extraction , 1993, Vision Research.

[12]  M J Morgan,et al.  Analogue models of motion perception. , 1980, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[13]  P. Cavanagh,et al.  Motion: the long and short of it. , 1989, Spatial vision.

[14]  K. Langley,et al.  Vertical and Horizontal Disparities from Phase , 1990, ECCV.

[15]  C. Trahiotis,et al.  Lateralization of low-frequency, complex waveforms: the use of envelope-based temporal disparities. , 1985, The Journal of the Acoustical Society of America.

[16]  R.N. Bracewell,et al.  Signal analysis , 1978, Proceedings of the IEEE.

[17]  Gregory C. DeAngelis,et al.  Depth is encoded in the visual cortex by a specialized receptive field structure , 1991, Nature.

[18]  Hans Knutsson,et al.  Filtering and reconstruction in image processing , 1984 .

[19]  A. Derrington,et al.  Separate detectors for simple and complex grating patterns? , 1985, Vision Research.

[20]  V. Lollo,et al.  Perception of directional sampled motion in relation to displacement and spatial frequency: Evidence for a unitary motion system , 1990, Vision Research.

[21]  A. Pantle,et al.  On the mechanism that encodes the movement of contrast variations: Velocity discrimination , 1989, Vision Research.

[22]  O. Braddick,et al.  Direction discrimination for band-pass filtered random dot kinematograms , 1990, Vision Research.

[23]  D J Heeger,et al.  Model for the extraction of image flow. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[24]  W. Reichardt,et al.  Autocorrelation, a principle for the evaluation of sensory information by the central nervous system , 1961 .

[25]  M. Pryce,et al.  Wave Propagation and Group Velocity , 1961, Nature.

[26]  Constantine Trahiotis,et al.  Detection of interaural delay in high‐frequency noise , 1981 .

[27]  G. Sperling,et al.  Second-order motion perception: space/time separable mechanisms , 1989, [1989] Proceedings. Workshop on Visual Motion.

[28]  T. Poggio,et al.  Visual hyperacuity: spatiotemporal interpolation in human vision , 1981, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[29]  A J Ahumada,et al.  Model of human visual-motion sensing. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[30]  David J. Fleet.  Measurement of image velocity , 1992 .

[31]  Walter F. Bischof,et al.  On the half-cycle displacement limit of sampled directional motion , 1991, Vision Research.

[32]  Oliver Braddick,et al.  Is there a half-cycle displacement limit for directional motion detection? , 1991, Vision Research.

[33]  G. Sperling,et al.  Drift-balanced random stimuli: a general basis for studying non-Fourier motion perception. , 1988, Journal of the Optical Society of America. A, Optics and image science.

[34]  T. Yin,et al.  Interaural time sensitivity of high-frequency neurons in the inferior colliculus. , 1984, The Journal of the Acoustical Society of America.

[35]  John K. Tsotsos,et al.  Techniques for disparity measurement , 1991, CVGIP Image Underst..

[36]  David C. Burr,et al.  Smooth and sampled motion , 1986, Vision Research.

[37]  E H Adelson,et al.  Spatiotemporal energy models for the perception of motion. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[38]  S. Nishida,et al.  Positive motion after-effect induced by bandpass-filtered random-dot kinematograms , 1992, Vision Research.

[39]  David J. Fleet,et al.  Stability of Phase Information , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[40]  E. Adelson,et al.  Directionally selective complex cells and the computation of motion energy in cat visual cortex , 1992, Vision Research.

[41]  Andrew B. Watson,et al.  Window of visibility: a psychophysical theory of fidelity in time-sampled visual motion displays , 1986 .

[42]  Hugh R. Wilson,et al.  Illusory motion of texture boundaries , 1993, Vision Research.