The role of motion streaks in human visual motion perception

For many years, artists and photographers have used blurred lines or ‘motion streaks’ along an object’s trajectory of motion to indicate fast motion. As it turns out, these streaks must occur in vision, because the visual system integrates information over time, around 100 120 ms. Generally streaks are not seen, but they could prove a useful cue to direction of motion, as suggested in an influential model proposed by Geisler (1999). In experiments exploting the tilt aftereffect and illusion paradigms, we found that strong motion streaks produced robust tilt aftereffects and illusions, similar in magnitude and orientation tuning to those induced by tilted lines. These effects were weak or absent in weak streak conditions, and when motion was too slow to form streaks. We also investigated binocular rivalry suppression of static stimuli by fast and slow motion, and found that grating stimuli oriented parallel to the direction of fast, rivalling motions were more deeply suppressed than those orthogonal to the motion direction, but only for fast, ‘streaky’ motion, not slow motion. We attributed this deeper suppression to within-channel masking by motion streaks, as there was clear orientation tuning of this effect, both during suppression and dominance phases. We further explored masking by motion streaks in two further studies addressing the orientation and spatial frequency tuning of dichoptic and monoptic masking by motion streaks. Finally, we used functional magnetic resonance imaging to explore the neural correlates of these streaks, and found similar patterns of activity for fast motion and static, oriented patterns, which could successfully be used by a classifier algorithm to decode whether a participant was viewing one of two directions of motion (45◦ or 135◦) after training on orientation sessions alone. Together, these results indicate that motion streaks produced by temporal integration of fast translating features effectively adapt orientation-selective cells, that they cause masking similar to that caused by static stimuli, that they can cause tuned suppression of oriented stimuli even when not seen, and that they are present in early visual cortex. Thus, motion streaks are present in the visual system, and would be available to perform the function ascribed to them by Geisler. This is dicussed in terms of traditional models of motion perception, and some novel predictions and future experiments are proposed.

[1]  R. Turner,et al.  Form and motion coherence activate independent, but not dorsal/ventral segregated, networks in the human brain , 2000, Current Biology.

[2]  J. Lappin,et al.  Perceptual differentiation of sequential visual patterns , 1972 .

[3]  David Alais,et al.  Increasing depth of binocular rivalry suppression along two visual pathways , 2003, Vision Research.

[4]  David Alais,et al.  Motion streaks in fast motion rivalry cause orientation-selective suppression. , 2009, Journal of vision.

[5]  G Francis,et al.  A Computational and Perceptual Account of Motion Lines , 1998, Perception.

[6]  Georgios A. Keliris,et al.  A binocular rivalry study of motion perception in the human brain , 2005, Vision Research.

[7]  Nestor Matthews,et al.  The Role of Speed Lines in Subtle Direction Judgments , 2004 .

[8]  B. L. Gros,et al.  Anisotropies in visual motion perception: a fresh look. , 1998, Journal of the Optical Society of America. A, Optics, image science, and vision.

[9]  F. Campbell,et al.  Orientational selectivity of the human visual system , 1966, The Journal of physiology.

[10]  P Wenderoth,et al.  The Role of the Blobs in Determining the Perception of Drifting Plaids and Their Motion Aftereffects , 1994, Perception.

[11]  P. Wenderoth,et al.  The different mechanisms of the direct and indirect tilt illusions , 1988, Vision Research.

[12]  E. Bullmore,et al.  The functional neuroanatomy of implicit-motion perception or ‘representational momentum’ , 2000, Current Biology.

[13]  O. Blanke,et al.  Direction‐selective motion blindness after unilateral posterior brain damage , 2003, The European journal of neuroscience.

[14]  P. Wenderoth,et al.  The depth and selectivity of suppression in binocular rivalry , 2001, Perception & psychophysics.

[15]  R. Blake,et al.  Visual motion, binocular correspondence and binocular rivalry , 1985, Biological Cybernetics.

[16]  Robert Fox,et al.  Optokinetic nystagmus as an objective indicator of binocular rivalry , 1975, Vision Research.

[17]  D. Mitchell,et al.  The spatial selectivity of the tilt aftereffect. , 1974, Vision research.

[18]  Andrew Blake,et al.  Does the visual system exploit projective geometry to help solve the motion correspondence problem? , 1999, Vision Research.

[19]  T. Meese,et al.  Binocular contrast interactions: Dichoptic masking is not a single process , 2007, Vision Research.

[20]  Jeroen J. A. van Boxtel,et al.  Dichoptic masking and binocular rivalry share common perceptual dynamics. , 2007, Journal of vision.

[21]  D. Bradley,et al.  Structure and function of visual area MT. , 2005, Annual review of neuroscience.

[22]  T. Meese,et al.  Psychophysical evidence for two routes to suppression before binocular summation of signals in human vision , 2007, Neuroscience.

[23]  J. Movshon,et al.  Linearity and Normalization in Simple Cells of the Macaque Primary Visual Cortex , 1997, The Journal of Neuroscience.

[24]  M. Goodale,et al.  Separate visual pathways for perception and action , 1992, Trends in Neurosciences.

[25]  E. Adelson,et al.  The analysis of moving visual patterns , 1985 .

[26]  C. Clifford Binocular rivalry , 2009, Current Biology.

[27]  Bart Krekelberg,et al.  Interactions between Speed and Contrast Tuning in the Middle Temporal Area: Implications for the Neural Code for Speed , 2006, The Journal of Neuroscience.

[28]  Nikolaus Kriegeskorte,et al.  Comparison of multivariate classifiers and response normalizations for pattern-information fMRI , 2010, NeuroImage.

[29]  A. Watson Probability summation over time , 1979, Vision Research.

[30]  E H Adelson,et al.  Spatiotemporal energy models for the perception of motion. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[31]  C W Tyler,et al.  Purely chromatic perception of motion in depth: Two eyes as sensitive as one , 1991, Perception & psychophysics.

[32]  Anthony J. Movshon,et al.  Visual Response Properties of Striate Cortical Neurons Projecting to Area MT in Macaque Monkeys , 1996, The Journal of Neuroscience.

[33]  O. Braddick,et al.  The combination of motion signals over time , 1989, Vision Research.

[34]  G. Westheimer,et al.  Discrimination of direction of motion in human vision. , 1994, Journal of neurophysiology.

[35]  R. Shapley,et al.  Dynamics of Orientation Selectivity in the Primary Visual Cortex and the Importance of Cortical Inhibition , 2003, Neuron.

[36]  O. Tzeng,et al.  Local-Level and Global-Level Form Characteristics in Apparent-Motion Correspondence , 1995, Perception.

[37]  D. Burr,et al.  Vision: Modular analysis – or not? , 1999, Current Biology.

[38]  Christian Wehrhahn,et al.  Contrast dependency of foveal spatial functions: orientation, vernier, separation, blur and displacement discrimination and the tilt and Poggendorff illusions , 1999, Vision Research.

[39]  W. Reichardt,et al.  A two dimensional field theory for motion computation , 1988, Biological Cybernetics.

[40]  C Koch,et al.  Computing motion in the primate's visual system. , 1989, The Journal of experimental biology.

[41]  S Zeki,et al.  Going beyond the information given: the relation of illusory visual motion to brain activity , 1993, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[42]  P. Lennie Single Units and Visual Cortical Organization , 1998, Perception.

[43]  D. Heeger,et al.  Retinotopy and Functional Subdivision of Human Areas MT and MST , 2002, The Journal of Neuroscience.

[44]  M. Carandini,et al.  Predictions of a recurrent model of orientation selectivity , 1997, Vision Research.

[45]  A J Ahumada,et al.  Model of human visual-motion sensing. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[46]  Brent R Beutter,et al.  Human discrimination of visual direction of motion with and without smooth pursuit eye movements. , 2003, Journal of vision.

[47]  David Alais,et al.  Independent Binocular Rivalry Processes for Motion and Form , 2006, Neuron.

[48]  A. Cowey,et al.  Retinal ganglion cells that project to the dorsal lateral geniculate nucleus in the macaque monkey , 1984, Neuroscience.

[49]  Neural substrates of the tilt illusion. , 1999, Australian and New Zealand journal of ophthalmology.

[51]  David Alais,et al.  Large shifts in perceived motion direction reveal multiple global motion solutions , 2006, Vision Research.

[52]  E Switkes,et al.  Spatial frequency specific interaction of dot patterns and gratings. , 1980, Proceedings of the National Academy of Sciences of the United States of America.

[53]  D. Burr Temporal summation of moving images by the human visual system , 1981, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[54]  John H. R. Maunsell,et al.  How parallel are the primate visual pathways? , 1993, Annual review of neuroscience.

[55]  Leonard E. White,et al.  Mapping multiple features in the population response of visual cortex , 2003, Nature.

[56]  Andrew B. Watson,et al.  Window of visibility: a psychophysical theory of fidelity in time-sampled visual motion displays , 1986 .

[57]  M J Morgan,et al.  Motion deblurring in human vision , 1997, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[58]  G. Rees,et al.  Predicting the orientation of invisible stimuli from activity in human primary visual cortex , 2005, Nature Neuroscience.

[59]  O. Braddick,et al.  Integration across Directions in Dynamic Random Dot Displays: Vector Summation or Winner Take All? , 1996, Vision Research.

[60]  R. Blake,et al.  Suppression During Binocular Rivalry Broadens Orientation Tuning , 2009, Psychological science.

[61]  Jeounghoon Kim,et al.  Perceived motion in the vector sum direction , 1994, Vision Research.

[62]  David Alais,et al.  Temporal whitening: transient noise perceptually equalizes the 1/f temporal amplitude spectrum. , 2009, Journal of vision.

[63]  D G Pelli,et al.  The VideoToolbox software for visual psychophysics: transforming numbers into movies. , 1997, Spatial vision.

[64]  A. T. Smith,et al.  Sharpening of drifting, blurred images , 1995, Vision Research.

[65]  Randolph Blake,et al.  Orientation selectivity in cats and humans assessed by masking , 1985, Vision Research.

[66]  M. Dawson,et al.  The how and why of what went where in apparent motion: modeling solutions to the motion correspondence problem. , 1991, Psychological review.

[67]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[68]  J. Hell,et al.  Motion-induced blindness in normal observers , 2022 .

[69]  Margaret S Livingstone,et al.  End-Stopping and the Aperture Problem Two-Dimensional Motion Signals in Macaque V1 , 2003, Neuron.

[70]  Scott O. Murray,et al.  Processing Shape, Motion and Three-dimensional Shape-from-motion in the Human Cortex , 2003 .

[71]  A. Cowey,et al.  Comparing the visual deficits of a motion blind patient with the visual deficits of monkeys with area MT removed , 1997, Neuropsychologia.

[72]  H. W. Karn Area and the Intensity-Time Relation in the Fovea , 1936 .

[73]  Sieu K. Khuu,et al.  Steady viewing dissipates global structure. , 2004, Perception.

[74]  C. Clifford,et al.  Suppressed Patterns Alter Vision during Binocular Rivalry , 2005, Current Biology.

[75]  R. Blake,et al.  On the inhibitory nature of binocular rivalry suppression. , 1979, Journal of experimental psychology. Human perception and performance.

[76]  Christopher C. Pack,et al.  Temporal dynamics of a neural solution to the aperture problem in visual area MT of macaque brain , 2001, Nature.

[77]  Stefan Treue,et al.  Human perception of structure from motion , 1991, Vision Research.

[78]  M. Georgeson,et al.  Motion blur and motion sharpening: temporal smear and local contrast non-linearity , 1998, Vision Research.

[79]  Sean P. MacEvoy,et al.  A precise form of divisive suppression supports population coding in primary visual cortex , 2009, Nature Neuroscience.

[80]  W. K. Simmons,et al.  Circular analysis in systems neuroscience: the dangers of double dipping , 2009, Nature Neuroscience.

[81]  Z. Kourtzi,et al.  Linking form and motion in the primate brain , 2008, Trends in Cognitive Sciences.

[82]  M. C. Morrone,et al.  Cross-orientation inhibition in cat is GABA mediated , 2004, Experimental Brain Research.

[83]  N. Logothetis,et al.  Visual competition , 2002, Nature Reviews Neuroscience.

[84]  Human velocity and direction discrimination compared , 1983 .

[85]  J. Cutting Generation of Synthetic Male and Female Walkers through Manipulation of a Biomechanical Invariant , 1978, Perception.

[86]  R. Blake,et al.  Binocular rivalry suppression: insensitive to spatial frequency and orientation change. , 1974, Vision research.

[87]  D. Alais,et al.  Evidence for two interacting temporal channels in human visual processing , 2006, Vision Research.

[88]  G. Boynton,et al.  Orientation-Specific Adaptation in Human Visual Cortex , 2003, The Journal of Neuroscience.

[89]  N. Kanwisher,et al.  Activation in Human MT/MST by Static Images with Implied Motion , 2000, Journal of Cognitive Neuroscience.

[90]  Timothy Ledgeway,et al.  Spatial frequency selective masking of first-order and second-order motion in the absence of off-frequency `looking' , 2004, Vision Research.

[91]  Hans P. Op de Beeck,et al.  Probing the mysterious underpinnings of multi-voxel fMRI analyses , 2010, NeuroImage.

[92]  I. Motoyoshi,et al.  Adaptation-induced blindness to sluggish stimuli. , 2010, Journal of vision.

[93]  Nicholas J. Wade,et al.  Binocular rivalry with moving patterns , 1984, Perception & psychophysics.

[94]  Moshe Gur,et al.  Cerebral Cortex doi:10.1093/cercor/bhi003 Orientation and Direction Selectivity of Neurons in V1 of Alert Monkeys: Functional Relationships and Laminar Distributions , 2022 .

[95]  S. Dakin,et al.  Critical band masking in optic flow , 2005, Network.

[96]  J. Lund,et al.  Compulsory averaging of crowded orientation signals in human vision , 2001, Nature Neuroscience.

[97]  C. Stromeyer,et al.  Human temporal impulse response speeds up with increased stimulus contrast , 2003, Vision Research.

[98]  J. Robson,et al.  Application of fourier analysis to the visibility of gratings , 1968, The Journal of physiology.

[99]  John Ross,et al.  Direct Evidence That “Speedlines” Influence Motion Mechanisms , 2002, The Journal of Neuroscience.

[100]  D Marr,et al.  Theory of edge detection , 1979, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[101]  D. Burr,et al.  Motion vision: Are ‘speed lines’ used in human visual motion? , 2000, Current Biology.

[102]  S. McKee,et al.  Detecting a trajectory embedded in random-direction motion noise , 1995, Vision Research.

[103]  A. Watson,et al.  Quest: A Bayesian adaptive psychometric method , 1983, Perception & psychophysics.

[104]  Z. Kourtzi ‘But still, it moves’ , 2004, Trends in Cognitive Sciences.

[105]  R. Sekuler,et al.  Masking of motion by broadband and filtered directional noise , 1979 .

[106]  Zoe Kourtzi,et al.  Implied motion from form in the human visual cortex. , 2005, Journal of neurophysiology.

[107]  A. B. Bonds Role of Inhibition in the Specification of Orientation Selectivity of Cells in the Cat Striate Cortex , 1989, Visual Neuroscience.

[108]  C Blakemore,et al.  On the existence of neurones in the human visual system selectively sensitive to the orientation and size of retinal images , 1969, The Journal of physiology.

[109]  M. J. Morgan,et al.  Spatial filtering precedes motion detection , 1992, Nature.

[110]  T. Schenk,et al.  Visual motion perception after brain damage: I. Deficits in global motion perception , 1997, Neuropsychologia.

[111]  P. Wenderoth,et al.  The Differential Effects of Brief Exposures and Surrounding Contours on Direct and Indirect Tilt Illusions , 1988, Perception.

[112]  Leslie G. Ungerleider,et al.  Object vision and spatial vision: two cortical pathways , 1983, Trends in Neurosciences.

[113]  David G. Stork,et al.  Pattern Classification (2nd ed.) , 1999 .

[114]  Eero P. Simoncelli,et al.  A model of neuronal responses in visual area MT , 1998, Vision Research.

[115]  J. Lappin,et al.  The detection of coherence in moving random-dot patterns , 1976, Vision Research.

[116]  E. Adelson,et al.  Phenomenal coherence of moving visual patterns , 1982, Nature.

[117]  John-Dylan Haynes Decoding Mental States from Patterns of Brain Activity , 2012 .

[118]  G. Legge Spatial frequency masking in human vision: binocular interactions. , 1979, Journal of the Optical Society of America.

[119]  D. Burr,et al.  Functional implications of cross-orientation inhibition of cortical visual cells. I. Neurophysiological evidence , 1982, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[120]  D. Alais,et al.  Orientation tuning of contrast masking caused by motion streaks. , 2010, Journal of vision.

[121]  R. Fox,et al.  Independence between binocular rivalry suppression duration and magnitude of suppression. , 1972, Journal of experimental psychology.