Predictive coding of visual motion in both monocular and binocular human visual processing.

Neural processing of sensory input in the brain takes time, and for that reason our awareness of visual events lags behind their actual occurrence. One way the brain might compensate to minimize the impact of the resulting delays is through extrapolation. Extrapolation mechanisms have been argued to underlie perceptual illusions in which moving and static stimuli are mislocalised relative to one another (such as the flash-lag and related effects). However, where in the visual hierarchy such extrapolation processes take place remains unknown. Here, we address this question by identifying monocular and binocular contributions to the flash-grab illusion. In this illusion, a brief target is flashed on a moving background that reverses direction. As a result, the perceived position of the target is shifted in the direction of the reversal. We show that the illusion is attenuated, but not eliminated, when the motion reversal and the target are presented dichoptically to separate eyes. This reveals extrapolation mechanisms at both monocular and binocular processing stages contribute to the illusion. We interpret the results in a hierarchical predictive coding framework, and argue that prediction errors in this framework manifest directly as perceptual illusions.

[1]  Michael W. Spratling A review of predictive coding algorithms , 2017, Brain and Cognition.

[2]  Michael Bach,et al.  Visual motion detection in man is governed by non-retinal mechanisms , 2000, Vision Research.

[3]  George L. Gerstein,et al.  Feature-linked synchronization of thalamic relay cell firing induced by feedback from the visual cortex , 1994, Nature.

[4]  Ikuya Murakami,et al.  Motion-induced position shift in stereoscopic and dichoptic viewing. , 2013, Journal of vision.

[5]  I. Murakami,et al.  Latency difference, not spatial extrapolation , 1998, Nature Neuroscience.

[6]  David Whitney,et al.  Motion distorts visual space: shifting the perceived position of remote stationary objects , 2000, Nature Neuroscience.

[7]  Gregor Schöner,et al.  Shorter latencies for motion trajectories than for flashes in population responses of cat primary visual cortex , 2004, The Journal of physiology.

[8]  Peter Elias,et al.  Predictive coding-I , 1955, IRE Trans. Inf. Theory.

[9]  David M. Eagleman,et al.  Prediction and postdiction: Two frameworks with the goal of delay compensation , 2008, Behavioral and Brain Sciences.

[10]  Anthony N. Burkitt,et al.  Predictive coding of visual object position ahead of moving objects revealed by time-resolved EEG decoding , 2018, NeuroImage.

[11]  Karl J. Friston,et al.  Canonical Microcircuits for Predictive Coding , 2012, Neuron.

[12]  Terrence J Sejnowski,et al.  Motion signals bias localization judgments: a unified explanation for the flash-lag, flash-drag, flash-jump, and Frohlich illusions. , 2007, Journal of vision.

[13]  V. Ramachandran,et al.  Illusory Displacement of Equiluminous Kinetic Edges , 1990, Perception.

[14]  Michael R. Ibbotson,et al.  Visual Perception: Saccadic Omission — Suppression or Temporal Masking? , 2009, Current Biology.

[15]  Michael J. Berry,et al.  Synchronized Firing among Retinal Ganglion Cells Signals Motion Reversal , 2007, Neuron.

[16]  A. Parker Binocular depth perception and the cerebral cortex , 2007, Nature Reviews Neuroscience.

[17]  K. Gegenfurtner,et al.  Neuronal Processing Delays Are Compensated in the Sensorimotor Branch of the Visual System , 2003, Current Biology.

[18]  M. Lappe,et al.  Neuronal latencies and the position of moving objects , 2001, Trends in Neurosciences.

[19]  Karl J. Friston,et al.  The mismatch negativity: A review of underlying mechanisms , 2009, Clinical Neurophysiology.

[20]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[21]  Hinze Hogendoorn,et al.  Predictive Coding with Neural Transmission Delays: A Real-Time Temporal Alignment Hypothesis , 2018, eNeuro.

[22]  Dirk Kerzel,et al.  Space and Time in Perception and Action: The Fröhlich effect: past and present , 2010 .

[23]  Romi Nijhawan,et al.  Motion extrapolation in catching , 1994, Nature.

[24]  E. Brenner,et al.  Hitting moving targets Continuous control of the acceleration of the hand on the basis of the target’s velocity , 1998, Experimental Brain Research.

[25]  H. Bedell,et al.  Flash-lag effect: differential latency, not postdiction. , 2000, Science.

[26]  P Cavanagh,et al.  The Position of Moving Objects , 2000, Science.

[27]  A. Borst Seeing smells: imaging olfactory learning in bees , 1999, Nature Neuroscience.

[28]  Rajesh P. N. Rao,et al.  Predictive Coding , 2019, A Blueprint for the Hard Problem of Consciousness.

[29]  Michael R. Ibbotson,et al.  Saccadic Modulation of Neural Responses: Possible Roles in Saccadic Suppression, Enhancement, and Time Compression , 2008, The Journal of Neuroscience.

[30]  David Cox,et al.  A neural network trained to predict future video frames mimics critical properties of biological neuronal responses and perception , 2018, ArXiv.

[31]  M. Meister,et al.  Dynamic predictive coding by the retina , 2005, Nature.

[32]  N M Grzywacz,et al.  Directional selectivity in vertebrate retinal ganglion cells. , 1993, Reviews of oculomotor research.

[33]  Gerrit W. Maus,et al.  Motion Extrapolation Into the Blind Spot , 2008, Psychological science.

[34]  Karl J. Friston,et al.  A theory of cortical responses , 2005, Philosophical Transactions of the Royal Society B: Biological Sciences.

[35]  Patrick Cavanagh,et al.  Strikingly rapid neural basis of motion-induced position shifts revealed by high temporal-resolution EEG pattern classification , 2015, Vision Research.

[36]  Duje Tadin,et al.  Unifying account of visual motion and position perception , 2015, Proceedings of the National Academy of Sciences.

[37]  Guillaume S. Masson,et al.  The Flash-Lag Effect as a Motion-Based Predictive Shift , 2017, PLoS Comput. Biol..

[38]  D. Hubel,et al.  Receptive fields, binocular interaction and functional architecture in the cat's visual cortex , 1962, The Journal of physiology.

[39]  K. D. De Valois,et al.  Vernier acuity with stationary moving Gabors. , 1991, Vision research.

[40]  Patrick Cavanagh,et al.  Motion Extrapolation for Eye Movements Predicts Perceived Motion-Induced Position Shifts , 2018, The Journal of Neuroscience.

[41]  Wolfram Erlhagen,et al.  Internal models for visual perception , 2003, Biological Cybernetics.

[42]  Cristopher M Niell,et al.  Vision: More Than Expected in the Early Visual System , 2013, Current Biology.

[43]  Patrick Cavanagh,et al.  The Flash Grab Effect , 2012 .

[44]  Stuart Anstis,et al.  Perceived shrinkage of motion paths. , 2009, Journal of experimental psychology. Human perception and performance.

[45]  Mazyar Fallah,et al.  A Motion-Dependent Distortion of Retinotopy in Area V4 , 2006, Neuron.

[46]  Michael J. Berry,et al.  Anticipation of moving stimuli by the retina , 1999, Nature.

[47]  C. Clifford Binocular rivalry , 2009, Current Biology.

[48]  D. Hubel,et al.  Binocular interaction in striate cortex of kittens reared with artificial squint. , 1965, Journal of neurophysiology.

[49]  Michael W. Spratling Predictive coding accounts for V1 response properties recorded using reverse correlation , 2012, Biological Cybernetics.

[50]  Romi Nijhawan,et al.  Visual prediction: Psychophysics and neurophysiology of compensation for time delays , 2008, Behavioral and Brain Sciences.

[51]  Karl J. Friston The free-energy principle: a unified brain theory? , 2010, Nature Reviews Neuroscience.

[52]  D. Hubel,et al.  Receptive fields and functional architecture of monkey striate cortex , 1968, The Journal of physiology.

[53]  T J Sejnowski,et al.  Motion integration and postdiction in visual awareness. , 2000, Science.