Expecting the unexpected: Temporal expectation increases the flash-grab effect.

In the flash-grab effect, when a disk is flashed on a moving background at the moment it reverses direction, the perceived location of the disk is strongly displaced in the direction of the motion that follows the reversal. Here, we ask whether increased expectation of the reversal reduces its effect on the motion-induced shift, as suggested by predictive coding models with first order predictions. Across four experiments we find that when the reversal is expected, the illusion gets stronger, not weaker. We rule out accumulating motion adaptation as a contributing factor. The pattern of results cannot be accounted for by first-order predictions of location. Instead, it appears that second-order predictions of event timing play a role. Specifically, we conclude that temporal expectation causes a transient increase in temporal attention, boosting the strength of the motion signal and thereby increasing the strength of the illusion.

[1]  Karl J. Friston,et al.  Attention, Uncertainty, and Free-Energy , 2010, Front. Hum. Neurosci..

[2]  E. Brenner,et al.  Hitting moving targets Continuous control of the acceleration of the hand on the basis of the target’s velocity , 1998, Experimental Brain Research.

[3]  Mazyar Fallah,et al.  A Motion-Dependent Distortion of Retinotopy in Area V4 , 2006, Neuron.

[4]  Karl J. Friston,et al.  Cerebral hierarchies: predictive processing, precision and the pulvinar , 2015, Philosophical Transactions of the Royal Society B: Biological Sciences.

[5]  R. Duncan Luce,et al.  Response Times: Their Role in Inferring Elementary Mental Organization , 1986 .

[6]  Hinze Hogendoorn,et al.  When predictions fail: Correction for extrapolation in the flash-grab effect. , 2019, Journal of vision.

[7]  Anna C Nobre,et al.  Combining spatial and temporal expectations to improve visual perception. , 2014, Journal of vision.

[8]  C. Summerfield,et al.  Expectation (and attention) in visual cognition , 2009, Trends in Cognitive Sciences.

[9]  F. Chavane,et al.  Imaging cortical correlates of illusion in early visual cortex , 2004, Nature.

[10]  Michael J. Berry,et al.  Anticipation of moving stimuli by the retina , 1999, Nature.

[11]  S. Klein,et al.  Evidence for an Attentional Component of the Perceptual Misalignment between Moving and Flashing Stimuli , 2002, Perception.

[12]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[13]  Patrick Cavanagh,et al.  Motion Extrapolation for Eye Movements Predicts Perceived Motion-Induced Position Shifts , 2018, The Journal of Neuroscience.

[14]  M G Saslow,et al.  Latency for saccadic eye movement. , 1967, Journal of the Optical Society of America.

[15]  Hirohisa Yaguchi,et al.  Measuring attention using flash-lag effect. , 2010, Journal of vision.

[16]  Floris P de Lange,et al.  Time-compressed preplay of anticipated events in human primary visual cortex , 2017, Nature Communications.

[17]  Rajesh P. N. Rao,et al.  Predictive coding in the visual cortex: a functional interpretation of some extra-classical receptive-field effects. , 1999 .

[18]  Preeti Verghese,et al.  Predictability and the Dynamics of Position Processing in the Flash-Lag Effect , 2005, Perception.

[19]  Shin'ya Nishida,et al.  Influence of motion signals on the perceived position of spatial pattern , 1999, Nature.

[20]  A. Nobre,et al.  The hazards of time , 2007, Current Opinion in Neurobiology.

[21]  J. Lupiáñez,et al.  Temporal attention enhances early visual processing: A review and new evidence from event-related potentials , 2006, Brain Research.

[22]  Anna C. Nobre,et al.  Synergistic Effect of Combined Temporal and Spatial Expectations on Visual Attention , 2005, The Journal of Neuroscience.

[23]  Elle van Heusden,et al.  Predictive coding of visual motion in both monocular and binocular human visual processing. , 2019, Journal of vision.

[24]  Marcus Vinícius C Baldo,et al.  The Modulation of the Flash-Lag Effect by Voluntary Attention , 2004, Perception.

[25]  M. Lappe,et al.  Neuronal latencies and the position of moving objects , 2001, Trends in Neurosciences.

[26]  Hinze Hogendoorn,et al.  Interpolation and extrapolation on the path of apparent motion , 2008, Vision Research.

[27]  Terrence J Sejnowski,et al.  Motion signals bias localization judgments: a unified explanation for the flash-lag, flash-drag, flash-jump, and Frohlich illusions. , 2007, Journal of vision.

[28]  George L. Gerstein,et al.  Feature-linked synchronization of thalamic relay cell firing induced by feedback from the visual cortex , 1994, Nature.

[29]  A. Nobre,et al.  Alpha Oscillations Related to Anticipatory Attention Follow Temporal Expectations , 2011, The Journal of Neuroscience.

[30]  A. Nobre,et al.  Temporal Expectation Improves the Quality of Sensory Information , 2012, The Journal of Neuroscience.

[31]  D G Pelli,et al.  The VideoToolbox software for visual psychophysics: transforming numbers into movies. , 1997, Spatial vision.

[32]  Hinze Hogendoorn,et al.  Predictions drive neural representations of visual events ahead of incoming sensory information , 2020, Proceedings of the National Academy of Sciences.

[33]  Romi Nijhawan,et al.  Motion extrapolation in catching , 1994, Nature.

[34]  Frans A. J. Verstraten,et al.  The Motion Aftereffect:A Modern Perspective , 1998 .

[35]  Anthony N. Burkitt,et al.  Predictive coding of visual object position ahead of moving objects revealed by time-resolved EEG decoding , 2018, NeuroImage.

[36]  Naotsugu Tsuchiya,et al.  Expectation and attention increase the integration of top-down and bottom-up signals in perception through different pathways , 2019, PLoS biology.

[37]  J. Namba,et al.  The attentional modulation of the flash-lag effect. , 2002, Brazilian journal of medical and biological research = Revista brasileira de pesquisas medicas e biologicas.

[38]  Romi Nijhawan,et al.  Visual prediction: Psychophysics and neurophysiology of compensation for time delays , 2008, Behavioral and Brain Sciences.

[39]  G. Karmos,et al.  Entrainment of Neuronal Oscillations as a Mechanism of Attentional Selection , 2008, Science.

[40]  Patrick Cavanagh,et al.  The flash grab effect , 2012, Vision Research.

[41]  P. J. Foley The foreperiod and simple reaction time. , 1959, Canadian journal of psychology.

[42]  Michael J. Berry,et al.  Synchronized Firing among Retinal Ganglion Cells Signals Motion Reversal , 2007, Neuron.

[43]  Joan López-Moliner,et al.  Motion signal and the perceived positions of moving objects. , 2007, Journal of vision.

[44]  Nicholas D. Duran,et al.  Prediction during statistical learning, and implications for the implicit/explicit divide , 2012, Advances in cognitive psychology.

[45]  P Cavanagh,et al.  The Position of Moving Objects , 2000, Science.

[46]  Patrick Cavanagh,et al.  Strikingly rapid neural basis of motion-induced position shifts revealed by high temporal-resolution EEG pattern classification , 2015, Vision Research.

[47]  Patrick Cavanagh,et al.  Localization of flash grab targets is improved with sustained spatial attention , 2016 .

[48]  T J Sejnowski,et al.  Motion integration and postdiction in visual awareness. , 2000, Science.

[49]  Alexander S. Ecker,et al.  Faster processing of moving compared to flashed bars in awake macaque V1 provides a neural correlate of the flash lag illusion , 2015, bioRxiv.

[50]  M. Lappe,et al.  The position of moving objects. , 2000, Perception.

[51]  Karl J. Friston,et al.  Does predictive coding have a future? , 2018, Nature Neuroscience.

[52]  J. Lupiáñez,et al.  Attentional preparation based on temporal expectancy modulates processing at the perceptual level , 2005, Psychonomic bulletin & review.

[53]  B. Rolke,et al.  Temporal uncertainty degrades perceptual processing , 2007, Psychonomic bulletin & review.