When predictions fail: Correction for extrapolation in the flash-grab effect.

Motion-induced position shifts constitute a broad class of visual illusions in which motion and position signals interact in the human visual pathway. In such illusions, the presence of visual motion distorts the perceived positions of objects in nearby space. Predictive mechanisms, which could contribute to compensating for processing delays due to neural transmission, have been given as an explanation. However, such mechanisms have struggled to explain why we do not usually perceive objects extrapolated beyond the end of their trajectory. Advocates of this interpretation have proposed a "correction-for-extrapolation" mechanism to explain this: When the object motion ends abruptly, this mechanism corrects the overextrapolation by shifting the perceived object location backwards to its actual location. However, such a mechanism has so far not been empirically demonstrated. Here, we use a novel version of the flash-grab illusion to demonstrate this mechanism. In the flash-grab effect, a target is flashed on a moving background that abruptly changes direction, leading to the mislocalization of the target. Here, we manipulate the angle of the direction change to dissociate the contributions of the background motion before and after the flash. Consistent with previous reports, we observe that perceptual mislocalization in the flash-grab illusion is mainly driven by motion after the flash. Importantly, however, we reveal a small but consistent mislocalization component in the direction opposite to the direction of the first motion sequence. This provides empirical support for the proposed correction-for-extrapolation mechanism, and therefore corroborates the interpretation that motion-induced position shifts might result from predictive interactions between motion and position signals.

[1]  I. Murakami,et al.  Latency difference, not spatial extrapolation , 1998, Nature Neuroscience.

[2]  Michael J. Berry,et al.  Synchronized Firing among Retinal Ganglion Cells Signals Motion Reversal , 2007, Neuron.

[3]  David M. Eagleman,et al.  Prediction and postdiction: Two frameworks with the goal of delay compensation , 2008, Behavioral and Brain Sciences.

[4]  Friedrich W. Fröhlich,et al.  Über die Messung der Empfindungszeit , 1924, Pflüger's Archiv für die gesamte Physiologie des Menschen und der Tiere.

[5]  Anthony N. Burkitt,et al.  Predictive coding of visual object position ahead of moving objects revealed by time-resolved EEG decoding , 2018, NeuroImage.

[6]  R Nijhawan,et al.  The Role of Attention in Motion Extrapolation: Are Moving Objects ‘Corrected’ or Flashed Objects Attentionally Delayed? , 2000, Perception.

[7]  Michael J. Berry,et al.  The Neural Circuit Mechanisms Underlying the Retinal Response to Motion Reversal , 2014, The Journal of Neuroscience.

[8]  Patrick Cavanagh,et al.  The flash grab effect , 2012, Vision Research.

[9]  David Whitney,et al.  Voluntary attention modulates motion-induced mislocalization. , 2011, Journal of vision.

[10]  Patrick Cavanagh,et al.  Motion Extrapolation for Eye Movements Predicts Perceived Motion-Induced Position Shifts , 2018, The Journal of Neuroscience.

[11]  R. Nijhawan,et al.  Neural delays, visual motion and the flash-lag effect , 2002, Trends in Cognitive Sciences.

[12]  Szonya Durant,et al.  Temporal dependence of local motion induced shifts in perceived position , 2004, Vision Research.

[13]  K. D. De Valois,et al.  Vernier acuity with stationary moving Gabors. , 1991, Vision research.

[14]  T J Sejnowski,et al.  Motion integration and postdiction in visual awareness. , 2000, Science.

[15]  David Whitney,et al.  Motion distorts visual space: shifting the perceived position of remote stationary objects , 2000, Nature Neuroscience.

[16]  P. Cavanagh,et al.  Illusory spatial offset of a flash relative to a moving stimulus is caused by differential latencies for moving and flashed stimuli , 2000, Vision Research.

[17]  T. Holy A Public Confession: The Retina Trumpets Its Failed Predictions , 2007, Neuron.

[18]  Elle van Heusden,et al.  Predictive coding of visual motion in both monocular and binocular human visual processing. , 2019, Journal of vision.

[19]  M. Lappe,et al.  The position of moving objects. , 2000, Perception.

[20]  Hinze Hogendoorn,et al.  Predictions drive neural representations of visual events ahead of incoming sensory information , 2020, Proceedings of the National Academy of Sciences.

[21]  Stanley A. Klein,et al.  Extrapolation or attention shift? , 1995, Nature.

[22]  Hinze Hogendoorn,et al.  Predictive Coding with Neural Transmission Delays: A Real-Time Temporal Alignment Hypothesis , 2018, eNeuro.

[23]  Rajesh P. N. Rao,et al.  Predictive coding in the visual cortex: a functional interpretation of some extra-classical receptive-field effects. , 1999 .

[24]  Neil W. Roach,et al.  Dynamics of Spatial Distortions Reveal Multiple Time Scales of Motion Adaptation , 2009, Journal of neurophysiology.

[25]  Terrence J Sejnowski,et al.  Untangling spatial from temporal illusions , 2002, Trends in Neurosciences.

[26]  Markus Lappe,et al.  Temporal recruitment along the trajectory of moving objects and the perception of position , 1999, Vision Research.

[27]  Romi Nijhawan,et al.  Forward displacements of fading objects in motion: The role of transient signals in perceiving position , 2006, Vision Research.

[28]  Mazyar Fallah,et al.  A Motion-Dependent Distortion of Retinotopy in Area V4 , 2006, Neuron.

[29]  Michael J. Berry,et al.  Anticipation of moving stimuli by the retina , 1999, Nature.

[30]  Markus Lappe,et al.  A model of the perceived relative positions of moving objects based upon a slow averaging process , 2000, Vision Research.

[31]  H. Bedell,et al.  Flash-lag effect: differential latency, not postdiction. , 2000, Science.

[32]  S. Holm A Simple Sequentially Rejective Multiple Test Procedure , 1979 .

[33]  Romi Nijhawan,et al.  Going, going, gone: localizing abrupt offsets of moving objects. , 2009, Journal of experimental psychology. Human perception and performance.

[34]  M. Lappe,et al.  Neuronal latencies and the position of moving objects , 2001, Trends in Neurosciences.

[35]  E. Brenner,et al.  Motion extrapolation is not responsible for the flash–lag effect , 2000, Vision Research.

[36]  V. Ramachandran,et al.  Illusory Displacement of Equiluminous Kinetic Edges , 1990, Perception.

[37]  Laurent Goffart,et al.  Does the Brain Extrapolate the Position of a Transient Moving Target? , 2015, The Journal of Neuroscience.

[38]  Zhuanghua Shi,et al.  Motion Extrapolation in the Central Fovea , 2012, PloS one.

[39]  Kuno Kirschfeld,et al.  The Fröhlich effect: a consequence of the interaction of visual focal attention and metacontrast , 1999, Vision Research.

[40]  Romi Nijhawan,et al.  Visual prediction: Psychophysics and neurophysiology of compensation for time delays , 2008, Behavioral and Brain Sciences.

[41]  George L. Gerstein,et al.  Feature-linked synchronization of thalamic relay cell firing induced by feedback from the visual cortex , 1994, Nature.

[42]  David Whitney,et al.  Motion-Dependent Representation of Space in Area MT+ , 2013, Neuron.

[43]  Author Events before the flash Do influence the flash-lag magnitude , 2017 .

[44]  I. Murakami,et al.  The flash-lag effect and the flash-drag effect in the same display. , 2016, Journal of vision.

[45]  Patrick Cavanagh,et al.  Strikingly rapid neural basis of motion-induced position shifts revealed by high temporal-resolution EEG pattern classification , 2015, Vision Research.

[46]  Duje Tadin,et al.  Unifying account of visual motion and position perception , 2015, Proceedings of the National Academy of Sciences.

[47]  David Whitney,et al.  The influence of visual motion on perceived position , 2002, Trends in Cognitive Sciences.

[48]  Sonja Stork,et al.  Comparing mislocalizations with moving stimuli: The Fröhlich effect, the flash-lag, and representational momentum , 2002 .

[49]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[50]  Semir Zeki,et al.  Perceptual compression of space through position integration , 2006, Proceedings of the Royal Society B: Biological Sciences.

[51]  P Cavanagh,et al.  The Position of Moving Objects , 2000, Science.

[52]  Gregor Schöner,et al.  Shorter latencies for motion trajectories than for flashes in population responses of cat primary visual cortex , 2004, The Journal of physiology.

[53]  Terrence J Sejnowski,et al.  Motion signals bias localization judgments: a unified explanation for the flash-lag, flash-drag, flash-jump, and Frohlich illusions. , 2007, Journal of vision.

[54]  Romi Nijhawan,et al.  Motion extrapolation in catching , 1994, Nature.