Faster is better: Visual responses to motion are stronger for higher refresh rates

Although neural responses with a millisecond precision were reported in the retina, lateral geniculate nucleus and visual cortex of multiple species, the presence and role of such a fine temporal structure is still debated at the cortical level and the general belief remains that early visual system encodes information at slower timescales. In this study, we used a new stimulation platform to generate visual stimuli that were very precisely encoded in time and we characterized in human subjects the EEG responses to moving patterns that shared the same global motion but differed in their fine scale spatio-temporal properties. In two experiments, we manipulated the information within temporal windows that corresponded to the frame duration in conventional (1/60 = 16.7ms, experience 1) and more recent (1/120 = 8.3ms, experience 2) visual displays. Our results demonstrate that EEG responses to temporally dense and coherent trajectories are significantly stronger than those to control conditions without these properties. They extend previous results from our group that showed that accurate temporal information (<10ms) significantly improve perceptual judgments on spatial discrimination, digit recognition and sensitivity for speed [Kime et al., 2016]. Altogether, our results suggest that instead of low-pass filtering the temporal information it receives from its thalamic afferents, the visual cortex may actually exploit its richness to improve visual perception. Significance statement Most visual experiments use frame-based stimulation screens which are synchronous and slow. This might not engage the full encoding capacity of the visual system, as in natural condition, visual information is asynchronously acquired by the retina with a very high temporal resolution. In the present study, we used an unconventional and highly configurable stimulation platform to determine the EEG responses to moving patterns that shared the same global motion but differed in their fine scale (<10ms) spatio-temporal properties. Our results demonstrate that brain responses in human are significantly stronger for motion patterns that are refreshed at very high frame rate (360Hz) and thereby provide a strong support for the use of very precise temporal stimulations in vision studies.

[1]  Zhou Wang,et al.  Perceptual aliasing factors and the impact of frame rate on video quality , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[2]  W. Newsome,et al.  A selective impairment of motion perception following lesions of the middle temporal visual area (MT) , 1988, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[3]  Chun-I Yeh,et al.  Temporal precision in the neural code and the timescales of natural vision , 2007, Nature.

[4]  Richard M. Leahy,et al.  Electromagnetic brain mapping , 2001, IEEE Signal Process. Mag..

[5]  B. Knight,et al.  Response variability and timing precision of neuronal spike trains in vivo. , 1997, Journal of neurophysiology.

[6]  Justin M. Ales,et al.  The steady-state visual evoked potential in vision research: A review. , 2015, Journal of vision.

[7]  Kajal T. Claypool,et al.  The effects of frame rate and resolution on users playing first person shooter games , 2006, Electronic Imaging.

[8]  Jean Lorenceau,et al.  Psychophysical Assessment of Perceptual Performance With Varying Display Frame Rates , 2016, Journal of Display Technology.

[9]  Daniel E. Wollman,et al.  Phase locking of neuronal responses to the vertical refresh of computer display monitors in cat lateral geniculate nucleus and striate cortex , 1995, Journal of Neuroscience Methods.

[10]  Stanley A. Klein,et al.  The folding fingerprint of visual cortex reveals the timing of human V1 and V2 , 2010, NeuroImage.

[11]  Christof Koch,et al.  Temporal Precision of Spike Trains in Extrastriate Cortex of the Behaving Macaque Monkey , 1999, Neural Computation.

[12]  E. Chichilnisky,et al.  Temporal Resolution of Ensemble Visual Motion Signals in Primate Retina , 2003, The Journal of Neuroscience.

[13]  Yoshihiko Kuroki,et al.  A psychophysical study of improvements in motion‐image quality by using high frame rates , 2007 .

[14]  Tim Gollisch,et al.  Eye Smarter than Scientists Believed: Neural Computations in Circuits of the Retina , 2010, Neuron.

[15]  R. Reid,et al.  Precise Firing Events Are Conserved across Neurons , 2002, The Journal of Neuroscience.

[16]  Arnaud Delorme,et al.  EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis , 2004, Journal of Neuroscience Methods.

[17]  James Gordon,et al.  Entrainment to Video Displays in Primary Visual Cortex of Macaque and Humans , 2004, The Journal of Neuroscience.

[18]  Anthony M Norcia,et al.  Dynamics and cortical distribution of neural responses to 2D and 3D motion in human. , 2014, Journal of neurophysiology.

[19]  Stanley A. Klein,et al.  The folding fingerprint of visual cortex reveals the timing of human V1 and V2 , 2007 .

[20]  Michael J. Berry,et al.  The structure and precision of retinal spike trains. , 1997, Proceedings of the National Academy of Sciences of the United States of America.