Differences between oculomotor and perceptual artifacts for temporally limited head mounted displays

Correspondence T. Scott Murdison, Facebook, Redmond, WA, USA. Email: smurdison@fb.com Abstract We used perceptual and oculomotor measures to understand the negative impacts of low (phantom array) and high (motion blur) duty cycles with a high-speed, AR-likehead-mounted display prototype. We observed large intersubject variability for the detection of phantom array artifacts but a highly consistent and systematic effect on saccadic eye movement targeting during low duty cycle presentations. This adverse effect on saccade endpoints was also related to an increased error rate in a perceptual discrimination task, showing a direct effect of display duty cycle on the perceptual quality. For high duty cycles, the probability of detecting motion blur increased during head movements, and this effect was elevated at lower refresh rates. We did not find an impact of the temporal display characteristics on compensatory eye movements during head motion (e.g., VOR). Together, our results allow us to quantify the tradeoff of different negative spatiotemporal impacts of user movements and make subsequent recommendations for optimized temporal HMD parameters.

[1]  Joshua A. Solomon,et al.  Gain control of saccadic eye movements is probabilistic , 2019, Proceedings of the National Academy of Sciences.

[2]  Philippe Lefèvre,et al.  Asynchrony between position and motion signals in the saccadic system. , 2006, Journal of neurophysiology.

[3]  Nicholas A. Steinmetz,et al.  Visual Space is Compressed in Prefrontal Cortex Before Eye Movements , 2014, Nature.

[4]  J. Jonas,et al.  Count and density of human retinal photoreceptors , 2004, Graefe's Archive for Clinical and Experimental Ophthalmology.

[5]  Harold E. Bedell,et al.  The effect of a temporary absence of target velocity information on visual tracking , 2004 .

[6]  M. A. Goodale,et al.  What is the best fixation target? The effect of target shape on stability of fixational eye movements , 2013, Vision Research.

[7]  Andrew B. Watson,et al.  High Frame Rates and Human Vision: A View through the Window of Visibility , 2013 .

[8]  R. Wurtz,et al.  Brain circuits for the internal monitoring of movements. , 2008, Annual review of neuroscience.

[9]  Guillaume S. Masson,et al.  Motion perception during saccadic eye movements , 2000, Nature Neuroscience.

[10]  P. Rakić,et al.  Distribution of photoreceptor subtypes in the retina of diurnal and nocturnal primates , 1990, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[11]  E Bizzi,et al.  The role of vestibular and neck afferents during eye-head coordination in the monkey. , 1974, Brain research.

[12]  A. Watson.  A formula for human retinal ganglion cell receptive field density as a function of visual field location. , 2014, Journal of vision.

[13]  Eugene McSorley,et al.  The influence of spatial frequency and contrast on saccade latencies , 2004, Vision Research.

[14]  Predictive mechanisms improve the vestibulo-ocular reflex in patients with bilateral vestibular failure , 2014, Journal of Neurology.

[15]  A. Berthoz,et al.  Changing patterns of eye-head coordination during 6 h of optically reversed vision , 2004, Experimental Brain Research.

[16]  Marcus Nyström,et al.  Sampling frequency and eye-tracking measures: how speed affects durations, latencies, and more , 2010 .

[17]  Robert S. Allison,et al.  Evaluation of the impact of high frame rates on legibility in S3D film , 2015, SAP.

[18]  Kevin J. MacKenzie,et al.  Psychophysical Evaluation of Persistence- and Frequency-Limited Displays for Virtual and Augmented Reality , 2018 .

[19]  Dario L. Ringach,et al.  When your eyes see more than you do , 2010, Current Biology.

[20]  W. Hershberger.  Saccadic eye movements and the perception of visual direction , 1987, Perception & psychophysics.

[21]  Patrick Cavanagh,et al.  Oculomotor Remapping of Visual Information to Foveal Retinotopic Cortex , 2016, Front. Syst. Neurosci..

[22]  S. C. Mclaughlin.  Parametric adjustment in saccadic eye movements , 1967 .

[23]  David R. Bull,et al.  The visibility of motion artifacts and their effect on motion quality , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[24]  David A. Robinson,et al.  Models of the saccadic eye movement control system , 1973, Kybernetik.

[25]  P. E. Hallett,et al.  Dependence of saccadic eye-movements on stimulus luminance, and an effect of task , 1988, Vision Research.

[26]  D. Melcher.  Predictive remapping of visual features precedes saccadic eye movements , 2007, Nature Neuroscience.

[27]  Gunnar Blohm,et al.  Saccade-induced changes in ocular torsion reveal predictive orientation perception. , 2019, Journal of vision.

[28]  J R Duhamel,et al.  The updating of the representation of visual space in parietal cortex by intended eye movements. , 1992, Science.

[29]  D. Pélisson,et al.  On-line modification of saccadic eye movements by retinal signals , 2003, Neuroreport.

[30]  Nancy Kanwisher,et al.  Feature-Binding Errors After Eye Movements and Shifts of Attention , 2014, Psychological science.

[31]  D. Burr,et al.  Selective suppression of the magnocellular visual pathway during saccadic eye movements , 1994, Nature.

[32]  Robert H Wurtz,et al.  Saccadic Corollary Discharge Underlies Stable Visual Perception , 2016, The Journal of Neuroscience.

[33]  Eli Brenner,et al.  Corrective saccades influence velocity judgments and interception , 2019, Scientific Reports.

[34]  Gavin S. P. Miller,et al.  The Problem of Persistence with Rotating Displays , 2017, IEEE Transactions on Visualization and Computer Graphics.

[35]  Martin Rolfs,et al.  The Joy of Retinal Painting: A Build-It-Yourself Device for Intrasaccadic Presentations , 2019, Perception.

[36]  Guido Marco Cicchini,et al.  Spatiotemporal Distortions of Visual Perception at the Time of Saccades , 2009, The Journal of Neuroscience.

[37]  Marco Boi,et al.  Consequences of the Oculomotor Cycle for the Dynamics of Perception , 2017, Current Biology.

[38]  W. Becker,et al.  An analysis of the saccadic system by means of double step stimuli , 1979, Vision Research.

[39]  S J Anderson,et al.  Peripheral spatial vision: limits imposed by optics, photoreceptors, and receptor pooling. , 1991, Journal of the Optical Society of America. A, Optics and image science.

[40]  M. Goodale,et al.  Separate visual pathways for perception and action , 1992, Trends in Neurosciences.

[41]  Kevin J. MacKenzie,et al.  3‐1: Psychophysical Evaluation of Persistence‐ and Frequency‐Limited Displays for Virtual and Augmented Reality , 2019 .