Eye-head coordination and dynamic visual scanning as indicators of visuo-cognitive demands in driving simulator

Driving is an everyday task involving a complex interaction between visual and cognitive processes. As such, an increase in the cognitive and/or visual demands can lead to a mental overload which can be detrimental for driving safety. Compiling evidence suggest that eye and head movements are relevant indicators of visuo-cognitive demands and attention allocation. This study aims to investigate the effects of visual degradation on eye-head coordination as well as visual scanning behavior during a highly demanding task in a driving simulator. A total of 21 emmetropic participants (21 to 34 years old) performed dual-task driving in which they were asked to maintain a constant speed on a highway while completing a visual search and detection task on a navigation device. Participants did the experiment with optimal vision and with contact lenses that introduced a visual perturbation (myopic defocus). The results indicate modifications of eye-head coordination and the dynamics of visual scanning in response to the visual perturbation induced. More specifically, the head was more involved in horizontal gaze shifts when the visual needs were not met. Furthermore, the evaluation of visual scanning dynamics, based on time-based entropy which measures the complexity and randomness of scanpaths, revealed that eye and gaze movements became less explorative and more stereotyped when vision was not optimal. These results provide evidence for a reorganization of both eye and head movements in response to increasing visual-cognitive demands during a driving task. Altogether, these findings suggest that eye and head movements can provide relevant information about visuo-cognitive demands associated with complex tasks. Ultimately, eye-head coordination and visual scanning dynamics may be good candidates to estimate drivers’ workload and better characterize risky driving behavior.

[1]  K. Ball,et al.  Visual attention problems as a predictor of vehicle crashes in older drivers. , 1993, Investigative ophthalmology & visual science.

[2]  D. Cox,et al.  An Analysis of Transformations , 1964 .

[3]  G S Rubin,et al.  Visual and medical risk factors for motor vehicle collision involvement among older drivers , 2008, British Journal of Ophthalmology.

[4]  Michael F. Land,et al.  Predictable eye-head coordination during driving , 1992, Nature.

[5]  Jamie L. Emerson,et al.  Predictors of driving outcomes in advancing age. , 2012, Psychology and aging.

[6]  J. Stahl,et al.  Amplitude of human head movements associated with horizontal saccades , 1999, Experimental Brain Research.

[7]  H. Taylor,et al.  Vision impairment and older drivers: who’s driving? , 2002, The British journal of ophthalmology.

[8]  Yu Fang,et al.  Eye-Head Coordination for Visual Cognitive Processing , 2015, PloS one.

[9]  Andrew T. Duchowski,et al.  Entropy-based statistical analysis of eye movement transitions , 2014, ETRA.

[10]  Johan Engström,et al.  Sensitivity of eye-movement measures to in-vehicle task difficulty , 2005 .

[11]  H. Deubel,et al.  Saccade target selection and object recognition: Evidence for a common attentional mechanism , 1996, Vision Research.

[12]  D. Roth,et al.  Relation of Useful Field of View and other Screening Tests to on-Road Driving Performance , 2000, Perceptual and motor skills.

[13]  Graham L. Pierce,et al.  Eye movements during scene viewing: Evidence for mixed control of fixation durations , 2008, Psychonomic bulletin & review.

[14]  Gayla M. Cissell,et al.  Can High‐Risk Older Drivers Be Identified Through Performance‐Based Measures in a Department of Motor Vehicles Setting? , 2006, Journal of the American Geriatrics Society.

[15]  K. Ball,et al.  Vision impairment, eye disease, and injurious motor vehicle crashes in the elderly. , 1998, Ophthalmic epidemiology.

[16]  G. Borghini,et al.  Neuroscience and Biobehavioral Reviews , 2022 .

[17]  N. Mackworth,et al.  The gaze selects informative details within pictures , 1967 .

[18]  Chin-Teng Lin,et al.  Spatial and temporal EEG dynamics of dual-task driving performance , 2011, Journal of NeuroEngineering and Rehabilitation.

[19]  Joel M. Cooper,et al.  Assessing the visual and cognitive demands of in-vehicle information systems , 2019, Cognitive Research: Principles and Implications.

[20]  M. Hayhoe,et al.  The coordination of eye, head, and hand movements in a natural task , 2001, Experimental Brain Research.

[21]  Ying Wang,et al.  The sensitivity of different methodologies for characterizing drivers’ gaze concentration under increased cognitive demand , 2014, Transportation Research Part F: Traffic Psychology and Behaviour.

[22]  E F FINCHAM,et al.  The reciprocal actions of accommodation and convergence , 1957, The Journal of physiology.

[23]  L. L. Di Stasi,et al.  Gaze entropy reflects surgical task load , 2016, Surgical Endoscopy.

[24]  Berthold Färber,et al.  Driver distraction based lane-keeping assistance , 2009 .

[25]  D N Dunham Cognitive difficulty of a peripherally presented visual task affects head movements during gaze displacement. , 1997, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[26]  Cynthia Owsley,et al.  Vision and driving , 2010, Vision Research.

[27]  L. L. Di Stasi,et al.  Quantifying the cognitive cost of laparo-endoscopic single-site surgeries: Gaze-based indices. , 2017, Applied ergonomics.

[28]  Z. Kapoula,et al.  Induced vergence-accommodation conflict reduces cognitive performance in the Stroop test , 2019, Scientific Reports.

[29]  I. Pike,et al.  Vision screening of older drivers for preventing road traffic injuries and fatalities. , 2014, The Cochrane database of systematic reviews.

[30]  Natalie Hutchings,et al.  Eye and head movement alterations in naïve progressive addition lens wearers , 2007, Ophthalmic & physiological optics : the journal of the British College of Ophthalmic Opticians.

[31]  Nikolaos M. Avouris,et al.  On Implicit Elicitation of Cognitive Strategies using Gaze Transition Entropies in Pattern Recognition Tasks , 2017, CHI Extended Abstracts.

[32]  Emily A. Cooper,et al.  Sensitivity and bias in the discrimination of two-dimensional and three-dimensional motion direction. , 2016, Journal of vision.

[33]  Julie M. Harris,et al.  Eye movements and hazard perception in active and passive driving , 2015, Visual cognition.

[34]  Johan Engström,et al.  Effects of visual and cognitive load in real and simulated motorway driving , 2005 .

[35]  Simon Schwab,et al.  Analysis of eye and head coordination in a visual peripheral recognition task , 2012 .

[36]  S R Ellis,et al.  Statistical Dependency in Visual Scanning , 1986, Human factors.

[37]  Gabriela Ciuperca,et al.  On the estimation of the entropy rate of finite Markov chains , 2005 .

[38]  H. Duncanson,et al.  Validity of the Mini‐Mental State Examination and the Montreal Cognitive Assessment in the Prediction of Driving Test Outcome , 2015, Journal of the American Geriatrics Society.

[39]  L. Downey,et al.  Stationary gaze entropy predicts lane departure events in sleep-deprived drivers , 2018, Scientific Reports.

[40]  K. Rayner Eye movements in reading and information processing: 20 years of research. , 1998, Psychological bulletin.

[41]  Megumi Hatori,et al.  The role of arrestin In melanopsin function , 2009 .

[42]  M. Trivedi,et al.  Head and eye gaze dynamics during visual attention shifts in complex environments. , 2012, Journal of vision.

[43]  Sara M. Johnson,et al.  Interaction of non-driving tasks with driving , 1995 .

[44]  Jocelyn Faubert,et al.  Three-Dimensional Multiple Object Tracking Speed Thresholds are Associated with Measures of Simulated Driving Performance in Older Drivers , 2017 .

[45]  T Rowan Candy,et al.  Accommodative and vergence responses to conflicting blur and disparity stimuli during development. , 2009, Journal of vision.

[46]  Brook Shiferaw,et al.  Neuroscience and Biobehavioral Reviews , 2022 .

[47]  D. Strayer,et al.  Cell phone-induced failures of visual attention during simulated driving. , 2003, Journal of experimental psychology. Applied.

[48]  Guillaume Giraudet,et al.  Driving simulator scenarios and measures to faithfully evaluate risky driving behavior: A comparative study of different driver age groups , 2017, PloS one.

[49]  Chin-Teng Lin,et al.  Theta and Alpha Oscillations in Attentional Interaction during Distracted Driving , 2018, Front. Behav. Neurosci..

[50]  L Staplin,et al.  Retrospective evaluation of alternative vision screening criteria for older and younger drivers. , 1993, Accident; analysis and prevention.

[51]  A. A. Spady,et al.  Analytical techniques of pilot scanning behavior and their application , 1986 .

[52]  Luis J Fuentes,et al.  The effects of flight complexity on gaze entropy: An experimental study with fighter pilots. , 2019, Applied ergonomics.

[53]  J. Fuller,et al.  Head movement propensity , 2004, Experimental Brain Research.

[54]  Andrew T. Duchowski,et al.  Group-wise similarity and classification of aggregate scanpaths , 2010, ETRA '10.

[55]  M. Corbetta,et al.  A Common Network of Functional Areas for Attention and Eye Movements , 1998, Neuron.

[56]  J. Wood,et al.  Influence of Presbyopic Corrections on Driving-Related Eye and Head Movements , 2009, Optometry and vision science : official publication of the American Academy of Optometry.

[57]  Matteo Valsecchi,et al.  Head movements modulate visual responsiveness in the absence of gaze shifts , 2008, Neuroreport.

[58]  Randall L. Harris,et al.  How a New Instrument Affects Pilots' Mental Workload , 1982 .

[59]  Julie M. Harris,et al.  A Link Between Attentional Function, Effective Eye Movements, and Driving Ability , 2016, Journal of experimental psychology. Human perception and performance.

[60]  Dario D. Salvucci,et al.  Threaded cognition: an integrated theory of concurrent multitasking. , 2008, Psychological review.

[61]  Karen Bandeen-Roche,et al.  A prospective, population-based study of the role of visual impairment in motor vehicle crashes among older drivers: the SEE study. , 2007, Investigative ophthalmology & visual science.

[62]  G. Rizzolatti,et al.  Reorienting attention across the horizontal and vertical meridians: Evidence in favor of a premotor theory of attention , 1987, Neuropsychologia.

[63]  L. Downey,et al.  Gaze entropy measures detect alcohol-induced driver impairment. , 2019, Drug and alcohol dependence.

[64]  Satoshi Shioiri,et al.  Why Do We Move Our Head to Look at an Object in Our Peripheral Region? Lateral Viewing Interferes with Attentive Search , 2014, PloS one.

[65]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[66]  S. Celebrini,et al.  Privileged visual processing of the straight-ahead direction in humans. , 2012, Journal of vision.

[67]  Randall L. Harris,et al.  Entropy, instrument scan and pilot workload , 1982 .

[68]  Alex Chaparro,et al.  Useful Field of View Predicts Driving in the Presence of Distracters , 2012, Optometry and vision science : official publication of the American Academy of Optometry.

[69]  Dariusz M Plewczynski,et al.  Three-dimensional Epigenome Statistical Model: Genome-wide Chromatin Looping Prediction , 2018, Scientific Reports.

[70]  Andrew T. Duchowski,et al.  Gaze Transition Entropy , 2015, TAP.

[71]  S. Wahl,et al.  Specific eye-head coordination enhances vision in progressive lens wearers. , 2016, Journal of vision.

[72]  E. Casson,et al.  Vision standards for driving in Canada and the United States. A review for the Canadian Ophthalmological Society. , 2000, Canadian journal of ophthalmology. Journal canadien d'ophtalmologie.

[73]  L. L. Di Stasi,et al.  Gaze-based Technology as a Tool for Surgical Skills Assessment and Training in Urology. , 2017, Urology.

[74]  A. Bartz Eye and Head Movements in Peripheral Vision: Nature of Compensatory Eye Movements , 1966, Science.

[75]  Derrick J. Parkhurst,et al.  Modeling the role of salience in the allocation of overt visual attention , 2002, Vision Research.

[76]  P. Riddell,et al.  Developmental Changes in the Balance of Disparity, Blur, and Looming/Proximity Cues to Drive Ocular Alignment and Focus , 2013, Perception.

[77]  D. Roth,et al.  Cumulative Meta-analysis of the Relationship Between Useful Field of View and Driving Performance in Older Adults: Current and Future Implications , 2005, Optometry and vision science : official publication of the American Academy of Optometry.

[78]  Bruce Abernethy,et al.  Gaze-contingent training enhances perceptual skill acquisition. , 2016, Journal of vision.

[79]  J. Antes The time course of picture viewing. , 1974, Journal of experimental psychology.

[80]  J. Gresset,et al.  Risk of accidents among elderly car drivers with visual acuity equal to 6/12 or 6/15 and lack of binocular vision , 1994, Ophthalmic & physiological optics : the journal of the British College of Ophthalmic Opticians.

[81]  Yuan Wang,et al.  Examining drivers' eye glance patterns during distracted driving: Insights from scanning randomness and glance transition matrix. , 2017, Journal of safety research.

[82]  Payam Yazdan-Ashoori,et al.  Vision and Driving: Canada , 2010, Journal of neuro-ophthalmology : the official journal of the North American Neuro-Ophthalmology Society.

[83]  M. A. Recarte,et al.  Mental workload while driving: effects on visual search, discrimination, and decision making. , 2003, Journal of experimental psychology. Applied.

[84]  Linda Ng Boyle,et al.  The Interaction of Cognitive Load and Attention-Directing Cues in Driving , 2009, Hum. Factors.

[85]  I. Pike,et al.  Vision screening of older drivers for preventing road traffic injuries and fatalities. , 2011, The Cochrane database of systematic reviews.

[86]  H. Pashler Dual-task interference in simple tasks: data and theory. , 1994, Psychological bulletin.

[87]  M W Morgan,et al.  Accommodation and vergence. , 1968, American journal of optometry and archives of American Academy of Optometry.

[88]  Terry C Lansdown,et al.  Distraction from multiple in-vehicle secondary tasks: vehicle performance and mental workload implications , 2004, Ergonomics.

[89]  K. Ball,et al.  Visual/cognitive correlates of vehicle accidents in older drivers. , 1991, Psychology and aging.

[90]  Bum-Suk Lee,et al.  Relationship Between Cognitive Perceptual Abilities and Accident and Penalty Histories Among Elderly Korean Drivers , 2016, Annals of rehabilitation medicine.

[91]  Michael B. McCamy,et al.  Task complexity modulates pilot electroencephalographic activity during real flights. , 2015, Psychophysiology.