Neuroscience and Biobehavioral Reviews

HighlightsThere are two types of gaze entropy: GTE and SGE.There may be an optimal range of GTE for a given task.GTE indicates level of efficiency in visual scanning.SGE reflects overall spatial dispersion of gaze.Normalising observed entropy improves interpretability. &NA; While the concept of entropy has been applied to gaze analysis, it is unclear what aspects of visual scanning it measures. In this review, we first outline gaze control as a complex system of spatial prediction. Second, we provide a brief introduction to the concept of entropy within the context of information theory as the foundation for gaze entropy measures; with a specific focus on equations for Shannon's entropy and conditional entropy. The application of these equations to gaze data is described as stationary gaze entropy (SGE) and gaze transition entropy (GTE) respectively. Third, we present an updated model of gaze orientation and propose an adaptable definition of GTE as a measure of visual scanning efficiency that underlies overall gaze dispersion measured by SGE. Finally, we review studies that have utilised GTE and SGE to assess visual scanning and discuss their results in relation to our proposed definitions and associated hypotheses. Methodological limitations in gaze entropy measures are discussed and suggestions provided to improve interpretability and generalisability of future studies.

[1]  Yuhong Yang.  Elements of Information Theory (2nd ed.). Thomas M. Cover and Joy A. Thomas , 2008 .

[2]  Bruce Abernethy,et al.  Gaze-contingent training enhances perceptual skill acquisition. , 2016, Journal of vision.

[3]  Leslie G. Ungerleider,et al.  Mechanisms of visual attention in the human cortex. , 2000, Annual review of neuroscience.

[4]  Per-Anders Fransson,et al.  Oculomotor deficits caused by 0.06% and 0.10% blood alcohol concentrations and relationship to subjective perception of drunkenness , 2010, Clinical Neurophysiology.

[5]  David S. Zee,et al.  Eye Movement Research in the Twenty-First Century—a Window to the Brain, Mind, and More , 2017, The Cerebellum.

[6]  P. König,et al.  Developmental changes in natural viewing behavior bottom-up and top-down differences between children, young adults , 2010 .

[7]  A. Clark.  Whatever next? Predictive brains, situated agents, and the future of cognitive science. , 2013, The Behavioral and brain sciences.

[8]  C. Koch,et al.  Computational modelling of visual attention , 2001, Nature Reviews Neuroscience.

[9]  Alan C. Bovik,et al.  Point-of-gaze analysis reveals visual search strategies , 2004, IS&T/SPIE Electronic Imaging.

[10]  Wilson S. Geisler,et al.  Contrast statistics for foveated visual systems: Contrast constancy and fixation selection , 2010 .

[11]  Hadas Okon-Singer,et al.  The role of attention bias to threat in anxiety: mechanisms, modulators and open questions , 2018, Current Opinion in Behavioral Sciences.

[12]  Zhaoping Li.  A saliency map in primary visual cortex , 2002, Trends in Cognitive Sciences.

[13]  Karl J. Friston.  The free-energy principle: a rough guide to the brain? , 2009, Trends in Cognitive Sciences.

[14]  G. Vandewalle,et al.  Influence of acute sleep loss on the neural correlates of alerting, orientating and executive attention components , 2012, Journal of sleep research.

[15]  Peter König,et al.  Exploration and Exploitation in Natural Viewing Behavior , 2017, Scientific Reports.

[16]  J R Duhamel,et al.  The updating of the representation of visual space in parietal cortex by intended eye movements. , 1992, Science.

[17]  Michael W. Spratling.  A predictive coding model of gaze shifts and the underlying neurophysiology , 2017 .

[18]  Michael Batty,et al.  Entropy, complexity, and spatial information , 2014, Journal of Geographical Systems.

[19]  Romain Quentin,et al.  Corrigendum: Frontal eye field, where art thou? Anatomy, function, and non-invasive manipulation of frontal regions involved in eye movements and associated cognitive operations , 2014, Front. Integr. Neurosci..

[20]  Stefan Glasauer,et al.  Cerebellar Contribution to Saccades and Gaze Holding , 2003 .

[21]  Michael L. Mack,et al.  Viewing task influences eye movement control during active scene perception. , 2009, Journal of vision.

[22]  A. Kingstone,et al.  Saliency does not account for fixations to eyes within social scenes , 2009, Vision Research.

[23]  Jillian H. Fecteau,et al.  Neural correlates of the automatic and goal-driven biases in orienting spatial attention. , 2004, Journal of neurophysiology.

[24]  Renato J. Cintra,et al.  Entropy-Based Statistical Analysis of PolSAR Data , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[25]  R. Remington,et al.  Sampling distributions of the entropy in visual scanning , 1989 .

[26]  Jon Driver,et al.  Functional connectivity between prefrontal and parietal cortex drives visuo-spatial attention shifts , 2017, Neuropsychologia.

[27]  Randall L. Harris,et al.  Entropy, instrument scan and pilot workload , 1982 .

[28]  Karl J. Friston,et al.  The Markov blankets of life: autonomy, active inference and the free energy principle , 2018, Journal of The Royal Society Interface.

[29]  Matthias Bethge,et al.  Information-theoretic model comparison unifies saliency metrics , 2015, Proceedings of the National Academy of Sciences.

[30]  Jae-Jin Kim,et al.  Aversive eye gaze during a speech in virtual environment in patients with social anxiety disorder , 2018, The Australian and New Zealand journal of psychiatry.

[31]  Nevena Padovan,et al.  Alcohol Hits You When It Is Hard: Intoxication, Task Difficulty, and Theta Brain Oscillations , 2016, Alcoholism, clinical and experimental research.

[32]  Rolf Zon,et al.  Eye Movements as an Indicator of Situation Awareness in a Flight Simulator Experiment , 2012 .

[33]  T. Poggio,et al.  Predicting the visual world: silence is golden , 1999, Nature Neuroscience.

[34]  Marios Belk,et al.  Influences of Users' Cognitive Strategies on Graphical Password Composition , 2017, CHI Extended Abstracts.

[35]  J. Duncan.  Converging levels of analysis in the cognitive neuroscience of visual attention. , 1998, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[36]  M. Hayhoe,et al.  In what ways do eye movements contribute to everyday activities? , 2001, Vision Research.

[37]  Antonio Torralba,et al.  Contextual guidance of eye movements and attention in real-world scenes: the role of global features in object search. , 2006, Psychological review.

[38]  M. Land.  Eye movements and the control of actions in everyday life , 2006, Progress in Retinal and Eye Research.

[39]  Andrew T. Duchowski,et al.  Gaze Transition Entropy , 2015, TAP.

[40]  Paul Wilson,et al.  Obsessive-compulsive symptoms and attentional bias: An eye-tracking methodology. , 2016, Journal of behavior therapy and experimental psychiatry.

[41]  Jing Hu,et al.  Information Entropy As a Basic Building Block of Complexity Theory , 2013, Entropy.

[42]  J. Ben Atkinson,et al.  Modeling and Analysis of Stochastic Systems , 1996 .

[43]  P. Whitney,et al.  Sleep Deprivation Diminishes Attentional Control Effectiveness and Impairs Flexible Adaptation to Changing Conditions , 2017, Scientific Reports.

[44]  Peter König,et al.  Feeling good, searching the bad: Positive priming increases attention and memory for negative stimuli on webpages , 2015, Comput. Hum. Behav..

[45]  P. König,et al.  Developmental Changes in Natural Viewing Behavior: Bottom-Up and Top-Down Differences between Children, Young Adults and Older Adults , 2010, Front. Psychology.

[46]  J. Henderson.  Gaze Control as Prediction , 2017, Trends in Cognitive Sciences.

[47]  T. Lincoln,et al.  Attentional biases to threat in social anxiety disorder: time to focus our attention elsewhere? , 2018, Anxiety, stress, and coping.

[48]  Ksenija Marinkovic,et al.  When the brain changes its mind: Oscillatory dynamics of conflict processing and response switching in a flanker task during alcohol challenge , 2018, PloS one.

[49]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[50]  Clayton Hickey,et al.  A temporal dependency account of attentional inhibition in oculomotor control , 2017, NeuroImage.

[51]  S. Glasauer,et al.  Cerebellar contribution to saccades and gaze holding: a modeling approach. , 2003, Annals of the New York Academy of Sciences.

[52]  R. J. Hall,et al.  Action-state orientation: construct validity of a revised measure and its relationship to work-related variables. , 2000, The Journal of applied psychology.

[53]  Jeffrey W. Cooney,et al.  Top-down suppression deficit underlies working memory impairment in normal aging , 2005, Nature Neuroscience.

[54]  T. Foulsham.  Eye movements and their functions in everyday tasks , 2015, Eye.

[55]  B. Tatler,et al.  Looking and Acting: Vision and eye movements in natural behaviour , 2009 .

[56]  T. Foulsham,et al.  What can saliency models predict about eye movements? Spatial and sequential aspects of fixations during encoding and recognition. , 2008, Journal of vision.

[57]  Con Stough,et al.  Drivers' visual scanning impairment under the influences of alcohol and distraction: a literature review. , 2015, Current drug abuse reviews.

[58]  Karl J. Friston.  Learning and inference in the brain , 2003, Neural Networks.

[59]  Katherine M. Armstrong,et al.  Visuomotor Origins of Covert Spatial Attention , 2003, Neuron.

[60]  M. Kimble,et al.  The impact of hypervigilance: evidence for a forward feedback loop. , 2014, Journal of anxiety disorders.

[61]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[62]  Mel Slater,et al.  An Analysis of Eye Scanpath Entropy in a Progressively Forming Virtual Environment , 2009, PRESENCE: Teleoperators and Virtual Environments.

[63]  Nicola C. Anderson,et al.  The influence of personality on social attention , 2014 .

[64]  Roozbeh Behroozmand,et al.  Premotor neural correlates of predictive motor timing for speech production and hand movement: evidence for a temporal predictive code in the motor system , 2017, Experimental Brain Research.

[65]  Michael F. Land,et al.  From eye movements to actions: how batsmen hit the ball , 2000, Nature Neuroscience.

[66]  Taiyong Bi,et al.  The structural and functional correlates of the efficiency in fearful face detection , 2017, Neuropsychologia.

[67]  Daniela Balslev,et al.  Role of Oculoproprioception in Coding the Locus of Attention , 2016, Journal of Cognitive Neuroscience.

[68]  Soonjo Hwang,et al.  Neurodevelopmental changes in the responsiveness of systems involved in top down attention and emotional responding , 2014, Neuropsychologia.

[69]  M. Corbetta,et al.  Neural Systems for Visual Orienting and Their Relationships to Spatial Working Memory , 2002, Journal of Cognitive Neuroscience.

[70]  S. Yantis,et al.  Selective visual attention and perceptual coherence , 2006, Trends in Cognitive Sciences.

[71]  L. L. Di Stasi,et al.  Gaze entropy reflects surgical task load , 2016, Surgical Endoscopy.

[72]  Heinrich H. Bülthoff,et al.  Effects of anxiety and cognitive load on instrument scanning behavior in a flight simulation , 2016, 2016 IEEE Second Workshop on Eye Tracking and Visualization (ETVIS).

[73]  R. Desimone,et al.  Neural mechanisms of selective visual attention. , 1995, Annual review of neuroscience.

[74]  G. Pourtois,et al.  What is Bottom-Up and What is Top-Down in Predictive Coding? , 2013, Front. Psychol..

[75]  Alan C Bovik,et al.  Contrast statistics for foveated visual systems: fixation selection by minimizing contrast entropy. , 2005, Journal of the Optical Society of America. A, Optics, image science, and vision.

[76]  P. Cavanagh,et al.  Predictive remapping of attention across eye movements , 2011, Nature Neuroscience.

[77]  Karl J. Friston,et al.  Working memory, attention, and salience in active inference , 2017, Scientific Reports.

[78]  S R Ellis,et al.  Statistical Dependency in Visual Scanning , 1986, Human factors.

[79]  Gabriela Ciuperca,et al.  On the estimation of the entropy rate of finite Markov chains , 2005 .

[80]  U. Büttner,et al.  Fastigial oculomotor region and the control of foveation during fixation. , 2010, Journal of neurophysiology.

[81]  J. Theeuwes,et al.  Top-down versus bottom-up attentional control: a failed theoretical dichotomy , 2012, Trends in Cognitive Sciences.

[82]  Werner Graf,et al.  The control of eye movements by the cerebellar nuclei: polysynaptic projections from the fastigial, interpositus posterior and dentate nuclei to lateral rectus motoneurons in primates , 2017, The European journal of neuroscience.

[83]  Xin Chen,et al.  Real-world visual search is dominated by top-down guidance , 2006, Vision Research.

[84]  Itamar S. Grunfeld,et al.  Mixed selectivity encoding and action selection in the prefrontal cortex during threat assessment , 2018, Current Opinion in Neurobiology.

[85]  Peter König,et al.  Overt Attention and Context Factors: The Impact of Repeated Presentations, Image Type, and Individual Motivation , 2011, PloS one.

[86]  T. Schenk,et al.  The Premotor theory of attention: Time to move on? , 2012, Neuropsychologia.

[87]  Karl J. Friston,et al.  The active construction of the visual world , 2017, Neuropsychologia.

[88]  Frank Schieber,et al.  Visual Entropy Metric Reveals Differences in Drivers' Eye Gaze Complexity across Variations in Age and Subsidiary Task Load , 2008 .

[89]  Grigori Yourganov,et al.  Observers' cognitive states modulate how visual inputs relate to gaze control. , 2016, Journal of experimental psychology. Human perception and performance.

[90]  Nikolaos M. Avouris,et al.  On Implicit Elicitation of Cognitive Strategies using Gaze Transition Entropies in Pattern Recognition Tasks , 2017, CHI Extended Abstracts.

[91]  Preeti Verghese,et al.  Where to look next? Eye movements reduce local uncertainty. , 2007, Journal of vision.

[92]  Jillian H. Fecteau,et al.  Salience, relevance, and firing: a priority map for target selection , 2006, Trends in Cognitive Sciences.

[93]  L. Downey,et al.  Stationary gaze entropy predicts lane departure events in sleep-deprived drivers , 2018, Scientific Reports.

[94]  S. Tobimatsu,et al.  Connectopathy in Autism Spectrum Disorders: A Review of Evidence from Visual Evoked Potentials and Diffusion Magnetic Resonance Imaging , 2017, Front. Neurosci..

[95]  Thierry Baccino,et al.  Methods for comparing scanpaths and saliency maps: strengths and weaknesses , 2012, Behavior Research Methods.

[96]  Tirin Moore,et al.  Prefrontal contributions to visual selective attention. , 2013, Annual review of neuroscience.

[97]  Geert J. P. Savelsbergh,et al.  Perceptual-cognitive skill and the in situ performance of soccer players , 2016, Quarterly journal of experimental psychology.

[98]  Otto Lappi,et al.  Eye movements in the wild: Oculomotor control, gaze behavior & frames of reference , 2016, Neuroscience & Biobehavioral Reviews.

[99]  M. Land,et al.  The Roles of Vision and Eye Movements in the Control of Activities of Daily Living , 1998, Perception.

[100]  Peter König,et al.  Emotions' Impact on Viewing Behavior under Natural Conditions , 2013, PloS one.

[101]  Mary Hayhoe,et al.  Control of attention and gaze in complex environments. , 2006, Journal of vision.

[102]  Gabriel Kreiman,et al.  There's Waldo! A Normalization Model of Visual Search Predicts Single-Trial Human Fixations in an Object Search Task. , 2014, Cerebral cortex.

[103]  M. Corbetta,et al.  A Common Network of Functional Areas for Attention and Eye Movements , 1998, Neuron.

[104]  Magali Seassau,et al.  Saccadic eye movements as markers of schizophrenia spectrum: Exploration in at-risk mental states , 2017, Schizophrenia Research.

[105]  B. Scassellati,et al.  Autism, eye-tracking, entropy , 2008, 2008 7th IEEE International Conference on Development and Learning.

[106]  Tuan D. Pham,et al.  A regularity statistic for images , 2018 .

[107]  David R. Bull,et al.  Fixation Prediction and Visual Priority Maps for Biped Locomotion , 2018, IEEE Transactions on Cybernetics.

[108]  Andreas Dengel,et al.  Entropy based transition analysis of eye movement on physics representational competence , 2016, UbiComp Adjunct.

[109]  Benjamin W Tatler,et al.  The central fixation bias in scene viewing: selecting an optimal viewing position independently of motor biases and image feature distributions. , 2007, Journal of vision.

[110]  L. L. Di Stasi,et al.  Gaze-based Technology as a Tool for Surgical Skills Assessment and Training in Urology. , 2017, Urology.

[111]  M. Goldberg,et al.  Attention, intention, and priority in the parietal lobe. , 2010, Annual review of neuroscience.

[112]  Jonathan Allsop,et al.  Flying under pressure: Effects of anxiety on attention and gaze behavior in aviation , 2014 .

[113]  Iain D. Gilchrist,et al.  Visual correlates of fixation selection: effects of scale and time , 2005, Vision Research.

[114]  Andrew T. Duchowski,et al.  Entropy-based statistical analysis of eye movement transitions , 2014, ETRA.

[115]  J. Henderson.  Human gaze control during real-world scene perception , 2003, Trends in Cognitive Sciences.

[116]  James R. Brockmole,et al.  LATEST: A Model of Saccadic Decisions in Space and Time , 2017, Psychological review.

[117]  K. Grill-Spector,et al.  The human visual cortex. , 2004, Annual review of neuroscience.

[118]  Mikko Nuutinen,et al.  Did You Notice It?—How Can We Predict the Subjective Detection of Video Quality Changes From Eye Movements? , 2017, IEEE Journal of Selected Topics in Signal Processing.

[119]  George L. Malcolm,et al.  Combining top-down processes to guide eye movements during real-world scene search. , 2010, Journal of vision.

[120]  A. Pfefferbaum,et al.  Dissociation of preparatory attention and response monitoring maturation during adolescence , 2014, Clinical Neurophysiology.

[121]  Alan Kennedy,et al.  Book Review: Eye Tracking: A Comprehensive Guide to Methods and Measures , 2016, Quarterly journal of experimental psychology.

[122]  S. Treue.  Visual attention: the where, what, how and why of saliency , 2003, Current Opinion in Neurobiology.

[123]  Karl J. Friston,et al.  Predictions not commands: active inference in the motor system , 2012, Brain Structure and Function.

[124]  L. L. Di Stasi,et al.  Quantifying the cognitive cost of laparo-endoscopic single-site surgeries: Gaze-based indices. , 2017, Applied ergonomics.

[125]  Ignace Hooge,et al.  Scan path entropy and arrow plots: capturing scanning behavior of multiple observers , 2013, Front. Psychol..

[126]  Jennifer A. Mangels,et al.  Predictive Codes for Forthcoming Perception in the Frontal Cortex , 2006, Science.

[127]  R. Olsen,et al.  The relationship between delay period eye movements and visuospatial memory. , 2014, Journal of vision.

[128]  J. Bisley.  The neural basis of visual attention , 2011, The Journal of physiology.

[129]  Romain Quentin,et al.  Frontal eye field, where art thou? Anatomy, function, and non-invasive manipulation of frontal regions involved in eye movements and associated cognitive operations , 2014, Front. Integr. Neurosci..

[130]  Philippe A. Chouinard,et al.  Overlapping neural circuits for visual attention and eye movements in the human cerebellum , 2015, Neuropsychologia.

[131]  Eric I. Knudsen,et al.  Descending Control of Neural Bias and Selectivity in a Spatial Attention Network: Rules and Mechanisms , 2014, Neuron.

[132]  Göte Nyman,et al.  How do we watch images? A case of change detection and quality estimation , 2012, Electronic Imaging.

[133]  Antoine Coutrot,et al.  Scanpath modeling and classification with hidden Markov models , 2017, Behavior Research Methods.

[134]  M. Walker,et al.  The sleep-deprived human brain , 2017, Nature Reviews Neuroscience.

[135]  Gregory J. Zelinsky,et al.  A Model of the Superior Colliculus Predicts Fixation Locations during Scene Viewing and Visual Search , 2017, The Journal of Neuroscience.

[136]  John Foster Dulles.  Did You Notice … , 2005 .

[137]  Kai-Christoph Hamborg,et al.  Time-Dependent Changes In Viewing Behavior On Similarly Structured Web Pages , 2011 .

[138]  René M. Müri,et al.  The role of the right frontal eye field in overt visual attention deployment as assessed by free visual exploration , 2015, Neuropsychologia.

[139]  A. Mohanty,et al.  Top-down and bottom-up factors in threat-related perception and attention in anxiety , 2016, Biological Psychology.

[140]  Rolf Zon,et al.  A Coherent Impression of the Pilots' Situation Awareness: Studying Relevant Human Factors Tools , 2011 .

[141]  Eero P. Simoncelli,et al.  Natural image statistics and neural representation. , 2001, Annual review of neuroscience.

[142]  Oliver C. Ibe,et al.  Markov processes for stochastic modeling , 2008 .

[143]  N. Lam,et al.  An Evaluation of Fractal Methods for Characterizing Image Complexity , 2002 .

[144]  Ilpo Kojo,et al.  Using hidden Markov model to uncover processing states from eye movements in information search tasks , 2008, Cognitive Systems Research.

[145]  D. Ballard,et al.  Eye guidance in natural vision: reinterpreting salience. , 2011, Journal of vision.