Is having similar eye movement patterns during face learning and recognition beneficial for recognition performance? Evidence from hidden Markov modeling

HighlightsMore people showed holistic scan patterns during face learning than recognition.Analytic patterns were associated with better recognition performance.About 40% of the participants used different patterns for learning and recognition.Pattern similarity between learning and recognition did not predict performance. ABSTRACT The hidden Markov model (HMM)‐based approach for eye movement analysis is able to reflect individual differences in both spatial and temporal aspects of eye movements. Here we used this approach to understand the relationship between eye movements during face learning and recognition, and its association with recognition performance. We discovered holistic (i.e., mainly looking at the face center) and analytic (i.e., specifically looking at the two eyes in addition to the face center) patterns during both learning and recognition. Although for both learning and recognition, participants who adopted analytic patterns had better recognition performance than those with holistic patterns, a significant positive correlation between the likelihood of participants’ patterns being classified as analytic and their recognition performance was only observed during recognition. Significantly more participants adopted holistic patterns during learning than recognition. Interestingly, about 40% of the participants used different patterns between learning and recognition, and among them 90% switched their patterns from holistic at learning to analytic at recognition. In contrast to the scan path theory, which posits that eye movements during learning have to be recapitulated during recognition for the recognition to be successful, participants who used the same or different patterns during learning and recognition did not differ in recognition performance. The similarity between their learning and recognition eye movement patterns also did not correlate with their recognition performance. These findings suggested that perceptuomotor memory elicited by eye movement patterns during learning does not play an important role in recognition. In contrast, the retrieval of diagnostic information for recognition, such as the eyes for face recognition, is a better predictor for recognition performance.

[1]  Anil K. Jain,et al.  Component-Based Representation in Automated Face Recognition , 2013, IEEE Transactions on Information Forensics and Security.

[2]  G. Rhodes,et al.  An own-race advantage for components as well as configurations in face recognition , 2008, Cognition.

[3]  J. Antrobus,et al.  EYE MOVEMENTS ACCOMPANYING DAYDREAMING, VISUAL IMAGERY, AND THOUGHT SUPPRESSION. , 1964, Journal of abnormal psychology.

[4]  K. Nakayama,et al.  The Cambridge Face Memory Test: Results for neurologically intact individuals and an investigation of its validity using inverted face stimuli and prosopagnosic participants , 2006, Neuropsychologia.

[5]  John M Henderson,et al.  Stable individual differences across images in human saccadic eye movements. , 2008, Canadian journal of experimental psychology = Revue canadienne de psychologie experimentale.

[6]  P. Schyns,et al.  Local Jekyll and Global Hyde : The Dual Identity of Face Identification , 2011 .

[7]  Galit Yovel,et al.  Faces in the eye of the beholder: unique and stable eye scanning patterns of individual observers. , 2014, Journal of vision.

[8]  G. E. Edmonds,et al.  Direction of gaze effects on early face processing: eyes-only versus full faces. , 2001, Brain research. Cognitive brain research.

[9]  Rob Jenkins,et al.  Arguments Against a Configural Processing Account of Familiar Face Recognition , 2015, Perspectives on psychological science : a journal of the Association for Psychological Science.

[10]  V. Bruce,et al.  Local and Relational Aspects of Face Distinctiveness , 1998, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[11]  Chi Fang,et al.  Computers do better than experts matching faces in a large population , 2010, 9th IEEE International Conference on Cognitive Informatics (ICCI'10).

[12]  N. Charness,et al.  The perceptual aspect of skilled performance in chess: Evidence from eye movements , 2001, Memory & cognition.

[13]  Bruno Laeng,et al.  Eye scanpaths during visual imagery reenact those of perception of the same visual scene , 2002, Cogn. Sci..

[14]  Roberto Cabeza,et al.  Features are Also Important: Contributions of Featural and Configural Processing to Face Recognition , 2000, Psychological science.

[15]  Matthew F. Peterson,et al.  Individual Differences in Eye Movements During Face Identification Reflect Observer-Specific Optimal Points of Fixation , 2013, Psychological science.

[16]  Nicola C. Anderson,et al.  Curious eyes: Individual differences in personality predict eye movement behavior in scene-viewing , 2012, Cognition.

[17]  M. Tovée,et al.  An Introduction to the Visual System , 1997 .

[18]  Guillaume A. Rousselet,et al.  Robust Correlation Analyses: False Positive and Power Validation Using a New Open Source Matlab Toolbox , 2012, Front. Psychology.

[19]  Tim Chuk,et al.  Caucasian and Asian eye movement patterns in face recognition: A computational exploration using hidden Markov models , 2014 .

[20]  Kathy Conklin,et al.  Adding more fuel to the fire: An eye-tracking study of idiom processing by native and non-native speakers , 2011 .

[21]  Tim Chuk,et al.  Hidden Markov model analysis reveals the advantage of analytic eye movement patterns in face recognition across cultures , 2017, Cognition.

[22]  R. Caldara,et al.  Putting Culture Under the ‘Spotlight’ Reveals Universal Information Use for Face Recognition , 2010, PloS one.

[23]  Frédéric Gosselin,et al.  Bubbles: a technique to reveal the use of information in recognition tasks , 2001, Vision Research.

[24]  J. Henderson.  Human gaze control during real-world scene perception , 2003, Trends in Cognitive Sciences.

[25]  J. Bartlett,et al.  Inversion and Configuration of Faces , 1993, Cognitive Psychology.

[26]  Megan H. Papesh,et al.  Deficits in cross-race face learning: insights from eye movements and pupillometry. , 2009, Journal of experimental psychology. Learning, memory, and cognition.

[27]  Carrick C. Williams,et al.  Eye movements are functional during face learning , 2005, Memory & cognition.

[28]  T. Allison,et al.  Electrophysiological Studies of Face Perception in Humans , 1996, Journal of Cognitive Neuroscience.

[29]  Margot J. Taylor,et al.  Eyes first! Eye processing develops before face processing in children , 2001, Neuroreport.

[30]  A. Mike Burton,et al.  Tolerance for distorted faces: Challenges to a configural processing account of familiar face recognition , 2014, Cognition.

[31]  Johanna K. Kaakinen,et al.  Individual Differences in Reading to Summarize Expository Text: Evidence From Eye Fixation Patterns , 2002 .

[32]  Antoni B. Chan,et al.  Clustering hidden Markov models with variational HEM , 2012, J. Mach. Learn. Res..

[33]  K. Rayner.  Eye movements in reading and information processing: 20 years of research. , 1998, Psychological bulletin.

[34]  Paul R. Cohen,et al.  Using Dynamic Time Warping to Bootstrap HMM-Based Clustering of Time Series , 2001, Sequence Learning.

[35]  Rachael E. Jack,et al.  Culture Shapes How We Look at Faces , 2008, PloS one.

[36]  Michael B. Lewis,et al.  Reducing the own-race bias in face recognition by attentional shift using fixation crosses preceding the lower half of a face , 2011 .

[37]  Michael J. Spivey,et al.  Eye Movements and Problem Solving , 2003, Psychological science.

[38]  L. Stark,et al.  Scanpaths in Eye Movements during Pattern Perception , 1971, Science.

[39]  Rachael E. Jack,et al.  Social Experience Does Not Abolish Cultural Diversity in Eye Movements , 2011, Front. Psychology.

[40]  W. Helsen,et al.  The eyes as a mirror of our thoughts: Quantification of motor imagery of goal-directed movements through eye movement registration , 2008, Behavioural Brain Research.

[41]  Hirohisa Kishino,et al.  Incorporating gene-specific variation when inferring and evaluating optimal evolutionary tree topologies from multilocus sequence data. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[42]  Jason J S Barton,et al.  Information Processing during Face Recognition: The Effects of Familiarity, Inversion, and Morphing on Scanning Fixations , 2006, Perception.

[43]  Reinhold Kliegl,et al.  The generation of secondary saccades without postsaccadic visual feedback. , 2013, Journal of vision.

[44]  S. Thorpe,et al.  Speed of processing in the human visual system , 1996, Nature.

[45]  M. Herzog,et al.  How color, regularity, and good Gestalt determine backward masking. , 2014, Journal of vision.

[46]  Y. Anzai,et al.  Pattern Recognition & Machine Learning , 2016 .

[47]  Tim Chuk,et al.  Understanding eye movements in face recognition using hidden Markov models. , 2014, Journal of vision.

[48]  B. Ripley,et al.  Pattern Recognition , 1968, Nature.

[49]  Geoffrey Underwood,et al.  Eye Movements in a Simple Music Reading Task: A Study of Expert and Novice Musicians , 1998 .

[50]  L. Stark,et al.  Scanpaths in saccadic eye movements while viewing and recognizing patterns. , 1971, Vision research.

[51]  Garrison W. Cottrell,et al.  Humans have idiosyncratic and task-specific scanpaths for judging faces , 2015, Vision Research.

[52]  V. Bruce,et al.  Do the eyes have it? Cues to the direction of social attention , 2000, Trends in Cognitive Sciences.

[53]  G. Cottrell,et al.  Two Fixations Suffice in Face Recognition , 2008, Psychological science.

[54]  Vladimir Arčabić,et al.  Econometric Modelling with Time Series: Specification, Estimation and Testing, Vance Martin, Stan Hurn and David Harris , 2016 .

[55]  Stan Hurn,et al.  Econometric Modelling with Time Series , 2013 .

[56]  Takahiro Sekiguchi,et al.  Individual differences in face memory and eye fixation patterns during face learning. , 2011, Acta psychologica.

[57]  Frédéric Gosselin,et al.  Spatio-temporal dynamics of face recognition in a flash: it's in the eyes , 2004, Cogn. Sci..

[58]  A. L. Yarbus.  Eye Movements During Perception of Complex Objects , 1967 .

[59]  David P. Crabb,et al.  Are Certain Eye Movement Patterns Linked To Better Face Recognition Performance In Patients With Central Glaucomatous Visual Field Loss , 2012 .