Hidden Markov model analysis reveals the advantage of analytic 1 eye movement patterns in face recognition across cultures 2

27 It remains controversial whether culture modulates eye movement behavior in 28 face recognition. Inconsistent results have been reported regarding whether cultural 29 differences in eye movement patterns exist, whether these differences affect 30 recognition performance, and whether participants use similar eye movement patterns 31 when viewing faces from different ethnicities. These inconsistencies may be due to 32 substantial individual differences in eye movement patterns within a cultural group. 33 Here we addressed this issue by conducting individual-level eye movement data 34 analysis using hidden Markov models (HMMs). Each individual’s eye movements 35 were modeled with an HMM. We clustered the individual HMMs according to their 36 similarities and discovered three common patterns in both Asian and Caucasian 37 participants: holistic (looking mostly at the face center), left-eye-biased analytic 38 (looking mostly at the two individual eyes in addition to the face center with a slight 39 bias to the left eye), and right-eye-based analytic (looking mostly at the right eye in 40 addition to the face center ).The frequency of participants adopting the three patterns 41 did not differ significantly between Asians and Caucasians, suggesting little 42 modulation from culture. Significantly more participants (75%) showed similar eye 43 movement patterns when viewing ownand other-race faces than different patterns. 44 Most importantly, participants with left-eye-biased analytic patterns performed 45 significantly better than those using either holistic or right-eye-biased analytic 46 patterns. These results suggest that active retrieval of facial feature information 47 through an analytic eye movement pattern may be optimal for face recognition 48 regardless of culture. 49 50

[1]  S. M. Luria,et al.  Comparison of Eye Movements over Faces in Photographic Positives and Negatives , 2013, Perception.

[2]  Matthew F. Peterson,et al.  Individual Differences in Eye Movements During Face Identification Reflect Observer-Specific Optimal Points of Fixation , 2013, Psychological science.

[3]  Reinhold Kliegl,et al.  The generation of secondary saccades without postsaccadic visual feedback. , 2013, Journal of vision.

[4]  Matthew F. Peterson,et al.  Looking just below the eyes is optimal across face recognition tasks , 2012, Proceedings of the National Academy of Sciences.

[5]  P. Quinn,et al.  Adults Scan Own- and Other-Race Faces Differently , 2012, PloS one.

[6]  Janet H. Hsiao,et al.  The optimal viewing position in face recognition. , 2012, Journal of vision.

[7]  Sébastien Miellet,et al.  iMap: a novel method for statistical fixation mapping of eye movement data , 2011, Behavior research methods.

[8]  Chi Fang,et al.  Computers do better than experts matching faces in a large population , 2010, 9th IEEE International Conference on Cognitive Informatics (ICCI'10).

[9]  R. Caldara,et al.  Inverting Faces Does Not Abolish Cultural Diversity in Eye Movements , 2010, Perception.

[10]  R. Caldara,et al.  Putting Culture Under the ‘Spotlight’ Reveals Universal Information Use for Face Recognition , 2010, PloS one.

[11]  R. Caldara,et al.  Culture Shapes Eye Movements for Visually Homogeneous Objects , 2010, Front. Psychology.

[12]  Megan H. Papesh,et al.  Deficits in cross-race face learning: insights from eye movements and pupillometry. , 2009, Journal of experimental psychology. Learning, memory, and cognition.

[13]  T. F. Gross Own-Ethnicity Bias in the Recognition of Black, East Asian, Hispanic, and White Faces , 2009 .

[14]  M. Bindemann,et al.  Viewpoint and center of gravity affect eye movements to human faces. , 2009, Journal of vision.

[15]  G. Cottrell,et al.  Two Fixations Suffice in Face Recognition , 2008, Psychological science.

[16]  G. Rhodes,et al.  An own-race advantage for components as well as configurations in face recognition , 2008, Cognition.

[17]  Gillian Rhodes,et al.  Contact, configural coding and the other-race effect in face recognition. , 2008, British journal of psychology.

[18]  Radford M. Neal Pattern Recognition and Machine Learning , 2007, Technometrics.

[19]  R. Nisbett,et al.  Culture and the Physical Environment , 2006, Psychological science.

[20]  N. Scott-Samuel,et al.  Idiosyncratic initiation of saccadic face exploration in humans , 2005, Vision Research.

[21]  Julie E. Boland,et al.  Cultural variation in eye movements during scene perception. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[22]  N. Brady,et al.  Perceptual asymmetries are preserved in memory for highly familiar faces of self and friend , 2005, Brain and Cognition.

[23]  Karen Gasper,et al.  Attending to the Big Picture: Mood and Global Versus Local Processing of Visual Information , 2002, Psychological science.

[24]  Frédéric Gosselin,et al.  Bubbles: a technique to reveal the use of information in recognition tasks , 2001, Vision Research.

[25]  J. Brigham,et al.  Thirty years of investigating the own-race bias in memory for faces: A meta-analytic review , 2001 .

[26]  Roberto Cabeza,et al.  Features are Also Important: Contributions of Featural and Configural Processing to Face Recognition , 2000, Psychological science.

[27]  Brian Mullen,et al.  Cross-Racial Facial Identification: A Social Cognitive Integration , 1992 .

[28]  P Bakan,et al.  Visual asymmetry in perception of faces. , 1973, Neuropsychologia.

[29]  Tin-yim Chuk,et al.  Understanding eye movements in face processing using hidden Markov models , 2016 .

[30]  Tim Chuk,et al.  Mind reading: Discovering individual preferences from eye movements using switching hidden Markov models , 2016, CogSci.

[31]  Tim Chuk,et al.  Hidden Markov model analysis reveals better eye movement strategies in face recognition , 2015, CogSci.

[32]  Anil K. Jain,et al.  Component-Based Representation in Automated Face Recognition , 2013, IEEE Transactions on Information Forensics and Security.

[33]  O. Mimura [Eye movements]. , 1992, Nippon Ganka Gakkai zasshi.