A grey area: how does image hue affect unfamiliar face matching?

The role of image colour in face identification has received little attention in research despite the importance of identifying people from photographs in identity documents (IDs). Here, in two experiments, we investigated whether colour congruency of two photographs, shown side by side, affects face-matching accuracy. Participants were presented with two images from the Models Face Matching Test (experiment 1) and a newly devised matching task incorporating female faces (experiment 2) and asked to decide whether they show the same person or two different people. The photographs were either both in colour, both in grayscale, or mixed (one in grayscale and one in colour). Participants were more likely to accept a pair of images as a “match”, i.e. same person, in the mixed condition, regardless of whether the identity of the pair was the same or not. This demonstrates a clear shift in bias between “congruent” colour conditions and the mixed trials. In addition, there was a small decline in accuracy in the mixed condition, relative to when the images were presented in colour. Our study provides the first evidence that the hue of document photographs matters for face-matching performance. This finding has important implications for the design and regulation of photographic ID worldwide.

[1]  Ahmed M. Megreya,et al.  Matching Face Images Taken on the Same Day or Months Apart: the Limitations of Photo ID , 2013 .

[2]  Ahmed M. Megreya,et al.  Hits and false positives in face matching: A familiarity-based dissociation , 2007, Perception & psychophysics.

[3]  H. Ellis,et al.  Identification of Familiar and Unfamiliar Faces from Internal and External Features: Some Implications for Theories of Face Recognition , 1979, Perception.

[4]  Rob Jenkins,et al.  Face Recognition by Metropolitan Police Super-Recognisers , 2016, PloS one.

[5]  A. Burton,et al.  Unfamiliar face matching: Pairs out-perform individuals and provide a route to training. , 2015, British journal of psychology.

[6]  A. Mike Burton,et al.  Face learning with multiple images leads to fast acquisition of familiarity for specific individuals , 2016, Quarterly journal of experimental psychology.

[7]  Hilde van der Togt,et al.  Publisher's Note , 2003, J. Netw. Comput. Appl..

[8]  Markus Bindemann,et al.  The Role of Color in Human Face Detection , 2009, Cogn. Sci..

[9]  Neil A. Macmillan,et al.  Detection Theory: A User's Guide , 1991 .

[10]  Claus-Christian Carbon,et al.  An Easy Game for Frauds? Effects of Professional Experience and Time Pressure on Passport-Matching Performance , 2017, Journal of experimental psychology. Applied.

[11]  J. Bittner,et al.  Cognitive Research : Principles and Implications , 2017 .

[12]  R. Kramer,et al.  Disguising Superman: How Glasses Affect Unfamiliar Face Matching , 2016 .

[13]  Swami Sankaranarayanan,et al.  Face recognition accuracy of forensic examiners, superrecognizers, and face recognition algorithms , 2018, Proceedings of the National Academy of Sciences.

[14]  Matthew Q. Hill,et al.  Perceptual expertise in forensic facial image comparison , 2015, Proceedings of the Royal Society B: Biological Sciences.

[15]  M. Tarr,et al.  Gender Recognition of Human Faces Using Color , 2008, Psychological science.

[16]  D. Calic.  From the laboratory to the real world : Evaluating the impact of impostors, expertise and individual differences on human face matching performance. , 2013 .

[17]  Ahmed M Megreya,et al.  Matching faces to photographs: poor performance in eyewitness memory (without the memory). , 2008, Journal of experimental psychology. Applied.

[18]  Wendy L. Braje,et al.  Illumination effects in face recognition , 1998, Psychobiology.

[19]  G. Pike,et al.  When Seeing should not be Believing: Photographs, Credit Cards and Fraud , 1997 .

[20]  Sarah Bate,et al.  Solving the Border Control Problem: Evidence of Enhanced Face Matching in Individuals with Extraordinary Face Recognition Skills , 2016, PloS one.

[21]  Markus Bindemann,et al.  The Effect of Feedback on Face‐Matching Accuracy , 2013 .

[22]  K. Petersson,et al.  The role of color information on object recognition: a review and meta-analysis. , 2011, Acta psychologica.

[23]  A. Burton,et al.  Smiles in face matching: Idiosyncratic information revealed through a smile improves unfamiliar face matching performance , 2018, British journal of psychology.

[24]  R. Kemp,et al.  Improving Unfamiliar Face Matching by Masking the External Facial Features , 2016 .

[25]  K. Lander,et al.  Matching Faces with Emotional Expressions , 2011, Front. Psychology.

[26]  Kay Ritchie,et al.  Learning faces from variability , 2015, Journal of vision.

[27]  Megan H. Papesh,et al.  Infrequent identity mismatches are frequently undetected , 2014, Attention, perception & psychophysics.

[28]  Matthew C Fysh,et al.  The Kent Face Matching Test , 2018, British journal of psychology.

[29]  David White,et al.  Feedback training for facial image comparison , 2014, Psychonomic bulletin & review.

[30]  A. Burton,et al.  Passport Officers’ Errors in Face Matching , 2014, PloS one.

[31]  R Kemp,et al.  Perception and Recognition of Normal and Negative Faces: The Role of Shape from Shading and Pigmentation Cues , 1996, Perception.

[32]  Naphtali Abudarham,et al.  Reverse engineering the face space: Discovering the critical features for face identification. , 2014, Journal of vision.

[33]  P. Sinha,et al.  Contribution of Color to Face Recognition , 2002, Perception.

[34]  R. Johnston,et al.  Motivational Incentives Improve Unfamiliar Face Matching Accuracy , 2013 .

[35]  Markus Bindemann,et al.  Feature instructions improve face-matching accuracy , 2018, PloS one.

[36]  Peter J. B. Hancock,et al.  Super‐recognisers in Action: Evidence from Face‐matching and Face Memory Tasks , 2015, Applied cognitive psychology.

[37]  A. Burton,et al.  The Glasgow Face Matching Test , 2010, Behavior research methods.