Crowd Effects in Unfamiliar Face Matching

Summary: Psychological research shows that humans can not reliably match unfamiliar faces. This presents a practical problem, because identity verification processes in a variety of occupational settings depend on people to perform these tasks reliably. In this context, it is surprising that very few studies have attempted to improve human performance. Here, we investigate whether distributing face matching tasks across groups of individuals might help to solve this problem. Across four studies, we measure the accuracy of the ‘crowd’ on a standard test of face matching ability and find that aggregating individual responses produces substantial gains in matching accuracy. We discuss the practical implications of this result and also suggest ways in which this approach might be used to improve our understanding of face perception more generally. Copyright © 2013 John Wiley & Sons, Ltd.

[1]  F. Galton.  Vox Populi , 1907, Nature.

[2]  Alan D. Baddeley,et al.  On Training People to Recognize Faces , 1979 .

[3]  Neil A. Macmillan,et al.  Detection Theory: A User's Guide , 1991 .

[4]  G. Pike,et al.  When Seeing should not be Believing: Photographs, Credit Cards and Fraud , 1997 .

[5]  Paul Miller,et al.  Verification of face identities from images captured on video. , 1999 .

[6]  H Gu,et al.  The effects of averaging subjective probability estimates between and within judges. , 2000, Journal of experimental psychology. Applied.

[7]  V. Bruce,et al.  Matching identities of familiar and unfamiliar faces caught on CCTV images. , 2001, Journal of experimental psychology. Applied.

[8]  M. Pepe.  The Statistical Evaluation of Medical Tests for Classification and Prediction , 2003 .

[9]  N. Kerr,et al.  Group performance and decision making. , 2004, Annual review of psychology.

[10]  James Surowiecki.  The wisdom of crowds: Why the many are smarter than the few and how collective wisdom shapes business, economies, societies, and nations Doubleday Books. , 2004 .

[11]  Lu Hong,et al.  Groups of diverse problem solvers can outperform groups of high-ability problem solvers. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[12]  R. Johnston,et al.  Demonstrating how unfamiliar faces become familiar using a face matching task , 2005 .

[13]  Ahmed M. Megreya,et al.  Unfamiliar faces are not faces: Evidence from a matching task , 2006, Memory & cognition.

[14]  Alice J. O'Toole,et al.  Fusing Face-Verification Algorithms and Humans , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[15]  Alice J. O'Toole,et al.  Face Recognition Algorithms Surpass Humans Matching Faces Over Changes in Illumination , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  David J. Hand,et al.  ROC Curves for Continuous Data , 2009 .

[17]  K. Nakayama,et al.  Super-recognizers: People with extraordinary face recognition ability , 2009, Psychonomic bulletin & review.

[18]  A. Burton,et al.  The Glasgow Face Matching Test , 2010, Behavior research methods.

[19]  George W. Quinn,et al.  Distinguishing identical twins by face recognition , 2011, Face and Gesture 2011.

[20]  C. Champod,et al.  Cognitive issues in fingerprint analysis: inter- and intra-expert consistency and the effect of a 'target' comparison. , 2011, Forensic science international.

[21]  Richard James,et al.  Swarm intelligence in humans: diversity can trump ability , 2011, Animal Behaviour.

[22]  Mark H. Johnson,et al.  Oxford Handbook of Face Perception , 2011 .

[23]  Marcus A. Butavicius,et al.  The Role of the Human Operator in Image-Based Airport Security Technologies , 2011 .

[24]  Rob Jenkins,et al.  Unfamiliar Face Perception , 2011 .

[25]  Rob Jenkins,et al.  Stable face representations , 2011, Philosophical Transactions of the Royal Society B: Biological Sciences.

[26]  A. Burton,et al.  Variability in photos of the same face , 2011, Cognition.

[27]  Tim Rakow,et al.  Who can recognize unfamiliar faces? Individual differences and observer consistency in person identification. , 2012, Journal of experimental psychology. Applied.

[28]  Bruce A. Draper,et al.  The Good, the Bad, and the Ugly Face Challenge Problem , 2012, Image and Vision Computing.

[29]  I. Dror,et al.  The Impact of Human–Technology Cooperation and Distributed Cognition in Forensic Science: Biasing Effects of AFIS Contextual Information on Human Experts * , 2012, Journal of forensic sciences.

[30]  Alice J. O'Toole,et al.  Comparing face recognition algorithms to humans on challenging tasks , 2012, TAP.

[31]  Identifying the Bad Guy in a Lineup Using Confidence Judgments Under Deadline Pressure , 2012, Psychological science.

[32]  A. Burton,et al.  Redesigning photo-ID to improve unfamiliar face matching performance. , 2014, Journal of experimental psychology. Applied.

[33]  David White,et al.  Feedback training for facial image comparison , 2014, Psychonomic bulletin & review.