Identification of faces obscured by noise: comparison of an artificial neural network with human observers

Face identification is easily accomplished by humans but is an exceptionally difficult task for machine vision algorithms. This report is the first to directly compare the face identification performance of humans with that of an artificialneural network,Dystal, using digitized images of the faces of eight individuals in an eight-alternative forced-response paradigm. The test images differed from the training images in facial expression, head tilt and rotation, amount and correlation of added noise, and the presence of a stocking mask in some of the images. The images were deliberately not preprocessed by a feature extraction algorithm to avoid confoundingthe performance of Dystal with the performance of the feature extraction algorithm.While human observers outperform Dystal at low noise levels, at high levels of correlated noise Dystal outperforms human observers, who score just above the chance level. The greater sensitivity to noise exhibited by human observers is attributed to the local feature extra...

[1]  D. Alkon Calcium-mediated reduction of ionic currents: a biophysical memory trace. , 1984, Science.

[2]  Alex Pentland,et al.  Bayesian face recognition using deformable intensity surfaces , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[3]  Roberto Brunelli,et al.  Face Recognition: Features Versus Templates , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Harold W. Faw Recognition of unfamiliar faces: Procedural and methodological considerations , 1992 .

[5]  Terrence J. Sejnowski,et al.  Analysis of hidden units in a layered network trained to classify sonar targets , 1988, Neural Networks.

[6]  G. Sandini,et al.  The Role of High Spatial Frequencies in Face Perception , 1983, Perception.

[7]  Robert J. Baron,et al.  Mechanisms of Human Facial Recognition , 1981, Int. J. Man Mach. Stud..

[8]  Kim T. Blackwell,et al.  Biological plausibility of synaptic associative memory models , 1994, Neural Networks.

[9]  L. Finkel,et al.  Intermediate-Level Visual Representations and the Construction of Surface Perception , 1995, Journal of Cognitive Neuroscience.

[10]  R. Desimone Face-Selective Cells in the Temporal Cortex of Monkeys , 1991, Journal of Cognitive Neuroscience.

[11]  O. Lahav,et al.  Galaxies, Human Eyes, and Artificial Neural Networks , 1994, Science.

[12]  Roberto Brunelli,et al.  Person identification using multiple cues , 1995, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Rama Chellappa,et al.  Human and machine recognition of faces: a survey , 1995, Proc. IEEE.

[14]  M. Binder,et al.  Application of an artificial neural network in epiluminescence microscopy pattern analysis of pigmented skin lesions: a pilot study , 1994, The British journal of dermatology.

[15]  G. Orban,et al.  Selectivity of macaque inferior temporal neurons for partially occluded shapes , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[16]  Alice J. O'Toole,et al.  Connectionist models of face processing: A survey , 1994, Pattern Recognit..

[17]  G. Rhodes Looking at Faces: First-Order and Second-Order Features as Determinants of Facial Appearance , 1988, Perception.

[18]  K Tanaka,et al.  Neuronal mechanisms of object recognition. , 1993, Science.

[19]  H. Wilson,et al.  Spatial frequency tuning of orientation selective units estimated by oblique masking , 1983, Vision Research.

[20]  Thomas P. Vogl,et al.  Dystal: a self-organizing ANN with pattern independent training time , 1992, [Proceedings 1992] IJCNN International Joint Conference on Neural Networks.

[21]  Donald Geman,et al.  Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Shinichi Tamura,et al.  Male/female identification from 8×6 very low resolution face images by neural network , 1996, Pattern Recognit..

[23]  Alice J. O'Toole,et al.  A physical system approach to recognition memory for spatially transformed faces , 1988, Neural Networks.

[24]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[25]  S J McKelvie Confidence and Accuracy in Facial Memory: Further Evidence for the Optimality Hypothesis , 1993, Perceptual and motor skills.

[26]  Jane A. Braun,et al.  Order of feature recognition in familiar and unfamiliar faces , 1990, Brain and Cognition.

[27]  Kyle J. Myers,et al.  Model observers for assessment of image quality , 1993 .