What the human face tells the human mind: some challenges for the robot-human interface

The human face serves a variety of different communicative functions in social interaction. The face mediates person identification, the perception of emotional expressions and lipreading. Perceiving the direction of social attention, and facial attractiveness, also affects interpersonal behaviour. This paper reviews these different uses made of facial information, and considers their computational demands. The possible link between the perception of faces and deeper levels of social understanding is emphasized through a discussion of developmental deficits affecting social cognition. Finally, the implications for the development of communication between robots and humans are discussed. It is concluded that it could be useful both for robots to understand human faces, and also to display buman-like facial gestures themselves.

[1]  T Landis,et al.  Face recognition and lipreading. A neurological dissociation. , 1986, Brain : a journal of neurology.

[2]  Q. Summerfield.  Some preliminaries to a comprehensive account of audio-visual speech perception. , 1987 .

[3]  I. W. R. Bushneil,et al.  Neonatal recognition of the mother's face , 1989 .

[4]  A. Cowey,et al.  Sensitivity to eye gaze in prosopagnosic patients and monkeys with superior temporal sulcus ablation , 1990, Neuropsychologia.

[5]  A. Young,et al.  Perceptual categories and the computation of “grandmother” , 1991 .

[6]  A. M. Burton,et al.  Sex Discrimination: How Do We Tell the Difference between Male and Female Faces? , 1993, Perception.

[7]  W. S. Condon.  The Relation of Interactional Synchrony to Cognitive and Emotional Processes , 1981 .

[8]  V. Bruce.  Influences of Familiarity on the Processing of Faces , 1986, Perception.

[9]  Q. Summerfield,et al.  Lipreading and audio-visual speech perception. , 1992, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[10]  A. M. Burton,et al.  I recognize your face but I can't remember your name: a simple explanation? , 1992, British journal of psychology.

[11]  A. Young,et al.  Matching familiar and unfamiliar faces on identity and expression , 1986, Psychological research.

[12]  U. Bellugi,et al.  Neuropsychological, neurological, and neuroanatomical profile of Williams syndrome. , 2005, American journal of medical genetics. Supplement.

[13]  T. J. Stonham,et al.  Practical Face Recognition and Verification with Wisard , 1986 .

[14]  V Bruce,et al.  Modelling face recognition. , 1992, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[15]  S. Baron-Cohen,et al.  Does the autistic child have a “theory of mind” ? , 1985, Cognition.

[16]  D Terzopoulos,et al.  The computer synthesis of expressive faces. , 1992, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[17]  A. Young,et al.  Understanding face recognition. , 1986, British journal of psychology.

[18]  F. Heider,et al.  An experimental study of apparent behavior , 1944 .

[19]  R. Stephenson.  A and V , 1962, The British journal of ophthalmology.

[20]  A. Cowey,et al.  Proceedings of a Royal Society discussion meeting on Processing the facial image , 1992 .

[21]  L Sirovich,et al.  Low-dimensional procedure for the characterization of human faces. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[22]  Richard J. Brown.  Neuropsychology Mental Structure , 1989 .

[23]  P. Ekman,et al.  The Repertoire of Nonverbal Behavior: Categories, Origins, Usage, and Coding , 1969 .

[24]  J. Siegel,et al.  Stressful life events and use of physician services among the elderly: the moderating role of pet ownership. , 1990, Journal of personality and social psychology.

[25]  T. Field,et al.  Discrimination and imitation of facial expressions by term and preterm neonates. , 1983 .

[26]  W. Yule,et al.  A cognitive and behavioural phenotype in Williams syndrome. , 1991, Journal of clinical and experimental neuropsychology.

[27]  H. Ellis.  Recognizing faces. , 1975, British journal of psychology.

[28]  P. Mundy,et al.  Defining the social deficits of autism: the contribution of non-verbal communication measures. , 1986, Journal of child psychology and psychiatry, and allied disciplines.

[29]  J. Bruner,et al.  The capacity for joint visual attention in the infant , 1975, Nature.

[30]  S. Carey.  Becoming a face expert. , 1992, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[31]  W. S. Condon,et al.  Neonate Movement Is Synchronized with Adult Speech: Interactional Participation and Language Acquisition , 1974, Science.

[32]  C. C. Goren,et al.  Visual following and pattern discrimination of face-like stimuli by newborn infants. , 1975, Pediatrics.

[33]  A. Dabbs.  The social psychology of facial appearance , 1989 .

[34]  Vicki Bruce,et al.  Processing Images of Faces , 1992 .

[35]  H. McGurk,et al.  Hearing lips and seeing voices , 1976, Nature.

[36]  J. Vroomen,et al.  Face recognition and lip-reading in autism , 1991 .

[37]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[38]  Geoffrey M. Stephenson,et al.  Eye‐contact in dyads: A test of the Independence Hypothesis , 1978 .

[39]  H. Yamada.  Visual Information for Categorizing Facial Expression of Emotions , 1993 .

[40]  P. Ekman,et al.  Constants across cultures in the face and emotion. , 1971, Journal of personality and social psychology.

[41]  G. Stephenson,et al.  INTERPERSONAL AND INTER-PARTY EXCHANGE: A LABORATORY SIMULATION OF AN INDUSTRIAL NEGOTIATION AT THE PLANT LEVEL , 1969 .

[42]  R. Campbell,et al.  FACE RECOGNITION AND LIPREADING , 1986 .

[43]  D I Perrett,et al.  Organization and functions of cells responsive to faces in the temporal cortex. , 1992, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[44]  C M Brickel,et al.  The therapeutic roles of cat mascots with a hospital-based geriatric population: a staff survey. , 1979, The Gerontologist.

[45]  A. Meltzoff,et al.  Imitation of Facial and Manual Gestures by Human Neonates , 1977, Science.

[46]  J Mullin,et al.  The Human Communication Research Centre dialogue database , 1992, Journal of Child Language.

[47]  A. Michotte.  The perception of causality , 1963 .

[48]  A. J. Mistlin,et al.  Neurones responsive to faces in the temporal cortex: studies of functional organization, sensitivity to identity and relation to perception. , 1984, Human neurobiology.

[49]  A. J. O'toole,et al.  Classifying faces by face and sex using an autoassociative memory trained for recognition , 1991 .

[50]  Suzanne K. Damarin,et al.  The second self: Computers and the human spirit , 1985 .

[51]  Mark H. Johnson,et al.  Biology and Cognitive Development: The Case of Face Recognition , 1993 .

[52]  Susan M. Widmayer,et al.  Developmental follow-up of infants delivered by Caesarean section and general anesthesia , 1980 .

[53]  Nichola. Rumsey,et al.  The Effect of Facial Disfigurement on the Proxemic Behavior of the General Public , 1982 .

[54]  Vicki Bruce,et al.  COMPUTER RECOGNITION OF FACES , 1989 .

[55]  R A Johnston,et al.  Understanding face recognition with an interactive activation model. , 1990, British journal of psychology.

[56]  R. Campbell,et al.  Hearing by eye : the psychology of lip-reading , 1988 .

[57]  D. Rutter,et al.  The Role of Visual Communication in Social Exchange , 1976 .

[58]  U. Frith.  Autism: Explaining the Enigma , 2005 .

[59]  C. Kleinke.  Gaze and eye contact: a research review. , 1986, Psychological bulletin.

[60]  A. Meltzoff,et al.  Integrating speech information across talkers, gender, and sensory modality: Female faces and male voices in the McGurk effect , 1991, Perception & psychophysics.

[61]  A. Cowey,et al.  The role of the 'face-cell' area in the discrimination and recognition of faces by monkeys. , 1992, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[62]  A. Anderson,et al.  The Effects of Visibility on Dialogue and Performance in a Cooperative Problem Solving Task , 1994 .

[63]  Simon Baron-Cohen,et al.  Perceptual role taking and protodeclarative pointing in autism , 1989 .

[64]  J. Haviland,et al.  The Induced Affect Response: 10-Week-Old Infants' Responses to Three Emotion Expressions. , 1987 .

[65]  John J. Magee,et al.  Categorical perception of facial expressions , 1992, Cognition.

[66]  A. Walker-Andrews.  Intermodal perception of expressive behaviors: Relation of eye and voice? , 1986 .

[67]  Ian Craw,et al.  Automatic extraction of face-features , 1987, Pattern Recognit. Lett..

[68]  A. M. Burton,et al.  What's the Difference between Men and Women? Evidence from Facial Measurement , 1993, Perception.