The recognition of mental states from dynamic and static facial expressions

The ability to recognize mental states from facial expressions is essential for effective social interaction. However, previous investigations of mental state recognition have used only static faces so the benefit of dynamic information for recognizing mental states remains to be determined. Experiment 1 found that dynamic faces produced higher levels of recognition accuracy than static faces, suggesting that the additional information contained within dynamic faces can facilitate mental state recognition. Experiment 2 explored the facial regions that are important for providing dynamic information in mental state displays. This involved using a new technique to freeze motion in a particular facial region (eyes, nose, mouth) so that this region was static while the remainder of the face was naturally moving. Findings showed that dynamic information in the eyes and the mouth was important and the region of influence depended on the mental state. Processes involved in mental state recognition are discussed.

[1]  Konstantin Stanislavsky,et al.  La formation de l'acteur , 1990 .

[2]  J. N. Bassili.  Facial motion in the perception of faces and of emotional expression. , 1978, Journal of experimental psychology. Human perception and performance.

[3]  Matthew Flatt,et al.  PsyScope: An interactive graphic system for designing and controlling experiments in the psychology laboratory using Macintosh computers , 1993 .

[4]  Vicki Bruce,et al.  Recognizing Famous Faces: Exploring the Benefits of Facial Motion , 2000 .

[5]  James J. Clark,et al.  Microsaccades as an overt measure of covert attention shifts , 2002, Vision Research.

[6]  Vicki Bruce,et al.  The role of motion in learning new faces , 2003 .

[7]  Sharon M. Thomas,et al.  Contributions of oral and extraoral facial movement to visual and audiovisual speech perception. , 2004, Journal of experimental psychology. Human perception and performance.

[8]  E Back.  Interpreting mental states from facial expressions : comparing participants with and without autism. , 2006 .

[9]  A J Shinkfield,et al.  Recognition of facial emotional expressions from moving and static displays by individuals with mental retardation. , 1999, American journal of mental retardation : AJMR.

[10]  A. Johnston,et al.  The Role of Movement in Face Recognition , 1997 .

[11]  Danielle Ropar,et al.  Do the eyes have it? Inferring mental states from animated faces in autism. , 2007, Child development.

[12]  J. Cohn,et al.  Deciphering the Enigmatic Face , 2005, Psychological science.

[13]  David Clark-Carter,et al.  Doing Quantitative Psychological Research: From Design To Report , 1997 .

[14]  Vicki Bruce,et al.  Dynamic properties influence the perception of facial , 2001 .

[15]  V. Bruce,et al.  The role of movement in the recognition of famous faces , 1999, Memory & cognition.

[16]  R. Adolphs,et al.  Impaired Recognition of Social Emotions following Amygdala Damage , 2002, Journal of Cognitive Neuroscience.

[17]  C. Deruelle,et al.  Motion and Emotion: A Novel Approach to the Study of Face Processing by Young Autistic Children , 2001, Journal of autism and developmental disorders.

[18]  G. Johansson.  Visual perception of biological motion and a model for its analysis , 1973 .

[19]  G. Pike,et al.  Recognizing moving faces: The relative contribution of motion and perspective view information. , 1997 .

[20]  Glyn W. Humphreys,et al.  Expression is computed separately from facial identity, and it is computed separately for moving and static faces: Neuropsychological evidence , 1993, Neuropsychologia.

[21]  T G F Gray,et al.  5 – COMPUTER SOFTWARE , 1992 .

[22]  K. Lander,et al.  Why are moving faces easier to recognize? , 2005, Visual Cognition.

[23]  Ralf Engbert,et al.  Microsaccades uncover the orientation of covert attention , 2003, Vision Research.

[24]  S. Baron-Cohen,et al.  Is There a "Language of the Eyes"? Evidence from Normal Adults, and Adults with Autism or Asperger Syndrome , 1997 .

[25]  R. Abrams,et al.  Motion Onset Captures Attention , 2003, Psychological science.

[26]  D. Berry.  What can a moving face tell us? , 1990, Journal of personality and social psychology.

[27]  D. Povinelli,et al.  Mindblindness. An Essay on Autism and Theory of Mind Simon Baron-Cohen 1995 , 1996, Trends in Neurosciences.

[28]  H. J. Jackson.  The Reading Mind , 2005 .

[29]  D. Simons,et al.  Moving and looming stimuli capture attention , 2003, Perception & psychophysics.

[30]  Simon Baron-Cohen,et al.  Reading the mind in the face: A cross-cultural and developmental study , 1996 .

[31]  P. Ekman,et al.  What the face reveals : basic and applied studies of spontaneous expression using the facial action coding system (FACS) , 2005 .

[32]  S. Baron-Cohen,et al.  The "Reading the Mind in the Eyes" Test revised version: a study with normal adults, and adults with Asperger syndrome or high-functioning autism. , 2001, Journal of child psychology and psychiatry, and allied disciplines.