Dynamic Emotional Faces Generalise Better to a New Expression but not to a New View

Prior research based on static images has found limited improvement for recognising previously learnt faces in a new expression after several different facial expressions of these faces had been shown during the learning session. We investigated whether non-rigid motion of facial expression facilitates the learning process. In Experiment 1, participants remembered faces that were either presented in short video clips or still images. To assess the effect of exposure to expression variation, each face was either learnt through a single expression or three different expressions. Experiment 2 examined whether learning faces in video clips could generalise more effectively to a new view. The results show that faces learnt from video clips generalised effectively to a new expression with exposure to a single expression, whereas faces learnt from stills showed poorer generalisation with exposure to either single or three expressions. However, although superior recognition performance was demonstrated for faces learnt through video clips, dynamic facial expression did not create better transfer of learning to faces tested in a new view. The data thus fail to support the hypothesis that non-rigid motion enhances viewpoint invariance. These findings reveal both benefits and limitations of exposures to moving expressions for expression-invariant face recognition.

[1]  Wenfeng Chen,et al.  Transfer between pose and expression training in face recognition , 2009, Vision Research.

[2]  Zhe Wang,et al.  On the facilitative effects of face motion on face recognition and its development , 2014, Front. Psychol..

[3]  Lijun Yin,et al.  A high-resolution 3D dynamic facial expression database , 2008, 2008 8th IEEE International Conference on Automatic Face & Gesture Recognition.

[4]  V. Bruce,et al.  The role of dynamic information in the recognition of unfamiliar faces , 1998, Memory & cognition.

[5]  Hervé Abdi,et al.  Learning the Moves: The Effect of Familiarity and Facial Motion on Person Recognition across Large Changes in Viewing Format , 2006, Perception.

[6]  A. O'Toole,et al.  Recognizing moving faces: a psychological and neural synthesis , 2002, Trends in Cognitive Sciences.

[7]  V. Bruce Changing faces: visual and non-visual coding processes in face recognition. , 1982, British journal of psychology.

[8]  Jeesun Kim,et al.  The Movement Advantage in Famous and Unfamiliar Faces: A Comparison of Point-Light Displays and Shape-Normalised Avatar Stimuli , 2013, Perception.

[9]  Heinrich H. Bülthoff,et al.  View-Based Recognition of Faces in Man and Machine: Re-Visiting Inter-Extra-Ortho , 2002, Biologically Motivated Computer Vision.

[10]  David White,et al.  Variation in Photos of the Same Face Drives Improvements in Identity Verification , 2015, Perception.

[11]  Olivier Pascalis,et al.  Own- and other-race face identity recognition in children: the effects of pose and feature composition. , 2014, Developmental psychology.

[12]  V. Bruce,et al.  The role of movement in the recognition of famous faces , 1999, Memory & cognition.

[13]  K. Lander,et al.  Exploring the Motion Advantage: Evaluating the Contribution of Familiarity and Differences in Facial Motion , 2017, Quarterly journal of experimental psychology.

[14]  Alan Johnston,et al.  Motion as a cue for viewpoint invariance , 2005 .

[15]  G. Pike,et al.  Recognizing moving faces: The relative contribution of motion and perspective view information. , 1997 .

[16]  Z. Kourtzi,et al.  A Matching Advantage for Dynamic Human Faces , 2002, Perception.

[17]  C. Liu,et al.  Effects of exposure to facial expression variation in face learning and recognition , 2014, Psychological research.

[18]  A. Burton,et al.  Redesigning photo-ID to improve unfamiliar face matching performance. , 2014, Journal of experimental psychology. Applied.

[19]  Chang Hong Liu,et al.  VRVision: A new tool for the display of 3-D images in behavioral research , 2005, Behavior research methods.

[20]  Alberta Ipser,et al.  Exemplar Variance Supports Robust Learning of Facial Identity , 2015, Journal of experimental psychology. Human perception and performance.

[21]  K. Lander,et al.  Independence of face identity and expression processing: exploring the role of motion , 2015, Front. Psychol..

[22]  Avi Chaudhuri,et al.  Reassessing the 3/4 view effect in face recognition , 2002, Cognition.

[23]  Jie Sui,et al.  Transfer between pose and illumination training in face recognition. , 2009, Journal of experimental psychology. Human perception and performance.

[24]  Janine Spencer,et al.  Categorizing identity from facial motion , 2015, Quarterly journal of experimental psychology.

[25]  P. Hancock,et al.  Robust representations for face recognition: The power of averages , 2005, Cognitive Psychology.

[26]  Dirk C. Keene Acknowledgements , 1975 .