How Context Influences Our Perception of Emotional Faces: A Behavioral Study on the Kuleshov Effect

Facial expressions are of major importance in understanding the mental and emotional states of others. So far, most studies on the perception and comprehension of emotions have used isolated facial expressions as stimuli; for example, photographs of actors displaying facial expressions corresponding to one of the so called ‘basic emotions.’ However, our real experience during social interactions is different: facial expressions of emotion are mostly perceived in a wider context, constituted by body language, the surrounding environment, and our beliefs and expectations. Already in the early twentieth century, the Russian filmmaker Lev Kuleshov argued that such context, established by intermediate shots of strong emotional content, could significantly change our interpretation of facial expressions in film. Prior experiments have shown behavioral effects pointing in this direction, but have only used static images as stimuli. Our study used a more ecological design with participants watching film sequences of neutral faces, crosscut with scenes of strong emotional content (evoking happiness or fear, plus neutral stimuli as a baseline condition). The task was to rate the emotion displayed by a target person’s face in terms of valence, arousal, and category. Results clearly demonstrated the presence of a significant effect in terms of both valence and arousal in the fear condition only. Moreover, participants tended to categorize the target person’s neutral facial expression choosing the emotion category congruent with the preceding context. Our results highlight the context-sensitivity of emotions and the importance of studying them under ecologically valid conditions.

[1]  B. Brewster A Scene at the ‘Movies’ , 1982 .

[2]  Noël Carroll,et al.  Toward a Theory of Point-of-View Editing: Communication, Emotion, and the Movies , 1993 .

[3]  C. Spielberger,et al.  Manual for the State-Trait Anxiety Inventory , 1970 .

[4]  Tobias Brosch,et al.  Faces in Context: A Review and Systematization of Contextual Influences on Affective Face Processing , 2012, Front. Psychology.

[5]  J. Russell The psychology of facial expression: Reading emotions from and into faces: Resurrecting a dimensional-contextual perspective , 1997 .

[6]  C. Izard Innate and universal facial expressions: evidence from developmental and cross-cultural research. , 1994, Psychological bulletin.

[7]  H. Hecht,et al.  The Auditory Kuleshov Effect: Multisensory Integration in Movie Editing , 2017, Perception.

[8]  Mark H. Davis,et al.  A Multidimensional Approach to Individual Differences in Empathy , 1980 .

[9]  Kristen A. Lindquist,et al.  Opinion TRENDS in Cognitive Sciences Vol.11 No.8 Cognitive-emotional interactions Language as context for the , 2022 .

[10]  Annmarie MacNamara,et al.  ERPs and the Study of Emotion , 2011 .

[11]  Ran R. Hassin,et al.  Angry, Disgusted, or Afraid? , 2008, Psychological science.

[12]  A. Calder,et al.  Personality influences the neural responses to viewing facial expressions of emotion , 2011, Philosophical Transactions of the Royal Society B: Biological Sciences.

[13]  Per Persson,et al.  Understanding Cinema: A Psychological Theory of Moving Imagery , 2003 .

[14]  P. Ekman,et al.  Constants across cultures in the face and emotion. , 1971, Journal of personality and social psychology.

[15]  P. Lang,et al.  Psychometric description of some specific-fear questionnaires. , 1974 .

[16]  B. Mesquita,et al.  Context in Emotion Perception , 2011 .

[17]  H. Meeren,et al.  Beyond the face: exploring rapid influences of context on face processing. , 2006, Progress in brain research.

[18]  Matthias J. Wieser,et al.  Why are you looking like that? How the context influences evaluation and processing of human faces , 2012, Social cognitive and affective neuroscience.

[19]  Stephen Prince,et al.  The Kuleshov Effect: Recreating the Classic Experiment , 1992 .

[20]  C. Carver,et al.  Behavioral inhibition, behavioral activation, and affective responses to impending reward and punishment: The BIS/BAS Scales , 1994 .

[21]  A. Ohman,et al.  Fear appears fast: temporal course of startle reflex potentiation in animal fearful subjects. , 1999, Psychophysiology.

[22]  M. Bradley,et al.  Activation of the visual cortex in motivated attention. , 2003, Behavioral neuroscience.

[23]  M. Bradley,et al.  Motivated attention: Affect, activation, and action. , 1997 .

[24]  A. J. Fridlund Human Facial Expression: An Evolutionary View , 1994 .

[25]  P. Ekman An argument for basic emotions , 1992 .

[26]  J. M. Carroll,et al.  Do facial expressions signal specific emotions? Judging emotion from the face in context. , 1996, Journal of personality and social psychology.

[27]  Moshe Bar,et al.  See it with feeling: affective predictions during object perception , 2009, Philosophical Transactions of the Royal Society B: Biological Sciences.

[28]  R. Bagby,et al.  The twenty-item Toronto Alexithymia Scale--I. Item selection and cross-validation of the factor structure. , 1994, Journal of psychosomatic research.

[29]  Anna Cabak Rédei,et al.  Does the Kuleshov Effect Really Exist? Revisiting a Classic Film Experiment on Facial Expressions and Emotional Contexts , 2013, Perception.

[30]  B. Salt Statistical Style Analysis of Motion Pictures , 1974 .

[31]  Kaitlin L. Brunick,et al.  Quicker, faster, darker: Changes in Hollywood film over 75 years , 2011, i-Perception.

[32]  J. Russell A circumplex model of affect. , 1980 .

[33]  P. Ekman Facial expression and emotion. , 1993, The American psychologist.

[34]  Edward Branigan Point of view in the cinema , 1979 .

[35]  M. Bradley,et al.  Affective startle modulation in anticipation and perception. , 2001, Psychophysiology.

[36]  M. Bradley,et al.  Looking at pictures: affective, facial, visceral, and behavioral reactions. , 1993, Psychophysiology.

[37]  M. Bradley,et al.  Emotion and motivation II: sex differences in picture processing. , 2001, Emotion.

[38]  Christian Büchel,et al.  Processing of facial expressions and their significance for the observer in subregions of the human amygdala , 2011, NeuroImage.

[39]  M. Bradley,et al.  The International Affective Picture System (IAPS) in the study of emotion and attention. , 2007 .

[40]  Bodo Winter,et al.  Linear models and linear mixed effects models in R with linguistic applications , 2013, ArXiv.

[41]  H. Meeren,et al.  Rapid perceptual integration of facial expression and emotional body language. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[42]  Andrew L. Alexander,et al.  Contextual Modulation of Amygdala Responsivity to Surprised Faces , 2004, Journal of Cognitive Neuroscience.

[43]  M. Bradley,et al.  Orienting and Emotional Perception: Facilitation, Attenuation, and Interference , 2012, Front. Psychology.

[44]  M. Bradley,et al.  Emotion and motivation I: defensive and appetitive reactions in picture processing. , 2001, Emotion.

[45]  R. Dolan,et al.  The Kuleshov Effect: the influence of contextual framing on emotional attributions. , 2006, Social cognitive and affective neuroscience.

[46]  M. Bradley,et al.  Emotion and the motivational brain , 2010, Biological Psychology.