Rational Inference of Beliefs and Desires From Emotional Expressions

Abstract We investigated people's ability to infer others’ mental states from their emotional reactions, manipulating whether agents wanted, expected, and caused an outcome. Participants recovered agents’ desires throughout. When the agent observed, but did not cause the outcome, participants’ ability to recover the agent's beliefs depended on the evidence they got (i.e., her reaction only to the actual outcome or to both the expected and actual outcomes; Experiments 1 and 2). When the agent caused the event, participants’ judgments also depended on the probability of the action (Experiments 3 and 4); when actions were improbable given the mental states, people failed to recover the agent's beliefs even when they saw her react to both the anticipated and actual outcomes. A Bayesian model captured human performance throughout (rs ≥ .95), consistent with the proposal that people rationally integrate information about others’ actions and emotional reactions to infer their unobservable mental states.

[1]  Michael C. Frank,et al.  Predicting Pragmatic Reasoning in Language Games , 2012, Science.

[2]  Paul L. Harris,et al.  Insight into the Time Course of Emotion among Western and Chinese Children. , 1985 .

[3]  R. Saxe,et al.  Disruption of the right temporoparietal junction with transcranial magnetic stimulation reduces the role of beliefs in moral judgments , 2010, Proceedings of the National Academy of Sciences.

[4]  Noah D. Goodman,et al.  Nonliteral understanding of number words , 2014, Proceedings of the National Academy of Sciences.

[5]  Mark Meerum Terwogt,et al.  Children's understanding of mental states as causes of emotions , 2005 .

[6]  R. Baillargeon,et al.  False-belief understanding in infants , 2010, Trends in Cognitive Sciences.

[7]  Charles Kemp,et al.  How to Grow a Mind: Statistics, Structure, and Abstraction , 2011, Science.

[8]  Ladan Shams,et al.  Bayesian Priors Are Encoded Independently from Likelihoods in Human Multisensory Perception Ladan Shams Introduction , 2022 .

[9]  L. Schulz,et al.  Inferring Beliefs and Desires From Emotional Reactions to Anticipated and Observed Events , 2017, Child development.

[10]  Noah D. Goodman,et al.  Knowledge and implicature: Modeling language understanding as social cognition , 2012, CogSci.

[11]  J. Tenenbaum,et al.  Opinion TRENDS in Cognitive Sciences Vol.10 No.7 July 2006 Special Issue: Probabilistic models of cognition Theory-based Bayesian models of inductive learning and reasoning , 2022 .

[12]  K. Scherer,et al.  Emotion Inferences from Vocal Expression Correlate Across Languages and Cultures , 2001 .

[13]  Michael C. Frank,et al.  Inferring word meanings by assuming that speakers are informative , 2014, Cognitive Psychology.

[14]  Alison Gopnik,et al.  Theoretical explanations of children's understanding of the mind , 1991 .

[15]  Rebecca Saxe,et al.  Neural Representations of Emotion Are Organized around Abstract Event Features , 2015, Current Biology.

[16]  J. C. Masters,et al.  Children's consensual knowledge about the experiential determinants of emotion. , 1980, Journal of personality and social psychology.

[17]  Andrew Ortony,et al.  The Cognitive Structure of Emotions , 1988 .

[18]  M. Ernst,et al.  Humans integrate visual and haptic information in a statistically optimal fashion , 2002, Nature.

[19]  Peter W Battaglia,et al.  Humans Trade Off Viewing Time and Movement Duration to Improve Visuomotor Accuracy in a Fast Reaching Task , 2007, The Journal of Neuroscience.

[20]  Hillary Anger Elfenbein,et al.  Toward a dialect theory: cultural differences in the expression and recognition of posed facial expressions. , 2007, Emotion.

[21]  T. Wheatley,et al.  Music and movement share a dynamic structure that supports universal expressions of emotion , 2012, Proceedings of the National Academy of Sciences.

[22]  H. Wellman,et al.  Meta-analysis of theory-of-mind development: the truth about false belief. , 2001, Child development.

[23]  Kamini Rege,et al.  Music and Movement , 1992, Nursing standard (Royal College of Nursing (Great Britain) : 1987).

[24]  Josef Perner,et al.  Pleased and surprised: Children's cognitive theory of emotion , 1991 .

[25]  Susanne A. Denham,et al.  Socialization of Preschoolers' Emotion Understanding. , 1994 .

[26]  P. Ekman,et al.  Constants across cultures in the face and emotion. , 1971, Journal of personality and social psychology.

[27]  K. Scherer,et al.  Emotion expression in body action and posture. , 2012, Emotion.

[28]  Joel Bradmetz,et al.  Is Little Red Riding Hood afraid of her grandmother? Cognitive vs. emotional response to a false belief , 1999 .

[29]  L. F. Barrett Was Darwin Wrong About Emotional Expressions? , 2011 .

[30]  Baxter S. Eaves,et al.  Epistemic trust: modeling children's reasoning about others' knowledge and intent. , 2012, Developmental science.

[31]  J. Gnepp,et al.  Children's use of situational information to infer emotion: Understanding emotionally equivocal situations. , 1987 .

[32]  J. Zaki,et al.  Cue Integration , 2013, Perspectives on psychological science : a journal of the Association for Psychological Science.

[33]  K. Scherer,et al.  Human Emotion Experiences Can Be Predicted on Theoretical Grounds: Evidence from Verbal Labeling , 2013, PloS one.

[34]  H. Wellman,et al.  Preschoolers' understanding of the link between thinking and feeling: cognitive cuing and emotional change. , 1997, Child development.

[35]  S.J.J. Smith,et al.  Empirical Methods for Artificial Intelligence , 1995 .

[36]  R. Lazarus Progress on a cognitive-motivational-relational theory of emotion. , 1991, The American psychologist.

[37]  Konrad Paul Kording,et al.  Bayesian integration in sensorimotor learning , 2004, Nature.

[38]  Ian A Apperly,et al.  Do humans have two systems to track beliefs and belief-like states? , 2009, Psychological review.

[39]  B. Mesquita,et al.  Context in Emotion Perception , 2011 .

[40]  Paul L. Harris,et al.  Do young children misunderstand their own emotions? , 2011 .

[41]  H. Wellman,et al.  Thinking about the past: early knowledge about links between prior experience, thinking, and emotion. , 2001, Child development.

[42]  F. Scharnowski,et al.  Long-lasting modulation of feature integration by transcranial magnetic stimulation. , 2009, Journal of vision.

[43]  E. Spelke,et al.  Preverbal infants identify emotional reactions that are incongruent with goal outcomes , 2014, Cognition.

[44]  B. Sodian,et al.  Children's understanding of moral emotions. , 1988, Child development.

[45]  Yong Tao,et al.  Compound facial expressions of emotion , 2014, Proceedings of the National Academy of Sciences.

[46]  A. Woodward,et al.  Infants use attention but not emotions to predict others' actions. , 2010, Infant behavior & development.

[47]  K. Scherer,et al.  Appraisal processes in emotion: Theory, methods, research. , 2001 .

[48]  J. Russell,et al.  Differentiation in preschooler's categories of emotion. , 2010, Emotion.

[49]  K. Doya,et al.  A unifying computational framework for motor control and social interaction. , 2003, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[50]  Jamil Zaki,et al.  Affective cognition: Exploring lay theories of emotion , 2015, Cognition.

[51]  J. Tenenbaum,et al.  Special issue on “Probabilistic models of cognition , 2022 .

[52]  Paul L. Harris,et al.  Children's Understanding of the Link between Situation and Emotion. , 1983 .

[53]  D. Matsumoto,et al.  Spontaneous facial expressions of emotion of congenitally and noncongenitally blind individuals. , 2009, Journal of personality and social psychology.

[54]  J. Russell,et al.  Children acquire emotion categories gradually , 2008 .

[55]  C. Izard Innate and universal facial expressions: evidence from developmental and cross-cultural research. , 1994, Psychological bulletin.

[56]  Chris L. Baker,et al.  Rational quantitative attribution of beliefs, desires and percepts in human mentalizing , 2017, Nature Human Behaviour.

[57]  Michael C. Frank,et al.  PSYCHOLOGICAL SCIENCE Research Article Using Speakers ’ Referential Intentions to Model Early Cross-Situational Word Learning , 2022 .

[58]  S. Baron-Cohen Do people with autism understand what causes emotion? , 1991, Child development.

[59]  Mark Meerum Terwogt,et al.  Children's Knowledge of the Situations that Provoke Emotion , 1987 .

[60]  Henry M. Wellman,et al.  Young children's reasoning about beliefs , 1988, Cognition.

[61]  L. F. Barrett,et al.  Handbook of Emotions , 1993 .

[62]  Paul L. Harris,et al.  Knowledge of the link between emotion and memory among normal and maladjusted boys. , 1983 .

[63]  Jessica L. Tracy,et al.  Expression of emotion , 2016 .

[64]  Nicola Yuill,et al.  Young children's coordination of motive and outcome in judgements of satisfaction and morality , 1984 .

[65]  P. Ekman An argument for basic emotions , 1992 .

[66]  Craig A. Smith,et al.  Appraisal components, core relational themes, and the emotions , 1993 .

[67]  Christopher G. Lucas,et al.  The Child as Econometrician: A Rational Model of Preference Understanding in Children , 2014, PloS one.

[68]  Michael C. Frank,et al.  Learning From Others , 2012, Perspectives on psychological science : a journal of the Association for Psychological Science.

[69]  Noah D. Goodman,et al.  The mentalistic basis of core social cognition: experiments in preverbal infants and a computational model. , 2013, Developmental science.

[70]  H. Meeren,et al.  Rapid perceptual integration of facial expression and emotional body language. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[71]  A. Gopnik,et al.  Early reasoning about desires: evidence from 14- and 18-month-olds. , 1997, Developmental psychology.

[72]  Jamil Zaki,et al.  PSYCHOLOGICAL SCIENCE Research Article It Takes Two The Interpersonal Nature of Empathic Accuracy , 2022 .

[73]  K. Scherer,et al.  Appraisal Theories of Emotion: State of the Art and Future Development , 2013 .

[74]  J. Bachorowski,et al.  Sounds of Emotion , 2003 .

[75]  G. Csibra,et al.  Teleological reasoning in infancy: the naı̈ve theory of rational action , 2003, Trends in Cognitive Sciences.

[76]  Edward H. Adelson,et al.  Motion illusions as optimal percepts , 2002, Nature Neuroscience.

[77]  J. Gnepp,et al.  Children's social sensitivity: Inferring emotions from conflicting cues. , 1983 .

[78]  Paul L. Harris,et al.  A lag between understanding false belief and emotion attribution in young children: Relationships with linguistic ability and mothers' mental‐state language , 2004 .

[79]  H. Wellman,et al.  From simple desires to ordinary beliefs: The early development of everyday psychology , 1990, Cognition.

[80]  Nancy L. Stein,et al.  The Causal Organisation of Emotional Knowledge: A Developmental Study , 1989 .

[81]  J. M. Carroll,et al.  Do facial expressions signal specific emotions? Judging emotion from the face in context. , 1996, Journal of personality and social psychology.

[82]  H. Wellman,et al.  Mind and emotion: Children's understanding of the emotional consequences of beliefs and desires , 1991 .

[83]  Chris L. Baker,et al.  Action understanding as inverse planning , 2009, Cognition.

[84]  David R. Olson,et al.  Trick or treat: Children's understanding of surprise , 1993 .

[85]  S. Carey,et al.  Understanding other minds: linking developmental psychology and functional neuroimaging. , 2004, Annual review of psychology.

[86]  P. Harris,et al.  Young Children's Theory of Mind and Emotion , 1989 .

[87]  J. Russell Core affect and the psychological construction of emotion. , 2003, Psychological review.

[88]  H. Wellman,et al.  Young children's understanding of perception, desire, and emotion. , 2000, Child development.

[89]  B. Sokol,et al.  The development of moral emotion expectancies and the happy victimizer phenomenon: A critical review of theory and application. , 2008 .

[90]  Nancy L. Stein,et al.  Children'S Knowledge of Events: A Causal Analysis of Story Structure1 , 1981 .

[91]  H. Wellman Making Minds: How Theory of Mind Develops , 2014 .

[92]  K. Scherer,et al.  The World of Emotions is not Two-Dimensional , 2007, Psychological science.

[93]  Johnny Fontaine,et al.  Cognitive structure of emotion terms in Indonesia and The Netherlands , 2002 .

[94]  Ted Ruffman,et al.  The belief-based emotion of surprise: the case for a lag in understanding relative to false belief , 1996 .

[95]  A. Ortony,et al.  Psychological Construction in the OCC Model of Emotion , 2013, Emotion review : journal of the International Society for Research on Emotion.

[96]  P. Harris,et al.  Emotion comprehension between 3 and 11 years: Developmental periods and hierarchical organization , 2004 .

[97]  Richard A. Fabes,et al.  Preschoolers' Attributions of the Situational Determinants of Others' Naturally Occurring Emotions , 1988 .

[98]  K. Lagattuta,et al.  When you shouldn't do what you want to do: young children's understanding of desires, rules, and emotions. , 2005, Child development.

[99]  James A. Russell,et al.  The fear gasping face as a threat display in a Melanesian society , 2016, Proceedings of the National Academy of Sciences.