Communication in action: Planning and interpreting communicative demonstrations.

Theory of mind enables an observer to interpret others' behavior in terms of unobservable beliefs, desires, intentions, feelings, and expectations about the world. This also empowers the person whose behavior is being observed: By intelligently modifying her actions, she can influence the mental representations that an observer ascribes to her, and by extension, what the observer comes to believe about the world. That is, she can engage in intentionally communicative demonstrations. Here, we develop a computational account of generating and interpreting communicative demonstrations by explicitly distinguishing between two interacting types of planning. Typically, instrumental planning aims to control states of the environment, whereas belief-directed planning aims to influence an observer's mental representations. Our framework extends existing formal models of pragmatics and pedagogy to the setting of value-guided decision-making, captures how people modify their intentional behavior to show what they know about the reward or causal structure of an environment, and helps explain data on infant and child imitation in terms of literal versus pragmatic interpretation of adult demonstrators' actions. Additionally, our analysis of belief-directed intentionality and mentalizing sheds light on the sociocognitive mechanisms that underlie distinctly human forms of communication, culture, and sociality. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

[1]  Mark K. Ho,et al.  The value of abstraction , 2019, Current Opinion in Behavioral Sciences.

[2]  Joseph L. Austerweil,et al.  People Teach With Rewards and Punishments as Communication, Not Reinforcements , 2018, Journal of experimental psychology. General.

[3]  Ivana Konvalinka,et al.  The body talks: Sensorimotor communication and its brain and kinematic signatures. , 2019, Physics of life reviews.

[4]  Gregory S. Sullivan.  Meaning , 2019, Servant Leadership in Sport.

[5]  Tanya Behne,et al.  The Rationality of (Over)imitation , 2018, Perspectives on psychological science : a journal of the Association for Psychological Science.

[6]  C. Tennie,et al.  Is Overimitation a Uniquely Human Phenomenon? Insights From Human Children as Compared to Bonobos. , 2018, Child development.

[7]  David G. Rand,et al.  Signaling Emotion and Reason in Cooperation , 2017, Journal of experimental psychology. General.

[8]  Fiery Cushman,et al.  Effectively Learning from Pedagogical Demonstrations , 2018, CogSci.

[9]  Mark K. Ho,et al.  Social is special: A normative framework for teaching with and learning from evaluative feedback , 2017, Cognition.

[10]  Baxter S. Eaves,et al.  Parameterizing developmental changes in epistemic trust , 2017, Psychonomic bulletin & review.

[11]  Chris L. Baker,et al.  Rational quantitative attribution of beliefs, desires and percepts in human mentalizing , 2017, Nature Human Behaviour.

[12]  Michael C. Frank,et al.  "I won't lie, it wasn't amazing": Modeling polite indirect speech , 2017, CogSci.

[13]  Michael C. Frank,et al.  Review Pragmatic Language Interpretation as Probabilistic Inference , 2022 .

[14]  Matthew R Nassar,et al.  Taming the beast: extracting generalizable knowledge from computational models of cognition , 2016, Current Opinion in Behavioral Sciences.

[15]  Jessica B. Hamrick,et al.  psiTurk: An open-source framework for conducting replicable behavioral experiments online , 2016, Behavior research methods.

[16]  Thomas L. Griffiths,et al.  Faster Teaching via POMDP Planning , 2016, Cogn. Sci..

[17]  M. Tomasello,et al.  Two- and 3-year-olds integrate linguistic and pedagogical cues in guiding inductive generalization and exploration. , 2016, Journal of experimental child psychology.

[18]  David G. Rand,et al.  Third-party punishment as a costly signal of trustworthiness , 2016, Nature.

[19]  H. H. Clark.  Depicting as a method of communication. , 2016, Psychological review.

[20]  Martin A. Nowak,et al.  Uncalculating cooperation is used to signal trustworthiness , 2016, Proceedings of the National Academy of Sciences.

[21]  Ines Gloeckner,et al.  Relevance Communication And Cognition , 2016 .

[22]  Fiery Cushman,et al.  Showing versus doing: Teaching by demonstration , 2016, NIPS.

[23]  M. Tomasello,et al.  Young children use pedagogical cues to modulate the strength of normative inferences. , 2015, The British journal of developmental psychology.

[24]  Jamil Zaki,et al.  Affective cognition: Exploring lay theories of emotion , 2015, Cognition.

[25]  Joshua B. Tenenbaum,et al.  Children’s understanding of the costs and rewards underlying rational action , 2015, Cognition.

[26]  Peter Dayan,et al.  Monte Carlo Planning Method Estimates Planning Horizons during Interactive Social Exchange , 2015, PLoS Comput. Biol..

[27]  G. Csibra,et al.  Infants learn enduring functions of novel tools from action demonstrations. , 2015, Journal of experimental child psychology.

[28]  M. Nowak,et al.  Cooperate without looking: Why we care what people think and not just what they do , 2015, Proceedings of the National Academy of Sciences.

[29]  Noah D. Goodman,et al.  Nonliteral understanding of number words , 2014, Proceedings of the National Academy of Sciences.

[30]  Noah D. Goodman,et al.  A rational account of pedagogical reasoning: Teaching by, and learning from, examples , 2014, Cognitive Psychology.

[31]  S. Pauen,et al.  The role of social interaction and pedagogical cues for eliciting and reducing overimitation in preschoolers. , 2014, Journal of experimental child psychology.

[32]  付伶俐.  打磨Using Language,倡导新理念 , 2014 .

[33]  G. Csibra,et al.  Beyond rational imitation: learning arbitrary means actions from communicative demonstrations. , 2013, Journal of experimental child psychology.

[34]  Noah D. Goodman,et al.  The mentalistic basis of core social cognition: experiments in preverbal infants and a computational model. , 2013, Developmental science.

[35]  W. Przepiorka,et al.  Charitable Giving as a Signal of Trustworthiness: Disentangling the Signaling Benefits of Altruistic Acts , 2013, SSRN Electronic Journal.

[36]  E. Markman,et al.  Preschoolers use intentional and pedagogical cues to guide inductive inferences and exploration. , 2012, Child development.

[37]  Michael C. Frank,et al.  Predicting Pragmatic Reasoning in Language Games , 2012, Science.

[38]  Baxter S. Eaves,et al.  Epistemic trust: modeling children's reasoning about others' knowledge and intent. , 2012, Developmental science.

[39]  Susan Goldin-Meadow,et al.  A word in the hand: action, gesture and mental representation in humans and non-human primates , 2012, Philosophical Transactions of the Royal Society B: Biological Sciences.

[40]  Patrick Shafto,et al.  Unifying pedagogical reasoning and epistemic trust. , 2012, Advances in child development and behavior.

[41]  Kara D. Sage,et al.  Disentangling the Social and the Pedagogical in Infants' Learning about Tool‐Use , 2011 .

[42]  A. Gopnik,et al.  Children’s imitation of causal action sequences is influenced by statistical and pedagogical evidence , 2011, Cognition.

[43]  Leslie Pack Kaelbling,et al.  Bayesian Policy Search with Policy Priors , 2011, IJCAI.

[44]  Frank C Keil,et al.  The scope and limits of overimitation in the transmission of artefact culture , 2011, Philosophical Transactions of the Royal Society B: Biological Sciences.

[45]  Chris L. Baker,et al.  Action understanding as inverse planning , 2009, Cognition.

[46]  M. Botvinick,et al.  Hierarchically organized behavior and its neural foundations: A reinforcement learning perspective , 2009, Cognition.

[47]  G. Csibra,et al.  Sensitivity to communicative relevance tells young children what to imitate. , 2009, Developmental science.

[48]  Dan Sperber,et al.  The moral, epistemic, and mindreading components of children’s vigilance towards deception , 2009, Cognition.

[49]  M. Tomasello,et al.  Ratcheting up the ratchet: on the evolution of cumulative culture , 2009, Philosophical Transactions of the Royal Society B: Biological Sciences.

[50]  Lydia M. Hopper,et al.  Emulation, imitation, over-imitation and the scope of culture for child and chimpanzee , 2009, Philosophical Transactions of the Royal Society B: Biological Sciences.

[51]  G. Csibra,et al.  Natural pedagogy , 2009, Trends in Cognitive Sciences.

[52]  G. Ritchie,et al.  Signalling signalhood and the emergence of communication , 2008, Cognition.

[53]  Michael Franke,et al.  Signal to act : game theory in pragmatics , 2009 .

[54]  P. Dayan,et al.  Reinforcement learning: The Good, The Bad and The Ugly , 2008, Current Opinion in Neurobiology.

[55]  M. Tomasello.  Origins of human communication , 2008 .

[56]  R. Sorrentino,et al.  Handbook of motivation and cognition across cultures , 2008 .

[57]  B. Malle.  Chapter 12 – The Fundamental Tools, and Possibly Universals, of Human Social Cognition , 2008 .

[58]  G. Csibra,et al.  Action Anticipation Through Attribution of False Belief by 2-Year-Olds , 2007, Psychological science.

[59]  D. L. Mumme,et al.  Doing the right thing: infants' selection of actions to imitate from observed event sequences. , 2007, Child development.

[60]  Siegfried Dewitte,et al.  Altruistic Behavior as a Costly Signal of General Intelligence , 2006 .

[61]  H. H. Clark.  Coordinating with each other in a material world , 2005 .

[62]  M. Tomasello,et al.  Understanding and sharing intentions: The origins of cultural cognition , 2005, Behavioral and Brain Sciences.

[63]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[64]  Colin Camerer,et al.  A Cognitive Hierarchy Model of Games , 2004 .

[65]  Andrew W. Moore,et al.  Variable Resolution Discretization in Optimal Control , 2002, Machine Learning.

[66]  Benjamin Spector.  Scalar Implicatures: Exhaustivity and Gricean Reasoning , 2004 .

[67]  G. Csibra,et al.  Teleological reasoning in infancy: the naı̈ve theory of rational action , 2003, Trends in Cognitive Sciences.

[68]  K. Doya,et al.  A unifying computational framework for motor control and social interaction. , 2003, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[69]  Sridhar Mahadevan,et al.  Recent Advances in Hierarchical Reinforcement Learning , 2003, Discret. Event Dyn. Syst..

[70]  Dare A. Baldwin,et al.  Evidence for ‘motionese’: modifications in mothers’ infant-directed action , 2002 .

[71]  H. Gintis,et al.  Costly signaling and cooperation. , 2001, Journal of theoretical biology.

[72]  J. Tenenbaum,et al.  Generalization, similarity, and Bayesian inference. , 2001, The Behavioral and brain sciences.

[73]  S. Levinson.  Presumptive Meanings: The theory of generalized conversational implicature , 2001 .

[74]  Yishay Mansour,et al.  Policy Gradient Methods for Reinforcement Learning with Function Approximation , 1999, NIPS.

[75]  Leslie Pack Kaelbling,et al.  Planning and Acting in Partially Observable Stochastic Domains , 1998, Artif. Intell..

[76]  Z. Nadasdy,et al.  Taking the intentional stance at 12 months of age , 1995, Cognition.

[77]  H. J. Arnold.  Introduction to the Practice of Statistics , 1990 .

[78]  John R. Anderson.  The Adaptive Character of Thought , 1990 .

[79]  Judea Pearl,et al.  Probabilistic reasoning in intelligent systems - networks of plausible inference , 1991, Morgan Kaufmann series in representation and reasoning.

[80]  S. Brison.  The Intentional Stance , 1989 .

[81]  R. Weale.  Vision. A Computational Investigation Into the Human Representation and Processing of Visual Information. David Marr , 1983 .

[82]  Allen Newell,et al.  The Knowledge Level , 1989, Artif. Intell..

[83]  D. Premack,et al.  Does the chimpanzee have a theory of mind? , 1978, Behavioral and Brain Sciences.

[84]  Allen Newell,et al.  Human Problem Solving. , 1973 .

[85]  R. Luce,et al.  On the possible psychophysical laws. , 1959, Psychological review.

[86]  R. Bellman.  A Markovian Decision Process , 1957 .

[87]  Bootstrap Methods and Permutation Tests * , 2022 .