COKE: A Cognitive Knowledge Graph for Machine Theory of Mind

Theory of mind (ToM) refers to humans' ability to understand and infer the desires, beliefs, and intentions of others. The acquisition of ToM plays a key role in humans' social cognition and interpersonal relations. Though indispensable for social intelligence, ToM is still lacking for modern AI and NLP systems since they cannot access the human mental state and cognitive process beneath the training corpus. To empower AI systems with the ToM ability and narrow the gap between them and humans, in this paper, we propose COKE: the first cognitive knowledge graph for machine theory of mind. Specifically, COKE formalizes ToM as a collection of 45k+ manually verified cognitive chains that characterize human mental activities and subsequent behavioral/affective responses when facing specific social circumstances. Beyond that, we further generalize COKE using pre-trained language models and build a powerful cognitive generation model COKE+. Experimental results in both automatic and human evaluation demonstrate the high quality of COKE and the superior ToM ability of COKE+.

[1]  Ronan Le Bras,et al.  SODA: Million-scale Dialogue Distillation with Social Commonsense Contextualization , 2022, ArXiv.

[2]  Ronan Le Bras,et al.  Neural Theory-of-Mind? On the Limits of Social Intelligence in Large LMs , 2022, EMNLP.

[3]  Y. Altun,et al.  LAD: Language Models as Data for Zero-Shot Dialog , 2022, SIGDIAL.

[4]  Yejin Choi The Curious Case of Commonsense Intelligence , 2022, Daedalus.

[5]  B. Sahakian,et al.  Theory of Mind and Preference Learning at the Interface of Cognitive Science, Neuroscience, and AI: A Review , 2022, Frontiers in Artificial Intelligence.

[6]  Soujanya Poria,et al.  CICERO: A Dataset for Contextualized Commonsense Inference in Dialogues , 2022, ACL.

[7]  Ryan J. Lowe,et al.  Training language models to follow instructions with human feedback , 2022, NeurIPS.

[8]  Ronan Le Bras,et al.  Symbolic Knowledge Distillation: from General Language Models to Commonsense Models , 2021, NAACL.

[9]  Orhan Firat,et al.  Towards Zero-Label Language Learning , 2021, ArXiv.

[10]  Kang Min Yoo,et al.  GPT3Mix: Leveraging Large-scale Language Models for Text Augmentation , 2021, EMNLP.

[11]  Luigi Atzori,et al.  IoT-Enabled Social Relationships Meet Artificial Social Intelligence , 2021, IEEE Internet of Things Journal.

[12]  N. Mostafazadeh,et al.  GLUCOSE: GeneraLized and COntextualized Story Explanations , 2020, Conference on Empirical Methods in Natural Language Processing.

[13]  Mark Chen,et al.  Language Models are Few-Shot Learners , 2020, NeurIPS.

[14]  Y-Lan Boureau,et al.  Revisiting the Evaluation of Theory of Mind through Question Answering , 2019, EMNLP.

[15]  W. Wölwer,et al.  Theory of mind, emotion recognition, delusions and the quality of the therapeutic relationship in patients with psychosis – a secondary analysis of a randomized-controlled therapy trial , 2019, BMC Psychiatry.

[16]  Colin Raffel,et al.  Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer , 2019, J. Mach. Learn. Res..

[17]  A. Giovagnoli Theory of mind across lifespan from ages 16 to 81 years , 2019, Epilepsy & Behavior.

[18]  Yejin Choi,et al.  COMET: Commonsense Transformers for Automatic Knowledge Graph Construction , 2019, ACL.

[19]  H. Francis Song,et al.  Machine Theory of Mind , 2018, ICML.

[20]  Frank Hutter,et al.  Decoupled Weight Decay Regularization , 2017, ICLR.

[21]  Xiaoyu Shen,et al.  DailyDialog: A Manually Labelled Multi-turn Dialogue Dataset , 2017, IJCNLP.

[22]  Catherine Havasi,et al.  ConceptNet 5.5: An Open Multilingual Graph of General Knowledge , 2016, AAAI.

[23]  A. Goldman To Appear in: , 2008 .

[24]  I. Apperly Mindreaders: The Cognitive Basis of "Theory of Mind" , 2010 .

[25]  M. Tomasello,et al.  Does the chimpanzee have a theory of mind? 30 years later , 2008, Trends in Cognitive Sciences.

[26]  Phil Russel,et al.  An Introduction to Cognitive Behaviour Therapy--Skills and Applications , 2008 .

[27]  Ori Friedman,et al.  Core mechanisms in ‘theory of mind’ , 2004, Trends in Cognitive Sciences.

[28]  Salim Roukos,et al.  Bleu: a Method for Automatic Evaluation of Machine Translation , 2002, ACL.

[29]  Mark W. Baldwin,et al.  Relational schemas and the processing of social information. , 1992 .

[30]  P. Harris,et al.  Young Children's Theory of Mind and Emotion , 1989 .

[31]  D. Premack,et al.  Does the chimpanzee have a theory of mind? , 1978, Behavioral and Brain Sciences.

[32]  Minlie Huang,et al.  AugESC: Large-scale Data Augmentation for Emotional Support Conversation with Pre-trained Language Models , 2022, ArXiv.

[33]  Yejin Choi,et al.  ATOMIC: An Atlas of Machine Commonsense for If-Then Reasoning , 2019, AAAI.