Theory of mind: mechanisms, methods, and new directions

Theory of Mind (ToM) has received significant research attention. Traditional ToM research has provided important understanding of how humans reason about mental states by utilizing shared world knowledge, social cues, and the interpretation of actions; however, many current behavioral paradigms are limited to static, “third-person” protocols. Emerging experimental approaches such as cognitive simulation and simulated social interaction offer opportunities to investigate ToM in interactive, “first-person” and “second-person” scenarios while affording greater experimental control. The advantages and limitations of traditional and emerging ToM methodologies are discussed with the intent of advancing the understanding of ToM in socially mediated situations.

[1]  S. Tipper,et al.  Gaze cueing of attention: visual attention, social cognition, and individual differences. , 2007, Psychological bulletin.

[2]  付伶俐.  打磨Using Language,倡导新理念 , 2014 .

[3]  E. Langer,et al.  Matters of mind: Mindfulness/mindlessness in perspective , 1992, Consciousness and Cognition.

[4]  Bilge Mutlu,et al.  Human-robot proxemics: Physical and psychological distancing in human-robot interaction , 2011, 2011 6th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[5]  J. Henry,et al.  Theory of mind following traumatic brain injury: The role of emotion recognition and executive dysfunction , 2006, Neuropsychologia.

[6]  F. Happé.  An advanced test of theory of mind: Understanding of story characters' thoughts and feelings by able autistic, mentally handicapped, and normal children and adults , 1994, Journal of autism and developmental disorders.

[7]  C. Njiokiktjien,et al.  Facial Identity and Facial Emotions: Speed, Accuracy, and Processing Strategies in Children and Adults , 2002, Journal of clinical and experimental neuropsychology.

[8]  K. Pelphrey,et al.  Brain Mechanisms for Social Perception , 2008, Annals of the New York Academy of Sciences.

[9]  Matthew W. Crocker,et al.  The effect of robot gaze on processing robot utterances , 2009 .

[10]  V. Croker,et al.  Recognition of emotion from facial expression following traumatic brain injury , 2005, Brain injury.

[11]  Arne Jönsson,et al.  Wizard of Oz studies: why and how , 1993, IUI '93.

[12]  Andrea Lockerd Thomaz,et al.  Using perspective taking to learn from ambiguous demonstrations , 2006, Robotics Auton. Syst..

[13]  N. Sebanz,et al.  Psychological research on joint action: Theory and data , 2011 .

[14]  P. Ekman.  Pictures of Facial Affect , 1976 .

[15]  David Shum,et al.  Reliability and validity of The Awareness of Social Inference Test (TASIT): A clinical test of social perception , 2006, Disability and rehabilitation.

[16]  Heloir,et al.  The Uncanny Valley , 2019, The Animation Studies Reader.

[17]  E. Hill.  Evaluating the theory of executive dysfunction in autism , 2004 .

[18]  R. Dolan,et al.  Psychology: Reward value of attractiveness and gaze , 2001, Nature.

[19]  C. Frith,et al.  The Neural Basis of Mentalizing , 2006, Neuron.

[20]  S. Baron-Cohen,et al.  Does the autistic child have a “theory of mind” ? , 1985, Cognition.

[21]  A. Karmiloff-Smith,et al.  Are children with autism blind to the mentalistic significance of the eyes , 1995 .

[22]  C. Breazeal,et al.  Robots that imitate humans , 2002, Trends in Cognitive Sciences.

[23]  Brian Scassellati,et al.  Theory of Mind for a Humanoid Robot , 2002, Auton. Robots.

[24]  Daphne Maurer,et al.  The perception of facial expressions by the three-month-old. , 1981, Child development.

[25]  Laura J. Claxton,et al.  Individual differences in executive functioning and theory of mind: An investigation of inhibitory control and planning ability. , 2004, Journal of experimental child psychology.

[26]  Bilge Mutlu,et al.  Coordination Mechanisms in Human-Robot Collaboration , 2013 .

[27]  D. Le Gall,et al.  What about theory of mind after severe brain injury? , 2006, Brain injury.

[28]  H. H. Clark,et al.  Speaking while monitoring addressees for understanding , 2004 .

[29]  S. Tipper,et al.  Predictive Gaze Cues and Personality Judgments , 2006, Psychological science.

[30]  J. Decety,et al.  From the perception of action to the understanding of intention , 2001, Nature reviews. Neuroscience.

[31]  Takayuki Kanda,et al.  Footing in human-robot conversations: How robots might shape participant roles using gaze cues , 2009, 2009 4th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[32]  H. Wimmer,et al.  Beliefs about beliefs: Representation and constraining function of wrong beliefs in young children's understanding of deception , 1983, Cognition.

[33]  A. Freire,et al.  Are eyes windows to a deceiver's soul? Children's use of another's eye gaze cues in a deceptive situation. , 2004, Developmental psychology.

[34]  A. Leslie,et al.  Exploration of the autistic child's theory of mind: knowledge, belief, and communication. , 1989, Child development.

[35]  S. Duncan,et al.  Some Signals and Rules for Taking Speaking Turns in Conversations , 1972 .

[36]  Bilge Mutlu,et al.  Robot behavior toolkit: Generating effective social behaviors for robots , 2012, 2012 7th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[37]  H. Ishiguro,et al.  The uncanny advantage of using androids in cognitive and social science research , 2006 .

[38]  H Brownell,et al.  The getting of wisdom: theory of mind in old age. , 1998, Developmental psychology.

[39]  J. Gregory Trafton,et al.  Enabling effective human-robot interaction using perspective-taking in robots , 2005, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[40]  Bilge Mutlu,et al.  Beyond Utterances: Distributed Cognition as a Framework for Studying Discourse in Adults with Acquired Brain Injury , 2012, Seminars in Speech and Language.

[41]  Bilge Mutlu,et al.  A Storytelling Robot: Modeling and Evaluation of Human-like Gaze Behavior , 2006, 2006 6th IEEE-RAS International Conference on Humanoid Robots.

[42]  M. Abdel-Hamid,et al.  Mental state attribution, neurocognitive functioning, and psychopathology: What predicts poor social competence in schizophrenia best? , 2007, Schizophrenia Research.

[43]  R. Baillargeon,et al.  False-belief understanding in 2.5-year-olds: evidence from two novel verbal spontaneous-response tasks. , 2012, Developmental science.

[44]  J. Loomis,et al.  Immersive virtual environment technology as a basic research tool in psychology , 1999, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[45]  Evan F. Risko,et al.  Social attention with real versus reel stimuli: toward an empirical approach to concerns about ecological validity , 2012, Front. Hum. Neurosci..

[46]  A. Goldman,et al.  Mirror neurons and the simulation theory of mind-reading , 1998, Trends in Cognitive Sciences.

[47]  Yuyan Luo,et al.  Do 10-month-old infants understand others’ false beliefs? , 2011, Cognition.

[48]  S. Baron-Cohen,et al.  The "Reading the Mind in the Eyes" Test revised version: a study with normal adults, and adults with Asperger syndrome or high-functioning autism. , 2001, Journal of child psychology and psychiatry, and allied disciplines.

[49]  Brian Scassellati,et al.  Motion-based robotic self-recognition , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[50]  F. Heider,et al.  An experimental study of apparent behavior , 1944 .

[51]  Melissa J. Green,et al.  Social cognition, empathy and functional outcome in schizophrenia , 2010, Schizophrenia Research.

[52]  L. Turkstra,et al.  Theory of Mind and social beliefs in adolescents with traumatic brain injury. , 2004, NeuroRehabilitation.

[53]  Sophia Vinogradov,et al.  Theory of Mind Skills Are Related to Gray Matter Volume in the Ventromedial Prefrontal Cortex in Schizophrenia , 2011, Biological Psychiatry.

[54]  Kevin S LaBar,et al.  Development of emotional facial recognition in late childhood and adolescence. , 2007, Developmental science.

[55]  Takayuki Kanda,et al.  Nonverbal leakage in robots: Communication of intentions through seemingly unintentional behavior , 2009, 2009 4th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[56]  G. Fink,et al.  It's in your eyes--using gaze-contingent stimuli to create truly interactive paradigms for social cognitive and affective neuroscience. , 2010, Social cognitive and affective neuroscience.

[57]  A. Slater,et al.  Reading emotions after child brain injury: A comparison between children with brain injury and non-injured controls , 2007, Brain injury.

[58]  Crystal L. Hoyt,et al.  Immersive Virtual Environment Technology as a Methodological Tool for Social Psychology , 2002 .

[59]  D. Premack,et al.  Does the chimpanzee have a theory of mind? , 1978, Behavioral and Brain Sciences.

[60]  S. McDonald,et al.  Theory of mind after traumatic brain injury , 2005, Neuropsychologia.

[61]  J. Bavelas,et al.  Listener Responses as a Collaborative Process: The Role of Gaze , 2002 .

[62]  Margaret Wilson,et al.  Six views of embodied cognition , 2002, Psychonomic bulletin & review.

[63]  I. Ajzen.  The theory of planned behavior , 1991 .

[64]  H. Wimmer,et al.  “John thinks that Mary thinks that…” attribution of second-order beliefs by 5- to 10-year-old children ☆ , 1985 .

[65]  K. Vogeley,et al.  Toward a second-person neuroscience 1 , 2013, Behavioral and Brain Sciences.

[66]  C. Frith,et al.  Schizophrenia, symptomatology and social inference: Investigating “theory of mind” in people with schizophrenia , 1995, Schizophrenia Research.

[67]  E. McClure.  A meta-analytic review of sex differences in facial expression processing and their development in infants, children, and adolescents. , 2000, Psychological bulletin.

[68]  E. Stip,et al.  Pragmatic and executive dysfunction in schizophrenia , 2010, Journal of Neurolinguistics.

[69]  John H. Flavell,et al.  Development of the appearance-reality distinction , 1983, Cognitive Psychology.

[70]  K. Nakayama,et al.  Crossing the 'uncanny valley': adaptation to cartoon faces can influence perception of human faces. , 2010, Perception.

[71]  Sean Andrist,et al.  Designing effective gaze mechanisms for virtual agents , 2012, CHI.

[72]  E. Granholm,et al.  A path model investigation of neurocognition, theory of mind, social competence, negative symptoms and real-world functioning in schizophrenia , 2011, Schizophrenia Research.

[73]  R. Jones,et al.  Recognition of Faux Pas by Normally Developing Children and Children with Asperger Syndrome or High-Functioning Autism , 1999, Journal of autism and developmental disorders.

[74]  Y. Sarfati,et al.  Attribution of intentions to others in people with schizophrenia: a non-verbal exploration with comic strips , 1997, Schizophrenia Research.

[75]  M. Ietswaart,et al.  Impairments in theory of mind shortly after traumatic brain injury and at 1-year follow-up. , 2006, Neuropsychology.

[76]  R. Miall,et al.  A system in the human brain for predicting the actions of others , 2004, Nature Neuroscience.

[77]  Duncan R Babbage,et al.  The importance of vocal affect to bimodal processing of emotion: implications for individuals with traumatic brain injury. , 2009, Journal of communication disorders.

[78]  Tatsuya Nomura,et al.  What People Assume about Humanoid and Animal-Type Robots: Cross-Cultural Analysis between Japan, Korea, and the United States , 2008, Int. J. Humanoid Robotics.

[79]  Jason A. Williams,et al.  Insincere Utterances and Gaze: Eye Contact during Sarcastic Statements , 2009, Perceptual and motor skills.

[80]  Cynthia Breazeal,et al.  Action parsing and goal inference using self as simulator , 2005, ROMAN 2005. IEEE International Workshop on Robot and Human Interactive Communication, 2005..

[81]  Daniel Smilek,et al.  Inhibition of return in response to gaze cues: The roles of time course and fixation cue , 2007 .

[82]  A. Simion,et al.  Exploring theory of mind after severe traumatic brain injury , 2010, Cortex.

[83]  J. Hietanen,et al.  Does it make a difference if I have an eye contact with you or with your picture? An ERP study. , 2011, Social cognitive and affective neuroscience.

[84]  Steven P. Tipper,et al.  Affective evaluations of objects are influenced by observed gaze direction and emotional expression , 2007, Cognition.

[85]  U. Frith,et al.  Revisiting the strange stories: revealing mentalizing impairments in autism. , 2009, Child development.

[86]  L. Turkstra.  Conversation-based assessment of social cognition in adults with traumatic brain injury , 2008, Brain injury.

[87]  E. Frank,et al.  Recognition of Nonverbal Communication of Affect Following Traumatic Brain Injury , 2000 .

[88]  J. Sideris,et al.  Social Communication and Theory of Mind in Boys with Autism and Fragile X Syndrome , 2012, Front. Psychology.

[89]  Klaus R. Scherer,et al.  Assessing the Ability to Recognize Facial and Vocal Expressions of Emotion: Construction and Validation of the Emotion Recognition Index , 2011 .

[90]  C. Nass,et al.  Machines and Mindlessness , 2000 .

[91]  M. Legerstee,et al.  Precursors to the development of intention at 6 months: understanding people and their actions. , 2000, Developmental psychology.

[92]  M. Crocker,et al.  Investigating joint attention mechanisms through spoken human–robot interaction , 2011, Cognition.

[93]  Herbert H. Clark,et al.  Managing problems in speaking , 1994, Speech Communication.

[94]  I. René J. A. te Boekhorst,et al.  Avoiding the uncanny valley: robot appearance, personality and consistency of behavior in an attention-seeking home scenario for a robot companion , 2008, Auton. Robots.

[95]  S. Nowicki,et al.  The measurement of emotional intensity from facial expressions. , 1993, The Journal of social psychology.

[96]  A. Kendon.  Some functions of gaze-direction in social interaction. , 1967, Acta psychologica.

[97]  H. Bekkering,et al.  Joint action: bodies and minds moving together , 2006, Trends in Cognitive Sciences.

[98]  Estela Bicho,et al.  Neuro-cognitive mechanisms of decision making in joint action: a human-robot interaction study. , 2011, Human movement science.