Towards computational models of intention detection and intention prediction

Intention recognition is one of the core components of mindreading, an important process in social cognition. Human beings, from age of 18months, have been shown to be able to extrapolate intentions from observed actions, even when the performer failed at achieving the goal. Existing accounts of intention recognition emphasize the use of an intent (plan) library, which is matched against observed actions for recognition. These therefore cannot account for recognition of failed sequences of actions, nor novel actions. In this paper, we begin to tackle these open questions by examining computational models for components of human intention recognition, which emphasize the ability of humans to detect and identify intentions in a sequence of observed actions, based solely on the rationality of movement (its efficiency). We provide a high-level overview of intention recognition as a whole, and then elaborate on two components of the model, which we believe to be at its core, namely, those of intention detection and intention prediction. By intention detection we mean the ability to discern whether a sequence of actions has any underlying intention at all, or whether it was performed in an arbitrary manner with no goal in mind. By intention prediction we mean the ability to extend an incomplete sequence of actions to its most likely intended goal. We evaluate the model, and these two components, in context of existing literature, and in a number of experiments with more than 140 human subjects. For intention detection, our model was able to attribute high levels of intention to those traces perceived by humans as intentional, and vice versa. For intention prediction as well, our model performed in a way that closely matched that of humans. The work highlights the intimate relationship between the ability to generate plans, and the ability to recognize intentions.

[1]  G. Rizzolatti,et al.  Parietal Lobe: From Action Organization to Intention Understanding , 2005, Science.

[2]  Jun Hong,et al.  Goal Recognition through Goal Graph Analysis , 2001, J. Artif. Intell. Res..

[3]  Richard Kelley,et al.  Context-Based Bayesian Intent Recognition , 2012, IEEE Transactions on Autonomous Mental Development.

[4]  Martin Davies,et al.  Mental Simulation: Evaluations and Applications - Reading in Mind and Language , 1995 .

[5]  J. J. Guajardo,et al.  How infants make sense of intentional action , 2001 .

[6]  Oren Etzioni,et al.  A Sound and Fast Goal Recognizer , 1995, IJCAI.

[7]  Kelly L. Madole,et al.  Developmental changes in infants' attention to function and form-function correlations , 1993 .

[8]  Alison Gopnik,et al.  Toddlers' understanding of intentions, desires and emotions: Explorations of the dark ages. , 1999 .

[9]  R. Goldman,et al.  Partial Observability and Probabilistic Plan/Goal Recognition , 2005 .

[10]  R. Ellis,et al.  On the relations between seen objects and components of potential actions. , 1998, Journal of experimental psychology. Human perception and performance.

[11]  三嶋 博之 The theory of affordances , 2008 .

[12]  A. Meltzoff,et al.  Infants' understanding of people and things: From body imitation to folk psychology. , 1995 .

[13]  Jeremy Wyatt,et al.  Learning Causality and Intentional Actions , 2006, Towards Affordance-Based Robot Control.

[14]  A. Meltzoff The 'like me' framework for recognizing and becoming an intentional agent. , 2007, Acta psychologica.

[15]  A. Woodward Infants selectively encode the goal object of an actor's reach , 1998, Cognition.

[16]  E. Berscheid,et al.  The Psychology of Interpersonal Relationships , 2004 .

[17]  Alan F. Blackwell,et al.  Goal recognition through goal graph analysis , 2001 .

[18]  Monica N. Nicolescu,et al.  An Architecture for Understanding Intent Using a Novel Hidden Markov Formulation , 2008, Int. J. Humanoid Robotics.

[19]  Jennifer H. Pfeifer,et al.  Understanding emotions in others: mirror neuron dysfunction in children with autism spectrum disorders , 2006, Nature Neuroscience.

[20]  Noam Hazon,et al.  On redundancy, efficiency, and robustness in coverage for multiple robots , 2008, Robotics Auton. Syst..

[21]  Leonard S. Mark,et al.  Perceiving Multiple Affordances for Objects , 2009 .

[22]  Nate Blaylock,et al.  Hierarchical Instantiated Goal Recognition , 2006 .

[23]  G. Csibra,et al.  Social learning and social cognition: The case for pedagogy , 2006 .

[24]  Gal A. Kaminka,et al.  Curing robot autism: a challenge , 2013, AAMAS.

[25]  P C Quinn,et al.  The categorization of above and below spatial relations by young infants. , 1994, Child development.

[26]  Amanda C. Brandone,et al.  You Can't Always Get What You Want , 2009, Psychological science.

[27]  J. Watson The Elementary Nature of Purposive Behavior: Evolving Minimal Neural Structures that Display Intrinsic Intentionality , 2005 .

[28]  A. Meltzoff Imitation as a mechanism of social cognition: Origins of empathy, theory of mind, and the representation of action. , 2007 .

[29]  William W. Gaver Technology affordances , 1991, CHI.

[30]  Infant Understanding of Containment: An Affordance Perceived or a Relationship Conceived?. , 1988 .

[31]  Maya Cakmak,et al.  To Afford or Not to Afford: A New Formalization of Affordances Toward Affordance-Based Robot Control , 2007, Adapt. Behav..

[32]  G. Csibra,et al.  The teleological origins of mentalistic action explanations: A developmental hypothesis , 1998 .

[33]  G. Rizzolatti,et al.  Action recognition in the premotor cortex. , 1996, Brain : a journal of neurology.

[34]  12-Month-Olds Produce Others' Intended but Unfulfilled Acts. , 2009, Infancy : the official journal of the International Society on Infant Studies.

[35]  J. Decety,et al.  Does visual perception of object afford action? Evidence from a neuroimaging study , 2002, Neuropsychologia.

[36]  F. Heider The psychology of interpersonal relations , 1958 .

[37]  R. Passingham,et al.  Objects automatically potentiate action: an fMRI study of implicit processing , 2003, The European journal of neuroscience.

[38]  M. Tomasello,et al.  Fourteen-through 18-month-old infants di eren-tially imitate intentional and accidental actions , 1998 .

[39]  J. Heal,et al.  Mind, reason, and imagination , 2003 .

[40]  Earl R. Babbie,et al.  The practice of social research , 1969 .

[41]  D. Premack,et al.  Does the chimpanzee have a theory of mind? , 1978, Behavioral and Brain Sciences.

[42]  Robert St. Amant,et al.  User Interface Affordances in a Planning Representation , 1999, Hum. Comput. Interact..

[43]  Manuel Lopes,et al.  Affordance-based imitation learning in robots , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[44]  C. Heyes,et al.  Infants' behavioral reenactment of "failed attempts": exploring the roles of emulation learning, stimulus enhancement, and understanding of intentions. , 2002, Developmental psychology.

[45]  M. Casasola,et al.  Infant categorization of containment, support and tight‐fit spatial relationships , 2002 .

[46]  D. Wolpert,et al.  Mental state inference using visual control parameters. , 2005, Brain research. Cognitive brain research.

[47]  G. Csibra,et al.  Teleological reasoning in infancy: the naı̈ve theory of rational action , 2003, Trends in Cognitive Sciences.

[48]  A. Meltzoff Understanding the Intentions of Others: Re-Enactment of Intended Acts by 18-Month-Old Children. , 1995, Developmental psychology.

[49]  Gal A. Kaminka,et al.  The use of hidden semi-Markov models in clinical diagnosis maze tasks , 2009, Intelligent Data Analysis.

[50]  K. Dautenhahn,et al.  Imitation and Social Learning in Robots, Humans and Animals: Behavioural, Social and Communicative Dimensions , 2009 .

[51]  Marina Paola Banchetti-Robino Ibn Sina and Husserl on Intention and Intentionality , 2003 .

[52]  M. Tomasello,et al.  Re-enacting intended acts: Comparing 12- and 18-month-olds , 1999 .

[53]  Wolfgang Prinz,et al.  The early origins of goal attribution in infancy , 2003, Consciousness and Cognition.

[54]  C. Breazeal,et al.  Robots that imitate humans , 2002, Trends in Cognitive Sciences.

[55]  Amanda C. Brandone The development of intention understanding in the first year of life: An exploration of infants' understanding of successful vs. failed intentional actions , 2010 .

[56]  A. Meltzoff,et al.  Imitation, Memory, and the Representation of Persons. , 1994, Infant behavior & development.

[57]  Z. Nadasdy,et al.  Taking the intentional stance at 12 months of age , 1995, Cognition.

[58]  Paul Cisek,et al.  Cortical mechanisms of action selection: the affordance competition hypothesis , 2007, Philosophical Transactions of the Royal Society B: Biological Sciences.

[59]  S. Waxman,et al.  Object names and object functions serve as cues to categories for infants. , 2002, Developmental psychology.

[60]  Gisa Aschersleben,et al.  Infant's perception of goal-directed actions performed by a mechanical device , 2005 .

[61]  M. Casasola,et al.  Six-month-old infants' categorization of containment spatial relations. , 2003, Child development.

[62]  A. Goldman,et al.  Mirror neurons and the simulation theory of mind-reading , 1998, Trends in Cognitive Sciences.

[63]  Blai Bonet,et al.  Planning as Heuristic Search: New Results , 1999, ECP.

[64]  Jessica S. Horst,et al.  What does it look like and what can it do? Category structure influences how infants categorize. , 2005, Child development.

[65]  Hector Geffner,et al.  Probabilistic Plan Recognition Using Off-the-Shelf Classical Planners , 2010, AAAI.

[66]  Guido Boella,et al.  Modelling the Interaction Between Objects: Roles as Affordances , 2006, KSEM.

[67]  G. Rizzolatti,et al.  Evidence for visuomotor priming effect , 1996, Neuroreport.

[68]  Leslie B. Cohen,et al.  The Role of Object Parts in Infants' Attention to Form-Function Correlations. , 1995 .

[69]  K. Harui,et al.  Distinguishing Intentional Actions from Accidental Actions , 2005, Proceedings. The 4nd International Conference on Development and Learning, 2005..

[70]  A. Meltzoff,et al.  Early Imitation Within a Functional Framework: The Importance of Person Identity, Movement, and Development. , 1992, Infant behavior & development.

[71]  J. Decety,et al.  From the perception of action to the understanding of intention , 2001, Nature reviews. Neuroscience.

[72]  R. Gordon Folk Psychology as Simulation , 1986 .

[73]  Robert P. Goldman,et al.  A Bayesian Model of Plan Recognition , 1993, Artif. Intell..

[74]  Cynthia Breazeal,et al.  Learning From and About Others: Towards Using Imitation to Bootstrap the Social Understanding of Others by Robots , 2005, Artificial Life.

[75]  A. Meltzoff,et al.  What imitation tells us about social cognition: a rapprochement between developmental psychology and cognitive neuroscience. , 2003, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[76]  Ad W. Smitsman,et al.  Infants' Perception of Dynamic Relations Between Objects: Passing Through or Support? , 1995 .

[77]  G. Kaminka,et al.  Towards Dynamic Tracking of Multi-Agents Teams : An Initial Report , 2007 .

[78]  Bernhard Schölkopf,et al.  Probabilistic Modeling of Human Movements for Intention Inference , 2012, Robotics: Science and Systems.