Context-dependent incremental decision making scrutinizing the intentions of others via Bayesian network model construction

Decision making about which are the scrutinized intentions of others, usually called intention reading or intention recognition, is an elementary basic decision making process required as a basis for other higher-level decision making, such as the intention-based decision making which we have set forth in previous work. We present herein a recognition method possessing several features desirable of an elementary process: i The method is context-dependent and incremental, enabling progressive construction of a three-layer Bayesian network model as more actions are observed, and in a context-situated manner that relies on a logic programming knowledge base concerning the context; ii The Bayesian network is structured from a specific knowledge base of readily specified and readily maintained Bayesian network fragments with simple structures, thereby enabling the efficient acquisition of that knowledge base engineered either by domain experts or else automatically from a plan corpus; and, iii The method addresses the issue of intention change and abandonment, and can appropriately resolve the issue of the recognition of multiple intentions. The several aspects of the method have been experimentally evaluated in applications and achieving definite success, using the Linux plan corpus and the so-called IPD plan corpora, which are playing sequences generated by game playing strategies needing to be recognized, in the iterated Prisoner's Dilemma. One other application concerns variations of Elder Care in the context of Ambient Intelligence.

[1]  Munindar P. Singh Intentions, Commitments and Rationality , 1991 .

[2]  M. Nowak,et al.  Stochastic dynamics of invasion and fixation. , 2006, Physical review. E, Statistical, nonlinear, and soft matter physics.

[3]  Thomas L. Dean,et al.  Probabilistic Temporal Reasoning , 1988, AAAI.

[4]  Luís Moniz Pereira,et al.  Intention-Based Decision Making via Intention Recognition and its Applications , 2013, Human Behavior Recognition Technologies.

[5]  Michael E. Bratman,et al.  Planning and the stability of intention , 1992, Minds and Machines.

[6]  N. S. Sridharan,et al.  The Plan Recognition Problem: An Intersection of Psychology and Artificial Intelligence , 1978, Artif. Intell..

[7]  Cristina Conati,et al.  On-Line Student Modeling for Coached Problem Solving Using Bayesian Networks , 1997 .

[8]  Sampath Srinivas,et al.  A Generalization of the Noisy-Or Model , 1993, UAI.

[9]  Nate Blaylock,et al.  Corpus-based, Statistical Goal Recognition , 2003, IJCAI.

[10]  Alex M. Andrew,et al.  Knowledge Representation, Reasoning and Declarative Problem Solving , 2004 .

[11]  Judea Pearl,et al.  Probabilistic reasoning in intelligent systems - networks of plausible inference , 1991, Morgan Kaufmann series in representation and reasoning.

[12]  Christopher W. Geib,et al.  Assessing the Complexity of Plan Recognition , 2004, AAAI.

[13]  Kim-Leng Poh,et al.  Constructing Bayesian Network in a Changing World , 2005, AAAI Spring Symposium: Challenges to Decision Support in a Changing World.

[14]  Raymond J. Mooney,et al.  Abductive Markov Logic for Plan Recognition , 2011, Proceedings of the AAAI Conference on Artificial Intelligence.

[15]  Francisco C. Santos,et al.  Corpus-Based Intention Recognition in Cooperation Dilemmas , 2012, Artificial Life.

[16]  Luís Moniz Pereira,et al.  Elder Care via Intention Recognition and Evolution Prospection , 2009, INAP.

[17]  Kathryn B. Laskey,et al.  Network Engineering for Complex Belief Networks , 1996, UAI.

[18]  Luís Moniz Pereira,et al.  Intention Recognition with Evolution Prospection and Causal Bayes Networks , 2011 .

[19]  M. Nowak,et al.  A strategy of win-stay, lose-shift that outperforms tit-for-tat in the Prisoner's Dilemma game , 1993, Nature.

[20]  Jochem Marotzke,et al.  Stabilizing the earth's climate is not a losing game: supporting evidence from public goods experiments. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[21]  Karim A. Tahboub,et al.  Journal of Intelligent and Robotic Systems (2005) DOI: 10.1007/s10846-005-9018-0 Intelligent Human–Machine Interaction Based on Dynamic Bayesian Networks Probabilistic Intention Recognition , 2004 .

[22]  Vibhav Gogate,et al.  SampleSearch: Importance sampling in presence of determinism , 2011, Artif. Intell..

[23]  Fariba Sadri,et al.  Logic-Based Approaches to Intention Recognition , 2011 .

[24]  Henry A. Kautz,et al.  Generalized Plan Recognition , 1986, AAAI.

[25]  Ernst Fehr,et al.  Testing Theories of Fairness - Intentions Matter , 2000, Games Econ. Behav..

[26]  Michael P. Wellman,et al.  Accounting for Context in Plan Recognition, with Application to Traffic Monitoring , 1995, UAI.

[27]  K. Sigmund The Calculus of Selfishness , 2010 .

[28]  Hector Geffner,et al.  Probabilistic Plan Recognition Using Off-the-Shelf Classical Planners , 2010, AAAI.

[29]  C. Heinze Modelling Intention Recognition for Intelligent Agent Systems , 2004 .

[30]  Ingrid Zukerman,et al.  Bayesian Models for Keyhole Plan Recognition in an Adventure Game , 2004, User Modeling and User-Adapted Interaction.

[31]  Eugene Santos,et al.  A decision theoretic approach for interface agent development , 1998 .

[32]  Francisco C. Santos,et al.  The Role of Intention Recognition in the Evolution of Cooperative Behavior , 2011, IJCAI.

[33]  J. Nelson Rushton,et al.  Probabilistic reasoning with answer sets , 2004, Theory and Practice of Logic Programming.

[34]  Luís Moniz Pereira,et al.  Anytime Intention Recognition via Incremental Bayesian Network Reconstruction , 2010, AAAI Fall Symposium: Proactive Assistant Agents.

[35]  Stuart J. Russell,et al.  The BATmobile: Towards a Bayesian Automated Taxi , 1995, IJCAI.

[36]  Nate Blaylock Recognizing Instantiated Goals using Statistical Methods , 2005 .

[37]  Luís Moniz Pereira,et al.  Moral Reasoning under Uncertainty , 2012, LPAR.

[38]  M. Nowak,et al.  Tit for tat in heterogeneous populations , 1992, Nature.

[39]  V. S. Costa,et al.  Theory and Practice of Logic Programming , 2010 .

[40]  O. Roy Thinking before acting : intentions, logic, rational choice , 2008 .

[41]  Han The Anh,et al.  Intention Recognition, Commitment and Their Roles in the Evolution of Cooperation - From Artificial Intelligence Techniques to Evolutionary Game Theory Models , 2013, Studies in Applied Philosophy, Epistemology and Rational Ethics.

[42]  Luís Moniz Pereira,et al.  Intention Recognition via Causal Bayes Networks Plus Plan Generation , 2009, EPIA.

[43]  Francisco C. Santos,et al.  Intention recognition, commitment and the evolution of cooperation , 2012, 2012 IEEE Congress on Evolutionary Computation.

[44]  Robert P. Goldman,et al.  A probabilistic plan recognition algorithm based on plan tree grammars , 2009, Artif. Intell..

[45]  Svetha Venkatesh,et al.  Efficient duration and hierarchical modeling for human activity recognition , 2009, Artif. Intell..

[46]  Luís Moniz Pereira,et al.  Intention-Based Decision Making with Evolution Prospection , 2011, EPIA.

[47]  Simon Parsons,et al.  What evolutionary game theory tells us about multiagent learning , 2007, Artif. Intell..

[48]  Robert P. Goldman,et al.  A Bayesian Model of Plan Recognition , 1993, Artif. Intell..

[49]  H. Roche,et al.  Why Copy Others? Insights from the Social Learning Strategies Tournament , 2010 .

[50]  Han The Anh,et al.  An Implementation of Extended P-Log Using XASP , 2008, ICLP.

[51]  Robert P. Goldman,et al.  A Probabilistic Model of Plan Recognition , 1991, AAAI.

[52]  Eric Horvitz,et al.  The Lumière Project: Bayesian User Modeling for Inferring the Goals and Needs of Software Users , 1998, UAI.

[53]  K. Laland,et al.  The evolutionary basis of human social learning , 2012, Proceedings of the Royal Society B: Biological Sciences.

[54]  W. Hamilton,et al.  The evolution of cooperation. , 1984, Science.

[55]  J. Pearl Causality: Models, Reasoning and Inference , 2000 .

[56]  Hung Hai Bui,et al.  A General Model for Online Probabilistic Plan Recognition , 2003, IJCAI.

[57]  Fabio Gagliardi Cozman,et al.  Axiomatizing Noisy-OR , 2004, ECAI.

[58]  Kathryn B. Laskey MEBN: A language for first-order Bayesian knowledge bases , 2008, Artif. Intell..

[59]  Kathryn B. Laskey,et al.  Network Fragments: Representing Knowledge for Constructing Probabilistic Models , 1997, UAI.

[60]  R. Wilensky Planning and Understanding: A Computational Approach to Human Reasoning , 1983 .

[61]  Eric Yeh,et al.  Efficient Online Learning and Prediction of Users' Desktop Actions , 2009, IJCAI.

[62]  Rama Chellappa,et al.  Machine Recognition of Human Activities: A Survey , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[63]  Robert P. Goldman,et al.  Recognizing Plan/Goal Abandonment , 2003, IJCAI.

[64]  Marcus J. Huber,et al.  Recognizing the Plans of Screen Reader Users , 2004 .

[65]  Svetha Venkatesh,et al.  Policy Recognition in the Abstract Hidden Markov Model , 2002, J. Artif. Intell. Res..

[66]  Analía Amandi,et al.  Goal Recognition with Variable-Order Markov Models , 2009, IJCAI.

[67]  Robert P. Goldman,et al.  A New Model of Plan Recognition , 1999, UAI.

[68]  Analía Amandi,et al.  Plan recognition for interface agents , 2007, Artificial Intelligence Review.

[69]  Michael E. Bratman,et al.  Intention, Plans, and Practical Reason , 1991 .

[70]  Luís Moniz Pereira,et al.  Collective Intention Recognition and Elder Care , 2010, AAAI Fall Symposium: Proactive Assistant Agents.

[71]  T. Han,et al.  Intention-based Decision Making for Strategic Scenarios Dynamics via Computational Logic , 2013 .

[72]  Arne Traulsen,et al.  Human strategy updating in evolutionary games , 2010, Proceedings of the National Academy of Sciences.

[73]  Josef Hofbauer,et al.  Evolutionary Games and Population Dynamics , 1998 .

[74]  Francisco C. Santos,et al.  Intention recognition promotes the emergence of cooperation , 2011, Adapt. Behav..

[75]  Francisco Javier Díez,et al.  Parameter adjustment in Bayes networks. The generalized noisy OR-gate , 1993, UAI.

[76]  Thomas G. Dietterich,et al.  Learning first-order probabilistic models with combining rules , 2005, Annals of Mathematics and Artificial Intelligence.

[77]  Avi Pfeffer,et al.  SPOOK: A system for probabilistic object-oriented knowledge representation , 1999, UAI.

[78]  Oren Etzioni,et al.  Scalable and adaptive goal recognition , 1998 .

[79]  Carlos Viegas Damásio Tabling for P-log probabilistic query evaluation. , 2009 .

[80]  David Y. Y. Yun,et al.  A Planning/Scheduling Methodology for the Constrained Resource Problem , 1989, IJCAI.

[81]  Luís Moniz Pereira,et al.  Evolution prospection in decision making , 2009, Intell. Decis. Technol..

[82]  Hector J. Levesque,et al.  Intention is Choice with Commitment , 1990, Artif. Intell..

[83]  Alan F. Blackwell,et al.  Goal recognition through goal graph analysis , 2001 .

[84]  Uwe D. Hanebeck,et al.  Tractable probabilistic models for intention recognition based on expert knowledge , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[85]  F. C. Santos,et al.  Risk of collective failure provides an escape from the tragedy of the commons , 2011, Proceedings of the National Academy of Sciences.

[86]  Arne Traulsen,et al.  Social learning promotes institutions for governing the commons , 2010, Nature.

[87]  Martin H. Levinson Not by Genes Alone: How Culture Transformed Human Evolution , 2006 .

[88]  Nate Blaylock,et al.  Statistical Goal Parameter Recognition , 2004, ICAPS.