The Independent Choice Logic for Modelling Multiple Agents Under Uncertainty

Abstract Inspired by game theory representations, Bayesian networks, influence diagrams, structured Markov decision process models, logic programming, and work in dynamical systems, the independent choice logic (ICL) is a semantic framework that allows for independent choices (made by various agents, including nature) and a logic program that gives the consequence of choices. This representation can be used as a specification for agents that act in a world, make observations of that world and have memory, as well as a modelling tool for dynamic environments with uncertainty. The rules specify the consequences of an action, what can be sensed and the utility of outcomes. This paper presents a possible-worlds semantics for ICL, and shows how to embed influence diagrams, structured Markov decision processes, and both the strategic (normal) form and extensive (game-tree) form of games within the ICL. It is argued that the ICL provides a natural and concise representation for multi-agent decision-making under uncertainty that allows for the representation of structured probability tables, the dynamic construction of networks (through the use of logical variables) and a way to handle uncertainty and decisions in a logical representation.

[1]  Joseph Y. Halpern,et al.  Knowledge, probability, and adversaries , 1993, JACM.

[2]  Daniel S. Weld,et al.  Probabilistic Planning with Information Gathering and Contingent Execution , 1994, AIPS.

[3]  Avi Pfeffer,et al.  Generating and Solving Imperfect Information Games , 1995, IJCAI.

[4]  Keiji Kanazawa,et al.  A Logic and Time Nets for Probabilistic Inference , 1991, AAAI.

[5]  Yoav Shoham,et al.  Agent-Oriented Programming , 1992, Artif. Intell..

[6]  David L. Poole,et al.  A Framework for Decision-Theoretic Planning I: Combining the Situation Calculus, Conditional Plans, Probability and Utility , 1996, UAI.

[7]  Craig Boutilier,et al.  Computing Optimal Policies for Partially Observable Decision Processes Using Compact Representations , 1996, AAAI/IAAI, Vol. 2.

[8]  Joseph Y. Halpern,et al.  From Statistical Knowledge Bases to Degrees of Belief , 1996, Artif. Intell..

[9]  Rodney A. Brooks,et al.  A Robust Layered Control Syste For A Mobile Robot , 2022 .

[10]  Keiji Kanazawa,et al.  A model for reasoning about persistence and causation , 1989 .

[11]  David Poole.  Logic Programming for Robot Control , 1995, IJCAI.

[12]  Craig Boutilier,et al.  Exploiting Structure in Policy Construction , 1995, IJCAI.

[13]  Craig Boutilier,et al.  Context-Specific Independence in Bayesian Networks , 1996, UAI.

[14]  F. Fairman.  Introduction to dynamic systems: Theory, models and applications , 1979, Proceedings of the IEEE.

[15]  Craig Boutilier,et al.  Nondeterministic Actions and the Frame Problem , 1995 .

[16]  David Poole,et al.  Exploiting the Rule Structure for Decision Making within the Independent Choice Logic , 1995, UAI.

[17]  Alan K. Mackworth,et al.  Will The Robot Do The Right Thing , 1992 .

[18]  Johann Eder,et al.  Logic and Databases , 1992, Advanced Topics in Artificial Intelligence.

[19]  Judea Pearl,et al.  Probabilistic reasoning in intelligent systems - networks of plausible inference , 1991, Morgan Kaufmann series in representation and reasoning.

[20]  John McCarthy,et al.  Applications of Circumscription to Formalizing Common Sense Knowledge , 1987, NMR.

[21]  Raymond Reiter,et al.  The Frame Problem in the Situation Calculus: A Simple Solution (Sometimes) and a Completeness Result for Goal Regression , 1991, Artificial and Mathematical Theory of Computation.

[22]  Ronald A. Howard,et al.  Readings on the Principles and Applications of Decision Analysis , 1989 .

[23]  J. Carbonell,et al.  Representing Plans Under Uncertainty: A Logic of Time, Chance, and Action , 1994 .

[24]  Stuart J. Russell,et al.  The BATmobile: Towards a Bayesian Automated Taxi , 1995, IJCAI.

[25]  E. Rowland.  Theory of Games and Economic Behavior , 1946, Nature.

[26]  James E. Smith,et al.  Structuring Conditional Relationships in Influence Diagrams , 1993, Oper. Res..

[27]  John McCarthy,et al.  SOME PHILOSOPHICAL PROBLEMS FROM THE STANDPOINT OF ARTI CIAL INTELLIGENCE , 1987 .

[28]  Lenhart K. Schubert.  Monotonic Solution of the Frame Problem in the Situation Calculus: An Efficient Method for Worlds wi , 1990 .

[29]  David Poole,et al.  Probabilistic Partial Evaluation: Exploiting Rule Structure in Probabilistic Inference , 1997, IJCAI.

[30]  Hector J. Levesque,et al.  GOLOG: A Logic Programming Language for Dynamic Domains , 1997, J. Log. Program..

[31]  Ying Zhang,et al.  A Foundation for the Design and Analysis of Robotic Systems and Behaviors , 1994 .

[32]  Ronald Fagin,et al.  Reasoning about knowledge , 1995 .

[33]  Michael P. Wellman,et al.  Planning and Control , 1991 .

[34]  John S. Breese,et al.  CONSTRUCTION OF BELIEF AND DECISION NETWORKS , 1992, Comput. Intell..

[35]  David Poole,et al.  Probabilistic Horn Abduction and Bayesian Networks , 1993, Artif. Intell..

[36]  Ying Zhang,et al.  Constraint Nets: A Semantic Model for Hybrid Dynamic Systems , 1995, Theor. Comput. Sci..

[37]  Leslie Pack Kaelbling,et al.  A Situated View of Representation and Control , 1995, Artif. Intell..

[38]  Nils J. Nilsson,et al.  Logic and Artificial Intelligence , 1991, Artif. Intell..

[39]  Martin L. Puterman,et al.  Markov Decision Processes: Discrete Stochastic Dynamic Programming , 1994 .

[40]  Krzysztof R. Apt,et al.  Logic Programming , 1990, Handbook of Theoretical Computer Science, Volume B: Formal Models and Sematics.

[41]  Nevin Lianwen Zhang,et al.  A computational theory of decision networks , 1993, Int. J. Approx. Reason..

[42]  Robert A. Kowalski,et al.  Logic for problem solving , 1982, The computer science library : Artificial intelligence series.

[43]  Joseph Y. Halpern.  An Analysis of First-Order Logics of Probability , 1989, IJCAI.

[44]  Randy Goebel,et al.  Computational intelligence - a logical approach , 1998 .

[45]  L. N. Kanal,et al.  Uncertainty in Artificial Intelligence 5 , 1990 .

[46]  Ronald L. Rivest,et al.  Learning decision lists , 2004, Machine Learning.

[47]  Roger B. Myerson,et al.  Game theory - Analysis of Conflict , 1991 .

[48]  L. J. Savage,et al.  The Foundation of Statistics , 1956 .

[49]  Devika Subramanian,et al.  Provably Bounded Optimal Agents , 1993, IJCAI.

[50]  James S. Albus,et al.  Brains, behavior, and robotics , 1981 .

[51]  Henry E. Kyburg,et al.  Knowledge Representation and Defeasible Reasoning , 1990 .

[52]  Teodor C. Przymusinski.  Three-Valued Nonmonotonic Formalisms and Semantics of Logic Programs , 1991, Artif. Intell..

[53]  D. Koller,et al.  The complexity of two-person zero-sum games in extensive form , 1992 .

[54]  R. M. Oliver,et al.  Influence diagrams, belief nets and decision analysis , 1992 .