Using multiple models of reality: on agents who know how to play safer

This thesis considers some aspects of multi-agent systems, seen as a metaphor for reasoning about the world, and providing a conceptual machinery that can be used to model and analyze the reality in which an agent is embedded. First, we study several modal logics for multi-agent systems; in particular, Alternating-time Temporal Logic (ATL) is studied in various contexts. Then, a concept of multi-level modeling of reality and multi-level decision making is proposed in the second part of the thesis.

[1]  Ernst Mally,et al.  Grundgesetze des Sollens : Elemente der Logik des Willens , 1926 .

[2]  E. Mally.  Grundgesetze des Sollens , .

[3]  J. Costi,et al.  The University of Edinburgh. , 1932, Nature.

[4]  J. Neumann,et al.  Theory of games and economic behavior , 1945, 100 Years of Math Milestones.

[5]  J. Neumann,et al.  The Theory of Games and Economic Behaviour , 1944 .

[6]  J. Nash.  Equilibrium Points in N-Person Games. , 1950, Proceedings of the National Academy of Sciences of the United States of America.

[7]  W. V. Quine.  Quantifiers and Propositional Attitudes , 1956 .

[8]  Alan Ross Anderson,et al.  A REDUCTION OF DEONTIC LOGIC TO ALETHIC MODAL LOGIC , 1958 .

[9]  K. Mellanby.  In confidence , 1976, Nature.

[10]  acobus Adrianus van Eck.  A system of temporally relative modal and deontic predicate logic and its philosophical applications , 1981 .

[11]  C. A. R. Hoare,et al.  Communicating Sequential Processes (Reprint) , 1983, Commun. ACM.

[12]  Robert C. Moore.  A Formal Theory of Knowledge and Action , 1984 .

[13]  R. Parikh.  The logic of games and its applications , 1985 .

[14]  Terry Winograd,et al.  Understanding computers and cognition , 1986 .

[15]  Joseph Y. Halpern,et al.  “Sometimes” and “not never” revisited: on branching versus linear time temporal logic , 1986, JACM.

[16]  Wolfgang Thomas,et al.  Computation Tree Logic CTL* and Path Quantifiers in the Monadic Theory of the Binary Tree , 1987, ICALP.

[17]  Henry E. Kyburg,et al.  Bayesian and Non-Bayesian Evidential Updating , 1987, Artificial Intelligence.

[18]  R. A. Corlett,et al.  A Monte-Carlo approach to uncertain inference , 1987 .

[19]  Judea Pearl,et al.  Do we need higher-order probabilities, and, if so, what do they mean? , 1987, Int. J. Approx. Reason..

[20]  John-Jules Ch. Meyer,et al.  A different approach to deontic logic: deontic logic viewed as a variant of dynamic logic , 1987, Notre Dame J. Formal Log..

[21]  Henry E. Kyburg,et al.  Higher order probabilities and intervals , 1988, Int. J. Approx. Reason..

[22]  George J. Klir,et al.  Fuzzy sets, uncertainty and information , 1988 .

[23]  Hans Weigand,et al.  Specifying Dynamic and Deontic Integrity Constraints , 1989, Data Knowl. Eng..

[24]  D. Berry,et al.  Statistics: Theory and Methods , 1990 .

[25]  Hector J. Levesque,et al.  All I Know: A Study in Autoepistemic Logic , 1990, Artif. Intell..

[26]  E. Allen Emerson,et al.  Temporal and Modal Logic , 1991, Handbook of Theoretical Computer Science, Volume B: Formal Models and Sematics.

[27]  Hector J. Levesque,et al.  Intention is Choice with Commitment , 1990, Artif. Intell..

[28]  José Luiz Fiadeiro,et al.  Temporal reasoning over deontic specifications , 1991, J. Log. Comput..

[29]  Anand S. Rao,et al.  Modeling Rational Agents within a BDI-Architecture , 1997, KR.

[30]  N. Belnap.  Backwards and Forwards in the Modal Logic of Agency , 1991 .

[31]  L. Morgenstern.  Knowledge and the frame problem , 1991 .

[32]  Valentin Goranko,et al.  Using the Universal Modality: Gains and Questions , 1992, J. Log. Comput..

[33]  Moshe Tennenholtz,et al.  On the Synthesis of Useful Social Laws for Artificial Agent Societies (Preliminary Report) , 1992, AAAI.

[34]  Sergiu Hart,et al.  Games in extensive and strategic forms , 1992 .

[35]  A. Kobsa.  User Modeling : Recent Work , Prospects and Hazards , 1993 .

[36]  Roel Wieringa,et al.  Applications of deontic logic in computer science: a concise overview , 1994 .

[37]  C. E. Alchourrón,et al.  Philosophical foundations of deontic logic and the logic of defeasible conditionals , 1994 .

[38]  Roel Wieringa,et al.  Deontic logic in computer science: normative system specification , 1994 .

[39]  Roel Wieringa,et al.  Deontic logic: a concise overview , 1994 .

[40]  Frédéric Cuppens,et al.  Expression of confidentiality policies with deontic logic , 1994 .

[41]  Ariel Rubinstein,et al.  A Course in Game Theory , 1995 .

[42]  Peter Norvig,et al.  Artificial Intelligence: A Modern Approach , 1995 .

[43]  David Draper,et al.  Assessment and Propagation of Model Uncertainty , 2011 .

[44]  François Laroussinie,et al.  About the Expressive Power of CTL Combinators , 1995, Inf. Process. Lett..

[45]  Philippe Schnoebelen,et al.  A Hierarchy of Temporal Logics with Past , 1995, Theor. Comput. Sci..

[46]  Nuel Belnap,et al.  The deliberative stit: A study of action, omission, ability, and obligation , 1995, J. Philos. Log..

[47]  M. Georgeff,et al.  Formal Models and Decision Procedures for Multi-Agent Systems , 1995 .

[48]  Ronald Fagin,et al.  Reasoning about knowledge , 1995 .

[49]  Andrew W. Moore,et al.  Reinforcement Learning: A Survey , 1996, J. Artif. Intell. Res..

[50]  David Carmel,et al.  Learning and using opponent models in adversary search , 1996 .

[51]  Thomas G. Dietterich.  What is machine learning? , 2020, Archives of Disease in Childhood.

[52]  Neeraj Arora,et al.  LEARNING TO TAKE RISKS , 1992 .

[53]  Moshe Tennenholtz,et al.  On the Emergence of Social Conventions: Modeling, Analysis, and Simulations , 1997, Artif. Intell..

[54]  Steve Renals,et al.  Confidence measures for hybrid HMM/ANN speech recognition , 1997, EUROSPEECH.

[55]  Thomas A. Henzinger,et al.  Alternating-time temporal logic , 1997, Proceedings 38th Annual Symposium on Foundations of Computer Science.

[56]  J. Hintikka,et al.  Game-Theoretical Semantics , 1997 .

[57]  Frank Dignum,et al.  Combining dynamic deontic logic and temporal logic for the specification of deadlines , 1997, Proceedings of the Thirtieth Hawaii International Conference on System Sciences.

[58]  Ian Frank,et al.  Finding Optimal Strategies for Imperfect Information Games , 1998, AAAI/IAAI.

[59]  Ian Frank,et al.  Search in Games with Incomplete Information: A Case Study Using Bridge Card Play , 1998, Artif. Intell..

[60]  Sandip Sen,et al.  Individual learning of coordination knowledge , 1998, J. Exp. Theor. Artif. Intell..

[61]  Thomas A. Henzinger,et al.  Alternating Refinement Relations , 1998, CONCUR.

[62]  Neri Merhav,et al.  Universal Prediction , 1998, IEEE Trans. Inf. Theory.

[63]  W. Hoek,et al.  Formalising abilities and opportunities of agents , 1998 .

[64]  Ian Frank,et al.  Search and planning under incomplete information - a study using bridge card play , 1998, Distinguished dissertations.

[65]  Shailesh Kumar,et al.  Confidence based Dual Reinforcement Q-Routing: an On-line Adaptive NetworkRouting Algorithm , 1998 .

[66]  John-Jules Ch. Meyer,et al.  Formalising Abilities and Opportunities of Agents , 1998, Fundam. Informaticae.

[67]  Ian Frank,et al.  Search and Planning Under Incomplete Information , 1998 .

[68]  Edmund H. Durfee,et al.  Learning nested agent models in an information economy , 1998, J. Exp. Theor. Artif. Intell..

[69]  Johan van den Akker,et al.  DEGAS: an active, temporal database of autonomous objects , 1998 .

[70]  Martin Shubik,et al.  Game theory, complexity, and simplicity Part III: Critique and prospective , 1998, Complex..

[71]  Klaus Schild.  On the Relationship Between BDI Logics and Standard Logics of Concurrency , 1998, ATAL.

[72]  M. Sloof,et al.  Physiology of Quality Change Modelling. Automated modelling of quality change of agricultural products , 1999 .

[73]  George J. Klir.  Uncertainty and Information Measures for Imprecise Probabilities: An Overview , 1999, ISIPTA.

[74]  Sandip Sen,et al.  Learning in multiagent systems , 1999 .

[75]  David Spelt,et al.  Verification Support for Object Database Design , 1999 .

[76]  Gethin Williams,et al.  Knowing What You Don't Know: Roles for Confidence Measures in Automatic Speech Recognition , 1999 .

[77]  Risto Miikkulainen,et al.  Confidence Based Dual Reinforcement Q-Routing: An adaptive online network routing algorithm , 1999, IJCAI.

[78]  E. C. Marshall,et al.  Strategies for Inference Robustness in ComplexModelling : An Application to LongitudinalPerformance Measures , 1999 .

[79]  Fausto Giunchiglia,et al.  Planning as Model Checking , 1999, ECP.

[80]  J. Gerbrandy.  Bisimulations on Planet Kripke , 1999 .

[81]  Grigoris Antoniou,et al.  A tutorial on default logics , 1999, CSUR.

[82]  Rolf Pfeifer,et al.  Understanding intelligence , 2020, Inequality by Design.

[83]  Faron Moller,et al.  On the expressive power of CTL , 1999, Proceedings. 14th Symposium on Logic in Computer Science (Cat. No. PR00158).

[84]  Matthew L. Ginsberg,et al.  GIB: Steps Toward an Expert-Level Bridge-Playing Program , 1999, IJCAI.

[85]  Michael J. Pazzani,et al.  A hybrid user model for news story classification , 1999 .

[86]  Ingrid Zukerman,et al.  Predicting users' requests on the WWW , 1999 .

[87]  Gerhard Weiss,et al.  Multiagent Systems , 1999 .

[88]  Mark Ryan,et al.  Logic in Computer Science: Modelling and Reasoning about Systems , 2000 .

[89]  M. Pauly.  Game logic for game theorists , 2000 .

[90]  M. de Rijke,et al.  Model Checking for combined logics , 2000 .

[91]  Bikramjit Banerjee,et al.  Learning Mutual Trust , 2000, Trust in Cyber-societies.

[92]  Fangzhen Lin,et al.  On strongest necessary and weakest sufficient conditions , 2000, Artif. Intell..

[93]  Marc Pauly,et al.  Logic for social software , 2000 .

[94]  Michael Wooldridge,et al.  Reasoning about rational agents , 2000, Intelligent robots and autonomous agents.

[95]  Ya-Qin Zhang,et al.  A confidence measure based moving object extraction system built for compressed domain , 2000, 2000 IEEE International Symposium on Circuits and Systems. Emerging Technologies for the 21st Century. Proceedings (IEEE Cat No.00CH36353).

[96]  Cem U. Saraydar,et al.  Paging area optimization based on interval estimation in wireless personal communication networks , 2000, Mob. Networks Appl..

[97]  Michael C. Mozer,et al.  Beyond Maximum Likelihood and Density Estimation: A Sample-Based Criterion for Unsupervised Learning of Complex Models , 2000, NIPS.

[98]  Ivan Koychev,et al.  Gradual Forgetting for Adaptation to Concept Drift , 2000 .

[99]  Mehdi Dastani,et al.  The BOID architecture: conflicts between beliefs, obligations, intentions and desires , 2001, AGENTS '01.

[100]  S. Renooij.  Qualitative approaches to quantifying probabilistic networks , 2001 .

[101]  V. Goranko.  Coalition games and alternating temporal logics , 2001 .

[102]  Christophe Ris,et al.  Use of acoustic prior information for confidence measure in ASR applications , 2001, INTERSPEECH.

[103]  Ivan Koychev.  Learning about User in the Presence of Hidden Context , 2001 .

[104]  Wojciech Jamroga,et al.  A Defense Model for Games with Incomplete Information , 2001, KI/ÖGAI.

[105]  Julie A. Adams,et al.  Multiagent Systems: A Modern Approach to Distributed Artificial Intelligence , 2001, AI Mag..

[106]  J. Benthem.  Games in dynamic epistemic logic , 2001 .

[107]  Pei Wang.  Confidence as Higher-Order Uncertainty , 2001, ISIPTA.

[108]  M. Pauly.  A Logical Framework for Coalitional Effectivity in Dynamic Procedures , 2001 .

[109]  Alessio Lomuscio,et al.  On Multi-agent Systems Specification via Deontic Logic , 2001, ATAL.

[110]  Marco Pistore,et al.  Planning as Model Checking for Extended Goals in Non-deterministic Domains , 2001, IJCAI.

[111]  Matthew L. Ginsberg,et al.  GIB: Imperfect Information in a Computationally Challenging Game , 2011, J. Artif. Intell. Res..

[112]  Patrick Doherty,et al.  Computing Strongest Necessary and Weakest Sufficient Conditions of First-Order Formulas , 2001, IJCAI.

[113]  W. J. Jamroga,et al.  Multilevel Modeling of Dialogue Environment for e-Commerce Agents , 2001 .

[114]  Mehdi Dastani,et al.  Resolving Conflicts between Beliefs, Obligations, Intentions, and Desires , 2001, ECSQARU.

[115]  Wilfrid Hodges,et al.  Logic and Games , 2001 .

[116]  Michael Wooldridge,et al.  Tractable multiagent planning for epistemic goals , 2002, AAMAS '02.

[117]  Marc Pauly,et al.  A Modal Logic for Coalitional Power in Games , 2002, J. Log. Comput..

[118]  W. Hoek,et al.  Epistemic logic: a survey , 2002 .

[119]  W. J. Jamroga.  Datasize-Based Confidence Measure for a Learning Agent , 2002 .

[120]  W. J. Jamroga,et al.  Multiple Models of Reality and How to Use Them , 2002 .

[121]  J.F.A.K. van Benthem,et al.  The Epistemic Logic of IF Games , 2003 .

[122]  M. Wooldridge,et al.  Model checking cooperation, knowledge, and time—a case study , 2003 .

[123]  Wojciech Jamroga.  Safer Decisions Against A Dynamic Opponent , 2003, IIS.

[124]  Michael Wooldridge,et al.  Towards a Logic of Rational Agency , 2003, Log. J. IGPL.

[125]  W. J. Jamroga.  A Confidence Measure for Learning Probabilistic Knowledge in a Dynamic Environment , 2003 .

[126]  W. Jamroga.  Some Remarks on Alternating Temporal Epistemic Logic , 2003 .

[127]  W. J. Jamroga,et al.  Confidence Measure for a Learning Agent , 2003 .

[128]  Govert van Drimmelen,et al.  Satisfiability in Alternating-time Temporal Logic , 2003, LICS.

[129]  L. J. Kortmann.  The resolution of visually guided behaviour , 2003 .

[130]  Barbara Messing,et al.  An Introduction to MultiAgent Systems , 2002, Künstliche Intell..

[131]  Alessio Lomuscio,et al.  Deontic Interpreted Systems , 2003, Stud Logica.

[132]  Michael Wooldridge,et al.  Cooperation, Knowledge, and Time: Alternating-time Temporal Epistemic Logic and its Applications , 2003, Stud Logica.

[133]  N. Giocoli.  Modeling Rational Agents , 2003 .

[134]  Jan Broersen.  Modal Action Logics for Reasoning about Reactive Systems , 2003 .

[135]  Wojciech Jamroga.  Multi-Agent Planning with Planning Graph , 2003 .

[136]  Wojciech Penczek,et al.  Unbounded model checking for alternating-time temporal logic , 2004, Proceedings of the Third International Joint Conference on Autonomous Agents and Multiagent Systems, 2004. AAMAS 2004..

[137]  Wojciech Jamroga,et al.  Agents that Know How to Play , 2004, Fundam. Informaticae.

[138]  Michael Wooldridge,et al.  Preferences in game logics , 2004, Proceedings of the Third International Joint Conference on Autonomous Agents and Multiagent Systems, 2004. AAMAS 2004..

[139]  Wojciech Jamroga,et al.  Strategic Planning through Model Checking of ATL Formulae , 2004, ICAISC.

[140]  Lai Xu.  Monitoring multi-party contracts for E-business , 2004 .

[141]  Wojciech Jamroga,et al.  Comparing Semantics of Logics for Multi-Agent Systems , 2004, Synthese.

[142]  Wojciech Jamroga,et al.  On Obligations and Abilities , 2004, DEON.

[143]  Michael Wooldridge,et al.  Knowledge as Strategic Ability , 2004, LCMAS.

[144]  Alessio Lomuscio,et al.  A formalisation of violation, error recovery, and enforcement in the bit transmission problem , 2004, Journal of Applied Logic.

[145]  Ingrid Zukerman,et al.  # 2001 Kluwer Academic Publishers. Printed in the Netherlands. Predictive Statistical Models for User Modeling , 1999 .

[146]  William J. Browne,et al.  Bayesian and likelihood-based methods in multilevel modeling 1 A comparison of Bayesian and likelihood-based methods for fitting multilevel models , 2006 .

[147]  Gerhard Widmer,et al.  Tracking Context Changes through Meta-Learning , 1997, Machine Learning.

[148]  Geert Jonker,et al.  On Epistemic Temporal Strategic Logic , 2005, LCMAS.

[149]  Pascal Gribomont,et al.  Epistemic logic , 2006, Logic and the Modalities in the Twentieth Century.

[150]  Valentin Goranko,et al.  Complete axiomatization and decidability of Alternating-time temporal logic , 2006, Theor. Comput. Sci..

[151]  Michael Wooldridge,et al.  Social laws in alternating time: effectiveness, feasibility, and synthesis , 2006, Synthese.