Reasoning about Cognitive Trust in Stochastic Multiagent Systems

We consider the setting of stochastic multiagent systems modelled as stochastic multiplayer games and formulate an automated verification framework for quantifying and reasoning about agents’ trust. To capture human trust, we work with a cognitive notion of trust defined as a subjective evaluation that agent A makes about agent B’s ability to complete a task, which in turn may lead to a decision by A to rely on B. We propose a probabilistic rational temporal logic PRTL*, which extends the probabilistic computation tree logic PCTL* with reasoning about mental attitudes (beliefs, goals, and intentions) and includes novel operators that can express concepts of social trust such as competence, disposition, and dependence. The logic can express, for example, that “agent A will eventually trust agent B with probability at least p that B will behave in a way that ensures the successful completion of a given task.” We study the complexity of the automated verification problem and, while the general problem is undecidable, we identify restrictions on the logic and the system that result in decidable, or even tractable, subproblems.

[1]  J. Kemeny,et al.  Denumerable Markov chains , 1969 .

[2]  Wojciech Jamroga,et al.  Towards a theory of intention revision , 2007, Synthese.

[3]  Ugur Kuter,et al.  Towards Self-Confidence in Autonomous Systems , 2016 .

[4]  Ronald Fagin,et al.  Reasoning about knowledge , 1995 .

[5]  Christel Baier,et al.  Principles of model checking , 2008 .

[6]  Frank E. Ritter,et al.  In order to learn : how the sequence of topics influences learning , 2007 .

[7]  John-Jules Ch. Meyer,et al.  A Logical Approach to the Dynamics of Commitments , 1999, Artif. Intell..

[8]  Cristiano Castelfranchi,et al.  The role of beliefs in goal dynamics: prolegomena to a constructive theory of intentions , 2007, Synthese.

[9]  Ö. Özer,et al.  Trust and Trustworthiness , 2017, The Handbook of Behavioral Operations.

[10]  Edmund M. Clarke,et al.  Model Checking , 1999, Handbook of Automated Reasoning.

[11]  Timothy W. Finin,et al.  Trust-Based Security in Pervasive Computing Environments , 2022 .

[12]  Azaria Paz,et al.  Introduction to probabilistic automata (Computer science and applied mathematics) , 1971 .

[13]  S. Asch Forming impressions of personality. , 1946, Journal of Abnormal Psychology.

[14]  Marta Z. Kwiatkowska,et al.  PRISM 4.0: Verification of Probabilistic Real-Time Systems , 2011, CAV.

[15]  Joseph Y. Halpern,et al.  Knowledge, probability, and adversaries , 1993, JACM.

[16]  Sebastian Junges,et al.  A Storm is Coming: A Modern Probabilistic Model Checker , 2017, CAV.

[17]  Morteza Lahijanian,et al.  Social Trust: A Major Challenge for the Future of Autonomous Systems , 2016, AAAI Fall Symposia.

[18]  Audun Jøsang,et al.  A Logic for Uncertain Probabilities , 2001, Int. J. Uncertain. Fuzziness Knowl. Based Syst..

[19]  Joseph Y. Halpern,et al.  Modeling Belief in Dynamic Systems, Part I: Foundations , 1997, Artif. Intell..

[20]  Bengt Jonsson,et al.  A logic for reasoning about time and reliability , 1990, Formal Aspects of Computing.

[21]  Krishnendu Chatterjee,et al.  What is decidable about partially observable Markov decision processes with ω-regular objectives , 2013, J. Comput. Syst. Sci..

[22]  Judea Pearl,et al.  Probabilistic Semantics for Nonmonotonic Reasoning: A Survey , 1989, KR.

[23]  Jan Broersen,et al.  BDI Logics , 2012 .

[24]  Anand S. Rao,et al.  Modeling Rational Agents within a BDI-Architecture , 1997, KR.

[25]  Andrea Bianco,et al.  Model Checking of Probabalistic and Nondeterministic Systems , 1995, FSTTCS.

[26]  Klaus Schild On the Relationship Between BDI Logics and Standard Logics of Concurrency , 1998, ATAL.

[27]  John D. Lee,et al.  Trust in Automation: Designing for Appropriate Reliance , 2004, Hum. Factors.

[28]  R. Hogarth,et al.  Order effects in belief updating: The belief-adjustment model , 1992, Cognitive Psychology.

[29]  Frank E. Ritter,et al.  In Order to Learn , 2007 .

[30]  Joyce E. Berg,et al.  Trust, Reciprocity, and Social History , 1995 .

[31]  Vladimiro Sassone,et al.  Trust models in ubiquitous computing , 2008, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[32]  Benjamin Kuipers,et al.  How can we trust a robot? , 2018, Commun. ACM.

[33]  Taolue Chen,et al.  Automatic verification of competitive stochastic systems , 2012, Formal Methods in System Design.

[34]  Wen-Guey Tzeng,et al.  A Polynomial-Time Algorithm for the Equivalence of Probabilistic Automata , 1992, SIAM J. Comput..

[35]  J. H. Davis,et al.  An Integrative Model Of Organizational Trust , 1995 .

[36]  Emiliano Lorini,et al.  Chapter 1 A simple logic of trust based on propositional assignments , 2011 .

[37]  L. Toledo-Pereyra Trust , 2006, Mediation Behaviour.

[38]  KwiatkowskaMarta,et al.  Reasoning about Cognitive Trust in Stochastic Multiagent Systems , 2019 .

[39]  Siddhartha S. Srinivasa,et al.  Planning with Trust for Human-Robot Collaboration , 2018, 2018 13th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[40]  C. Castelfranchi,et al.  Social Trust : A Cognitive Approach , 2000 .

[41]  Christel Baier,et al.  Principles of Model Checking (Representation and Mind Series) , 2008 .

[42]  Han Yi,et al.  Trust and e-commerce: a study of consumer perceptions , 2003, Electron. Commer. Res. Appl..

[43]  Judy Goldsmith,et al.  Complexity issues in Markov decision processes , 1998, Proceedings. Thirteenth Annual IEEE Conference on Computational Complexity (Formerly: Structure in Complexity Theory Conference) (Cat. No.98CB36247).

[44]  Joost-Pieter Katoen,et al.  On the Satisfiability of Some Simple Probabilistic Logics , 2016, 2016 31st Annual ACM/IEEE Symposium on Logic in Computer Science (LICS).

[45]  Emiliano Lorini,et al.  A logic of trust and reputation , 2010, Log. J. IGPL.

[46]  Andrea Gasparri,et al.  Trust-based interactions in teams of mobile agents , 2016, 2016 American Control Conference (ACC).

[47]  P. Gollwitzer Goal Achievement: The Role of Intentions , 1993 .

[48]  Adnan Aziz,et al.  It Usually Works: The Temporal Logic of Stochastic Systems , 1995, CAV.

[49]  Neera Jain,et al.  A Classification Model for Sensing Human Trust in Machines Using EEG and GSR , 2018, ACM Trans. Interact. Intell. Syst..