Formalising Trust as a Computational Concept

Trust is a judgement of unquestionable utility — as humans we use it every day of our lives. However, trust has suffered from an imperfect understanding, a plethora of definitions, and informal use in the literature and in everyday life. It is common to say “I trust you,” but what does that mean? This thesis provides a clarification of trust. We present a formalism for trust which provides us with a tool for precise discussion. The formalism is implementable: it can be embedded in an artificial agent, enabling the agent to make trust-based decisions. Its applicability in the domain of Distributed Artificial Intelligence (DAI) is raised. The thesis presents a testbed populated by simple trusting agents which substantiates the utility of the formalism. The formalism provides a step in the direction of a proper understanding and definition of human trust. A contribution of the thesis is its detailed exploration of the possibilities of future work in the area.

[1]  F. Nye,et al.  Social Exchange in Developing Relationships , 1979 .

[2]  C. Butler,et al.  An experiment in cooperation. , 1969, Nursing outlook.

[3]  D. Wallace,et al.  Communication, group loyalty, and trust in the PD game , 1969 .

[4]  T. Schelling,et al.  The Strategy of Conflict. , 1961 .

[5]  D. H. Mills.  The Logic and Limits of Trust , 1983 .

[6]  W. Hamilton,et al.  The evolution of cooperation. , 1984, Science.

[7]  A. K. Dasgupta,et al.  Cost-Benefit Analysis: Theory and Practice. , 1973 .

[8]  R. Turner,et al.  Economics of Natural Resources and the Environment , 1989 .

[9]  P. Bonacich,et al.  The Development of Trust and Mistrust in Mixed-Motive Games , 1970 .

[10]  N. Burley,et al.  Social Evolution, Robert Trivers. Benjamin/Cummings, Menlo Park, Calfornia (1985), xvii, +462, Price £19.95 in U.K., $18.95 in U.S.A. (paperback) , 1986 .

[11]  J. Lewis,et al.  Trust as a Social Reality , 1985 .

[12]  Les Gasser,et al.  Social Conceptions of Knowledge and Action: DAI Foundations and Open Systems Semantics , 1991, Artif. Intell..

[13]  Van Ark,et al.  Group Dynamics: The Psychology of Small Group Behavior , 1972 .

[14]  Klaus Krickeberg,et al.  Markov learning models for multiperson interactions , 1962 .

[15]  A. Baier.  Trust and Antitrust , 1986, Ethics.

[16]  Lecomber.  Economics of natural resources , 1979 .

[17]  Eugene H. Spafford,et al.  The internet worm: crisis and aftermath , 1989 .

[18]  John D. Lee,et al.  Trust, self-confidence, and operators' adaptation to automation , 1994, Int. J. Hum. Comput. Stud..

[19]  R. Golembiewski,et al.  The centrality of interpersonal trust in group processes , 1975 .

[20]  Ludwig Wittgenstein,et al.  On certainty = Über Gewissheit , 1991 .

[21]  R. Zeckhauser,et al.  Risk within reason. , 1990, Science.

[22]  Trudy Govier.  Trust, Distrust, and Feminist Theory , 1992 .

[23]  Harold W. Thimbleby,et al.  Liveware: A New Approach to Sharing Data in Social Networks , 1991, Int. J. Man Mach. Stud..

[24]  Bjørn Lomborg,et al.  Game Theory Versus Multiple Agents: The Iterated Prisoner's Dilemma , 1992, MAAMAW.

[25]  Roy L. Behr,et al.  Nice Guys Finish Last—Sometimes , 1981 .

[26]  GasserLes.  Social conceptions of knowledge and action , 1991 .

[27]  J. Rotter.  A new scale for the measurement of interpersonal trust. , 1967, Journal of personality.

[28]  M. Nicholson.  The Resolution of Conflict , 1967 .

[29]  M. Deutsch.  A Theory of Co-operation and Competition , 1949 .

[30]  Patrick Suppes,et al.  Markov learning models for multiperson interactions , 1962 .

[31]  Bernhardt Lieberman.  i-Trust: a notion of trust in three-person games and international affairs , 1964 .

[32]  David Chapman,et al.  Pengi: An Implementation of a Theory of Activity , 1987, AAAI.

[33]  Allen Newell,et al.  Computer science as empirical inquiry: symbols and search , 1976, CACM.

[34]  A. Drogoul,et al.  Multi-Agent Simulation as a Tool for Modeling Societies: Application to Social Differentiation in Ant Colonies , 1992, MAAMAW.

[35]  R. Trivers.  The Evolution of Reciprocal Altruism , 1971, The Quarterly Review of Biology.

[36]  李幼升,et al.  Ph , 1989 .

[37]  Blair H. Sheppard,et al.  Business on a handshake , 1992 .

[38]  G. Reeke.  Marvin Minsky, The Society of Mind , 1991, Artif. Intell..

[39]  Paul R. Cohen,et al.  Benchmarks, Test Beds, Controlled Experimentation, and the Design of Agent Architectures , 1993, AI Mag..

[40]  Toby Tyrrell,et al.  Computational mechanisms for action selection , 1993 .

[41]  J. Rotter.  Interpersonal trust, trustworthiness, and gullibility. , 1980 .

[42]  Michael Georgeff,et al.  Reasoning about actions and plans , 1986 .

[43]  Derek Long,et al.  A Model for Learning by Source Control , 1988, IPMU.

[44]  Richard Lindley.  Lying: Moral Choice in Public and Private Life , 1980 .

[45]  Robert M. Pirsig.  Lila: An Inquiry into Morals , 1991 .

[46]  M. Deutsch.  An Experimental Study of the Effects of Co-Operation and Competition upon Group Process , 1949 .

[47]  Han Reichgelt,et al.  Towards a Semantics of Desires , 1991 .

[48]  Bernard Barber,et al.  The Logic and Limits of Trust , 1983 .

[49]  H. Simon,et al.  A Behavioral Model of Rational Choice , 1955 .

[50]  P. Swingle.  The resolution of conflict. , 1989 .

[51]  Diego Gambetta,et al.  Mafia: The Price of Distrust , 1988 .

[52]  Lars Hertzberg,et al.  On the attitude of trust , 1988 .

[53]  Pattie Maes,et al.  A bottom-up mechanism for behavior selection in an artificial creature , 1991 .

[54]  Patrick Bateson,et al.  THE BIOLOGICAL EVOLUTION OF COOPERATION AND TRUST , 1988 .

[55]  Innes A. Ferguson.  TouringMachines: an architecture for dynamic, rational, mobile agents , 1992 .

[56]  N. Luhmann.  Trust and Power , 1979 .

[57]  Joseph Y. Halpern,et al.  Knowledge and common knowledge in a distributed environment , 1984, JACM.

[58]  Gary James Jason,et al.  The Logic of Scientific Discovery , 1988 .

[59]  Thomas Hobbes,et al.  LEVIATHAN Or the Matter Forme and Power of a Commonwealth Ecclesiasticall and Civil , 1946 .

[60]  M. Gilpin,et al.  Metapopulation dynamics: a brief his-tory and conceptual domain , 1991 .

[61]  Olli Lagenspetz,et al.  Legitimacy and Trust , 1992 .

[62]  Ian H. Witten,et al.  THE WORM THAT TURNED: A SOCIAL USE OF COMPUTER VIRUSES , 1989 .

[63]  R. Dawkins,et al.  The extended phenotype : the gene as the unit of selection , 1982 .

[64]  K. Popper,et al.  Conjectures and Refutations , 1963 .

[65]  Roger C. Schank,et al.  Where's the AI? , 1991, AI Mag..

[66]  J. Elster.  Ulysses And The Sirens , 1979 .

[67]  P. Dasgupta.  Trust as a commodity , 1988 .

[68]  Han Reichgelt,et al.  Integrating Classical and Reactive Planning within an Architecture for Autonomous Agents , 1991, EWSP.

[69]  S. Boon,et al.  The dynamics of interpersonal trust: resolving uncertainty in the ace of risk , 1991 .

[70]  J. Rotter.  Generalized expectancies for interpersonal trust. , 1971 .

[71]  A. M. Turing,et al.  Computing Machinery and Intelligence , 1950, The Philosophy of Artificial Intelligence.

[72]  M. Argyle.  Cooperation, the basis of sociability , 1991 .

[73]  Pattie Maes,et al.  Situated agents can have goals , 1990, Robotics Auton. Syst..

[74]  Arthur Gladstone.  The social behavior of a rational animal: a review , 1961 .

[75]  MAURICE BRUCE,et al.  Leviathan or the Matter, Forme and Power of a Commonwealth, Ecclesiasticall and Civil The Second Treatise of Civil Government, and a Letter concerning Toleration On Liberty and Considerations on Representative Government Prophets and Peoples Politics and Morals , 1947, Nature.

[76]  Ronald E. Anderson.  ACM code of ethics and professional conduct , 1992, CACM.

[77]  H. Godfray.  The evolution of forgiveness , 1992, Nature.

[78]  Cristiano Castelfranchi,et al.  Artificial Social Systems , 1994 .

[79]  Jeffrey S. Rosenschein,et al.  A Domain Theory for Task Oriented Negotiation , 1993, IJCAI.

[80]  Carson C. Woo,et al.  SANP: a communication level protocol for negotiations (abstract) , 1992, SIGO.

[81]  Tom Campbell.  Seven theories of human society , 1981 .

[82]  John F. Shoch,et al.  The “worm” programs—early experience with a distributed computation , 1982, CACM.

[83]  Ilkka Hanski,et al.  Metapopulation dynamics : empirical and theoretical investigations , 1991 .

[84]  Carl Hewitt,et al.  Open Information Systems Semantics for Distributed Artificial Intelligence , 1991, Artif. Intell..

[85]  Kenneth A. Deffenbacher,et al.  A maturing of research on the behaviour of eyewitnesses , 1991 .

[86]  Pattie Maes,et al.  Designing autonomous agents: Theory and practice from biology to engineering and back , 1990, Robotics Auton. Syst..

[87]  M MuirBonnie.  Trust between humans and machines, and the design of decision aids , 1987 .

[88]  K. Sycara.  Utility theory in conflict resolution , 1988 .

[89]  Robert L. Swinth,et al.  The establishment of the trust relationship , 1967 .

[90]  R. Hinde,et al.  Cooperation and prosocial behaviour , 1991 .

[91]  R. S. D. Motta.  Economics of natural resources and the environment , 1990 .

[92]  Lester B. Lave,et al.  Risk orientation as a predictor in the Prisoner's Dilemma , 1966 .

[93]  Naftaly H. Minsky.  Law-governed systems , 1991, Softw. Eng. J..

[94]  Jeffrey S. Rosenschein,et al.  Rational interaction: cooperation among intelligent agents , 1986 .

[95]  Randall Steeb,et al.  Strategies of Cooperation in Distributed Problem Solving , 1983, IJCAI.

[96]  Paul R. Cohen,et al.  Envelopes as a Vehicle for Improving the Efficiency of Plan Execution , 1990 .

[97]  Bjorn Lomborg.  Game theory vs. multiple agents : The iterated Prisoner's Dilemma , 1994 .

[98]  Kaori Sato.  Trust and group size in a social dilemma , 1988 .

[99]  Francisco J. Garijo,et al.  MAKILA: A Tool for the Development of Cooperative Societies , 1992, MAAMAW.

[100]  R. Dawkins.  The Blind Watchmaker , 1986 .

[101]  Reid G. Smith,et al.  The Contract Net Protocol: High-Level Communication and Control in a Distributed Problem Solver , 1980, IEEE Transactions on Computers.

[102]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[103]  Thomas Y. C. Woo,et al.  Authentication for distributed systems , 1997, Computer.

[104]  Gregory S. Kavka.  Hobbes's War of All Against All , 1983, Ethics.

[105]  Herbert A. Simon,et al.  The Sciences of the Artificial , 1970 .

[106]  Eithan Ephrati,et al.  Multi-Agent Planning as Search for a Consensus that Maximizes Social Welfare , 1992, MAAMAW.

[107]  J. G. Holmes,et al.  Trust in close relationships. , 1985 .

[108]  Naftaly H. Minsky,et al.  The Imposition of Protocols Over Open Distributed Systems , 1991, IEEE Trans. Software Eng..

[109]  J. Galliers.  A theoretical framework for computer models of cooperative dialogue, acknowledging multiagent conflict , 1988 .

[110]  Cristiano Castelfranchi,et al.  Artificial Social Systems: 4th European Workshop on Modelling Autonomous Agents in a Multi-Agent World, MAAMAW '92, S. Martino al Cimino, Italy, July 29 - 31, 1992. Selected Papers , 1994 .

[111]  Forlano George.  An Experiment in Coöperation , 1932 .

[112]  John T. Kohl,et al.  The Evolution of the Kerberos Authentication Service , 1992 .

[113]  L. Preston,et al.  Utility interactions in a two-person world , 1961 .

[114]  Stephen Marsh,et al.  Trust in Distributed Artificial Intelligence , 1992, MAAMAW.

[115]  J. Dunn.  Trust and Political Agency , 1990 .

[116]  Yutaka Yamamoto,et al.  A Morality Based on Trust: Some Reflections on Japanese Morality , 1990 .

[117]  Philip E. Agre,et al.  ABSTRACT REASONING AS EMERGENT FROM CONCRETE ACTIVITY , 1987 .

[118]  J. Dunn,et al.  Philosophy in History: The concept of “trust” in the politics of John Locke , 1984 .

[119]  Stephanie Forrest,et al.  Emergent computation: self-organizing, collective, and cooperative phenomena in natural and artificial computing networks , 1990 .

[120]  John C. Harsanyi,et al.  Morality and the Prisoner's Dilemma problem: Comments on Baier's paper , 1977 .

[121]  Bernard Williams,et al.  Making sense of humanity: Formal structures and social reality , 1995 .

[122]  Frank von Martial.  Coordinating Plans of Autonomous Agents , 1992, Lecture Notes in Computer Science.

[123]  A. H. Bond,et al.  An Analysis of Problems and Research in DAI , 1988 .

[124]  Derek Parfit,et al.  Prudence, morality, and the prisoner's dilemma , 1981 .

[125]  O. J. Harvey.  Motivation and social interaction : cognitive determinants , 1963 .

[126]  Steven P. McNeel,et al.  Cooperation and Competitive Goals: A Social-Comparison Analysis , 1974 .

[127]  Michael P. Georgeff,et al.  A Theory of Action for MultiAgent Planning , 1984, AAAI.

[128]  N. Jennings.  On Being Responsible , 1992 .

[129]  S. Shapiro.  The Social Control of Impersonal Trust , 1987, American Journal of Sociology.

[130]  Harold W. Thimbleby.  Can viruses ever be useful? , 1991, Comput. Secur..

[131]  M. E. Shaw.  Group dynamics : the psychology of small group behavior , 1971 .

[132]  Steven P. McNeel,et al.  Training cooperation in the Prisoner's Dilemma ☆ , 1973 .