Machine Agency in Human-Machine Networks; Impacts and Trust Implications

We live in an emerging hyper-connected era in which people are in contact and interacting with an increasing number of other people and devices. Increasingly, modern IT systems form networks of humans and machines that interact with one another. As machines take a more active role in such networks, they exert an in-creasing level of influence on other participants. We review the existing literature on agency and propose a definition of agency that is practical for describing the capabilities and impact human and machine actors may have in a human-machine network. On this basis, we discuss and demonstrate the impact and trust implica-tions for machine actors in human-machine networks for emergency decision support, healthcare and future smart homes. We maintain that machine agency not only facilitates human to machine trust, but also interpersonal trust; and that trust must develop to be able to seize the full potential of future technology.

[1]  David V. Canter,et al.  Fires and human behaviour , 1980 .

[2]  George Bravos,et al.  Human-Machine Networks: Towards a Typology and Profiling Framework , 2016, HCI.

[3]  S. Shyam Sundar,et al.  Balancing human agency and object agency: an end-user interview study of the internet of things , 2012, UbiComp.

[4]  Clifford Nass,et al.  Anthropocentrism and computers , 1995, Behav. Inf. Technol..

[5]  Jeremy Rose,et al.  Machine Agency as Perceived Autonomy: An Action Perspective , 2000, Organizational and Social Perspectives on IT.

[6]  B. J. Fogg,et al.  Persuasive computers: perspectives and research directions , 1998, CHI.

[7]  Susan Wiedenbeck,et al.  On-line trust: concepts, evolving themes, a model , 2003, Int. J. Hum. Comput. Stud..

[8]  William R. King,et al.  A meta-analysis of the technology acceptance model , 2006, Inf. Manag..

[9]  A. Bandura Self-Efficacy: The Exercise of Control , 1997, Journal of Cognitive Psychotherapy.

[10]  Nigel Shadbolt,et al.  A Taxonomic Framework for Social Machines , 2014 .

[11]  Konstantin Beznosov,et al.  The socialbot network: when bots socialize for fame and money , 2011, ACSAC '11.

[12]  J. Drury,et al.  Collective action and psychological change: the emergence of new social identities. , 2000, The British journal of social psychology.

[13]  Rosalind W. Picard Affective Computing , 1997 .

[14]  John Law,et al.  Notes on the theory of the actor-network: Ordering, strategy, and heterogeneity , 1992 .

[15]  J. H. Davis,et al.  An Integrative Model Of Organizational Trust , 1995 .

[16]  P. Leonardi Materiality, Sociomateriality, and Socio-Technical Systems: What Do These Terms Mean? How are They Related? Do We Need Them? , 2012 .

[17]  C. Nass,et al.  Machines and Mindlessness , 2000 .

[18]  George Bravos,et al.  Understanding Human-Machine Networks: A Cross-Disciplinary Survey , 2015, ArXiv.

[19]  Jeremy Rose,et al.  The Problem of Agency; How Humans Act, How Machines Act , 2003 .

[20]  Manuel Blum,et al.  reCAPTCHA: Human-Based Character Recognition via Web Security Measures , 2008, Science.

[21]  A. M. Rich,et al.  Automated diagnostic aids: The effects of aid reliability on users' trust and reliance , 2001 .

[22]  Michael Vitale,et al.  The Wisdom of Crowds , 2015, Cell.

[23]  David V. Canter,et al.  Intentionality and fatality during the King's Cross underground fire , 1992 .

[24]  P. Scraton Policing with Contempt: The Degrading of Truth and Denial of Justice in the Aftermath of the Hillsborough Disaster , 1999 .

[25]  W. Dutton,et al.  Trust in the Internet as an experience technology , 2006 .

[26]  N Moray,et al.  Trust, control strategies and allocation of function in human-machine systems. , 1992, Ergonomics.

[27]  J. Rose,et al.  The Double Dance of Agency : a socio-theoretic account of how machines and humans interact , 2005 .

[28]  A. Bandura Social cognitive theory: an agentic perspective. , 1999, Annual review of psychology.

[29]  J. H. Davis,et al.  An Integrative Model of Organizational Trust: Past, Present, and Future , 2007 .

[30]  Akbar Zaheer,et al.  Trust as an Organizing Principle Bill McEvily , 2003 .

[31]  A. Kellerman,et al.  The Constitution of Society : Outline of the Theory of Structuration , 2015 .

[32]  Batya Friedman,et al.  Human agency and responsible computing: Implications for computer system design , 1992, J. Syst. Softw..

[33]  Sushil Jajodia,et al.  Who is tweeting on Twitter: human, bot, or cyborg? , 2010, ACSAC '10.

[34]  B Roebuck,et al.  The investigation of the Hillsborough disaster by the Health and Safety Executive , 1995 .

[35]  John D. Lee,et al.  Trust in Automation: Designing for Appropriate Reliance , 2004 .