A Survey on Trust in Autonomous Systems

As a result of the exponential growth in technology and computing in recent years, autonomous systems are becoming more relevant in our daily lives. As these systems evolve and become more complex, the notion of trust in human-autonomy interaction becomes a prominent issue that affects the performance of human-autonomy teaming. Prior studies indicate that humans have low levels of trust in semi and fully autonomous systems. In this survey, we review a wide range of technical papers and articles and go over the related experimental techniques in the literature of trust. We also explain limitations that are present in existing research works, and discuss open problems in this domain. It’s apparent that trust management is critical for the development of future artificial intelligence technologies.

[1]  Petros A. Ioannou,et al.  Driving Autopilot with Personalization Feature for Improved Safety and Comfort , 2015, 2015 IEEE 18th International Conference on Intelligent Transportation Systems.

[2]  Reena Master,et al.  Measurement of human trust in a hybrid inspection system based on signal detection theory measures , 2004 .

[3]  Holly A. Yanco,et al.  Identifying Factors that Influence Trust in Automated Cars and Medical Diagnosis Systems , 2014, AAAI Spring Symposia.

[4]  Göran Falkman,et al.  Presenting system uncertainty in automotive UIs for supporting trust calibration in autonomous driving , 2013, AutomotiveUI.

[5]  Raja Parasuraman,et al.  Humans and Automation: Use, Misuse, Disuse, Abuse , 1997, Hum. Factors.

[6]  Neera Jain,et al.  Real-Time Sensing of Trust in Human-Machine Interactions , 2016 .

[7]  Neera Jain,et al.  Dynamic modeling of trust in human-machine interactions , 2017, 2017 American Control Conference (ACC).

[8]  Christopher A. Miller,et al.  Trust and etiquette in high-criticality automated systems , 2004, CACM.

[9]  William Payre,et al.  Fully Automated Driving , 2016, Hum. Factors.

[10]  Bonnie M. Muir,et al.  Trust in automation. I: Theoretical issues in the study of trust and human intervention in automated systems , 1994 .

[11]  Rosemarie E. Yagoda,et al.  You Want Me to Trust a ROBOT? The Development of a Human–Robot Interaction Trust Scale , 2012, International Journal of Social Robotics.

[12]  Timothy Lethbridge,et al.  A New Approach for the Trust Calculation in Social Networks , 2006, ICE-B.

[13]  Eric Robinson,et al.  Science and Technology in the Industrial Revolution , 1970 .

[14]  N Moray,et al.  Trust, control strategies and allocation of function in human-machine systems. , 1992, Ergonomics.

[15]  R.R. Murphy,et al.  Robot-assisted medical reachback: a survey of how medical personnel expect to interact with rescue robots , 2004, RO-MAN 2004. 13th IEEE International Workshop on Robot and Human Interactive Communication (IEEE Catalog No.04TH8759).

[16]  Anand K. Gramopadhye,et al.  Measurement of trust in complex and dynamic systems using a quantitative approach , 2004 .

[17]  Sabine Himmel.  Science And Technology In The Industrial Revolution , 2016 .

[18]  Robin R. Murphy,et al.  An investigation of MML methods for fault diagnosis in mobile robots , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[19]  Toshiyuki Inagaki,et al.  Laboratory studies of trust between humans and machines in automated systems , 1999 .

[20]  George A. Bekey,et al.  AUTONOMOUS ROBOTS, From Biological Inspiration to Implementation and Control, by G.A. Bekey, MIT Press, 2005, xv + 577 pp., index, ISBN 0-262-02578-7, 25 pages of references (Hb. £35.95) , 2005, Robotica.

[21]  Jessie Y. C. Chen,et al.  A Meta-Analysis of Factors Affecting Trust in Human-Robot Interaction , 2011, Hum. Factors.

[22]  Moaed A. Abd,et al.  Trust , Satisfaction and Frustration Measurements During Human-Robot Interaction , 2017 .

[23]  Timothy G. Rosser,et al.  Indian and American consumer perceptions of cockpit configuration policy , 2015 .

[24]  Fumin Zhang,et al.  Human-Robot Mutual Trust in (Semi)autonomous Underwater Robots , 2014 .

[25]  Bonnie M. Muir,et al.  Trust Between Humans and Machines, and the Design of Decision Aids , 1987, Int. J. Man Mach. Stud..

[26]  Jacques Penders,et al.  Enhancing trust and confidence in human robot interaction , 2013 .

[27]  Danielle Dai,et al.  Public Perceptions of Self-Driving Cars: The Case of Berkeley, California , 2014 .

[28]  Michiel Woldring,et al.  Guidelines for Trust in Future ATM Systems: Principles , 2003 .

[29]  Regina A. Pomranky,et al.  The role of trust in automation reliance , 2003, Int. J. Hum. Comput. Stud..

[30]  John D. Lee,et al.  Trust in Automation: Designing for Appropriate Reliance , 2004 .

[31]  Cees J. H. Midden,et al.  The effects of errors on system trust, self-confidence, and the allocation of control in route planning , 2003, Int. J. Hum. Comput. Stud..

[32]  N. Moray,et al.  Trust in automation. Part II. Experimental studies of trust and human intervention in a process control simulation. , 1996, Ergonomics.

[33]  Ann M. Bisantz,et al.  The impact of cognitive feedback on judgment performance and trust with decision aids , 2008 .

[34]  D. Wiegmann,et al.  Similarities and differences between human–human and human–automation trust: an integrative review , 2007 .

[35]  Rino Falcone,et al.  Trust and control: A dialectic link , 2000, Appl. Artif. Intell..

[36]  Makoto Itoh,et al.  Trust in and use of automation: their dependence on occurrence patterns of malfunctions , 1999, IEEE SMC'99 Conference Proceedings. 1999 IEEE International Conference on Systems, Man, and Cybernetics (Cat. No.99CH37028).

[37]  Kristin E. Schaefer,et al.  The Perception And Measurement Of Human-robot Trust , 2013 .

[38]  Douglas R. Stinson,et al.  Social secret sharing in cloud computing using a new trust function , 2012, 2012 Tenth Annual International Conference on Privacy, Security and Trust.

[39]  Pei-Luen Patrick Rau,et al.  A Cross-cultural Study: Effect of Robot Appearance and Task , 2010, Int. J. Soc. Robotics.

[40]  Jenay M. Beer,et al.  Toward a framework for levels of robot autonomy in human-robot interaction , 2014, Journal of human-robot interaction.

[41]  Daniel R. Ilgen,et al.  Not All Trust Is Created Equal: Dispositional and History-Based Trust in Human-Automation Interactions , 2008, Hum. Factors.

[42]  D. Jolly,et al.  Trust between man and machine in a teleoperation system , 1996 .

[43]  Daniel P. Stormont,et al.  Analyzing Human Trust of Autonomous Systems in Hazardous Environments , 2008 .

[44]  Riender Happee,et al.  Public opinion on automated driving: results of an international questionnaire among 5000 respondents , 2015 .

[45]  Mehrdad Nojoumian,et al.  Impacts of Robot Assistant Performance on Human Trust , Satisfaction , and Frustration , 2017 .

[46]  Mehrdad Nojoumian.  Trust, Influence and Reputation Management Based on Human Reasoning , 2015, AAAI Workshop: Incentive and Trust in E-Communities.

[47]  P. Koopman,et al.  A Philosophy for Developing Trust in Self-driving Cars , 2015 .

[48]  Ricardo A. Daziano,et al.  Are Consumers Willing to Pay to Let Cars Drive for Them? Analyzing Response to Autonomous Vehicles , 2017 .