Trust-Based Design of Human-Guided Algorithms

Abstract : By combining the strengths of human and computers, Human Machine Collaborative Decision Making has been shown to generate higher quality solutions in less time than conventional computerized methods. Human-guided algorithms (HGAs) harness the power of sophisticated algorithms and computers to provide flexibility to the human decision maker to model correctly and dynamically the problem and steer the algorithm to solutions that match his/her objectives. HGAs are designed to make the power of Operations Research accessible to problem domain experts and decision makers, and incorporate their expert knowledge. In order to appropriately utilize algorithms during a planner's decision making, HGA operators must appropriately trust the HGA and the final solution. Through the use of trust-based design (TBD), it was hypothesized that users of the HGA will gain better insight into the solution process, improve their calibration of trust, and generate superior solutions. The application of TBD requires the consideration of algorithms, solution steering methods, and displays required to best match human and computer complimentary strengths and to generate solutions that can be appropriately trusted. Abstract hierarchy, Ecological Interface Design, and various trust models are used to ensure that the HGA operators' evaluation of trust can be correctly calibrated. A human-subject evaluation was used to test the effectiveness of the TBD design approach for HGAs. An HGA was designed and developed using the described TBD approach. The participants were presented with the task of using the HGA to develop a routing plan for military aircraft. The results showed that TBD had a significant effect on trust, HGA performance, and the quality of final solutions. Another finding was that, HGA operators must be provided with additional trust related information to improve their understanding in order to calibrate properly their trust in the system.

[1]  J. G. Hollands,et al.  Engineering Psychology and Human Performance , 1984 .

[2]  Bonnie M. Muir,et al.  Trust in automation. I: Theoretical issues in the study of trust and human intervention in automated systems , 1994 .

[3]  Heath A. Ruff,et al.  Human Interaction with Levels of Automation and Decision-Aid Fidelity in the Supervisory Control of Multiple Simulated Unmanned Air Vehicles , 2002, Presence: Teleoperators & Virtual Environments.

[4]  Regina A. Pomranky,et al.  The role of trust in automation reliance , 2003, Int. J. Hum. Comput. Stud..

[5]  Loren G. Terveen,et al.  Overview of human-computer collaboration , 1995, Knowl. Based Syst..

[6]  Sheue-Ling Hwang,et al.  Application of quality engineering to evaluate the effects of situation awareness and trust in automation system , 1999, IEEE SMC'99 Conference Proceedings. 1999 IEEE International Conference on Systems, Man, and Cybernetics (Cat. No.99CH37028).

[7]  Jeremy S Malasky,et al.  Human machine collaborative decision making in a complex optimization system , 2005 .

[8]  John D. Lee,et al.  Trust in Automation: Designing for Appropriate Reliance , 2004, Hum. Factors.

[9]  S S Stevens,et al.  HUMAN ENGINEERING FOR AN EFFECTIVE AIR-NAVIGATION AND TRAFFIC-CONTROL SYSTEM, AND APPENDIXES 1 THRU 3 , 1951 .

[10]  Gary Klein,et al.  A Recognitional Planning Model , 1999 .

[11]  Kiel M. Martin.  Dynamic Planning Under Uncertainty for Theater Airlift Operations , 2007 .

[12]  Jens Rasmussen.  Ecological Interface Design for Reliable Human-Machine Systems , 1999 .

[13]  Stacey D. Scott,et al.  Investigating human-computer optimization , 2002, CHI.

[14]  Anthony J. Masalonis.  Effects of training operators on situation-specific automation reliability , 2003, SMC'03 Conference Proceedings. 2003 IEEE International Conference on Systems, Man and Cybernetics. Conference Theme - System Security and Assurance (Cat. No.03CH37483).

[15]  Christopher D. Wickens,et al.  A model for types and levels of human interaction with automation , 2000, IEEE Trans. Syst. Man Cybern. Part A.

[16]  Makoto Itoh,et al.  Trust in and use of automation: their dependence on occurrence patterns of malfunctions , 1999, IEEE SMC'99 Conference Proceedings. 1999 IEEE International Conference on Systems, Man, and Cybernetics (Cat. No.99CH37028).

[17]  K. Mosier,et al.  Human Decision Makers and Automated Decision Aids: Made for Each Other? , 1996 .

[18]  Joe Marks,et al.  The HuGS platform: a toolkit for interactive optimization , 2002, AVI '02.

[19]  Keith W. DeGregory,et al.  Optimization-based allocation of force protection resources in an asymmetric environment , 2007 .

[20]  Kim J. Vicente,et al.  Supporting operator problem solving through ecological interface design , 1995, IEEE Trans. Syst. Man Cybern..

[21]  John D. Lee,et al.  Trust, self-confidence, and operators' adaptation to automation , 1994, Int. J. Hum. Comput. Stud..

[22]  Jennie J. Gallimore,et al.  Investigation of error rates when controlling multiple uninhabited combat aerial vehicles , 2004, Proceedings of the 2004 Winter Simulation Conference, 2004..

[23]  Kim J. Vicente,et al.  Ecological interface design: theoretical foundations , 1992, IEEE Trans. Syst. Man Cybern..

[24]  Alex M. Andrew,et al.  Humans and Automation: System Design and Research Issues , 2003 .

[25]  N Moray,et al.  Trust, control strategies and allocation of function in human-machine systems. , 1992, Ergonomics.

[26]  Joe Marks,et al.  Human-guided tabu search , 2002, AAAI/IAAI.

[27]  Kathleen L. Mosier,et al.  Does automation bias decision-making? , 1999, Int. J. Hum. Comput. Stud..

[28]  Abuse.  Humans and Automation : Use , Misuse , Disuse , , 2008 .

[29]  S. Narayanan,et al.  Human effectiveness issues in simulated uninhabited combat aerial vehicles , 2003, Proceedings of the 2003 Winter Simulation Conference, 2003..

[30]  Tom Krenzke.  Ant colony optimization for agile motion planning , 2006 .

[31]  Ji Gao,et al.  Extending the decision field theory to model operators' reliance on automation in supervisory control situations , 2006, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[32]  Bonnie M. Muir,et al.  Trust Between Humans and Machines, and the Design of Decision Aids , 1987, Int. J. Man Mach. Stud..

[33]  N. Moray,et al.  Trust in automation. Part II. Experimental studies of trust and human intervention in a process control simulation. , 1996, Ergonomics.