Measuring the Effectiveness of Human Autonomy Teaming

We examined two metrics for assessing Human-Autonomy-Teaming (HAT) performance, subjective workload and eye-gaze durations, in a simulation of dispatcher flight following while interacting with the HAT features of an Autonomous Constrained Flight Planner. Operator workload was lower in the HAT condition and decreased with time in the scenario. However, participants took more time to uplink flight plan changes in this condition.

[1]  Christopher D. Wickens,et al.  Humans: Still Vital After All These Years of Automation , 2008, Hum. Factors.

[2]  Ricky Russell,et al.  A Human-Autonomy Teaming Approach for a Flight-Following Task , 2017 .

[3]  Mica R. Endsley,et al.  From Here to Autonomy , 2017, Hum. Factors.

[4]  Mary L. Cummings,et al.  Functional Requirements for Onboard Intelligent Automation in Single Pilot Operations , 2016 .

[5]  Birsen Donmez,et al.  Evaluation criteria for human-automation performance metrics , 2008, PerMIS.

[6]  R. Mcintyre,et al.  A Conceptual Framework for Teamwork Measurement , 1997 .

[7]  John M. O'Hara,et al.  Identifying Requirements for Effective Human-Automation Teamwork , 2014 .

[8]  Guy H. Walker,et al.  Measuring Situation Awareness in complex systems: Comparison of measures study , 2009 .

[9]  Janice Langan-Fox,et al.  Human–automation teams and adaptable control for future air traffic management , 2009 .

[10]  Kim-Phuong L. Vu,et al.  Training Air Traffic Controller Trust in Automation within a NextGen Environment , 2013, HCI.

[11]  Jessie Y. C. Chen,et al.  A Meta-Analysis of Factors Affecting Trust in Human-Robot Interaction , 2011, Hum. Factors.

[12]  Jessie Y. C. Chen,et al.  Supervisory Control of Multiple Robots: Human-Performance Issues and User-Interface Design , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[13]  Joel Lachter,et al.  Beyond Point Design: General Pattern to Specific Implementations , 2017, AHFE.

[14]  Michael Matessa.  Using a Crew Resource Management Framework to Develop Human-Autonomy Teaming Measures , 2017 .

[15]  Vernoi Battiste,et al.  Transport Pilot Workload: A Comparison of Two Subjective Techniques , 1988 .

[16]  Janice Langan-Fox,et al.  Corrigendum to “Human-automation teams and adaptable control for future air traffic management” [Int J Ind Ergon (39) (2009) 894–903] , 2011 .

[17]  N. Moray,et al.  Trust in automation. Part II. Experimental studies of trust and human intervention in a process control simulation. , 1996, Ergonomics.

[18]  Colin G. Drury,et al.  Foundations for an Empirically Determined Scale of Trust in Automated Systems , 2000 .

[19]  Joel Lachter,et al.  Why Human-Autonomy Teaming? , 2017, AHFE.