Modeling real-time human-automation collaborative scheduling of unmanned vehicles

Recent advances in autonomy have enabled a future vision of single operator control of multiple heterogeneous Unmanned Vehicles (UVs). Real-time scheduling for multiple UVs in uncertain environments will require the computational ability of optimization algorithms combined with the judgment and adaptability of human supervisors. Automated Schedulers (AS), while faster and more accurate than humans at complex computation, are notoriously "brittle" in that they can only take into account those quantifiable variables, parameters, objectives, and constraints identified in the design stages that were deemed to be critical. Previous research has shown that when human operators collaborate with AS in real-time operations, inappropriate levels of operator trust, high operator workload, and a lack of goal alignment between the operator and AS can cause lower system performance and costly or deadly errors. Currently, designers trying to address these issues test different system components, training methods, and interaction modalities through costly human-in-the-loop testing. Thus, the objective of this thesis was to develop and validate a computational model of real-time human-automation collaborative scheduling of multiple UVs. First, attributes that are important to consider when modeling real-time human-automation collaborative scheduling were identified, providing a theoretical basis for the model proposed in this thesis. Second, a Collaborative Human-Automation Scheduling (CHAS) model was developed using system dynamics modeling techniques, enabling the model to capture non-linear human behavior and performance patterns, latencies and feedback interactions in the system, and qualitative variables such as human trust in automation. The CHAS model can aid a designer of future UV systems by simulating the impact of changes in system design and operator training on human and system performance. This can reduce the need for time-consuming human-in-the-loop testing that is typically required to evaluate such changes. It can also allow the designer to explore a wider trade space of system changes than is possible through prototyping or experimentation. Through a multi-stage validation process, the CHAS model was tested on three experimental data sets to build confidence in the accuracy and robustness of the model under different conditions. Next, the CHAS model was used to develop recommendations for system design and training changes to improve system performance. These changes were implemented and through an additional set of human subject experiments, the quantitative predictions of the CHAS model were validated. Specifically, test subjects who play computer and video games frequently were found to have a higher propensity to over-trust automation. By priming these gamers to lower their initial trust to a more appropriate level, system performance was improved by 10% as compared to gamers who were primed to have higher trust in the AS. The CHAS model provided accurate quantitative predictions of the impact of priming…

[1]  Linda G. Pierce,et al.  Take the Advice of a Decision Aid: I'D Rather be Wrong ! , 2005 .

[2]  Jonathan P. How,et al.  Receding horizon control of autonomous aerial vehicles , 2002, Proceedings of the 2002 American Control Conference (IEEE Cat. No.CH37301).

[3]  Birsen Donmez,et al.  Supporting intelligent and trustworthy maritime path planning decisions , 2010, Int. J. Hum. Comput. Stud..

[4]  Diana Schmidt A Queuing Analysis of the Air Traffic Controller''s Workload , 1978 .

[5]  Mary L. Cummings,et al.  Mixed-initiative strategies for real-time scheduling of multiple unmanned vehicles , 2012, 2012 American Control Conference (ACC).

[6]  Thomas B. Sheridan,et al.  Telerobotics, Automation, and Human Supervisory Control , 2003 .

[7]  Jessie Y. C. Chen,et al.  A Meta-Analysis of Factors Affecting Trust in Human-Robot Interaction , 2011, Hum. Factors.

[8]  Peter Norvig,et al.  Artificial Intelligence: A Modern Approach , 1995 .

[9]  C. B. Cave Very Long-Lasting Priming in Picture Naming , 1997 .

[10]  J. Forrester Industrial Dynamics , 1997 .

[11]  Jonathan P. How,et al.  Operator Object Function Guidance for a Real-Time Unmanned Vehicle Scheduling Algorithm , 2012, J. Aerosp. Comput. Inf. Commun..

[12]  C. S. Green,et al.  Action video game modifies visual selective attention , 2003, Nature.

[13]  Anders Petersen,et al.  Intensive video gaming improves encoding speed to visual short-term memory in young male adults. , 2013, Acta psychologica.

[14]  Alexander C. Kahn,et al.  Experimental evaluation of human-machine collaborative algorithms in planning for multiple UAVs , 2005, 2005 IEEE International Conference on Systems, Man and Cybernetics.

[15]  Joseph L Thomer,et al.  Trust-Based Design of Human-Guided Algorithms , 2007 .

[16]  Jessie Y. C. Chen,et al.  Supervisory Control of Multiple Robots: Human-Performance Issues and User-Interface Design , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[17]  Andrew Kopeikin,et al.  Flight Testing a Heterogeneous Multi-UAV System with Human Supervision , 2012 .

[18]  Armen A Mkrtchyan,et al.  Modeling operator performance in low task load supervisory domains , 2011 .

[19]  J. G. Hollands,et al.  Engineering Psychology and Human Performance , 1984 .

[20]  Philip J. Smith,et al.  Design of a Cooperative Problem-Solving System for En-Route Flight Planning: An Empirical Evaluation , 1994 .

[21]  Peter M. Senge,et al.  A system dynamics approach to investment-function formulation and testing , 1980 .

[22]  E. Reed The Ecological Approach to Visual Perception , 1989 .

[23]  Joe Marks,et al.  Human-Guided Simple Search , 2000, AAAI/IAAI.

[24]  Jacob W. Crandall,et al.  Predicting Operator Capacity for Supervisory Control of Multiple UAVs , 2007, Innovations in Intelligent Machines.

[25]  Jonathan P. How,et al.  Robust Decentralized Task Assignment for Cooperative UAVs , 2006 .

[26]  M. Anjali Sastry Time and tide in organizations : simulating change processes in adaptive, punctuated, and ecological theories of organizational evolution , 1995 .

[27]  George P. Richardson Introduction to System Dynamics Modeling , 1981 .

[28]  Katia P. Sycara,et al.  Neglect benevolence in human control of swarms in the presence of latency , 2012, 2012 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[29]  Michael A. Goodrich,et al.  Experiments in adjustable autonomy , 2001, 2001 IEEE International Conference on Systems, Man and Cybernetics. e-Systems and e-Man for Cybernetics in Cyberspace (Cat.No.01CH37236).

[30]  John D. Lee,et al.  Trust, self-confidence, and operators' adaptation to automation , 1994, Int. J. Hum. Comput. Stud..

[31]  Sameera S. Ponda,et al.  Decentralized Information-Rich Planning and Hybrid Sensor Fusion for Uncertainty Reduction in Human-Robot Missions , 2011 .

[32]  S Lewandowsky,et al.  The dynamics of trust: comparing humans to automation. , 2000, Journal of experimental psychology. Applied.

[33]  John D. Lee,et al.  Trust in Automation: Designing for Appropriate Reliance , 2004 .

[34]  Frank Rösler,et al.  N400 Effects Reflect Activation Spread During Retrieval of Arithmetic Facts , 1999 .

[35]  L. Darrell Whitley,et al.  Mixed Initiative Scheduling for the Air Force Satellite Control Network , 1999 .

[36]  Dhavan V. Shah,et al.  MEDIA PRIMING EFFECTS: ACCESSIBILITY, ASSOCIATION, AND ACTIVATION , 1998 .

[37]  Raja Parasuraman,et al.  Humans and Automation: Use, Misuse, Disuse, Abuse , 1997, Hum. Factors.

[38]  Mary L. Cummings,et al.  Collaborative Human-Automation Decision Making , 2009, Handbook of Automation.

[39]  Colin G. Drury,et al.  Foundations for an Empirically Determined Scale of Trust in Automated Systems , 2000 .

[40]  Thomas B. Sheridan,et al.  Dynamic Decisions and Work Load in Multitask Supervisory Control , 1980, IEEE Transactions on Systems, Man, and Cybernetics.

[41]  J. Gregory Trafton,et al.  Human control of multiple unmanned vehicles: effects of interface type on execution and task switching times , 2006, HRI '06.

[42]  Mustapha Mouloua,et al.  Human Performance, Situation Awareness and Automation. Current Research and Trends. Volume 1 , 2004 .

[43]  Youdan Kim,et al.  Genetic Algorithm Based Decentralized Task Assignment for Multiple Unmanned Aerial Vehicles in Dynamic Environments , 2011 .

[44]  Jeffrey M. Bradshaw,et al.  Trust in Automation , 2013, IEEE Intelligent Systems.

[45]  J. Sterman Misperceptions of feedback in dynamic decision making , 1989 .

[46]  P. Hancock,et al.  Stress, Workload, and Fatigue , 2009 .

[47]  Birsen Donmez,et al.  Modeling Workload Impact in Multiple Unmanned Vehicle Supervisory Control , 2010, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[48]  E. Vandewater,et al.  Media and Attention, Cognition, and School Achievement , 2008, The Future of children.

[49]  J.K. Hedrick,et al.  Border patrol and surveillance missions using multiple unmanned air vehicles , 2004, 2004 43rd IEEE Conference on Decision and Control (CDC) (IEEE Cat. No.04CH37601).

[50]  Christopher A. Miller,et al.  Human-Computer Etiquette: MANAGING EXPECTIONS with INTENTIONAL AGENTS , 2004 .

[51]  Andrew Greasley,et al.  A comparison of system dynamics and discrete event simulation , 2009 .

[52]  D. Schacter Implicit memory: History and current status. , 1987 .

[53]  K. Preston White,et al.  Systems engineering models of human-machine interaction , 1981, Proceedings of the IEEE.

[54]  Stacey D. Scott,et al.  Investigating human-computer optimization , 2002, CHI.

[55]  Thomas B. Sheridan,et al.  DRAFT COPY 1 CH XX : Human Supervisory Control Challenges in Network Centric Operations , 2010 .

[56]  Mary L. Cummings,et al.  Boredom and Distraction in Multiple Unmanned Vehicle Supervisory Control , 2013, Interact. Comput..

[57]  R. F. Lorch,et al.  Priming and search processes in semantic memory: a test of three models of spreading activation , 1982 .

[58]  Jonathan P. How,et al.  The Impact of Human–Automation Collaboration in Decentralized Multiple Unmanned Vehicle Control , 2012, Proceedings of the IEEE.

[59]  Jonathan P. How,et al.  Scalable reward learning from demonstration , 2013, 2013 IEEE International Conference on Robotics and Automation.

[60]  L J Skitka,et al.  Automation bias: decision making and performance in high-tech cockpits. , 1997, The International journal of aviation psychology.

[61]  Robert P. Goldman,et al.  The Playbook™ Approach to Adaptive Automation , 2005 .

[62]  Mary L. Cummings,et al.  Predicting Controller Capacity in Supervisory Control of Multiple UAVs , 2008, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[63]  Philip J. Smith,et al.  Brittleness in the design of cooperative problem-solving systems: the effects on user performance , 1997, IEEE Trans. Syst. Man Cybern. Part A.

[64]  Jonathan P. How,et al.  Increasing autonomy of UAVs , 2009, IEEE Robotics & Automation Magazine.

[65]  J.A. Stankovic,et al.  Misconceptions about real-time computing: a serious problem for next-generation systems , 1988, Computer.

[66]  V. Barnett,et al.  Applied Linear Statistical Models , 1975 .

[67]  Christopher D. Wickens,et al.  The Future of Air Traffic Control: Human Operators and Automation , 1998 .

[68]  T. P. Wright,et al.  Factors affecting the cost of airplanes , 1936 .

[69]  R Parasuraman,et al.  Designing automation for human use: empirical studies and quantitative models , 2000, Ergonomics.

[70]  Stephanie Guerlain Using the Critiquing Approach to Cope with Brittle Expert Systems , 1995 .

[71]  John D. Sterman,et al.  Expectation formation in behavioral simulation models , 1986 .

[72]  Andrew S Clare,et al.  Dynamic human-computer collaboration in real-time unmanned vehicle scheduling , 2010 .

[73]  M. J. D. Powell,et al.  An efficient method for finding the minimum of a function of several variables without calculating derivatives , 1964, Comput. J..

[74]  John D. Sterman,et al.  Testing Behavioral Simulation Models by Direct Experiment , 1987 .

[75]  Barry G. Silverman Human-Computer Collaboration , 1992, Hum. Comput. Interact..

[76]  A. Tversky,et al.  Judgment under Uncertainty: Heuristics and Biases , 1974, Science.

[77]  Timothy A. Salthouse,et al.  Decision Making and Problem Solving , 1982 .

[78]  John R. Anderson How Can the Human Mind Occur in the Physical Universe , 2007 .

[79]  Colonel,et al.  UNITED STATES AIR FORCE , 2013 .

[80]  Jack Homer,et al.  Partial-model testing as a validation tool for system dynamics (1983) , 2012 .

[81]  Victor A. Riley,et al.  A General Model of Mixed-Initiative Human-Machine Systems , 1989 .

[82]  Jens Rasmussen,et al.  Skills, rules, and knowledge; signals, signs, and symbols, and other distinctions in human performance models , 1983, IEEE Transactions on Systems, Man, and Cybernetics.

[83]  D. Norman,et al.  Psychological Issues in Support of Multiple Activities , 1986 .

[84]  J M Thompson,et al.  Human factors in telesurgery: effects of time delay and asynchrony in video and control feedback with local manipulative assistance. , 1999, Telemedicine journal : the official journal of the American Telemedicine Association.

[85]  Mary L. Cummings,et al.  Teamwork in controlling multiple robots , 2012, 2012 7th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[86]  C. B. Tilanus,et al.  Applied Economic Forecasting , 1966 .

[87]  N. Repenning,et al.  Disaster Dynamics: Understanding the Role of Quantity in Organizational Collapse , 2002 .

[88]  Mica R. Endsley,et al.  Toward a Theory of Situation Awareness in Dynamic Systems , 1995, Hum. Factors.

[89]  Nicholas Roy,et al.  Comparing the Performance of Expert User Heuristics and an Integer Linear Program in Aircraft Carrier Deck Operations , 2014, IEEE Transactions on Cybernetics.

[90]  Mary L. Cummings,et al.  Paying Attention to the Man behind the Curtain , 2011, IEEE Pervasive Computing.

[91]  Glenn Gunzelmann,et al.  An Initial Evaluation of a Cognitive Model of UAV Reconnaissance , 2008 .

[92]  H Stefan Bracha,et al.  Freeze, Flight, Fight, Fright, Faint: Adaptationist Perspectives on the Acute Stress Response Spectrum , 2004, CNS Spectrums.

[93]  Thomas B. Sheridan,et al.  Space teleoperation through time delay: review and prognosis , 1993, IEEE Trans. Robotics Autom..

[94]  John R. Anderson A Spreading Activation Theory of Memory , 1988 .

[95]  Joseph M. Sussman,et al.  Routing and scheduling temporal and heterogeneous freight car traffic on rail networks , 1998 .

[96]  Dimitris Bertsimas,et al.  A Robust Optimization Approach to Inventory Theory , 2006, Oper. Res..

[97]  Janet E. Miller,et al.  Development of Metrics for Trust in Automation , 2010 .

[98]  Penelope M. Sanderson,et al.  Towards the model human scheduler , 1991 .

[99]  M. Tushman,et al.  Organizational Evolution: A Metamorphosis Model of Convergence and Reorientation , 1985 .

[100]  G. L. Ricard,et al.  Manual control with delays: a bibliography , 1994, COMG.

[101]  Mary L. Cummings,et al.  Identifying Suitable Algorithms for Human-Computer Collaborative Scheduling of Multiple Unmanned Vehicles , 2012 .

[102]  John D. Lee,et al.  Human-Automation Collaboration in Dynamic Mission Planning: A Challenge Requiring an Ecological Approach , 2006 .

[103]  John R. Wilson,et al.  A New Model of Scheduling in Manufacturing: Tasks, Roles, and Monitoring , 2004, Hum. Factors.

[104]  Bonnie M. Muir,et al.  Trust Between Humans and Machines, and the Design of Decision Aids , 1987, Int. J. Man Mach. Stud..

[105]  Raja Parasuraman,et al.  Beyond Levels of Automation: An Architecture for More Flexible Human-Automation Collaboration , 2003 .

[106]  Jessie Y. C. Chen,et al.  A Model of Human-Robot Trust , 2011 .

[107]  Dan R. Olsen,et al.  Fan-out: measuring human control of multiple robots , 2004, CHI.

[108]  Mary L. Cummings,et al.  Developing Operator Capacity Estimates for Supervisory Control of Autonomous Vehicles , 2007, Hum. Factors.

[109]  Carl Nehme,et al.  Modeling human supervisory control in heterogeneous unmanned vehicle systems , 2009 .

[110]  M. Scerbo STRESS, WORKLOAD, AND BOREDOM IN VIGILANCE: A PROBLEM AND AN ANSWER. , 2001 .

[111]  Raja Parasuraman,et al.  The World is not Enough: Trust in Cognitive Agents , 2012 .

[112]  D. Sterman,et al.  Misperceptions of Feedback in a Dynamic Decision Making Experiment , 1989 .

[113]  Jason C. Ryan,et al.  Assessing the performance of human-automation collaborative planning systems , 2011 .

[114]  S. G. Ponnambalam,et al.  An extensive review of research in swarm robotics , 2009, 2009 World Congress on Nature & Biologically Inspired Computing (NaBIC).

[115]  Jeremiah Gertler,et al.  Homeland Security: Unmanned Aerial Vehicles and Border Surveillance , 2010 .

[116]  Donald A. Norman,et al.  User Centered System Design: New Perspectives on Human-Computer Interaction , 1988 .

[117]  Mary L. Cummings,et al.  Assessing Operator Workload and Performance in Expeditionary Multiple Unmanned Vehicle Control , 2010 .

[118]  Kaveh Nezami Rad Modelling collaborative planning and scheduling scenarios that include human and computer decision activities , 2008 .

[119]  Linda G. Pierce,et al.  The Perceived Utility of Human and Automated Aids in a Visual Detection Task , 2002, Hum. Factors.

[120]  P. B. Sujit,et al.  Multiple UAV Task Allocation Using Particle Swarm Optimization , 2008 .

[121]  R. Henson Neuroimaging studies of priming , 2003, Progress in Neurobiology.

[122]  Mary L. Cummings,et al.  The Role of Human-Automation Consensus in Multiple Unmanned Vehicle Scheduling , 2010, Hum. Factors.

[123]  Jean Scholtz,et al.  Adapting GOMS to model human-robot interaction , 2007, 2007 2nd ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[124]  N. Moray,et al.  Adaptive automation, trust, and self-confidence in fault management of time-critical tasks. , 2000, Journal of experimental psychology. Applied.

[125]  Joe Marks,et al.  Human-Guided Search : Survey and Recent Results , 2003 .

[126]  Heath A. Ruff,et al.  Human Interaction with Levels of Automation and Decision-Aid Fidelity in the Supervisory Control of Multiple Simulated Unmanned Air Vehicles , 2002, Presence: Teleoperators & Virtual Environments.

[127]  Jacob W. Crandall,et al.  Attention Allocation Efficiency in Human-UV Teams , 2007 .

[128]  李幼升,et al.  Ph , 1989 .

[129]  Jessie Y. C. Chen,et al.  Human Performance Issues and User Interface Design for Teleoperated Robots , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[130]  Douglas A. Wiegmann,et al.  Effects of Attribute and Goal Framing on Automation Reliance and Compliance , 2005 .

[131]  Daniel Noel Southern,et al.  Human-guided management of collaborating unmanned vehicles in degraded communication environments , 2010 .

[132]  R. Yerkes,et al.  The relation of strength of stimulus to rapidity of habit‐formation , 1908 .

[133]  Michael A. Goodrich,et al.  Towards combining UAV and sensor operator roles in UAV-enabled visual search , 2008, 2008 3rd ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[134]  J. G. Miller,et al.  Information input overload and psychopathology. , 1960, The American journal of psychiatry.

[135]  Paul Scerri,et al.  Design and evaluation of the Adaptive Interface Management System (AIMS) for collaborative mission planning with unmanned vehicles , 2012, Infotech@Aerospace.

[136]  J. Márquez,et al.  Introducing a Human-Automation Collaboration Taxonomy (HACT) in Command and Control Decision-Support Systems , 2007 .

[137]  Yaman Barlas,et al.  Formal aspects of model validity and validation in system dynamics , 1996 .

[138]  Maria Olinda Rodas,et al.  Developing a Decision Tool to Evaluate Unmanned System's Command and Control Technologies in Network Centric Operations Environments , 2011 .

[139]  Steffen Bayer,et al.  Business dynamics: Systems thinking and modeling for a complex world , 2004 .

[140]  Mary L. Cummings,et al.  Modeling multiple human operators in the supervisory control of heterogeneous unmanned vehicles , 2009, PerMIS.

[141]  Susana Rubio,et al.  Evaluation of Subjective Mental Workload: A Comparison of SWAT, NASA‐TLX, and Workload Profile Methods , 2004 .

[142]  Gregory Schraw,et al.  Assessing metacognitive awareness , 1994 .

[143]  Allen Newell,et al.  The psychology of human-computer interaction , 1983 .

[144]  Mary L. Cummings,et al.  Automation Bias in Intelligent Time Critical Decision Support Systems , 2004 .

[145]  Han-Lim Choi,et al.  Consensus-Based Decentralized Auctions for Robust Task Allocation , 2009, IEEE Transactions on Robotics.

[146]  Thomas B. Sheridan,et al.  Monitoring Behavior and Supervisory Control , 1976 .

[147]  Alborz Geramifard,et al.  Model estimation within planning and learning , 2012, 2012 American Control Conference (ACC).

[148]  Liling Ren,et al.  Interaction of Automation and Time Pressure in a Route Replanning Task , 2002 .

[149]  George P. Richardson,et al.  Introduction to System Dynamics Modeling with DYNAMO , 1981 .

[150]  Mary L. Cummings,et al.  TASK-BASED INTERFACES FOR DECENTRALIZED MULTIPLE UNMANNED VEHICLE CONTROL , 2011 .

[151]  Anthony S. White,et al.  A qualitative systems dynamic model of human monitoring ofautomated systems. , 2003 .

[152]  Michael Lewis,et al.  USARSim: Simulation for the Study of Human-Robot Interaction , 2007 .

[153]  Mary L. Cummings,et al.  Assessing operator strategies for real-time replanning of multiple unmanned vehicles , 2012 .

[154]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[155]  Hyochoong Bang,et al.  Cooperative Task Assignment and Path Planning of Multiple UAVs Using Genetic Algorithm , 2007 .

[156]  Michael J. Barnes,et al.  Modeling the effects of crew size and crew fatigue on the control of tactical unmanned aerial vehicles (TUAVs) , 2000, 2000 Winter Simulation Conference Proceedings (Cat. No.00CH37165).

[157]  Michael A. Goodrich,et al.  Task Switching and Multi-Robot Teams , 2005 .

[158]  Emilio Frazzoli,et al.  On Efficient Cooperative Strategies between UAVs and Humans in a Dynamic Environment , 2008 .

[159]  Jenny W. Rudolph,et al.  The Dynamics of Action-Oriented Problem Solving: Linking Interpretation and Choice , 2009 .

[160]  J M Coyle,et al.  System dynamics in defence analysis: some case studies , 1999, J. Oper. Res. Soc..

[161]  Jeffrey D. Anderson,et al.  Managing autonomy in robot teams: Observations from four experiments , 2007, 2007 2nd ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[162]  Andreas Größler,et al.  Inductive and Deductive System Dynamics Modeling , 2007 .

[163]  D. Kahneman,et al.  Attention and Effort , 1973 .

[164]  Andersen Consultng,et al.  A Comparison of System Dynamics ( SD ) and Discrete Event Simulation ( DES ) , 1999 .

[165]  Y. Barlas,et al.  Discrete vs. Continuous Simulation: When Does It Matter? 1 , 2009 .

[166]  N Moray,et al.  Trust, control strategies and allocation of function in human-machine systems. , 1992, Ergonomics.

[167]  Jens Rasmussen,et al.  Outlines of a Hybrid Model of the Process Plant Operator , 1976 .

[168]  Christopher D. Wickens,et al.  Control of Multiple-UAVs: A Workload Analysis , 2003 .

[169]  Andrew K. Whitten,et al.  Decentralized Planning for Autonomous Agents Cooperating in Complex Missions , 2010 .

[170]  Ji Gao,et al.  Extending the decision field theory to model operators' reliance on automation in supervisory control situations , 2006, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[171]  Ravi Kant,et al.  A Study of Creativity of Secondary School Children as a Correlate of Some Television Viewing Habits , 2012 .

[172]  Andrew S. Clare,et al.  Modeling the Impact of Operator Trust on Performance in Multiple Robot Control , 2013, AAAI Spring Symposium: Trust and Autonomous Systems.

[173]  Han-Lim Choi,et al.  Real-Time Multi-UAV Task Assignment in Dynamic and Uncertain Environments , 2009 .

[174]  Mary L. Cummings,et al.  The Need for Command and Control Instant Message Adaptive Interfaces: Lessons Learned from Tactical Tomahawk Human-in-the-Loop Simulations , 2004, Cyberpsychology Behav. Soc. Netw..

[175]  D. Schacter,et al.  Priming and the Brain , 1998, Neuron.