DRAFT COPY 1 CH XX : Human Supervisory Control Challenges in Network Centric Operations

Network-centric operations (NCOs), envisioned for future command and control systems in military and civilian settings, must be supported by sophisticated automated systems, so human-computer inter...

[1]  J. Veltman,et al.  Physiological workload reactions to increasing levels of task difficulty. , 1998, Ergonomics.

[2]  Mark W. Scerbo,et al.  Effects of a Psychophysiological System for Adaptive Automation on Performance, Workload, and the Event-Related Potential P300 Component , 2003, Hum. Factors.

[3]  Alex M. Andrew,et al.  Humans and Automation: System Design and Research Issues , 2003 .

[4]  N Moray,et al.  Trust, control strategies and allocation of function in human-machine systems. , 1992, Ergonomics.

[5]  David B. Kaber,et al.  The effects of level of automation and adaptive automation on human performance, situation awareness and workload in a dynamic control task , 2004 .

[6]  Sheryl L. Miller.  Window of Opportunity: Using the Interruption Lag to Manage Disruption in Complex Tasks , 2002 .

[7]  Nadine B. Sarter,et al.  How are we doing?: Presenting System Confidence Information to Support Trust Calibration and Adaptive Function Allocation , 2003 .

[8]  Anthony H. Dekker,et al.  C4ISR Architectures, Social Network Analysis and the FINC Methodology: An Experiment in Military Organisational Structure , 2002 .

[9]  Jennifer Blackhurst,et al.  Network-based approach to modelling uncertainty in a supply chain , 2004 .

[10]  Darryl G. Humphrey,et al.  Toward a Psychophysiological Assessment of Dynamic Changes in Mental Workload , 1994, Human factors.

[11]  C. Macklin,et al.  Big is better? Human factors issues of large screen displays with military command teams , 2001 .

[12]  Mary Beth Rosson,et al.  Notification and awareness: synchronizing task-oriented collaborative activity , 2003, Int. J. Hum. Comput. Stud..

[13]  Nancy J. Cooke,et al.  Coordinated Awareness of Situation by Teams (CAST): Measuring Team Situation Awareness of a Communication Glitch , 2005 .

[14]  Yili Liu,et al.  Queueing network modeling of human performance of concurrent spatial and verbal tasks , 1994, IEEE Trans. Syst. Man Cybern. Part A.

[15]  Charles E. Billings,et al.  Aviation Automation: The Search for A Human-centered Approach , 1996 .

[16]  Heath A. Ruff,et al.  Human Interaction with Levels of Automation and Decision-Aid Fidelity in the Supervisory Control of Multiple Simulated Unmanned Air Vehicles , 2002, Presence: Teleoperators & Virtual Environments.

[17]  S. Strogatz.  Exploring complex networks , 2001, Nature.

[18]  Regina A. Pomranky,et al.  The role of trust in automation reliance , 2003, Int. J. Hum. Comput. Stud..

[19]  L. Ross,et al.  Biased Assimilation and Attitude Polarization: The Effects of Prior Theories on Subsequently Considered Evidence , 1979 .

[20]  Thomas B. Sheridan,et al.  Telerobotics, Automation, and Human Supervisory Control , 2003 .

[21]  Mary L. Cummings,et al.  The Need for Command and Control Instant Message Adaptive Interfaces: Lessons Learned from Tactical Tomahawk Human-in-the-Loop Simulations , 2004, Cyberpsychology Behav. Soc. Netw..

[22]  J. Gibson.  The Ecological Approach to Visual Perception , 1979 .

[23]  Jean-Marc Robert,et al.  Trust in new decision aid systems , 2006, IHM '06.

[24]  J. E. Groves,et al.  Made in America: Science, Technology and American Modernist Poets , 1989 .

[25]  Mary Anne Buttigieg,et al.  Object Displays Do Not Always Support Better Integrated Task Performance , 1989 .

[26]  Ann M. Bisantz,et al.  Utilizing graphical formats to convey uncertainty in a decision-making task , 2002 .

[27]  Colin Potts,et al.  Design of Everyday Things , 1988 .

[28]  Harvey S. Smallman,et al.  Naive Realism: Misplaced Faith in Realistic Displays , 2005 .

[29]  Christopher D. Wickens,et al.  Unmanned Aerial Vehicle Flight Control: False Alarms versus Misses , 2004 .

[30]  Kim J. Vicente,et al.  Ecological interface design: theoretical foundations , 1992, IEEE Trans. Syst. Man Cybern..

[31]  Ann M. Bisantz,et al.  The Role of Meta-Information in C2 Decision-Support Systems , 2006 .

[32]  Harvey S. Smallman,et al.  The Use of 2D and 3D Displays for Shape-Understanding versus Relative-Position Tasks , 2001, Hum. Factors.

[33]  Mary L. Cummings,et al.  Automation and Accountability in Decision Support System Interface Design , 2006 .

[34]  R. Yerkes,et al.  The relation of strength of stimulus to rapidity of habit‐formation , 1908 .

[35]  Christopher D. Wickens,et al.  A model for types and levels of human interaction with automation , 2000, IEEE Trans. Syst. Man Cybern. Part A.

[36]  Jeffrey M. Bradshaw,et al.  Ten Challenges for Making Automation a "Team Player" in Joint Human-Agent Activity , 2004, IEEE Intell. Syst..

[37]  Hankins Tc,et al.  A comparison of heart rate, eye activity, EEG and subjective measures of pilot mental workload during flight. , 1998, Aviation, space, and environmental medicine.

[38]  R Kakigi,et al.  [Event-related brain potentials]. , 1997, Nihon rinsho. Japanese journal of clinical medicine.

[39]  Harvey S. Smallman,et al.  Recovery from Interruptions to a Dynamic Monitoring Task: The Beguiling Utility of Instant Replay , 2005 .

[40]  Daniel C. McFarlane,et al.  Coordinating the Interruption of People in Human-Computer Interaction , 1999, INTERACT.

[41]  E. Hess,et al.  Pupil Size in Relation to Mental Activity during Simple Problem-Solving , 1964, Science.

[42]  J. Gregory Trafton,et al.  Human control of multiple unmanned vehicles: effects of interface type on execution and task switching times , 2006, HRI '06.

[43]  Chris Berka,et al.  Real-Time Analysis of EEG Indexes of Alertness, Cognition, and Memory Acquired With a Wireless EEG Headset , 2004, Int. J. Hum. Comput. Interact..

[44]  Robert S. Bolia,et al.  A multi-layer visual display for air battle managers: Effects of depth and transparency on performance and workload in a dual-task scenario , 2004 .

[45]  Håkan Jansson,et al.  An analysis of driver’s steering behaviour during auditory or haptic warnings for the designing of lane departure warning system , 2003 .

[46]  Edwin Hutchins,et al.  How a Cockpit Remembers Its Speeds , 1995, Cogn. Sci..

[47]  Christopher D. Wickens,et al.  An introduction to human factors engineering , 1997 .

[48]  M. Just,et al.  Interdependence of Nonoverlapping Cortical Systems in Dual Cognitive Tasks , 2001, NeuroImage.

[49]  Mary L. Cummings,et al.  Creating moral buffers in weapon control interface design , 2004, IEEE Technology and Society Magazine.

[50]  Robert G Loeb,et al.  A laboratory evaluation of an auditory display designed to enhance intraoperative monitoring. , 2002, Anesthesia and analgesia.

[51]  Mica R. Endsley,et al.  Toward a Theory of Situation Awareness in Dynamic Systems , 1995, Hum. Factors.

[52]  Jana M. Price,et al.  Collaborative Planning and Coordinated Team Performance , 2022 .

[53]  Stephen M. Fiore,et al.  Process mapping and shared cognition: Teamwork and the development of shared problem models. , 2004 .

[54]  Mary L. Cummings,et al.  The Impact of Intelligent Aiding for Multiple Unmanned Aerial Vehicle Schedule Management , 2007 .

[55]  A. Kramer,et al.  Physiological metrics of mental workload: A review of recent progress , 1990, Multiple-task performance.

[56]  Jacob W. Crandall,et al.  Identifying Predictive Metrics for Supervisory Control of Multiple Robots , 2007, IEEE Transactions on Robotics.

[57]  Arthur D. Fisk,et al.  Modeling and analysis of a dynamic judgment task using a lens model approach , 2000, IEEE Trans. Syst. Man Cybern. Part A.

[58]  Marcus Watson,et al.  Sonification Supports Eyes-Free Respiratory Monitoring and Task Time-Sharing , 2004, Hum. Factors.

[59]  Chris Miller,et al.  The human factor in complexity , 2000 .

[60]  Nadine Sarter,et al.  Multimodal information presentation: Design guidance and research challenges , 2006 .

[61]  Nadine B. Sarter,et al.  Supporting Decision Making and Action Selection under Time Pressure and Uncertainty: The Case of In-Flight Icing , 2001, Hum. Factors.

[62]  Alan C. Schultz,et al.  Using a natural language and gesture interface for unmanned vehicles , 2000, Defense, Security, and Sensing.

[63]  Mary L. Cummings,et al.  Operator scheduling strategies in supervisory control of multiple UAVs , 2007 .

[64]  Bonnie M. Muir,et al.  Trust Between Humans and Machines, and the Design of Decision Aids , 1987, Int. J. Man Mach. Stud..

[65]  Stephanie Guerlain,et al.  An Interactive Decision Support Tool for Real-time In-flight Replanning of Autonomous Vehicles , 2004 .

[66]  N. Moray,et al.  Adaptive automation, trust, and self-confidence in fault management of time-critical tasks. , 2000, Journal of experimental psychology. Applied.

[67]  E L Wiener,et al.  Application of Vigilance Research: Rare, Medium, or Well Done? , 1987, Human factors.

[68]  Thomas B. Sheridan,et al.  Human and Computer Control of Undersea Teleoperators , 1978 .

[69]  Jonathan Histon,et al.  Structural considerations and cognitive complexity in air traffic control , 2002, Proceedings. The 21st Digital Avionics Systems Conference.

[70]  E. Hess,et al.  Pupil Size as Related to Interest Value of Visual Stimuli , 1960, Science.

[71]  Michael S. Wogalter,et al.  Designing Effective Warnings , 2006 .

[72]  A. Pope,et al.  Biocybernetic system evaluates indices of operator engagement in automated task , 1995, Biological Psychology.

[73]  Martha Grabowski,et al.  Network Performance Impacts on Operators in Safety-critical Systems , 2006, Int. J. Inf. Technol. Decis. Mak..

[74]  Anthony P Tvaryanas,et al.  Visual scan patterns during simulated control of an uninhabited aerial vehicle (UAV). , 2004, Aviation, space, and environmental medicine.

[75]  J. Cellier,et al.  Interference between switched tasks , 1992 .

[76]  Glenn F. Wilson,et al.  Real-Time Assessment of Mental Workload Using Psychophysiological Measures and Artificial Neural Networks , 2003, Hum. Factors.

[77]  John D. Lee,et al.  Trust, self-confidence, and operators' adaptation to automation , 1994, Int. J. Hum. Comput. Stud..

[78]  M. Rugg,et al.  Electrophysiology of Mind: Event-Related Brain Potentials and Cognition , 1995 .

[79]  John D. Lee,et al.  Trust in Automation: Designing for Appropriate Reliance , 2004 .

[80]  Keith Baker,et al.  Organizational Structure and Dynamic Information Awareness in Command Teams , 2004 .

[81]  J. Gregory Trafton,et al.  Memory for goals: an activation-based model , 2002, Cogn. Sci..

[82]  Mary Beth Rosson,et al.  Paradox of the active user , 1987 .

[83]  Hiroshi Furukawa,et al.  A flexible delegation-type interface enhances system performance in human supervision of multiple robots: empirical studies with RoboFlag , 2005, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[84]  M. L. Cummings,et al.  UAVs as Tactical Wingmen : Control Methods and Pilots ’ Perceptions , .

[85]  Raja Parasuraman,et al.  Designing for Flexible Interaction Between Humans and Automation: Delegation Interfaces for Supervisory Control , 2007, Hum. Factors.

[86]  Lindsley Boiney.  Team Decision Making in Time-Sensitive Environments , 2005 .

[87]  D. Watts.  The “New” Science of Networks , 2004 .

[88]  Endsley,et al.  A model of inter- and intrateam situation awareness: implications for design, training and measurement , 2001 .

[89]  L J Skitka,et al.  Automation Bias and Errors: Are Crews Better Than Individuals? , 2000, The International journal of aviation psychology.

[90]  Cees J. H. Midden,et al.  The effects of errors on system trust, self-confidence, and the allocation of control in route planning , 2003, Int. J. Hum. Comput. Stud..

[91]  Mica R. Endsley,et al.  Design and Evaluation for Situation Awareness Enhancement , 1988 .

[92]  Philip J. Smith,et al.  Brittleness in the design of cooperative problem-solving systems: the effects on user performance , 1997, IEEE Trans. Syst. Man Cybern. Part A.

[93]  Raja Parasuraman,et al.  Effects of Imperfect Automation on Decision Making in a Simulated Command and Control Task , 2007, Hum. Factors.

[94]  Shelley E. Taylor,et al.  Social cognition, 2nd ed. , 1991 .

[95]  Jacob W. Crandall,et al.  Predicting Operator Capacity for Supervisory Control of Multiple UAVs , 2007, Innovations in Intelligent Machines.

[96]  Scott Makeig,et al.  Eye Activity Correlates of Workload during a Visuospatial Memory Task , 2001, Hum. Factors.

[97]  Hal R. Varian,et al.  Information rules - a strategic guide to the network economy , 1999 .

[98]  D. C. McFarlane,et al.  Recovering Context After Interruption , 2019, Proceedings of the Twenty-Fourth Annual Conference of the Cognitive Science Society.

[99]  Kathleen L. Mosier,et al.  Accountability and automation bias , 2000, Int. J. Hum. Comput. Stud..

[100]  Daniel C. McFarlane,et al.  Comparison of Four Primary Methods for Coordinating the Interruption of People in Human-Computer Interaction , 2002, Hum. Comput. Interact..

[101]  Raja Parasuraman,et al.  Beyond Levels of Automation: An Architecture for More Flexible Human-Automation Collaboration , 2003 .

[102]  A. Tversky,et al.  Judgment under Uncertainty: Heuristics and Biases , 1974, Science.

[103]  Timothy A. Salthouse,et al.  Decision Making and Problem Solving , 1982 .

[104]  Mary L. Cummings,et al.  Automation Bias in Intelligent Time Critical Decision Support Systems , 2004 .

[105]  Robert Johansen,et al.  Groupware: Computer Support for Business Teams , 1988 .

[106]  John Polich,et al.  P300 in Clinical Applications: Meaning, Method, and Measurement , 1991 .

[107]  Stephanie Guerlain.  INTERACTIVE ADVISORY SYSTEMS , 2000 .

[108]  Christopher D. Wickens,et al.  Multiple resources and performance prediction , 2002 .

[109]  Mary Anne Buttigieg,et al.  Emergent Features in Visual Display Design for Two Types of Failure Detection Tasks , 1991, Human factors.

[110]  Thomas B. Sheridan,et al.  Mitigation of human supervisory control wait times through automation strategies , 2005 .

[111]  Christopher D. Wickens,et al.  On the Independence of Compliance and Reliance: Are Automation False Alarms Worse Than Misses? , 2007, Hum. Factors.

[112]  Heath A. Ruff,et al.  Manual Versus Speech Input for Unmanned Aerial Vehicle Control Station Operations , 2003 .

[113]  M. L. Cummings,et al.  Collaborative Human-Computer Decision Making in Network Centric Warfare , 2005 .

[114]  Krishna R. Pattipati,et al.  Networks of Decision-Making and Communicating Agents: A New Methodology for Design and Evaluation of Organizational Strategies and Heterarchical Structures , 2005 .

[115]  Mary L. Cummings,et al.  Operator Performance and Intelligent Aiding in Unmanned Aerial Vehicle Scheduling , 2007, IEEE Intelligent Systems.

[116]  Daniel Gopher,et al.  Switching attention between tasks: Exploration of the components of executive control and their development with training , 1996 .

[117]  Yi Zhang,et al.  A dynamic model of interaction between reliance on automation and cooperation in multi-operator multi-automation situations , 2006 .

[118]  N. Moray,et al.  Trust in automation. Part II. Experimental studies of trust and human intervention in a process control simulation. , 1996, Ergonomics.

[119]  J. Andreassi.  Psychophysiology: Human Behavior and Physiological Response , 1980 .

[120]  Mary L. Cummings,et al.  Developing Operator Capacity Estimates for Supervisory Control of Autonomous Vehicles , 2007, Hum. Factors.

[121]  Mica R. Endsley,et al.  The Effect of Task Load and Shared Displays on Team Situation Awareness , 2000 .

[122]  J. Somervell.  Measuring distraction and awareness caused by graphical and textual displays in the periphery , 2001 .

[123]  Keith Stewart Gempler,et al.  DISPLAY OF PREDICTOR RELIABILITY ON A COCKPIT DISPLAY OF TRAFFIC INFORMATION , 1999 .

[124]  Michael R. Macedonia,et al.  Power from the Edge , 2005, Computer.

[125]  Kathleen L. Mosier,et al.  Does automation bias decision-making? , 1999, Int. J. Hum. Comput. Stud..

[126]  Kipling D. Williams,et al.  PROCESSES Social Loafing: A Meta-Analytic Review and Theoretical Integration , 2022 .

[127]  Nancy J. Cooke,et al.  Measuring Team Knowledge: A Window to the Cognitive Underpinnings of Team Performance , 2003 .

[128]  Christopher D. Wickens,et al.  Mission Control of Multiple Unmanned Aerial Vehicles: A Workload Analysis , 2005, Hum. Factors.

[129]  David S Alberts,et al.  Network Centric Warfare: Developing and Leveraging Information Superiority , 1999 .

[130]  J.-C. Angue,et al.  Quantitative analysis of mental workload influence on eye scanning movements , 1993, Proceedings of IEEE Systems Man and Cybernetics Conference - SMC.

[131]  Ravi S. Adapathya,et al.  Strategic Behavior, Workload, and Performance in Task Scheduling , 1991 .

[132]  Linda R. Elliott,et al.  Comparing the effects of visual-auditory and visual-tactile feedback on user performance: a meta-analysis , 2006, ICMI '06.

[133]  Mary L. Cummings,et al.  Deconstructing Complexity in Air Traffic Control , 2005 .

[134]  Yuri N. Levchuk,et al.  Normative Design of Organizations — Part I : Mission Planning , 2001 .

[135]  D. Norman,et al.  Psychological Issues in Support of Multiple Activities , 1986 .

[136]  Berthold Färber,et al.  BREAKING UP OPEN-LOOP STEERING CONTROL ACTIONS: THE STEERING WHEEL AS AN ACTIVE CONTROL DEVICE , 1993 .

[137]  Yvette J. Tenney,et al.  Situation awareness catches on: what? so what? now what? , 2006 .

[138]  Raja Parasuraman,et al.  Adaptive Automation for Human-Robot Teaming in Future Command and Control Systems , 2007 .

[139]  Stephanie Guerlain,et al.  User-Initiated Notification: A Concept for Aiding the Monitoring Activities of Process Control Operators , 1996 .

[140]  J Miller,et al.  Channel interaction and the redundant-targets effect in bimodal divided attention. , 1991, Journal of experimental psychology. Human perception and performance.

[141]  J. G. Hollands,et al.  Engineering Psychology and Human Performance , 1984 .

[142]  David B. Kaber,et al.  Design of Automation for Telerobots and the Effect on Performance, Operator Situation Awareness, and Subjective Workload , 2000 .

[143]  Philip J. Smith,et al.  Design of a Cooperative Problem-Solving System for En-Route Flight Planning: An Empirical Evaluation , 1994 .

[144]  K B Bennett,et al.  Graphical Displays: Implications for Divided Attention, Focused Attention, and Problem Solving , 1992, Human factors.

[145]  Ann M. Bisantz,et al.  Utilizing Graphical Formats to Convey Uncertainty in a Decision Making Task , 2000 .

[146]  Michael A. Goodrich,et al.  Validating human-robot interaction schemes in multitasking environments , 2005, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[147]  Barbara Tversky,et al.  Animation: can it facilitate? , 2002, Int. J. Hum. Comput. Stud..

[148]  J. Sterman.  Misperceptions of feedback in dynamic decision making , 1989 .

[149]  Tibor Vámos,et al.  Adapting automation to man, culture and society , 1983, Autom..

[150]  Daniel Gopher,et al.  Switching tasks and attention policies. , 2000, Journal of experimental psychology. General.

[151]  P. Tetlock,et al.  Accountability: a social magnifier of the dilution effect. , 1989, Journal of personality and social psychology.

[152]  C. Wickens.  Engineering psychology and human performance, 2nd ed. , 1992 .

[153]  Rena A. Conejo.  The Effects of Highlighting, Validity, and Feature Type on Air-to-Ground Target Acquisition Performance. , 1998 .

[154]  K. Mosier,et al.  Human Decision Makers and Automated Decision Aids: Made for Each Other? , 1996 .

[155]  John L. Andreassi.  Psychophysiology: Human behavior & physiological response, 5th ed. , 2007 .

[156]  Raja Parasuraman,et al.  Humans and Automation: Use, Misuse, Disuse, Abuse , 1997, Hum. Factors.

[157]  Krishna R. Pattipati,et al.  Normative design of organizations. I. Mission planning , 2002, IEEE Trans. Syst. Man Cybern. Part A.

[158]  Nadine B. Sarter,et al.  Good Vibrations: Tactile Feedback in Support of Attention Allocation and Human-Automation Coordination in Event-Driven Domains , 1999, Hum. Factors.

[159]  Paul P. Maglio,et al.  Tradeoffs in displaying peripheral information , 2000, CHI.

[160]  Thomas B. Sheridan,et al.  Dynamic Decisions and Work Load in Multitask Supervisory Control , 1980, IEEE Transactions on Systems, Man, and Cybernetics.

[161]  Diana Schmidt.  A Queuing Analysis of the Air Traffic Controller''s Workload , 1978 .

[162]  E. M. Altmann,et al.  Task Interruption: Resumption Lag and the Role of Cues , 2004 .

[163]  M. Sheelagh T. Carpendale,et al.  Storage bins: mobile storage for collaborative tabletop displays , 2005, IEEE Computer Graphics and Applications.