Human Factors Measurement for Future Air Traffic Control Systems

Objective: This article provides a critical review of research pertaining to the measurement of human factors (HF) issues in current and future air traffic control (ATC). Background: Growing worldwide air traffic demands call for a radical departure from current ATC systems. Future systems will have a fundamental impact on the roles and responsibilities of ATC officers (ATCOs). Valid and reliable methods of assessing HF issues associated with these changes, such as a potential increase (or decrease) in workload, are of utmost importance for advancing theory and for designing systems, procedures, and training. Method: We outline major aviation changes and how these relate to five key HF issues in ATC. Measures are outlined, compared, and evaluated and are followed by guidelines for assessing these issues in the ATC domain. Recommendations for future research are presented. Results: A review of the literature suggests that situational awareness and workload have been widely researched and assessed using a variety of measures, but researchers have neglected the areas of trust, stress, and boredom. We make recommendations for use of particular measures and the construction of new measures. Conclusion: It is predicted that, given the changing role of ATCOs and profound future airspace requirements and configurations, issues of stress, trust, and boredom will become more significant. Researchers should develop and/or refine existing measures of all five key HF issues to assess their impact on ATCO performance. Furthermore, these issues should be considered in a holistic manner. Application: The current article provides an evaluation of research and measures used in HF research on ATC that will aid research and ATC measurement.

[1]  Albert J. Rehmann,et al.  Handbook of Human Performance Measures and Crew Requirements for Flightdeck Research. , 1995 .

[2]  Francis T. Durso,et al.  En Route Operational Errors and Situational Awareness , 1998 .

[3]  Teresa Lesiuk,et al.  The effect of preferred music listening on stress levels of air traffic controllers , 2008 .

[4]  Walter C. Borman,et al.  Task Performance and Contextual Performance: The Meaning for Personnel Selection Research , 1997 .

[5]  Raja Parasuraman,et al.  Free Flight and the Air Traffic Controller: Active Control versus Passive Monitoring , 1999 .

[6]  Kevin Sprong Improving Flight Efficiency Through Terminal Area RNAV , 2005 .

[7]  Peter Brooker,et al.  SESAR and NextGen: Investing In New Paradigms , 2008, Journal of Navigation.

[8]  Hugo de Jonge ATM/CNS: the response to current and future needs , 2000 .

[9]  Peter Brooker,et al.  Air traffic control automation: For humans or people? , 2005 .

[10]  David B. Kaber,et al.  Workload State Classification With Automation During Simulated Air Traffic Control , 2007 .

[11]  André Dittmar,et al.  Mental workload in air traffic control: an index constructed from field tests. , 2004, Aviation, space, and environmental medicine.

[12]  Tecnología do ar e espaço European Organisation for the Safety of Air Navigation , 2010 .

[13]  David B. Kaber,et al.  Adaptive Automation of a Dynamic Control Task Based on Secondary Task Workload Measurement , 1999 .

[14]  Neville A. Stanton,et al.  Human Factors and Ergonomics Methods , 2004 .

[15]  Cheryl K. Beeler,et al.  Workload history effects: A comparison of sudden increases and decreases on performance , 2006 .

[16]  David B. Kaber,et al.  On the Design of Adaptive Automation for Complex Systems , 2001 .

[17]  L. M. Sherer,et al.  RADIO TECHNICAL COMMISSION FOR AERONAUTICS , 1947 .

[18]  F. Vanderhaegen,et al.  COMMUNICATION AND COOPERATION ANALYSIS IN AIR TRAFFIC CONTROL , 1995 .

[19]  P. Goillau,et al.  Guidelines for Trust in Future ATM Systems: A Literature Review , 2003 .

[20]  William C. Elm,et al.  Integrating Cognitive Systems Engineering Throughout the Systems Engineering Process , 2008 .

[21]  Eduardo Salas,et al.  Situation Awareness in Team Performance: Implications for Measurement and Training , 1995, Hum. Factors.

[22]  Raja Parasuraman,et al.  Effects of Automated Conflict Cuing and Traffic Density on Air Traffic Controller Performance and Visual Attention in a Datalink Environment , 2006 .

[23]  Tyler H. Shaw,et al.  Effects of warned and unwarned demand transitions on vigilance performance and stress , 2008, Anxiety, stress, and coping.

[24]  Todd D. Hollander,et al.  Signal regularity and the mindlessness model of vigilance. , 2005, British journal of psychology.

[25]  Barry Kirwan,et al.  Validation of human reliability assessment techniques: Part 1 -- Validation issues , 1997 .

[26]  Janice Langan-Fox,et al.  Human–automation teams and adaptable control for future air traffic management , 2009 .

[27]  Conclusions , 1989 .

[28]  Sarah Sharples,et al.  Datalink in air traffic management: Human factors issues in communications. , 2007, Applied ergonomics.

[29]  Katharine K. Lee,et al.  Developing ATC Automation in the Field: It Pays to Get Your Hands Dirty , 1998 .

[30]  Mica R. Endsley,et al.  Shared situation awareness in the flight deck-ATC system , 1998 .

[31]  Joel S. Warm,et al.  Vigilance Requires Hard Mental Work and Is Stressful , 2008, Hum. Factors.

[32]  William M. Jones,et al.  Situation Awareness Information Dominance & Information Warfare. , 1997 .

[33]  Carol A. Manning,et al.  INVESTIGATING THE VALIDITY OF PERFORMANCE AND OBJECTIVE WORKLOAD EVALUATION RESEARCH (POWER) , 2001 .

[34]  D. Ballinger,et al.  Changes in roles/responsibilities of Air Traffic Control under precision taxiing , 2007, 2007 IEEE/AIAA 26th Digital Avionics Systems Conference.

[35]  Kenneth R. Allendoerfer,et al.  Effect of Free Flight Conditions on Controller Performance, Workload, and Situation Awareness , 1997 .

[36]  Peter Brooker,et al.  Controller workload, airspace capacity and future systems. , 2003 .

[37]  Ed M. Dougherty Context and human reliability analysis , 1993 .

[38]  M R Endsley,et al.  Level of automation effects on performance, situation awareness and workload in a dynamic control task. , 1999, Ergonomics.

[39]  Esa M. Rantanen,et al.  Hierarchical Conflict Detection in Air Traffic Control , 2005 .

[40]  Thomas Prevot,et al.  ATC Technologies for Controller-Managed and Autonomous Flight Operations , 2005 .

[41]  Raja Parasuraman,et al.  Fuzzy signal detection theory: analysis of human and machine performance in air traffic control, and analytic considerations , 2003, Ergonomics.

[42]  I. Singh,et al.  Individual differences in monitoring failures of automation , 1993 .

[43]  Eduardo Salas,et al.  Understanding adaptability : a prerequisite for effective performance within complex environments , 2006 .

[44]  George Shouksmith,et al.  Job Stress Factors for New Zealand and Canadian Air Traffic Controllers , 1988 .

[45]  Christopher A. Miller,et al.  Bridging the Information Transfer Gap: Measuring Goodness of Information Fit , 1999, J. Vis. Lang. Comput..

[46]  Jean-Michel Hoc,et al.  Cognitive Evaluation of Human-Human and Human-Machine Cooperation Modes in Air Traffic Control , 1998 .

[47]  Janice Langan-Fox,et al.  VALIDITY AND RELIABILITY OF MEASURES OF OCCUPATIONAL AND ROLE STRESS USING SAMPLES OF AUSTRALIAN MANAGERS AND PROFESSIONALS , 1996 .

[48]  Mica R. Endsley,et al.  Distribution of Attention, Situation Awareness and Workload in a Passive Air Traffic Control Task: Implications for Operational Errors and Automation , 1998 .

[49]  Alex M. Andrew,et al.  Humans and Automation: System Design and Research Issues , 2003 .

[50]  N Moray,et al.  Trust, control strategies and allocation of function in human-machine systems. , 1992, Ergonomics.

[51]  Parimal Kopardekar,et al.  Traffic Complexity Measurement Under Higher Levels of Automation and Higher Traffic Densities , 2008 .

[52]  Raja Parasuraman,et al.  Performance Consequences of Automation-Induced 'Complacency' , 1993 .

[53]  David B. Kaber,et al.  The effects of level of automation and adaptive automation on human performance, situation awareness and workload in a dynamic control task , 2004 .

[54]  Mica R. Endsley,et al.  The Out-of-the-Loop Performance Problem and Level of Control in Automation , 1995, Hum. Factors.

[55]  Sarah Sharples,et al.  Changing the role of the air traffic controller: how will free flight affect memory for spatial events? , 2007, Applied ergonomics.

[56]  Leslie A. DeChurch,et al.  Teamwork in multiteam systems. , 2005, The Journal of applied psychology.

[57]  Matthias Weippert,et al.  Fuzzy Evaluation of Heart Rate Signals for Mental Stress Assessment , 2007, IEEE Transactions on Fuzzy Systems.

[58]  P. Goillau,et al.  Guidelines for Trust in Future ATM Systems: Measures , 2003 .

[59]  Robert M. Hayes,et al.  Systems analysis and design , 1970, ACM '70.

[60]  Janice Langan-Fox,et al.  Team Mental Models: Techniques, Methods, and Analytic Approaches , 2000, Hum. Factors.

[61]  Parimal Kopardekar,et al.  Airspace Configuration Concepts for the Next Generation Air Transportation System , 2008 .

[62]  Raja Parasuraman,et al.  Automation in Future Air Traffic Management: Effects of Decision Aid Reliability on Controller Performance and Mental Workload , 2005, Hum. Factors.

[63]  Pamela S Della Rocco,et al.  Dynamic Resectorization in Air Traffic Control: A Human Factors Perspective , 2006 .

[64]  Christopher D. Wickens,et al.  Flight to the Future: Human Factors in Air Traffic Control Edited by Christopher D. Wickens, Anne S. Mavor, & James P. McGee 1997, 368 pages, $44.95. Washington, DC: National Academy Press ISBN 0-309-05637-3 , 1997 .

[65]  D O'Hare,et al.  Situational awareness ability and cognitive skills training in a complex real-world task , 2007, Ergonomics.

[66]  Donald Hameluck,et al.  Underlying Factors in Air Traffic Control Incidents , 1989 .

[67]  M. Endsley Automation and situation awareness. , 1996 .

[68]  Karel Brookhuis,et al.  Handbook of Human Factors and Ergonomics Methods , 2009 .

[69]  Ben Willems,et al.  Implications of reduced involvement in en route air traffic control. , 1999 .

[70]  R Weston,et al.  HUMAN FACTORS IN AIR TRAFFIC CONTROL , 1982 .

[71]  Nancy J. Cooke,et al.  Advances in Measuring Team Cognition , 2003 .

[72]  D. Schroeder,et al.  Blink Rate: A Possible Measure of Fatigue , 1994, Human factors.

[73]  Edward M. Hitchcock,et al.  Automation cueing modulates cerebral blood flow and vigilance in a simulated air traffic control task , 2003 .

[74]  C. Collet,et al.  Subjective aspects of mental workload in air-traffic control , 2005 .

[75]  Guy H. Walker,et al.  What really is going on? Review of situation awareness models for individuals and teams , 2008 .

[76]  Frederick M. J. Lichacz,et al.  Examining the Effects of Combined Stressors on Dynamic Task Performance , 2005 .

[77]  E.C. Smith Assessment of controller situation awareness in future terminal RNAV operations , 2007, 2007 IEEE/AIAA 26th Digital Avionics Systems Conference.

[78]  J. O'hanlon,et al.  Boredom: practical consequences and a theory. , 1981, Acta psychologica.

[79]  Ronald C Kessler,et al.  Cardiovascular Reactivity to Work Stress Predicts Subsequent Onset of Hypertension: The Air Traffic Controller Health Change Study , 2004, Psychosomatic medicine.

[80]  Dirk Schäfer,et al.  Human Factors Impacts in Air Traffic Management , 2005 .

[81]  John Annett,et al.  A note on the validity and reliability of ergonomics methods , 2002 .

[82]  Peter Brooker,et al.  AIRBORNE SEPARATION ASSURANCE SYSTEMS: TOWARDS A WORK PROGRAMME TO PROVE SAFETY , 2004 .

[83]  Aydan Cavcar,et al.  New Directions for ATC Training: A Discussion , 2004 .

[84]  Daniel R. Ilgen,et al.  Not All Trust Is Created Equal: Dispositional and History-Based Trust in Human-Automation Interactions , 2008, Hum. Factors.

[85]  Mark S. Young,et al.  Guide to Methodology in Ergonomics: Designing for Human Use , 1999 .

[86]  C E Melton Physiological Stress in Air Traffic Controllers: A Review, , 1982 .

[87]  P. Hancock,et al.  Stress, Workload, and Fatigue , 2009 .

[88]  Gunnar Hauland Measuring Individual and Team Situation Awareness During Planning Tasks in Training of En Route Air Traffic Control , 2008 .

[89]  C. Wickens Engineering psychology and human performance, 2nd ed. , 1992 .

[90]  Anthony J. Masalonis Effects of training operators on situation-specific automation reliability , 2003, SMC'03 Conference Proceedings. 2003 IEEE International Conference on Systems, Man and Cybernetics. Conference Theme - System Security and Assurance (Cat. No.03CH37483).

[91]  Raymond E King,et al.  Operational Use of the Air Traffic Selection and Training Battery , 2007 .

[92]  M.R. Endsley,et al.  Shared situation awareness in the flight deck-ATC system , 1998, 17th DASC. AIAA/IEEE/SAE. Digital Avionics Systems Conference. Proceedings (Cat. No.98CH36267).

[93]  Giovanni Costa,et al.  Occupational stress and stress prevention in air traffic control , 1996 .

[94]  Ulf Ahlstrom,et al.  Using eye movement activity as a correlate of cognitive workload , 2006 .

[95]  Thomas B. Sheridan,et al.  Next Generation Air Transportation Systems : Human-Automation Interaction and Organizational Risks , 2006 .

[96]  Mustapha Mouloua,et al.  Automation and Human Performance : Theory and Applications , 1996 .

[97]  S. Gregor,et al.  Measuring Human-Computer Trust , 2000 .

[98]  Jenny Waycott,et al.  Effects of advance organizers, mental models and abilities on task and recall performance using a mobile phone network , 2006 .

[99]  Michela Terenzi,et al.  Procedural errors in air traffic control: effects of traffic density, expertise, and automation. , 2006, Aviation, space, and environmental medicine.

[100]  F. T. Eggemeier,et al.  Recommendations for Mental Workload Measurement in a Test and Evaluation Environment , 1993 .

[101]  Janice Langan-Fox,et al.  Mental models, team mental models, and performance: Process, development, and future directions , 2004 .

[102]  Chung-Hsing Yeh,et al.  Human performance interfaces in air traffic control. , 2010, Applied ergonomics.

[103]  Neville Stanton,et al.  Situation awareness measurement: a review of applicability for C4i environments. , 2006, Applied ergonomics.

[104]  A. J. Masys,et al.  A systemic perspective of situation awareness: An analysis of the 2002 mid‐air collision over Überlingen, Germany , 2005 .

[105]  David Meister,et al.  Conceptual foundations of human factors measurement , 2003 .

[106]  James P. Bliss Alarm Reaction Patterns by Pilots as a Function of Reaction Modality , 1997 .

[107]  Andres Zellweger Simulation in CNS/ATM research with examples from the United States , 2003, Simul. Model. Pract. Theory.

[108]  Klaus Eyferth,et al.  Securing future ATM-concepts' safety by measuring situation awareness in ATC , 2003 .

[109]  Danko Nikolić,et al.  SITUATION AWARENESS AS A PREDICTOR OF PERFORMANCE IN EN ROUTE AIR TRAFFIC CONTROLLERS , 1998 .

[110]  S. Gronlund,et al.  Situation Awareness , 2006 .

[111]  Christopher D. Wickens,et al.  Workload and Reliability of Predictor Displays in Aircraft Traffic Avoidance , 2000 .

[112]  Thomas Prevot,et al.  Studying NextGen Concepts with the Multi -Aircraft Control System , 2008 .

[113]  T. Shimomitsu,et al.  Intraindividual relationships between blood pressure level and emotional state. , 1996, Psychotherapy and psychosomatics.

[114]  Cary L. Cooper,et al.  Stress among air traffic controllers: Occupational sources of coronary heart disease risk , 1981 .

[115]  William N. Dember,et al.  VIGILANCE AND WORKLOAD IN AUTOMATED SYSTEMS. , 1996 .

[116]  Nancy J. Cooke,et al.  On Teams, Teamwork, and Team Performance: Discoveries and Developments , 2008, Hum. Factors.

[117]  Raja Parasuraman,et al.  The Role of the Air Traffic Controller in Future Air Traffic Management: An Empirical Study of Active Control versus Passive Monitoring , 2001, Hum. Factors.

[118]  Oliver Sträter,et al.  Recovery from equipment failures in ATC: Determination of contextual factors , 2007, Reliab. Eng. Syst. Saf..

[119]  R. Rose,et al.  Definition of a responder: analysis of behavioral, cardiovascular, and endocrine responses to varied workload in air traffic controllers. , 1993, Psychosomatic medicine.

[120]  S Skerfving,et al.  Musculoskeletal disorders among female and male air traffic controllers performing identical and demanding computer work , 2006, Ergonomics.

[121]  C. Colleta,et al.  Autonomic nervous system and subjective ratings of strain in air-traffic control , 2008 .

[122]  Anton Koros,et al.  Advanced Concept of the National Airspace System of 2015: Human Factors Considerations for Air Traffic Control , 2007 .

[123]  Gemma Cox,et al.  Flightdeck and air traffic control collaboration evaluation (FACE): evaluating aviation communication in the laboratory and field. , 2007, Applied ergonomics.

[124]  Banavar Sridhar,et al.  Short-Term National Airspace System Delay Prediction Using Weather Impacted Traffic Index , 2008 .

[125]  E. Jeannot,et al.  The Development of Situation Awareness Measures in ATM Systems , 2003 .

[126]  Massimo Felici,et al.  Trust Strategies and Policies in Complex Socio-technical Safety-Critical Domains: An Analysis of the Air Traffic Management Domain , 2006, RISE.

[127]  J. Langan-Fox Skill acquisition and the development of a team mental model: an integrative approach to analysing organizational teams, task, and context , 2008 .

[128]  Shayne Loft,et al.  Modeling and Predicting Mental Workload in En Route Air Traffic Control: Critical Review and Broader Implications , 2007, Hum. Factors.

[129]  Rob C J Ruigrok,et al.  Human factors evaluations of Free Flight Issues solved and issues remaining. , 2007, Applied ergonomics.

[130]  Frank E. Ritter,et al.  Effects of light and heavy workload on air traffic tactical operations: a hazard rate model , 1999 .

[131]  Michael Kastner,et al.  STRESS IN MODERN AIR TRAFFIC CONTROL SYSTEMS AND POTENTIAL INFLUENCES ON MEMORY , 2002 .

[132]  F. H. Hawkins,et al.  Human Factors Education in European Air Transport Operations , 1984 .

[133]  Linda G. Pierce,et al.  Adaptive Automation: Building Flexibility into Human-Machine Systems , 2006 .

[134]  J. Hittner,et al.  Effects of neuroticism and workload history on performance , 2004 .

[135]  Glenn F. Wilson,et al.  Psychophysiological responses to changes in workload during simulated air traffic control , 1996, Biological Psychology.

[136]  Shayne Loft,et al.  An analysis of relational complexity in an air traffic control conflict detection task , 2006, Ergonomics.

[137]  M. Hyland,et al.  Secretory immunoglobulin A reactivity to acute and cumulative acute multi-tasking stress: relationships between reactivity and perceived workload , 2004, Biological Psychology.

[138]  J. Stern,et al.  Time on task and blink effects on saccade duration. , 1996, Ergonomics.

[139]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[140]  Colin Drury,et al.  Designing ergonomics studies , 2005 .

[141]  V. B. Maxwell,et al.  Stress in air traffic control , 1986 .

[142]  Eric Hoffman,et al.  Assessing the Impact of a New Instruction on Air Traffic Controller Monitoring Tasks , 2004 .

[143]  Ashley Nunes,et al.  The Impact of Automation Use on the Mental Model: Findings from the Air Traffic Control Domain , 2003 .

[144]  Scott M. Galster,et al.  Air Traffic Controller Performance and Workload Under Mature Free Flight: Conflict Detection and Resolution of Aircraft Self-Separation , 2001 .

[145]  Barry Kirwan,et al.  The role of the controller in the accelerating industry of air traffic management , 2001 .

[146]  Brian Hilburn,et al.  Air Traffic Controller and Management Attitudes Toward Automation: An Empirical Investigation , 2001 .

[147]  F Harris,et al.  Performance indicators. , 1985, Health and social service journal.

[148]  C. Collet,et al.  Complexity and Controller Workload : Trying to Bridge the Gap , 2002 .

[149]  Lisanne Bainbridge,et al.  Ironies of automation , 1982, Autom..

[150]  Fred Paas,et al.  Dynamic Task Selection in Flight Management System Training , 2006 .

[151]  J. Veltman,et al.  Physiological indices of workload in a simulated flight task , 1996, Biological Psychology.

[152]  Janice Langan-Fox,et al.  Power motivation, illness, coping strategies and psychological stress in police trainees , 1997 .

[153]  N. Stanton,et al.  Is utility in the mind of the beholder? A study of ergonomics methods. , 1998, Applied Ergonomics.

[154]  Dirk Schaefer,et al.  Monotony in Air Traffic Control , 2007 .

[155]  David B. Kaber,et al.  Situation awareness implications of adaptive automation for information processing in an air traffic control-related task , 2006 .

[156]  G Shouksmith,et al.  The interaction of culture with general job stressors in air traffic controllers. , 1997, The International journal of aviation psychology.

[157]  Sarah Sharples,et al.  Methods in the understanding of human factors , 2005 .

[158]  Carol A. Manning,et al.  The Relationship Between Air Traffic Control Communication Events and Measures of Controller Taskload and Workload , 2002 .

[159]  Eric W. Farmer,et al.  The regulation of work demands and strain. , 1995 .

[160]  Raja Parasuraman,et al.  Humans and Automation: Use, Misuse, Disuse, Abuse , 1997, Hum. Factors.

[161]  Raja Parasuraman,et al.  Effects of Automated Cueing on Decision Implementation in a Visual Search Task , 2001 .

[162]  Rebecca A. Grier,et al.  Fundamental dimensions of subjective state in performance settings: task engagement, distress, and worry. , 2002, Emotion.

[163]  Joachim Vogt,et al.  The Impact of Workload on Heart Rate and Blood Pressure in En-Route and Tower Air Traffic Control , 2006 .

[164]  Esther Oprins,et al.  Design of a Competence-Based Assessment System for Air Traffic Control Training , 2006 .

[165]  Amanda D. Angie,et al.  The effects of workload history on dual task performance , 2005 .

[166]  Erik Hollnagel,et al.  Flight decks and free flight: where are the system boundaries? , 2007, Applied ergonomics.

[167]  Einar M. Rønquist,et al.  Foreword , 1999, Biological Psychiatry.

[168]  R. I. Thackray The Stress of Boredom and Monotony: A Consideration of the Evidence , 1981, Psychosomatic medicine.

[169]  Mica R. Endsley,et al.  Toward a Theory of Situation Awareness in Dynamic Systems , 1995, Hum. Factors.

[170]  Mica R Endsley,et al.  SITUATION AWARENESS IN AIR TRAFFIC CONTROL: THE PICTURE. , 1998 .

[171]  S. Kauppinen,et al.  European medium-term conflict detection field trials [ATC] , 2002, Proceedings. The 21st Digital Avionics Systems Conference.

[172]  Albert Boquet,et al.  An Assessment of Commuting Risk Factors for Air Traffic Control Specialists , 2006 .

[173]  Giovanni Costa,et al.  Psychophysical conditions of air traffic controllers evaluated by the standard shiftwork index , 1995 .

[174]  Glenn F. Wilson,et al.  Operator Functional State Classification Using Multiple Psychophysiological Features in an Air Traffic Control Task , 2003, Hum. Factors.

[175]  K. Wolfgang Kallus,et al.  A PSYCHOPHYSIOLOGICAL INVESTIGATION OF THE CONCEPT OF MONOTONY IN ATC : EFFECTS OF TRAFFIC REPETITIVENESS AND TRAFFIC DENSITY , 2004 .

[176]  J. G. Hollands,et al.  Engineering Psychology and Human Performance , 1984 .

[177]  David B. Kaber,et al.  Design of Automation for Telerobots and the Effect on Performance, Operator Situation Awareness, and Subjective Workload , 2000 .

[178]  A.W.K. Gaillard,et al.  Operator Functional State: The Assessment and Prediction of Human Performance Degradation in Complex Tasks , 2003 .

[179]  Raja Parasuraman,et al.  Designing for Flexible Interaction Between Humans and Automation: Delegation Interfaces for Supervisory Control , 2007, Hum. Factors.

[180]  A. Wirth,et al.  Analyzing shared and team mental models , 2001 .

[181]  Serge Debernard,et al.  AMANDA V3: Toward a Common Workspace between Air Traffic Controllers , 2008, First International Conference on Advances in Computer-Human Interaction.

[182]  Richard Bolczak,et al.  Accommodating ATC System Evolution through Advanced Training Techniques , 2005 .

[183]  David B. Kaber,et al.  Towards a Sensitive Measure of Situation Awareness in Adaptively Automated Systems , 2006 .

[184]  Serge Debernard,et al.  Common Work Space or How to Support Cooperative Activities Between Human Operators and Machine: Application to Air Traffic Control , 2007, HCI.

[185]  A J Tattersall,et al.  An experimental evaluation of instantaneous self-assessment as a measure of workload. , 1996, Ergonomics.

[186]  Rachael Gordon,et al.  Measuring safety culture in a research and development centre: A comparison of two methods in the Air Traffic Management domain , 2007 .

[187]  J. S. Gray,et al.  Monotony and Boredom. , 1952 .

[188]  The influence of aircraft proximity data on the subjective mental workload of controllers in the air traffic control task. , 1999, Ergonomics.

[189]  Andrew R. Dattel,et al.  Does Situation Awareness Add to the Validity of Cognitive Tests? , 2006, Hum. Factors.

[190]  Guy H. Walker,et al.  Measuring Situation Awareness in complex systems: Comparison of measures study , 2009 .

[191]  Abuse Humans and Automation : Use , Misuse , Disuse , , 2008 .

[192]  Mica R. Endsley,et al.  The Application of Human Factors to the Development of Expert Systems for Advanced Cockpits , 1987 .

[193]  D.R. Barker,et al.  Assessment of terminal RNAV mixed equipage , 2004, The 23rd Digital Avionics Systems Conference (IEEE Cat. No.04CH37576).