A framework to assess the ability of automation to deliver capacity targets in European airspace

The maximum number of flights that the Air Traffic Management (ATM) system can safely and efficiently control over a period of time i.e. airspace capacity, has become a limitation over the last decade, due to a rapid increase in air traffic activity. Therefore, the ATM system in developed countries is undergoing a series of modernisation initiatives to ensure that the future ATM system is able to provide sufficient capacity to safely meet future air traffic demand. As a result, there is a need to assess if the proposed changes can effectively be translated into the desired increase in capacity. This thesis addresses this issue by developing an en-route airspace capacity estimation framework, able to measure the impact of future ATM system modernisation deployments on airspace capacity. In order to do this, it identifies the key airspace capacity drivers for current and future operations, focussing on three areas: air traffic controller workload, air traffic predictability and Air Traffic Control (ATC) centre cost-efficiency. In each of the three framework areas, the research develops methodologies that overcome the deficiencies of existing capacity estimation techniques. This leads to an innovative multidimensional approach to airspace capacity estimation, able to reflect the different relationships of airspace capacity with the framework areas. The framework quantifies the relationship between the ATC centre planning process accuracy and airspace capacity. It estimates the effect of increased predictability on airspace capacity through the performance of the Airspace Management and Air Traffic Flow & Capacity Management functions. Finally, it computes air traffic controller workload with considerable accuracy (up to 80% of the actual workload) during medium-low workload scenarios and reflects the workload trend (Spearman’s rank coefficient = 0.72) during high workload scenarios.

[1]  Angela Nuic,et al.  AIRCRAFT PERFORMANCE MODELING FOR AIR TRAFFIC MANAGEMENT APPLICATIONS , 2003 .

[2]  J. Kubalcik,et al.  Analysis of FMS-generated trajectory prediction accuracy and sensitivity , 2007, 2007 IEEE/AIAA 26th Digital Avionics Systems Conference.

[3]  Finn Verner Jensen,et al.  Bayesian Networks and Influence Diagrams , 1997 .

[4]  J.S. DeArmon,et al.  Benefits of RNAV terminal procedures: air/ground communication reduction and airport capacity improvements [ATC] , 2002, Proceedings. The 21st Digital Avionics Systems Conference.

[5]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[6]  Milan Janic Air Transport System Analysis and Modelling: Capacity, Quality of Services and Economics , 2000 .

[7]  J. Sperandio The regulation of working methods as a function of work-load among air traffic controllers. , 1978, Ergonomics.

[8]  Yang Wang,et al.  Using galvanic skin response for cognitive load measurement in arithmetic and reading tasks , 2012, OZCHI.

[9]  J. Shaoul Human Error , 1973, Nature.

[10]  Lenny Fukshansky,et al.  Revisiting the hexagonal lattice: on optimal lattice circle packing , 2009, 0911.4106.

[11]  E. J. Modzelesky,et al.  An air traffic management (ATM) system performance model , 2001, 20th DASC. 20th Digital Avionics Systems Conference (Cat. No.01CH37219).

[12]  David Martz,et al.  Development Methods , 2014, Design and Development of Training Games.

[13]  D. Burger,et al.  Memory Bandwidth Limitations of Future Microprocessors , 1996, 23rd Annual International Symposium on Computer Architecture (ISCA'96).

[14]  John Y. N. Cho,et al.  Sector Workload Model for Benefits Analysis and Convective Weather Capacity Prediction , 2013 .

[15]  K. Ronald Laughery,et al.  The integrated performance modeling environment—simulating human-system performance , 1997, WSC '97.

[16]  Mica R. Endsley,et al.  Design and Evaluation for Situation Awareness Enhancement , 1988 .

[17]  Amedeo R. Odoni,et al.  Existing and Required Modeling Capabilities for Evaluating ATM Systems and Concepts , 1997 .

[18]  Robert Graham,et al.  Performance framework and influence model in ATM , 2009, 2009 IEEE/AIAA 28th Digital Avionics Systems Conference.

[19]  R. John Hansman The Impact of Information Technologies on Air Transportation , 2005 .

[20]  Andres G. Zellweger,et al.  Assessing the Benefits of Collaborative Decision Making in Air Traffic Management , 2001 .

[21]  Penelope M. Sanderson,et al.  Development and Validation of a Multilevel Model for Predicting Workload Under Routine and Nonroutine Conditions in an Air Traffic Management Center , 2014, Hum. Factors.

[22]  Steven B Boswell EVALUATION OF THE CAPACITY AND DELAY BENEFITS OF TERMINAL AIR TRAFFIC CONTROL AUTOMATION. , 1993 .

[23]  Yiyuan Zhao,et al.  Sensitivity of Trajectory Prediction in Air Traffic Management , 1999 .

[24]  Alexander Klein,et al.  Weather Forecast Accuracy: Study of Impact on Airport Capacity and Estimation of Avoidable Costs , 2009 .

[25]  Peter Brooker,et al.  Controller workload, airspace capacity and future systems. , 2003 .

[26]  Joseph S. B. Mitchell,et al.  Capacity Estimation for Airspaces with Convective Weather Constraints , 2007 .

[27]  M R Phillips,et al.  The validation of fast-time air traffic simulations in practice , 2000, J. Oper. Res. Soc..

[28]  Sarah Sharples,et al.  An observation tool to study air traffic control and flightdeck collaboration. , 2007, Applied ergonomics.

[29]  Uffe Kjærulff,et al.  Bayesian Networks and Influence Diagrams: A Guide to Construction and Analysis , 2007, Information Science and Statistics.

[30]  Frederic Barbaresco,et al.  Optimising runway throughput through wake vortex detection, prediction and decision support tools , 2011, 2011 Tyrrhenian International Workshop on Digital Communications - Enhanced Surveillance of Aircraft and Vehicles.

[31]  Joan M. Ryder,et al.  Cognitive Task Analysis of Expertise in Air Traffic Control , 1993 .

[32]  Christopher D. Wickens,et al.  Workload Assessment and Prediction , 1990 .

[33]  Shin-Lai Optimizing Airspace Sectors for Varying Demand Patterns using Multi-Controller Staffing , 2009 .

[34]  Mary L. Cummings,et al.  Partitioning Complexity in Air Traffic Management Tasks , 2006 .

[35]  Peter Brooker,et al.  The European ATC System: Constraints and Traffic Management , 1990, Journal of Navigation.

[36]  J H McCracken,et al.  Analyses of Selected LHX Mission Functions: Implications for Operator Workload and System Automation Goals , 1984 .

[37]  Diana Schmidt A Queuing Analysis of the Air Traffic Controller''s Workload , 1978 .

[38]  Jonathan Histon The impact of structure on cognitive complexity in air traffic control , 2002 .

[39]  Anthony J. Masalonis,et al.  DYNAMIC DENSITY AND COMPLEXITY METRICS FOR REALTIME TRAFFIC FLOW MANAGEMENT , 2003 .

[40]  M. Cano,et al.  Complexity analysis in the next generation of air traffic management system , 2007, 2007 IEEE/AIAA 26th Digital Avionics Systems Conference.

[41]  F. Hawkins Human factors in aviation. , 1979, Journal of psychosomatic research.

[42]  Shayne Loft,et al.  Modeling and Predicting Mental Workload in En Route Air Traffic Control: Critical Review and Broader Implications , 2007, Hum. Factors.

[43]  Carol A. Manning,et al.  POWER: OBJECTIVE ACTIVITY AND TASKLOAD ASSESSMENT IN EN ROUTE AIR TRAFFIC CONTROL , 2002 .

[44]  Washington Y. Ochieng,et al.  Framework to Assess an Area Control Centre's Operating Cost-efficiency: a Case Study , 2015 .

[45]  Heinz Erzberger,et al.  Safety Analysis for Advanced Separation Concepts , 2006 .

[46]  Jennifer Wilson,et al.  Flight Deck Automation issues , 1999 .

[47]  Christopher D. Wickens,et al.  The Dissociation between Subjective Workload and Performance: A Multiple Resource Approach , 1983 .

[48]  Raja Parasuraman,et al.  Automation in Future Air Traffic Management: Effects of Decision Aid Reliability on Controller Performance and Mental Workload , 2005, Hum. Factors.

[49]  Tysen Mueller,et al.  Strategic Aircraft Trajectory Prediction Uncertainty and Statistical Sector Traffic Load Modeling , 2002 .

[50]  William J. Dunlay,et al.  Analytical Models of Perceived Air Traffic Control Conflicts , 1975 .

[51]  S. Mondoloni,et al.  Commonality in disparate trajectory predictors for air traffic management applications , 2005, 24th Digital Avionics Systems Conference.

[52]  R. Ehrmanntraut,et al.  Airspace design process for dynamic sectorisation , 2007, 2007 IEEE/AIAA 26th Digital Avionics Systems Conference.

[53]  Hasan Ayaz,et al.  Cognitive Workload Assessment of Air Traffic Controllers Using Optical Brain Imaging Sensors , 2010 .

[54]  Mark D. Rodgers,et al.  CONVERSION OF THE CTA, INC., EN ROUTE OPERATIONS CONCEPTS DATABASE INTO A FORMAL SENTENCE OUTLINE JOB TASK TAXONOMY , 1993 .

[55]  Christopher D. Wickens,et al.  Multiple resources and performance prediction , 2002 .

[56]  Thomas Prevot,et al.  Human-in-the-Loop Evaluation of Ground-Based Automated Separation Assurance for NextGen , 2008 .

[57]  Kang Li,et al.  Understanding Perceived Complexity in Human Supervisory Control , 2000, Cognition, Technology & Work.

[58]  R. Likert “Technique for the Measurement of Attitudes, A” , 2022, The SAGE Encyclopedia of Research Design.

[59]  Oliver Straeter,et al.  Age, Experience and Automation in European Air Traffic Control , 2003 .

[60]  Dorothy Robyn REFORMING THE AIR TRAFFIC CONTROL SYSTEM TO PROMOTE EFFICIENCY AND REDUCE DELAYS Prepared for the Council of Economic Advisers by , 2007 .

[61]  Steven D. Thompson Terminal Area Separation Standards: Historical Development, Current Standards, and Processes for Change, , 1997 .

[62]  Kazuo Furuta,et al.  An evaluation method of team situation awareness based on mutual belief , 2008, Cognition, Technology & Work.

[63]  Banavar Sridhar,et al.  Airspace Complexity and its Application in Air Traffic Management , 1998 .

[64]  Larry Bailey Analysis of en route operational errors : probability of resolution and time-on-position. , 2012 .

[65]  Richard C. Atkinson,et al.  Human Memory: A Proposed System and its Control Processes , 1968, Psychology of Learning and Motivation.

[66]  Workload Model Air traffic controller staffing in the en route domain : a review of the Federal Aviation Administration's task load model , 2010 .

[67]  Richard I. Thackray,et al.  Age-Related Differences in complex Monitoring Performance , 1981 .

[68]  Ann Williamson,et al.  Driving monotonous routes in a train simulator: the effect of task demand on driving performance and subjective experience , 2012, Ergonomics.

[69]  David K. Schmidt,et al.  On modeling ATC work load and sector capacity , 1976 .

[70]  Wendell R. Ricks,et al.  Cognitive models of pilot categorization and prioritization of flight-deck information , 1995 .

[71]  Marcel Mongeau,et al.  Aircraft Trajectory Planning Under Uncertainty by Light Propagation , 2012 .

[72]  Minghua Hu,et al.  Airspace Capacity Management Based on Control Workload and Coupling Constraints between Airspaces , 2009, 2009 International Conference on Computer Modeling and Simulation.

[73]  Simone Benedetto,et al.  Driver workload and eye blink duration , 2011 .

[74]  A. Hughes Oxford English Dictionary. , 2008, Isis; an international review devoted to the history of science and its cultural influences.

[75]  Glen A. Gilbert Historical Development of the Air Traffic Control System , 1973, IEEE Trans. Commun..

[76]  Michael S. Nolan,et al.  Fundamentals of Air Traffic Control , 1990 .

[77]  Vojin S. Tosic,et al.  Terminal airspace capacity model , 1982 .

[78]  W. Ochieng,et al.  Estimation of European Airspace Capacity from a Model of Controller Workload , 2002, Journal of Navigation.

[79]  Michael Bloem,et al.  Combining Airspace Sectors for the Efficient Use of Air Traffic Control Resources , 2008 .

[80]  M Davis Application of fast-time simulation techniques to the study of ATC systems. , 1971, Ergonomics.

[81]  C. Tamvaclis,et al.  Use of aircraft derived data for more efficient ATM operations , 2004, The 23rd Digital Avionics Systems Conference (IEEE Cat. No.04CH37576).

[82]  Milan Janic,et al.  En Route Sector Capacity Model , 1991, Transp. Sci..

[83]  Carol A. Manning MEASURING AIR TRAFFIC CONTROLLER PERFORMANCE IN A HIGH FIDELITY SIMULATION , 2000 .

[84]  Crutchfield Jerry,et al.  Predicting Subjective Workload Ratings: A Comparison and Synthesis of Operational and Theoretical Models , 2007 .

[85]  A J Tattersall,et al.  An experimental evaluation of instantaneous self-assessment as a measure of workload. , 1996, Ergonomics.

[86]  B. Willems Future en route air traffic control workstation: back to basics , 2004, The 23rd Digital Avionics Systems Conference (IEEE Cat. No.04CH37576).

[87]  Laura Pickup,et al.  The Operational Demand Evaluation Checklist (ODEC) of workload for railway signalling. , 2010, Applied ergonomics.

[88]  Peter J Goillau,et al.  MALERN CAPACITY ESTIMATE (MACE): A PROPOSED COGNITIVE MEASURE FOR COMPLEX SYSTEMS. , 1997 .

[89]  George L. Donohue A SIMPLIFIED AIR TRANSPORTATION SYSTEM CAPACITY MODEL , 1999 .

[90]  Pierre Savéant,et al.  Multiobjective tactical planning under uncertainty for air traffic flow and capacity management , 2013, 2013 IEEE Congress on Evolutionary Computation.

[91]  Paul U. Lee,et al.  Prediction of Traffic Complexity and Controller Workload in Mixed Equipage NextGen Environments , 2012 .

[92]  Christopher D. Wickens,et al.  The Future of Air Traffic Control: Human Operators and Automation , 1998 .

[93]  Klaus Eyferth,et al.  A model of air traffic controllers' conflict detection and conflict resolution , 2003 .

[94]  R. H. Mogford,et al.  The Complexity Construct in Air Traffic Control: A Review and Synthesis of the Literature. , 1995 .

[95]  Richard H. Thayer,et al.  Concept of Operations , 2001 .

[96]  Hartmut Fricke,et al.  Air traffic control complexity as workload driver , 2010 .

[97]  A. Schäfer,et al.  The future mobility of the world population , 2000 .

[98]  Washington Y. Ochieng,et al.  A Trend Analysis of Air Traffic Occurrences in the UK Airspace , 2003 .

[99]  S. C. Choi Tests of equality of dependent correlation coefficients , 1977 .

[100]  Arnab Majumdar,et al.  A method to estimate air traffic controller mental workload based on traffic clearances , 2014 .

[101]  Stephanie Koch Human Factors In Air Traffic Control , 2016 .

[102]  Laudeman,et al.  DYNAMIC DENSITY: AN AIR TRAFFIC MANAGEMENT METRIC , 1998 .

[103]  Jie Mi,et al.  Robust Nonparametric Statistical Methods , 1999, Technometrics.

[104]  A Gregoriades,et al.  Automated assistance for human factors analysis in complex systems , 2006, Ergonomics.

[105]  Banavar Sridhar,et al.  Effects of conflict resolution maneuvers and traffic density on free flight , 1996 .

[106]  Carol A. Manning,et al.  Sequences of Actions for Individual and Teams of Air Traffic Controllers , 1994, Hum. Comput. Interact..

[107]  W E Collins,et al.  Relationships of anxiety scores to screening and training status of air traffic controllers. , 1991, Aviation, space, and environmental medicine.

[108]  R. Christien,et al.  Air traffic complexity indicators & ATC sectors classification , 2002, Proceedings. The 21st Digital Avionics Systems Conference.

[109]  S. Kauppinen,et al.  European medium-term conflict detection field trials [ATC] , 2002, Proceedings. The 21st Digital Avionics Systems Conference.

[110]  Esther Oprins,et al.  The Influence of Automation Support on Performance, Workload, and Situation Awareness of Air Traffic Controllers , 2012 .

[111]  Mark D. Phillips,et al.  Analyzing Controller Tasks to Define Air Traffic Control System Automation Requirements , 1987 .

[112]  Wolfgang Schuster,et al.  Trajectory prediction for future air traffic management – complex manoeuvres and taxiing , 2015, The Aeronautical Journal.

[113]  G. Solomos,et al.  Analysis of Excess Flying Time in the National Airspace System , 2005 .

[114]  Parimal Kopardekar,et al.  Analysis of Current Sectors Based on Traffic and Geometry , 2008 .

[115]  Barry Kirwan,et al.  The role of the controller in the accelerating industry of air traffic management , 2001 .

[116]  Wolfgang Schuster,et al.  High-accuracy four-dimensional trajectory prediction for civil aircraft , 2012 .

[117]  W. Voss,et al.  National Airspace Capacity Estimate , 1998 .

[118]  Eugene P. Gilbo,et al.  Airport capacity: representation, estimation, optimization , 1993, IEEE Trans. Control. Syst. Technol..

[119]  B. Sridhar,et al.  MACROSCOPIC WORKLOAD MODEL FOR ESTIMATING EN ROUTE SECTOR CAPACITY , 2007 .

[120]  R. S. Ratner,et al.  The Air Traffic Controller's Contribution to ATC System Capacity in Manual and Automated Environments. Volume III. Terminal Operations. , 1973 .

[121]  Parimal Kopardekar,et al.  Controller Workload Analysis Methodology to Predict Increases in Airspace Capacity , 2003 .

[122]  Janice Langan-Fox,et al.  Human–automation teams and adaptable control for future air traffic management , 2009 .

[123]  G. R. J. Hockey Compensatory control in the regulation of human performance under stress and high workload: A cognitive-energetical framework , 1997, Biological Psychology.

[124]  T. Wall,et al.  General practitioners' subjective experience of surgery workload. , 1991, Social science & medicine.

[125]  Ap Dawid,et al.  Causal inference using influence diagrams: The problem of partial compliance (with Discussion) , 2003 .

[126]  M. D’Esposito Working memory. , 2008, Handbook of clinical neurology.

[127]  Ross D. Shachter Evaluating Influence Diagrams , 1986, Oper. Res..

[128]  Erik Hollnagel,et al.  Cognitive reliability and error analysis method : CREAM , 1998 .

[129]  John Moore,et al.  Air traffic functions in the NextGen and SESAR airspace , 2009, 2009 IEEE/AIAA 28th Digital Avionics Systems Conference.

[130]  A Bisseret Analysis of mental processes involved in air traffic control. , 1971, Ergonomics.

[131]  Brian Hilburn,et al.  COGNITIVE COMPLEXITY IN AIR TRAFFIC CONTROL: A LITERATURE REVIEW , 2004 .

[132]  Giovanni Nero - 1-FIVE YEARS EXPERIENCE IN ATM COST BENCHMARKING , 2007 .

[133]  C. V. Horn [Air traffic]. , 1950, Statisticky zpravodaj. Czechoslovak Republic. Statni Urad Statisticky.

[134]  M. Endsley Automation and situation awareness. , 1996 .

[135]  Rüdiger Ehrmanntraut Full Automation of Air Traffic Management in High Complexity Airspace , 2009 .

[136]  Lynne Martin,et al.  Comparison of Ground-Based and Airborne Function Allocation Concepts for NextGen Using Human-In-The-Loop Simulations , 2010 .

[137]  Charles E. Billings,et al.  Human-Centered Aviation Automation: Principles and Guidelines , 1996 .

[138]  Parimal Kopardekar,et al.  Initial Implications of Automation on Dynamic Airspace Configuration , 2007 .

[139]  Robert Maxwell Automation possibilities in air traffic control , 1975, 1975 IEEE Conference on Decision and Control including the 14th Symposium on Adaptive Processes.

[140]  Andrew J. Cook,et al.  European air traffic management : principles, practice, and research , 2007 .

[141]  Tone Magister,et al.  Effect of seasonal traffic variability on the performance of air navigation service providers , 2012 .

[142]  A. Klein,et al.  Airspace capacity estimation using flows and Weather-Impacted Traffic Index , 2008, 2008 Integrated Communications, Navigation and Surveillance Conference.

[143]  Jack P. C. Kleijnen,et al.  EUROPEAN JOURNAL OF OPERATIONAL , 1992 .

[144]  Arnab Majumdar,et al.  Air traffic predictability framework – Development, performance evaluation and application , 2014 .

[145]  N. M. Morris,et al.  On Looking into the Black Box: Prospects and Limits in the Search for Mental Models , 1986 .

[146]  Jing Lin-lin,et al.  Notice of RetractionLateral separation minima analysis based on Required Navigation Performance , 2010, 2010 3rd International Conference on Computer Science and Information Technology.

[147]  Tara J. Weidner CAPACITY-RELATED BENEFITS OF PROPOSED CNS/ATM TECHNOLOGIES , 1998 .

[148]  J Polak,et al.  A FRAMEWORK FOR THE ESTIMATION OF EUROPEAN AIRSPACE CAPACITY USING A MODEL OF CONTROLLER WORKLOAD , 2001 .

[149]  ECONOMETRIC COST-EFFICIENCY BENCHMARKING OF AIR NAVIGATION SERVICE PROVIDERS , 2012 .

[150]  William S. Pawlak,et al.  A FRAMEWORK FOR THE EVALUATION OF AIR TRAFFIC CONTROL COMPLEXITY , 1996 .

[151]  Christopher D. Wickens,et al.  A model for types and levels of human interaction with automation , 2000, IEEE Trans. Syst. Man Cybern. Part A.

[152]  Arash Yousefi,et al.  Safety-capacity trade-off and phase transition analysis of automated separation assurance concepts , 2011, 2011 IEEE/AIAA 30th Digital Avionics Systems Conference.

[153]  Robert E Windom,et al.  Time... and time again. , 1986, Public health reports.

[154]  A J Hudgell,et al.  Assessing the Capacity of Novel ATM Systems , 2001 .

[155]  Arnab Majumdar,et al.  Identifying Airspace Capacity Factors in the Air Traffic Management System , 2012 .

[156]  Mica R. Endsley,et al.  Situation awareness information requirements for en route air traffic control. , 1994 .

[157]  Arnab Majumdar,et al.  En-Route Sector Capacity Estimation Methodologies: An International Survey , 2005 .

[158]  P. Averty,et al.  Evaluating a new index of mental workload in real ATC situation using psychophysiological measures , 2002, Proceedings. The 21st Digital Avionics Systems Conference.

[159]  Lisanne Bainbridge,et al.  Ironies of automation , 1982, Autom..

[160]  John M. Flach,et al.  Envisaging the Future Air Traffic Management System , 2011 .

[161]  Chester Gong,et al.  Concept and Laboratory Analysis of Trajectory Based Automation for Separation Assurance , 2006 .

[162]  Carol A. Manning,et al.  Relationship of Sector Activity and Sector Complexity to Air Traffic Controller Taskload , 2006 .

[163]  Parimal Kopardekar,et al.  Traffic Complexity Measurement Under Higher Levels of Automation and Higher Traffic Densities , 2008 .

[164]  S. Ratcliffe AUTOMATION IN AIR TRAFFIC MANAGEMENT , 1985 .

[165]  John A. Hughes,et al.  The Automation of Air Traffic Control , 1975, Journal of navigation.