Dissociation Between Mental Workload, Performance, and Task Awareness in Pilots of High Performance Aircraft

The purpose of this study was to demonstrate how the inclusion of a tactical task goal awareness measure complemented mental workload and performance measures in a simulated air combat mission. It was hypothesized that the evaluation of the tactical task goal awareness could provide additional information concerning the cognitive demands a pilot is exposed to during a complex air combat task. A test setting was developed to test this hypothesis in a virtual flight training device. To highlight the impact of task complexity, high performance aircraft pilots’ heart rate (HR), interbeat-interval (IBI), and performance in two simple flying tasks were first compared. Then, a similar comparison, complemented with the tactical task goal awareness measure, was made with two complex flying tasks. It was found that when the pilot's awareness of the tactical goals was low, a combination of low performance and low mental workload occurred. It was concluded that when the pilots’ performance is evaluated on a complex air combat task, the awareness of the tactical goals, performance, and mental workload should be studied together as the pilot's awareness can explain some of HR/IBI responses that could be otherwise misinterpreted. More generally, mental workload, performance, and task goal awareness should all be considered when the operator's performance in any complex human–machine system is assessed.

[1]  M Angelborg-Thanderz,et al.  Information complexity--mental workload and performance in combat aircraft. , 1997, Ergonomics.

[2]  Hankins Tc,et al.  A comparison of heart rate, eye activity, EEG and subjective measures of pilot mental workload during flight. , 1998, Aviation, space, and environmental medicine.

[3]  Mary L. Cummings,et al.  Operator scheduling strategies in supervisory control of multiple UAVs , 2007 .

[4]  Reinhard Braunstingl,et al.  Requirements for Future Collision Avoidance Systems in Visual Flight: A Human-Centered Approach , 2013, IEEE Transactions on Human-Machine Systems.

[5]  Hubert S. Feild,et al.  Has the Inverted-U Theory of Stress and Job Performance Had a Fair Test? , 2003 .

[6]  G F Wilson,et al.  Air-to-ground training missions: a psychophysiological workload analysis. , 1993, Ergonomics.

[7]  Heikki Mansikka,et al.  Fighter pilots' heart rate, heart rate variation and performance during an instrument flight rules proficiency test. , 2016, Applied ergonomics.

[8]  D. Kahneman,et al.  Attention and Effort , 1973 .

[9]  Henry R. Jex,et al.  Measuring Mental Workload: Problems, Progress, and Promises , 1988 .

[10]  A. H. Roscoe Assessing pilot workload. Why measure heart rate, HRV and respiration? , 1992, Biological Psychology.

[11]  Staffan Magnusson,et al.  Similarities and Differences in Psychophysiological Reactions Between Simulated and Real Air-to-Ground Missions , 2002 .

[12]  K. J. Vicente,et al.  Spectral Analysis of Sinus Arrhythmia: A Measure of Mental Effort , 1987, Human factors.

[13]  Kenneth W. Bauer,et al.  Improving pilot mental workload classification through feature exploitation and combination: a feasibility study , 2005, Comput. Oper. Res..

[14]  R. Parasuraman,et al.  Psychophysiology and adaptive automation , 1996, Biological Psychology.

[15]  Mica R. Endsley,et al.  Predictive Utility of an Objective Measure of Situation Awareness , 1990 .

[16]  Mica R. Endsley,et al.  Situation awareness global assessment technique (SAGAT) , 1988, Proceedings of the IEEE 1988 National Aerospace and Electronics Conference.

[17]  G. R. J. Hockey Compensatory control in the regulation of human performance under stress and high workload: A cognitive-energetical framework , 1997, Biological Psychology.

[18]  Randall L. Schweller,et al.  Knowing the Unknown Unknowns: Misplaced Certainty and the Onset of War , 2011 .

[19]  Christopher D. Wickens,et al.  A model for types and levels of human interaction with automation , 2000, IEEE Trans. Syst. Man Cybern. Part A.

[20]  Michael C. Dorneich,et al.  Interaction of Automation Visibility and Information Quality in Flight Deck Information Automation , 2017, IEEE Transactions on Human-Machine Systems.

[21]  H. Gr Compensatory control in the regulation of human performance under stress and high workload; a cognitive-energetical framework. , 1997 .

[22]  Birgit Vogel-Heuser,et al.  Supporting Operators in Process Control Tasks—Benefits of Interactive 3-D Visualization , 2016, IEEE Transactions on Human-Machine Systems.

[23]  Michael D. Matthews,et al.  A Comparison of Expert Ratings and Self-Assessments of Situation Awareness During a Combat Fatigue Course , 2011 .

[24]  F. Thomas Eggemeier,et al.  Workload assessment methodology. , 1986 .

[25]  G. Wong,et al.  Known Knowns, Known Unknowns, Unknown Unknowns , 2011 .

[26]  Roberto Sabatini,et al.  A novel approach to night vision imaging systems development, integration and verification in military aircraft , 2013 .

[27]  Christopher D. Wickens,et al.  Multiple resources and performance prediction , 2002 .

[28]  Fred G. W. C. Paas,et al.  The Efficiency of Instructional Conditions: An Approach to Combine Mental Effort and Performance Measures , 1992 .

[29]  David B. Kaber,et al.  Design of Automation for Telerobots and the Effect on Performance, Operator Situation Awareness, and Subjective Workload , 2000 .

[30]  Mica R. Endsley,et al.  Analysis of Situation Awareness from Critical Incident Reports , 2000 .

[31]  M R Endsley,et al.  Level of automation effects on performance, situation awareness and workload in a dynamic control task. , 1999, Ergonomics.

[32]  John M. Reising,et al.  Workload and Situation Awareness in Future Aircraft , 1987 .

[33]  Heikki Mansikka,et al.  Fighter pilots’ heart rate, heart rate variation and performance during instrument approaches , 2016, Ergonomics.

[34]  J Aasman,et al.  Operator Effort and the Measurement of Heart-Rate Variability , 1987, Human factors.

[35]  R. Clemen,et al.  Soft Computing , 2002 .

[36]  Barry H. Kantowitz,et al.  Mental Workload , 2020, Encyclopedia of Behavioral Medicine.

[37]  David C Logan,et al.  Known knowns, known unknowns, unknown unknowns and the propagation of scientific enquiry. , 2009, Journal of experimental botany.

[38]  Hoang ChuDuc,et al.  A Review of Heart Rate Variability and its Applications , 2013 .

[39]  J. Veltman,et al.  Physiological indices of workload in a simulated flight task , 1996, Biological Psychology.

[40]  L. A. Whitaker,et al.  A cognitive classification of pilot performance in air combat , 1992, Proceedings of the IEEE 1992 National Aerospace and Electronics Conference@m_NAECON 1992.

[41]  M. Endsley Automation and situation awareness. , 1996 .

[42]  Thomas E. Nygren,et al.  The Subjective Workload Assessment Technique: A Scaling Procedure for Measuring Mental Workload , 1988 .

[43]  Christopher D Wickens,et al.  Processing Resources in Attention, Dual Task Performance, and Workload Assessment. , 1981 .

[44]  Dick de Waard,et al.  The measurement of drivers' mental workload , 1996 .

[45]  Rubin Wang,et al.  Recognition of Mental Workload Levels Under Complex Human–Machine Collaboration by Using Physiological Features and Adaptive Support Vector Machines , 2015, IEEE Transactions on Human-Machine Systems.

[46]  P G Jorna,et al.  Heart rate and workload variations in actual and simulated flight. , 1993, Ergonomics.

[47]  A. H. Roscoe,et al.  Heart rate as a psychophysiological measure for in-flight workload assessment. , 1993, Ergonomics.

[48]  Robert C. Williges,et al.  Behavioral Measures of Aircrew Mental Workload , 1979 .

[49]  John B. Kidd,et al.  Decisions with Multiple Objectives—Preferences and Value Tradeoffs , 1977 .

[50]  Glenn F. Wilson,et al.  Heart Rate Measures of Flight Test and Evaluation , 2002 .

[51]  Rubin Wang,et al.  Nonlinear Dynamic Classification of Momentary Mental Workload Using Physiological Features and NARX-Model-Based Least-Squares Support Vector Machines , 2017, IEEE Transactions on Human-Machine Systems.

[52]  Daniel G Bobrow,et al.  On data-limited and resource-limited processes , 1975, Cognitive Psychology.

[53]  Geoffrey Ho,et al.  Effects of display mode and input method for handheld control of micro aerial vehicles for a reconnaissance mission , 2013, IEEE Transactions on Human-Machine Systems.

[54]  R. L. Keeney,et al.  Decisions with Multiple Objectives: Preferences and Value Trade-Offs , 1977, IEEE Transactions on Systems, Man, and Cybernetics.

[55]  Mica R. Endsley,et al.  The Out-of-the-Loop Performance Problem and Level of Control in Automation , 1995, Hum. Factors.

[56]  G. Mulder The Concept and Measurement of Mental Effort , 1986 .

[57]  E R Jones,et al.  Human Factors Aspects of Simulation: Report of the Working Group on Simulation , 1985 .

[58]  Mica R. Endsley,et al.  Toward a Theory of Situation Awareness in Dynamic Systems , 1995, Hum. Factors.

[59]  Tomi Laitinen,et al.  Heart rate and performance during combat missions in a flight simulator. , 2007, Aviation, space, and environmental medicine.

[60]  Christopher D. Wickens,et al.  Multiple Resources and Mental Workload , 2008, Hum. Factors.

[61]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[62]  Mary L. Cummings,et al.  Task Versus Vehicle-Based Control Paradigms in Multiple Unmanned Vehicle Supervision by a Single Operator , 2014, IEEE Transactions on Human-Machine Systems.

[63]  Kilseop Ryu,et al.  Evaluation of mental workload with a combined measure based on physiological indices during a dual task of tracking and mental arithmetic , 2005 .

[64]  Glenn F. Wilson,et al.  An Analysis of Mental Workload in Pilots During Flight Using Multiple Psychophysiological Measures , 2002 .

[65]  Reidun Ursin,et al.  Physiological Indicators of Mental Workload , 1979 .

[66]  W W Wierwille,et al.  Physiological Measures of Aircrew Mental Workload , 1979, Human factors.

[67]  Christina F. Rusnock,et al.  Simulation-Based Evaluation of Adaptive Automation Revoking Strategies on Cognitive Workload and Situation Awareness , 2017, IEEE Transactions on Human-Machine Systems.

[68]  Ole Kæseler Andersen,et al.  Acute pain increases heart rate: Differential mechanisms during rest and mental stress , 2005, Autonomic Neuroscience.

[69]  Mica R. Endsley,et al.  Situation Awareness Information Requirements Analysis for En Route Air Traffic Control , 1994 .

[70]  Neville A Stanton,et al.  The process of processing: exploring the validity of Neisser's perceptual cycle model with accounts from critical decision-making in the cockpit , 2015, Ergonomics.

[71]  G. Breithardt,et al.  Heart rate variability: standards of measurement, physiological interpretation and clinical use. Task Force of the European Society of Cardiology and the North American Society of Pacing and Electrophysiology. , 1996 .

[72]  U. Neisser Cognitive Psychology. (Book Reviews: Cognition and Reality. Principles and Implications of Cognitive Psychology) , 1976 .

[73]  A. O. Dick,et al.  Operator Workload: Comprehensive Review and Evaluation of Operator Workload Methodologies , 1989 .

[74]  Jennifer M. Kavanagh Stress and Performance A Review of the Literature and its Applicability to the Military , 2005 .

[75]  Fred Paas,et al.  Dynamic problem selection in air traffic control training: a comparison between performance, mental effort and mental efficiency , 2001, Comput. Hum. Behav..

[76]  David M. Gaba,et al.  Situation Awareness in Anesthesiology , 1995, Hum. Factors.

[77]  C Sekiguchi,et al.  Frequency analysis of heart rate variability under flight conditions. , 1979, Aviation, space, and environmental medicine.

[78]  Greg L. Zacharias,et al.  A computational situation assessment model for nuclear power plant operations , 1997, IEEE Trans. Syst. Man Cybern. Part A.

[79]  Graham Wilson,et al.  Psychophysiological assessment of workload in multi-task environments , 2020 .