Real-time and multi-factor determination of mental workload for the aircraft certification process

Certifying cockpit systems is a long and costly process, with much emphasis on the negotiations between industry and authority's representatives. Also, a recent trend has resulted in a split between conventional and human factor scenarios approaches. As such, Human-machine Interface certification is performed rather late in the process and still relies on well-known and accepted methodologies, such as NASA-TLX tool for assessing workload. Conversely, ground truth for mental workload evaluation in aeronautics remains subjective values obtained from very limited expert pilot panels. On the other hand, other methodologies such as dual tasks and physiologic measures have been developed in labs for decades and used in simulated or real flights, but with a somewhat limited perceived added value by both industry and States experts. This article aims at discussing this conundrum through a recent example. It will present the rationale for the development of a physiologic approach based on realistic scenarios in aircraft simulators, and machine learning tools to implement a real-time complementary approach for mental workload measurement, which could help the certification process. The perceived need for pilot real-time behavior modeling and some elements of trust and acceptability will be discussed.

[1]  Nicolas Vayatis,et al.  The Complementary Role of Activity Context in the Mental Workload Evaluation of Helicopter Pilots: A Multi-tasking Learning Approach , 2018, H-WORKLOAD.

[2]  M. Lorr,et al.  Manual for the Profile of Mood States , 1971 .

[3]  S. Tremblay,et al.  Using near infrared spectroscopy and heart rate variability to detect mental overload , 2014, Behavioural Brain Research.

[4]  Neville A Stanton,et al.  Hierarchical task analysis: developments, applications, and extensions. , 2006, Applied ergonomics.

[5]  F. T. Eggemeier,et al.  Recommendations for Mental Workload Measurement in a Test and Evaluation Environment , 1993 .

[6]  Daniel J. Barber,et al.  The Psychometrics of Mental Workload , 2015, Hum. Factors.

[7]  N. Endler,et al.  Multidimensional assessment of coping: a critical evaluation. , 1990, Journal of personality and social psychology.

[8]  Sally A. Seven,et al.  Selecting Performance Measures: "Objective" versus "Subjective" Measurement , 1992 .

[9]  C. Spielberger,et al.  Manual for the State-Trait Anxiety Inventory , 1970 .

[10]  Catherine Sauvagnac,et al.  11. Charge de travail et stress , 2004 .

[11]  Peter A Hancock,et al.  State of science: mental workload in ergonomics , 2015, Ergonomics.

[12]  Christophe Bourdin,et al.  Effectiveness of Physiological and Psychological Features to Estimate Helicopter Pilots' Workload: A Bayesian Network Approach , 2013, IEEE Transactions on Intelligent Transportation Systems.

[13]  Susana Rubio,et al.  Evaluation of Subjective Mental Workload: A Comparison of SWAT, NASA‐TLX, and Workload Profile Methods , 2004 .

[14]  Susan G. Hill,et al.  Traditional and raw task load index (TLX) correlations: Are paired comparisons necessary? In A , 1989 .

[15]  Guy H. Walker,et al.  Human Factors Methods: A Practical Guide for Engineering and Design , 2012 .

[16]  Burl Mostul Measurement of Ambiguity Tolerance (MAT-50): Further Construct Validation , 1977 .

[17]  Brian Francis Gore,et al.  Measuring and Evaluating Workload: A Primer , 2010 .

[18]  A Sebok,et al.  Team performance in process control: influences of interface design and staffing levels , 2000, Ergonomics.

[19]  D. Kripke,et al.  Faculty Publications Physical Activity and Public Health Criterion Validity of the Pittsburgh Sleep Quality Index: Investigation in a Non-clinical Sample Publication Info Criterion Validity of the Pittsburgh Sleep Quality Index: Investigation in a Non-clinical Sample , 2022 .

[20]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[21]  Dick de Waard,et al.  The measurement of drivers' mental workload , 1996 .

[22]  R. Goonetilleke,et al.  Simplified subjective workload assessment technique , 2001, Ergonomics.