Understanding the human performance envelope using electrophysiological measures from wearable technology

In this article, we capture electrophysiological measures from a new wearable technology to understand the human performance envelope. Using the NASA Multi-Attribute Task Battery (MATB II), participants completed tasks associated with flight control which included communication, tracking and system and resource monitoring. Electrophysiological measures relating to cardiac activity and respiration were taken using the new wearable technology. Our results show significant differences in both heart rate and respiration rate in response to different taskloads and that higher taskloads were associated with higher mental workload. Frequency measures of heart rate variability discriminated different task types but not taskloads. This finding may be related to differences in task complexity being more important than the number events which we have used to manipulate taskload. We suggest that this new generation of wearable sensors could be used to inform operator locus in a human performance envelope, indicating when assistance by the aircraft or another crew member may be necessary to maintain safe and efficient performance.

[1]  Majid Fallahi,et al.  Effects of mental workload on physiological and subjective responses during traffic density monitoring: A field study. , 2016, Applied ergonomics.

[2]  Joan Cahill,et al.  A Sociotechnical Model of the Flight Crew Task , 2014, Hum. Factors.

[3]  D. Brodie,et al.  Effects of Short-Term Psychological Stress on the Time and Frequency Domains of Heart-Rate Variability , 2000, Perceptual and motor skills.

[4]  Olivier Chételat,et al.  Clinical validation of LTMS-S: A wearable system for vital signs monitoring , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[5]  A. Treisman.  VERBAL CUES, LANGUAGE, AND MEANING IN SELECTIVE ATTENTION. , 1964, The American journal of psychology.

[6]  Tamsyn Edwards,et al.  Factor interaction influences on human performance in air traffic control: the need for a multifactorial model. , 2012, Work.

[7]  Mao-Jiun J. Wang,et al.  Effective Indices for Monitoring Mental Workload While Performing Multiple Tasks , 2015, Perceptual and motor skills.

[8]  Febo Cincotti,et al.  Towards a multimodal bioelectrical framework for the online mental workload evaluation , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[9]  S. Fairclough,et al.  Prediction of subjective states from psychophysiology: A multivariate approach , 2006, Biological Psychology.

[10]  Bin Wu,et al.  Using Physiological Parameters to Evaluate Operator's Workload in Manual Controlled Rendezvous and Docking (RVD) , 2011, HCI.

[11]  Erik Hollnagel,et al.  Human factors and folk models , 2004, Cognition, Technology & Work.

[12]  James C. Christensen,et al.  Coadaptive Aiding and Automation Enhance Operator Performance , 2013, Hum. Factors.

[13]  Glenn F. Wilson,et al.  Psychophysiological responses to changes in workload during simulated air traffic control , 1996, Biological Psychology.

[14]  A. Malliani,et al.  Heart rate variability. Standards of measurement, physiological interpretation, and clinical use , 1996 .

[15]  Staffan Nählinder,et al.  A Comparison of Two Recorders for Obtaining In-flight Heart Rate Data , 2006 .

[16]  Nitish V. Thakor,et al.  Cognitive Workload Discrimination in Flight Simulation Task Using a Generalized Measure of Association , 2015, ICONIP.

[17]  Nicklas Dahlstrom,et al.  A Comparison of Two Recorders for Obtaining In-flight Heart Rate Data , 2006, Applied psychophysiology and biofeedback.

[18]  Neville A. Stanton,et al.  Identifying Markers of Performance Decline in Air Traffic Controllers , 2016 .

[19]  Richard W. Backs,et al.  Cardiorespiratory Indices of Mental Workload during Simulated Air Traffic Control , 2000 .

[20]  L. Mulder,et al.  Please Scroll down for Article Ergonomics Cardiovascular and Eye Activity Measures as Indices for Momentary Changes in Mental Effort during Simulated Flight Cardiovascular and Eye Activity Measures as Indices for Momentary Changes in Mental Effort during Simulated Flight , 2022 .

[21]  Michael E. Miller,et al.  Prediction of Perceived Workload From Task Performance and Heart Rate Measures , 2013 .

[22]  Neville A. Stanton,et al.  Pilot–Controller Communication Problems and an Initial Exploration of Language-Engineering Technologies as a Potential Solution , 2016 .

[23]  Mirza Mansoor Baig,et al.  A comprehensive survey of wearable and wireless ECG monitoring systems for older adults , 2013, Medical & Biological Engineering & Computing.

[24]  Xiaolu Dong,et al.  Mental workload measurement for emergency operating procedures in digital nuclear power plants , 2013, Ergonomics.

[25]  Xi-Qing Sun,et al.  Heart Rate and Respiration Responses to Real Traffic Pattern Flight , 2008, Applied psychophysiology and biofeedback.

[26]  Przemyslaw Guzik,et al.  ECG by mobile technologies. , 2016, Journal of electrocardiology.

[27]  J. Veltman,et al.  Physiological workload reactions to increasing levels of task difficulty. , 1998, Ergonomics.

[28]  Whose Fallacies? , 2015 .

[29]  Guy Gratton.  Initial Airworthiness: Determining the Acceptability of New Airborne Systems , 2014 .

[30]  Peter A Hancock,et al.  State of science: mental workload in ergonomics , 2015, Ergonomics.

[31]  Charles E. Billings,et al.  Aviation Automation: The Search for A Human-centered Approach , 1996 .

[32]  Louise Venables,et al.  The influence of task demand and learning on the psychophysiological response. , 2005, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[33]  Daniel J. Barber,et al.  The Psychometrics of Mental Workload , 2015, Hum. Factors.

[34]  Bruno Berberian,et al.  Development of the Human Performance Envelope Concept for Cockpit HMI Design , 2019 .