Fuzzy-TLX: using fuzzy integrals for evaluating human mental workload with NASA-Task Load indeX in laboratory and field studies

The aim of this study was to assess mental workload in which various load sources must be integrated to derive reliable workload estimates. We report a new algorithm for computing weights from qualitative fuzzy integrals and apply it to the National Aeronautics and Space Administration -Task Load indeX (NASA-TLX) subscales in order to replace the standard pair-wise weighting technique (PWT). In this paper, two empirical studies were reported: (1) In a laboratory experiment, age- and task-related variables were investigated in 53 male volunteers and (2) In a field study, task- and job-related variables were studied on aircrews during 48 commercial flights. The results found in this study were as follows: (i) in the experimental setting, fuzzy estimates were highly correlated with classical (using PWT) estimates; (ii) in real work conditions, replacing PWT by automated fuzzy treatments simplified the NASA-TLX completion; (iii) the algorithm for computing fuzzy estimates provides a new classification procedure sensitive to various variables of work environments and (iv) subjective and objective measures can be used for the fuzzy aggregation of NASA-TLX subscales. Practitioner Summary: NASA-TLX, a classical tool for mental workload assessment, is based on a weighted sum of ratings from six subscales. A new algorithm, which impacts on input data collection and computes weights and indexes from qualitative fuzzy integrals, is evaluated through laboratory and field studies. Pros and cons are discussed.

[1]  Y. Yamamoto,et al.  Effects of Stroop color-word conflict test on the autonomic nervous system responses. , 1997, The American journal of physiology.

[2]  Jan M Noyes,et al.  A self-analysis of the NASA-TLX workload measure , 2007, Ergonomics.

[3]  J. Ridley.  Studies of Interference in Serial Verbal Reactions , 2001 .

[4]  M. Sugeno.  FUZZY MEASURES AND FUZZY INTEGRALS—A SURVEY , 1993 .

[5]  Shyi-Ming Chen.  NEW METHODS FOR SUBJECTIVE MENTAL WORKLOAD ASSESSMENT AND FUZZY RISK ANALYSIS , 1996 .

[6]  C L Webber,et al.  Dynamical assessment of physiological systems and states using recurrence plot strategies. , 1994, Journal of applied physiology.

[7]  Ari Widyanti,et al.  Cultural influences on the measurement of subjective mental workload , 2011 .

[8]  I. Antelmi,et al.  Influence of age, gender, body mass index, and functional capacity on heart rate variability in a cohort of subjects without heart disease. , 2004, The American journal of cardiology.

[9]  Mathieu Serrurier,et al.  Elicitating Sugeno Integrals: Methodology and a Case Study , 2009, ECSQARU.

[10]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[11]  André Dittmar,et al.  Mental workload in air traffic control: an index constructed from field tests. , 2004, Aviation, space, and environmental medicine.

[12]  M Brackstone,et al.  Examination of the use of fuzzy sets to describe relative speed perception , 2000, Ergonomics.

[13]  E. Raufaste.  Sugeno integrals in subjective mental workload evaluation Application to flying personnel data , 2007 .

[14]  R. Hughson,et al.  Heart rate variability at rest and exercise: influence of age, gender, and physical training. , 1996, Canadian journal of applied physiology = Revue canadienne de physiologie appliquee.

[15]  Susan G. Hill,et al.  Traditional and raw task load index (TLX) correlations: Are paired comparisons necessary? In A , 1989 .

[16]  D. Lievin,et al.  Intégration d'une tâche de contrôle dans l'activité d'opérateurs de fabrication : le cas d'un atelier d'électronique. , 1997 .

[17]  Armelle Prunier,et al.  Heart rate variability as a measure of autonomic regulation of cardiac activity for assessing stress and welfare in farm animals — A review , 2007, Physiology & Behavior.

[18]  J. Stroop.  Studies of interference in serial verbal reactions. , 1992 .

[19]  Mao-Jiun J. Wang,et al.  Subjective assessment of mental workload: a fuzzy linguistic multi-criteria approach , 1994 .

[20]  J. Zbilut,et al.  Recurrence quantification analysis as a tool for nonlinear exploration of nonstationary cardiac signals. , 2002, Medical engineering & physics.

[21]  R. Greenberg.  Biometry , 1969, The Yale Journal of Biology and Medicine.

[22]  Thomas E. Nygren,et al.  Psychometric Properties of Subjective Workload Measurement Techniques: Implications for Their Use in the Assessment of Perceived Mental Workload , 1991 .

[23]  Robert S Bridger,et al.  Cognitive task demands, self-control demands and the mental well-being of office workers , 2011, Ergonomics.

[24]  M. Sugeno,et al.  A theory of fuzzy measures: Representations, the Choquet integral, and null sets , 1991 .

[25]  F. James Rohlf,et al.  Biometry: The Principles and Practice of Statistics in Biological Research , 1969 .

[26]  Sandra G. Hart,et al.  Nasa-Task Load Index (NASA-TLX); 20 Years Later , 2006 .