Impact of experience on the sensitivity, acceptability, and intrusive of two subjective mental workload techniques: The NASA TLX and workload profile.

BACKGROUND Today's work environments have high cognitive demands, and mental workload is one of the main causes of work stress, human errors, and accidents. While several mental workload studies have compared the mental workload perceived by groups of experienced participants to that perceived by novice groups, no comparisons have been made between the same individuals performing the same tasks at different times. OBJECTIVE This work aims to compare NASA Task Load Index (NASA-TLX) to Workload Profile (WP) in terms of their sensitivity. The comparison considers the impact of experience and task differentiation in the same individual once a degree of experience has been developed in the execution of the same tasks. It also considers the acceptability and intrusivity of the techniques. METHODS The sample consisted of 30 participants who performed four tasks in two sessions. The first session was performed when participants had no experience; the second session was performed after a time of practice. Mental workload was assessed after each session. Statistical methods were used to compare the results. RESULTS The NASA-TLX proved to be more sensitive to experience, while the WP showed greater sensitivity to task differentiation. In addition, while both techniques featured a similar degree of intrusivity, the NASA-TLX received greater acceptability. CONCLUSION The acceptability of WP is low due to the high complexity of its dimensions and clarifying explanations of these may be necessary to increase acceptability. Future research proposals should be expanded to consider mental workload when designing work environments in current manufacturing environments.

[1]  Hossein Ebrahimi,et al.  The effect of workload on nurses' quality of life with moderating perceived social support during the COVID-19 pandemic. , 2021, Work.

[2]  M. Hertzum Reference values and subscale patterns for the task load index (TLX): a meta-analytic review , 2021, Ergonomics.

[3]  Glenn F. Wilson,et al.  Workload assessment in multi-task environments , 2020 .

[4]  D. Spahn,et al.  Validation of the Raw National Aeronautics and Space Administration Task Load Index (NASA-TLX) Questionnaire to Assess Perceived Workload in Patient Monitoring Tasks: Pooled Analysis Study Using Mixed Models , 2020, Journal of medical Internet research.

[5]  Bram B. Van Acker,et al.  Understanding mental workload: from a clarifying concept analysis toward an implementable framework , 2018, Cognition, Technology & Work.

[6]  Anna Brolin,et al.  Experimental study of cognitive aspects affecting human performance in manual assembly , 2017 .

[7]  Sharon Claxton Bommer,et al.  A Theoretical Framework For Evaluating Mental Workload Resources in Human Systems Design for Manufacturing Operations , 2016 .

[8]  Paul Beaudry,et al.  The Great Reversal in the Demand for Skill and Cognitive Tasks , 2013, Journal of Labor Economics.

[9]  Rebecca A. Grier How High is High? A Meta-Analysis of NASA-TLX Global Workload Scores , 2015 .

[10]  Catherine Berthelon,et al.  Mental workload and driving , 2014, Front. Psychol..

[11]  Patricia A. Reuter-Lorenz,et al.  Age differences in prefontal recruitment during verbal working memory maintenance depend on memory load , 2010, Cortex.

[12]  Gladys Rolo González,et al.  Desarrollo de una Escala Subjetiva de Carga Mental de Trabajo (ESCAM) , 2009 .

[13]  R. Knight,et al.  Age-related top-down suppression deficit in the early stages of cortical visual memory processing , 2008, Proceedings of the National Academy of Sciences.

[14]  Christopher D. Wickens,et al.  Multiple Resources and Mental Workload , 2008, Hum. Factors.

[15]  Neville A Stanton,et al.  Hierarchical task analysis: developments, applications, and extensions. , 2006, Applied ergonomics.

[16]  Anil Mital,et al.  Advanced technologies and humans in manufacturing workplaces: an interdependent relationship , 2004 .

[17]  Susana Rubio,et al.  Evaluation of Subjective Mental Workload: A Comparison of SWAT, NASA‐TLX, and Workload Profile Methods , 2004 .

[18]  S. Miyake Multivariate workload evaluation combining physiological and subjective measures. , 2001, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[19]  G. Salvendy,et al.  Review and reappraisal of modelling and predicting mental workload in single- and multi-task environments , 2000 .

[20]  Celestine A. Ntuen,et al.  The application of fuzzy set theory to cognitive workload evaluation of electronic circuit board inspectors , 1999 .

[21]  P. Tsang,et al.  Diagnosticity and multidimensional subjective workload ratings. , 1996, Ergonomics.

[22]  C. Wickens,et al.  The Sternberg memory search task as an index of pilot workload , 1986 .