NASA TLX: Software for assessing subjective mental workload

Obtaining mental workload levels during task performance is a difficult procedure. The workload level experienced by an operator can affect task performance. This effect can be caused by either excessive or reduced mental workload. Thus, estimating workload levels can help isolate sources that affect performance. Several techniques can be used to measure operator workload. Psychophysiological measurements using electroencephalograms (EEGs) have been used with much success. However, EEG machines are not the most portable, practical, or ubiquitous devices, which constrains their usefulness in experiments. Obtaining physiological mental workload data is a nontrivial task, and there has been a large amount of work on designing lightweight and portable workload measuring devices (Kramer, 1991). Workload assessment techniques should possess the following properties: sensitivity, diagnostic capabilities, selectivity, low intrusiveness, reliability, and ease of implementation (Eggemeier, 1988). The NASA Task Load Index (TLX) has been shown to meet these criteria (Rubio, Diaz, Martin, & Puente, 2004). It is a subjective workload assessment technique that relies on a multidimensional construct to derive an overall workload score based on a weighted average of ratings on six subscales: mental demand, physical demand, temporal demand, performance, effort, and frustration level. The use of these six subscales to compute an overall workload score has been found to reduce variability among subjects, relative to a unidimensional workload rating, while providing diagnostic information about workload sources (Hart & Staveland, 1988). Specific sources of mental workload imposed by different tasks are an important determinant of workload experiences. Three of the subscales relate to the demands imposed on the subject (mental, physical, and temporal demand), whereas the other subscales focus on the interaction of the subject with the task (performance, effort, and frustration level). Descriptions of the six subscales are

[1]  William F. Moroney,et al.  A comparison of two scoring procedures with the NASA task load index in a simulated flight task , 1992, Proceedings of the IEEE 1992 National Aerospace and Electronics Conference@m_NAECON 1992.

[2]  James L. Szalma,et al.  Workload and Performance: A Field Evaluation in a Police Shooting Range , 2004 .

[3]  Jennifer A. Safar,et al.  The Effects of use on Acceptance and Trust in Voice Authentication Technology , 2006 .

[4]  F. T. Eggemeier.  Properties of Workload Assessment Techniques , 1988 .

[5]  S. Miyake.  Multivariate workload evaluation combining physiological and subjective measures. , 2001, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[6]  A. Kramer,et al.  Physiological metrics of mental workload: A review of recent progress , 1990, Multiple-task performance.

[7]  Sandra G. Hart,et al.  Nasa-Task Load Index (NASA-TLX); 20 Years Later , 2006 .

[8]  F. Drasgow,et al.  Equivalence of computerized and paper-and-pencil cognitive ability tests: A meta-analysis. , 1993 .

[9]  David B. Kaber,et al.  Design of Automation for Telerobots and the Effect on Performance, Operator Situation Awareness, and Subjective Workload , 2000 .

[10]  Daniel P. J. Bruneau,et al.  A self-analysis of the NASA-TLX workload measure , 2007, Ergonomics.

[11]  Susana Rubio,et al.  Evaluation of Subjective Mental Workload: A Comparison of SWAT, NASA‐TLX, and Workload Profile Methods , 2004 .

[12]  Susan G. Hill,et al.  Traditional and raw task load index (TLX) correlations: Are paired comparisons necessary? In A , 1989 .

[13]  Peom Park,et al.  User required information modality and structure of In-Vehicle Navigation System focused on the urban commuter , 1997 .

[14]  G. Matthews,et al.  Automatic-Controlled Information Processing and Error Detection in a Simulated Pharmacy-Verification Task , 2003, Perceptual and motor skills.

[15]  J. C. Byers,et al.  Comparison of Four Subjective Workload Rating Scales , 1992 .

[16]  D. Dawson,et al.  Does variation in workload affect fatigue in a regular 12-hour shift system? , 2007 .

[17]  Kilseop Ryu,et al.  Evaluation of mental workload with a combined measure based on physiological indices during a dual task of tracking and mental arithmetic , 2005 .

[18]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .