Some Measurement and Methodological Considerations in the Application of Subjective Workload Measurement Techniques

Previous research with the NASA Task Load Index (TLX) and the Subjective Workload Assessment Technique (SWAT) has demonstrated their sensitivity to variations in workload under flight and other complex work conditions but has not addressed some important measurement and methodological issues regarding their application. This article reviews data that address several such issues including the effects of delayed workload ratings, the effects of previous workload levels on ratings, and procedures used to combine subscale ratings into one overall estimate of subjective workload.

[1]  R. Klatzky.  Human Memory: Structures And Processes , 1975 .

[2]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[3]  F. Thomas Eggemeier,et al.  The Effect of Intervening Task Performance on Subjective Workload Ratings , 1984 .

[4]  Jerome C. Notestine,et al.  Subjective Workload Assessment and Effect of Delayed Ratings in a Probability Monitoring Task , 1984 .

[5]  R A MONTY,et al.  KEEPING TRACK OF SEQUENTIAL EVENTS: EFFECTS OF RATE, CATEGORIES, AND TRIAL LENGTH. , 1965, Journal of experimental psychology.

[6]  Susan G. Hill,et al.  Workload Assessment of a Mobile Air Defense Missile System , 1988 .

[7]  Susan G. Hill,et al.  Traditional and raw task load index (TLX) correlations: Are paired comparisons necessary? In A , 1989 .

[8]  J. C. Byers,et al.  Comparison of Four Subjective Workload Rating Scales , 1992 .

[9]  Mark S. Crabtree,et al.  Proceedings of the Human Factors Society Annual Meeting (27th) on the Effect of Delayed Report on Subjective Ratings of Mental Workloads, Held at Norkfolk, VA on 10-14 October 1983. , 1983 .

[10]  William F. Moroney,et al.  A comparison of two scoring procedures with the NASA task load index in a simulated flight task , 1992, Proceedings of the IEEE 1992 National Aerospace and Electronics Conference@m_NAECON 1992.

[11]  Thomas E. Nygren,et al.  Psychometric Properties of Subjective Workload Measurement Techniques: Implications for Their Use in the Assessment of Perceived Mental Workload , 1991 .

[12]  Thomas E. Nygren,et al.  The Subjective Workload Assessment Technique: A Scaling Procedure for Measuring Mental Workload , 1988 .

[13]  F. T. Eggemeier,et al.  The Effect of Delayed Report on Subjective Ratings of Mental Workload , 1983 .

[14]  Christopher D. Wickens,et al.  Workload Assessment and Prediction , 1990 .

[15]  Philip J. Masline.  A comparison of the sensitivity of interval scale psychometric techniques in the assessment of subjective mental workload , 1986 .

[16]  A. W. Melton.  Implications of short-term memory for a general theory of memory , 1963 .

[17]  A. O. Dick,et al.  Operator Workload: Comprehensive Review and Evaluation of Operator Workload Methodologies , 1989 .

[18]  David W. Biers,et al.  An Alternative to Measuring Subjective Workload: Use of SWAT without the Card Sort , 1988 .