The Measure of human error: Direct and indirect performance shaping factors

The goal of performance shaping factors (PSFs) is to provide measures to account for human performance. PSFs fall into two categories—direct and indirect measures of human performance. While some PSFs such as “time to complete a task” are directly measurable, other PSFs, such as “fitness for duty,” can only be measured indirectly through other measures and PSFs, such as through fatigue measures. This paper explores the role of direct and indirect measures in human reliability analysis (HRA) and the implications that measurement theory has on analyses and applications using PSFs. The paper concludes with suggestions for maximizing the reliability and validity of PSFs.

[1]  H. Kyburg.  Theory and measurement , 1984 .

[2]  William J. Galyean.  Orthogonal PSF Taxonomy for Human Reliability Analyses (PSAM-0281) , 2006 .

[3]  Alija Kulenović,et al.  Standards for Educational and Psychological Testing , 1999 .

[4]  Maria L. Thomas,et al.  Neural basis of alertness and cognitive performance impairments during sleepiness. I. Effects of 24 h of sleep deprivation on waking human regional brain activity , 2000, Journal of sleep research.

[5]  Brian Ellis,et al.  Basic Concepts of Measurement. , 1966 .

[6]  Ronald L. Boring,et al.  A Simplified Expert Elicitation Guideline (PSAM-0089) , 2006 .

[7]  A. Williamson,et al.  Moderate sleep deprivation produces impairments in cognitive and motor performance equivalent to legally prescribed levels of alcohol intoxication , 2000, Occupational and environmental medicine.

[8]  J. Nunnally.  Psychometric Theory (2nd ed), New York: McGraw-Hill. , 1978 .

[9]  John A. Forester,et al.  Human Reliability Analysis (HRA) Good Practices , 2004 .

[10]  Ronald Laurids Boring.  Improving Human Scaling Reliability , 2003 .

[11]  Michael W. L. Chee,et al.  Dissociation of cortical regions modulated by both working memory load and sleep deprivation and by sleep deprivation alone , 2005, NeuroImage.

[12]  Ronald L. Boring,et al.  A human reliability based usability evaluation method for safety-critical software , 2006, CHI 2006.

[13]  L. Cronbach,et al.  Construct validity in psychological tests. , 1955, Psychological bulletin.

[14]  Ronald L. Boring,et al.  Mind as Magnitude: Reconsidering Information Processing in Cognitive Engineering , 2005 .