Task frequency rating accuracy : The effect of task engagement and experience

In this study, researchers examined the effect of task engagement and experience on frequency rating accuracy with an objective measure of task frequency. By contrasting findings from the memory literature on frequency estimation with current task analysis practices, these investigators proposed that task performers and respondents with low levels of experience would generate more accurate frequency estimates compared with task observers and respondents with high levels of experience. Participants were randomly assigned to a task engagement condition (performer vs. observer) as well as to an experience condition (low vs. high). In support of the hypotheses, participants in the performer and low-experience conditions demonstrated greater accuracy in their frequency ratings. These findings were illustrated with several different measures of accuracy. Implications for task analysis research and practices are discussed.

[1]  Mark S. Teachout,et al.  THE RELATIONSHIP BETWEEN WORK EXPERIENCE AND JOB PERFORMANCE: A CONCEPTUAL AND META‐ANALYTIC REVIEW , 1995 .

[2]  Robyn Fivush,et al.  Scripts and episodes: The development of event memory , 1992 .

[3]  C. Shea,et al.  Pew (1966) Revisited: Acquisition of Hierarchical Control as a Function of Observational Practice. , 1992, Journal of motor behavior.

[4]  Frank J. Landy,et al.  Job analysis: The composition of SME samples. , 1991 .

[5]  Patricia L. Weir,et al.  Effects of model's skill level and model's knowledge of results on the performance of a dart throwing task , 1990 .

[6]  J. A. Robinson,et al.  Autobiographical memory: The next phase , 1990 .

[7]  D. Bruce,et al.  Memories of a bicycle tour , 1989 .

[8]  N. Schmitt,et al.  Internal analyses of task ratings by job incumbents. , 1989 .

[9]  Wayman C. Mullins,et al.  Group composition as a determinant of job analysis outcomes. , 1988 .

[10]  William K. Balzer,et al.  Meaning and measurement of performance rating accuracy: Some methodological and theoretical concerns. , 1988 .

[11]  Robert J. Harvey,et al.  Influence of amount of job descriptive information on job analysis rating accuracy. , 1988 .

[12]  L. Rips,et al.  Answering autobiographical questions: the impact of memory and inference on surveys. , 1987, Science.

[13]  R. Rice,et al.  The Effects of Participation in Decision‐Making on Worker Satisfaction and Productivity: An Organizational Simulation1 , 1987 .

[14]  Thomas M. Stutzman,et al.  AN EVALUATION OF METHODS TO SELECT RESPONDENTS TO STRUCTURED JOB‐ANALYSIS QUESTIONNAIRES , 1986 .

[15]  H. Ohnogi.  Four-Year-Old Children's Visual Attention in Direct and Observational Learning , 1986, Perceptual and motor skills.

[16]  Henry M. Wellman,et al.  Accuracies and inaccuracies in autobiographical memories , 1986 .

[17]  R. Lord.  Accuracy in behavioral measurement: An alternative definition based on raters' cognitive schema and signal detection theory. , 1985 .

[18]  J. L. Warner,et al.  Inflation bias in self-assessment examinations: Implications for valid employee selection. , 1984 .

[19]  Angelo S. DeNisi,et al.  EXPERT AND NAIVE RATERS USING THE PAQ: DOES IT MATTER? , 1984 .

[20]  Ronald D. Pannone.  PREDICTING TEST PERFORMANCE: A CONTENT VALID APPROACH TO SCREENING APPLICANTS , 1984 .

[21]  W. Hockley,et al.  Retrieval of item frequency information in a continuous memory task , 1984, Memory & cognition.

[22]  A. D. Fisk,et al.  Memory as a function of attention, level of processing, and automatization. , 1984, Journal of experimental psychology. Learning, memory, and cognition.

[23]  D. E. Thompson,et al.  COURT STANDARDS FOR JOB ANALYSIS IN TEST VALIDATION , 1982 .

[24]  Gregory A. Davis,et al.  Potential Sources of Bias in Job Analytic Processes1 , 1982 .

[25]  William K. Balzer,et al.  Relationship between observational accuracy and accuracy in evaluating performance. , 1982 .

[26]  Harriet Shaklee,et al.  Sources of error in judging event covariations: Effects of memory demands. , 1982 .

[27]  Edwin T. Cornelius,et al.  A comparison of holistic and decomposed judgment strategies in job analyses by job incumbents. , 1980 .

[28]  Milton D. Hakel,et al.  CONVERGENCE AMONG DATA SOURCES, RESPONSE BIAS, AND RELIABILITY AND VALIDITY OF A STRUCTURED JOB ANALYSIS QUESTIONNAIRE , 1979 .

[29]  W C Borman,et al.  Consistency of rating accuracy and rating errors in the judgment of human performance. , 1977, Organizational behavior and human performance.

[30]  Sheldon Zedeck,et al.  Format and scoring variations in behavioral expectation evaluations , 1976 .

[31]  E. J. Rowe,et al.  Depth of processing in a frequency judgment task , 1974 .

[32]  A. O'reilly.  SKILL REQUIREMENTS: SUPERVISOR‐SUBORDINATE CONFLICT , 1973 .

[33]  Robert C. Mecham,et al.  A study of job characteristics and job dimensions as based on the Position Analysis Questionnaire (PAQ). , 1972 .

[34]  Douglas L. Hintzman,et al.  Repetition and memory: Evidence for a multiple-trace hypothesis. , 1971 .

[35]  Charmine E J Härtel.  The Industrial-Organizational Psychologist , 1993 .

[36]  Norbert Schwarz,et al.  Response scales as frames of reference: The impact of frequency range on diagnostic judgements , 1991 .

[37]  N. Schwarz,et al.  What mediates the impact of response alternatives on frequency reports of mundane behaviors , 1990 .

[38]  Richard R. Reilly,et al.  An investigation of the validity of expert true score estimates in appraisal research , 1989 .

[39]  Robert L. Dipboye,et al.  Effects of training and information on the accuracy and reliability of job evaluations. , 1988 .

[40]  R. Maki,et al.  Effects of level of processing and rehearsal on frequency judgments. , 1987, Journal of experimental psychology. Learning, memory, and cognition.

[41]  R. Greene.  Effects of intentionality and strategy on memory for frequency. , 1986 .

[42]  Donald Maxwell,et al.  Estimates of Frequency: Attribute or Attribution? , 1986 .

[43]  R. Greene,et al.  Incidental learning of event frequency , 1984, Memory & cognition.

[44]  Ronald A. Ash,et al.  Self-assessment in personnel selection. , 1977 .