Holistic versus decomposed ratings of general dimensions of work activity

Purpose – The purpose of this paper is to examine the accuracy of the US Department of Labor's Occupational Information Network (O*NET), which, replacing the Dictionary of Occupational Titles, analyzes jobs via a hierarchical taxonomy of work in which all task‐level activities are summarized into a 42‐construct taxonomy of first‐order generalized work activities (GWAs).Design/methodology/approach – This study examined the degree of convergence between ratings made using the holistic‐judgment process in the O*NET (which directly rates GWAs using single‐item scales) vs traditional decomposed‐judgment methods which statistically combine ratings of multiple activity items for each GWA.Findings – Analysis of holistic O*NET general work activity ratings with decomposed common‐metric questionnaire (CMQ) ratings revealed poor convergence between holistic vs decomposed methods, low interrater agreement and a tendency for incumbents to rate higher than job analysts.Practical implications – It is believed that these...

[1]  Thomas M. Stutzman.  Within Classification Job Differences. , 1983 .

[2]  S. A. Fine.  A STRUCTURE OF WORKER Functions , 1955 .

[3]  C. M. Tashman.  Dictionary of Occupational Titles , 2008 .

[4]  Duane T. Wegener,et al.  Evaluating the use of exploratory factor analysis in psychological research. , 1999 .

[5]  A. Denisi,et al.  Investigation of the uses of self-reports of abilities. , 1977 .

[6]  Robert J. Harvey,et al.  QUANTITATIVE APPROACHES TO JOB CLASSIFICATION: A REVIEW AND CRITIQUE , 1986 .

[7]  Herbert W. Marsh,et al.  Longitudinal confirmatory factor analysis: Common, time‐specific, item‐specific, and residual‐error components of variance , 1994 .

[8]  Thomas M. Stutzman,et al.  AN EVALUATION OF METHODS TO SELECT RESPONDENTS TO STRUCTURED JOB‐ANALYSIS QUESTIONNAIRES , 1986 .

[9]  Robert J. Harvey,et al.  Yes Virginia, thereis an objective reality in job analysis , 2000 .

[10]  A L Comrey,et al.  Distortions In A Commonly Used Factor Analytic Procedure. , 1979, Multivariate behavioral research.

[11]  R. MacCallum,et al.  THE APPLICATION OF EXPLORATORY FACTOR ANALYSIS IN APPLIED PSYCHOLOGY: A CRITICAL REVIEW AND ANALYSIS , 1986 .

[12]  Mark A. Wilson,et al.  Repeating items to estimate the test-retest reliability of task inventory ratings. , 1990 .

[13]  Robert C. Mecham,et al.  A study of job characteristics and job dimensions as based on the Position Analysis Questionnaire (PAQ). , 1972 .

[14]  R. Linn.  A monte carlo approach to the number of factors problem , 1968, Psychometrika.

[15]  B Walton,et al.  Job and Task Analysis. , 1979 .

[16]  R. Harvey.  The future of partial correlation as a means to reduce halo in performance ratings. , 1982 .

[17]  J. Ross,et al.  Mean performance and the factor analysis of learning data , 1964 .

[18]  S. A. Fine,et al.  Cues used by raters in the rating of temperament requirements of jobs. , 1959 .

[19]  N. Webb,et al.  Generalizability of General Education Development Ratings of Jobs in the United States , 1981 .

[20]  Phil Lewis,et al.  Revision of O*NET Data Collection Instruments , 2000 .

[21]  K. Widaman.  Common Factor Analysis Versus Principal Component Analysis: Differential Bias in Representing Model Parameters? , 1993, Multivariate behavioral research.

[22]  The Estimates of Worker Trait Requirements: for 4,000 Jobs* , 1957 .

[23]  Paul E. Levy,et al.  Industrial/Organizational Psychology: Understanding the Workplace , 2002 .

[24]  Norman G. Peterson,et al.  An occupational information system for the 21st century: The development of O*NET. , 1999 .

[25]  B. Green,et al.  Reliabilities of selected ratings available from the Dictionary of Occupational Titles.. , 1983 .

[26]  P. Hom,et al.  Structural equations modeling test of a turnover theory: Cross-sectional and longitudinal analyses. , 1991 .

[27]  Ernest J. McCormick,et al.  A factor analysis of job activities. , 1961 .

[28]  Robert J. Harvey,et al.  A comparison of holistic versus decomposed rating of Position Analysis Questionnaire work dimensions. , 1988 .

[29]  Michael D. Mumford,et al.  Basic and cross-functional skills. , 1999 .

[30]  Sidney A. Fine,et al.  Functional job Analysis: A Foundation for Human Resources Management , 1999 .

[31]  R Ratcliff,et al.  Bias effects in implicit memory tasks. , 1996, Journal of experimental psychology. General.

[32]  Lloyd G. Humphreys,et al.  Latent roots of random data correlation matrices with squared multiple correlations on the diagonal: A monte carlo study , 1976 .

[33]  M. D. Dunnette.  Handbook of Industrial and Organizational Psychology , 2005 .

[34]  E. A. Fleishman,et al.  Toward a Taxonomy of Human Performance. , 1975 .

[35]  L. Tucker,et al.  Some mathematical notes on three-mode factor analysis , 1966, Psychometrika.

[36]  L. Tucker,et al.  Evaluation of factor analytic research procedures by means of simulated correlation matrices , 1969 .

[37]  Michael D. Mumford,et al.  UNDERSTANDING WORK USING THE OCCUPATIONAL INFORMATION NETWORK (O*NET): IMPLICATIONS FOR PRACTICE AND RESEARCH , 2001 .

[38]  Edward L. Levine,et al.  Accuracy or consequential validity: which is the better standard for job analysis data? , 2000 .

[39]  L. James,et al.  rwg: An assessment of within-group interrater agreement. , 1993 .

[40]  Walter C. Borman,et al.  Generalized work activities , 1999 .

[41]  Peter C. M. Molenaar,et al.  Rotation in the dynamic factor modeling of multivariate stationary time series , 2001 .