Peer and subordinate performance appraisal measurement equivalence.

Confirmatory factor analysis (CFA) and item response theory (IRT) were applied to determine the extent to which peer and subordinate ratings of managers on a team-building skill dimension are directly comparable. Simultaneous CFA in the 2 groups of raters suggested that the 2 sets of ratings are calibrated equivalently, and polytomous IRT methods led to similar conclusions. The results were replicated in independent samples of raters. These are encouraging results for practitioners or researchers who compare ratings from these 2 groups. In addition to presenting the empirical findings from the study and illustrating how CFA and IRT methods of testing measurement equivalence compare, the article shows the unique types of information about performance appraisals that IRT and CFA can provide to researchers and practitioners, with implications for future research.

[1]  F. Samejima.  Estimation of latent ability using a response pattern of graded scores , 1968 .

[2]  Allan S. Cohen,et al.  Detection of Differential Item Functioning in the Graded Response Model , 1993 .

[3]  Wim J. van der Linden,et al.  IRT-Based Internal Measures of Differential Functioning of Items and Tests , 1995 .

[4]  R. Kanfer,et al.  Equivalence of psychological measurement in heterogeneous populations. , 1985, The Journal of applied psychology.

[5]  T. Maurer,et al.  Contrast effects in behavioral measurement: An investigation of alternative process explanations. , 1991 .

[6]  Barbara M. Byrne,et al.  A Primer of LISREL , 1989 .

[7]  G J Lautenschlager,et al.  A Comparison of Alternatives to Conducting Monte Carlo Analyses for Determining Parallel Analysis Criteria. , 1989, Multivariate behavioral research.

[8]  Robert J. Vandenberg,et al.  A Central Question in Cross-Cultural Research: Do Employees of Different Cultures Interpret Work-related Measures in an Equivalent Manner?: , 1994 .

[9]  Nambury S. Raju,et al.  ORGANIZATIONAL DEVELOPMENT INTERVENTIONS: A META‐ANALYSIS OF THEIR EFFECTS ON SATISFACTION AND OTHER ATTITUDES , 1989 .

[10]  Karl G. Jöreskog,et al.  LISREL 7: A guide to the program and applications , 1988 .

[11]  E. Salas,et al.  Team building and its influence on team effectiveness: An examination of conceptual and empirical developments. , 1992 .

[12]  K. Kelley,et al.  Issues, theory, and research in industrial/organizational psychology , 1992 .

[13]  B. Byrne,et al.  Testing for the equivalence of factor covariance and mean structures: The issue of partial measurement invariance. , 1989 .

[14]  Keith F Widaman,et al.  Confirmatory factor analysis and item response theory: two approaches for exploring measurement invariance. , 1993, Psychological bulletin.

[15]  Paul S. George.  Team building without tears. , 1987 .