Relative validity of peer and self-evaluations in self-directed interdependent work teams

Peer and self-evaluations were conducted on interdependent multidisciplinary self-directed work teams. Teams worked on two projects during the semester with membership changing between the two projects. Generalizability theory was used to partition the peer ratings into three variance components; rater effect, ratee effect, and the variance unaccounted for by the rater and ratee effects (rater by ratee interaction). The correspondence between the ratee effect and criterion measures for "effort applied to the task" and "technical knowledge applied to the task" was used as a measure of the peer evaluation validity. Self-evaluations were compared to the same criterion measures. The Fisher's average correlation coefficient between the criterion measure and the ratee effect from the peer evaluations was 0.69. In contrast, Fisher's average correlation coefficient between the criterion measure and self-evaluations was 0.25. Peer evaluations had greater validity than self-evaluations in the context of interdependent teamwork.

[1]  D. A. Kenny,et al.  A general model of consensus and accuracy in interpersonal perception. , 1991, Psychological review.

[2]  S. Grossberg,et al.  Psychological Review , 2003 .

[3]  Sarit Kraus,et al.  Aggregating social behavior into person models: perceiver-induced consistency. , 1994, Journal of personality and social psychology.

[4]  L. Goodwin,et al.  Using Generalizability Theory in Early Childhood Special Education , 1991 .

[5]  D. A. Kenny,et al.  The Social Relations Model , 1984 .

[6]  A. Kruglanski.  The Psychology of Being "Right": The Problem of Accuracy in Social Perception and Cognition , 1989 .

[7]  O. John,et al.  Accuracy and bias in self-perception: individual differences in self-enhancement and the role of narcissism. , 1994, Journal of personality and social psychology.

[8]  Eva Nick,et al.  The dependability of behavioral measurements: theory of generalizability for scores and profiles , 1973 .

[9]  Mark P. Zanna,et al.  Advances in Experimental Social Psychology , 1986, Advances in Experimental Social Psychology.

[10]  R. Thompson.  Reliability, Validity, And Bias In Peer Evaluations Of Self Directed Interdependent Work Teams , 2001 .

[11]  Giacomo Mauro DAriano.  The Journal of Personality and Social Psychology. , 2002 .

[12]  J. McGourty,et al.  Incorporating student peer review and feedback into the assessment process , 1998, FIE '98. 28th Annual Frontiers in Education Conference. Moving from 'Teacher-Centered' to 'Learner-Centered' Education. Conference Proceedings (Cat. No.98CH36214).

[13]  D. A. Kenny,et al.  Interpersonal Perception: A Social Relations Analysis , 1988 .

[14]  D. A. Kenny,et al.  A New Round Robin Analysis of Variance for Social Interaction Data , 1979 .

[15]  L. Cronbach,et al.  Conceptual and methodological problems in interpersonal perception. , 1955, Psychological review.

[16]  Donald B. Rubin,et al.  The Dependability of Behavioral Measurements: Theory of Generalizability for Scores and Profiles. , 1974 .

[17]  N. Anderson.  Foundations of information integration theory , 1981 .

[18]  David A. Kenny.  A general model of consensus and accuracy in interpersonal perception. , 1991 .