Open feedback in gymnastic judging causes conformity bias based on informational influencing

Abstract The aims of this study were twofold: (1) to determine whether open feedback (i.e. the ability to hear or see the scores of colleague judges after each performance) would lead judges in gymnastics to conform with their colleagues, and (2) to identify the underlying process on which this conformity is based. Twenty-three certified Flemish judges in women's gymnastics were randomly divided into panels of a maximum of five judges. These panels had to rate the same 30 videotaped individual vaults: 15 in phase 1 and 15 in phase 2. Two independent variables were orthogonally manipulated: feedback (or no feedback) during phase 1 and feedback (or no feedback) during phase 2. The results of phase 1 revealed that the variation between the judges' scores was less within panels that had received feedback than within panels that had not received feedback. We therefore conclude that the availability of feedback elicits conformity among gymnastic judges. The results of phase 2 indicated that this conformity continued even when feedback was no longer provided, suggesting that the observed conformity was based on informational influencing (i.e. because of uncertainty about the correct responses) and not on normative influencing (i.e. out of fear of standing out in the group).

[1]  Henning Plessner,et al.  Expectation Biases in Gymnastics Judging , 1999 .

[2]  D. Collins,et al.  The Art of Reason versus the Exactness of Science in Elite Refereeing: Comments on Plessner and Betsch (2001). , 2002, Journal of sport & exercise psychology.

[3]  Jackie Puhl,et al.  Use of Video Replay in Judging Gymnastics Vaults , 1980 .

[4]  D. Ste-Marie.  Memory biases in gymnastic judging: differential effects of surface feature changes , 2003 .

[5]  D. Ste-Marie,et al.  Memory-Influenced Biases in Gymnastic Judging Occur across Different Prior Processing Conditions , 2001, Research quarterly for exercise and sport.

[6]  M. Deutsch,et al.  A study of normative and informational social influences upon individual judgement. , 1955, Journal of abnormal psychology.

[7]  D. Landers.  Research Bulletin: A Review of Research on Gymnastic Judging , 1970 .

[8]  D. Ste-Marie,et al.  A Reputation Bias in Figure Skating Judging , 2004 .

[9]  Lysann Damisch,et al.  Olympic medals as fruits of comparison? Assimilation and contrast in sequential performance judgments. , 2006, Journal of experimental psychology. Applied.

[10]  Filip Boen,et al.  Judging Bias in Synchronized Swimming: Open Feedback Leads to Nonperformance-Based Conformity , 2004 .

[11]  Diane M. Ste-Marie,et al.  Enduring memory-influenced biases in gymnastic judging. , 1996 .

[12]  J. Nunnally.  Psychometric Theory (2nd ed), New York: McGraw-Hill. , 1978 .

[13]  C. Ansorge,et al.  Bias in judging women's gymnastics induced by expectations of within-team order. , 1978, Research quarterly.

[14]  Walter C. Borman,et al.  Effects of instructions to avoid halo error on reliability and validity of performance evaluation ratings. , 1975 .

[15]  C. Ansorge,et al.  Judging Bias Induced by Viewing Contrived Videotapes: A Function of Selected Psychological Variables , 1983 .

[16]  C. A. Moore,et al.  FIELD‐DEPENDENT AND FIELD‐INDEPENDENT COGNITIVE STYLES AND THEIR EDUCATIONAL IMPLICATIONS , 1975 .

[17]  Filip Boen,et al.  The impact of open feedback on conformity among judges in rope skipping , 2006 .

[18]  C. Ansorge,et al.  International Bias Detected in Judging Gymnastic Competition at the 1984 Olympic Games , 1988 .

[19]  H. Lindman.  Analysis of variance in complex experimental designs , 1974 .

[20]  Timothy D. Lee,et al.  Prior processing effects on gymnastic judging. , 1991 .

[21]  C. Whissell,et al.  National Bias in Judgments of Olympic-Level Skating , 1993 .