The use and misuse of student evaluations of teaching

With the purpose of highlighting the validity and use of student evaluations of teaching (SETs), this article analyzes student grades and student evaluations of teaching performance along with nine other independent variables in the Spanish program of a major university. Data analyzed for this project represents four years of teaching and includes the evaluations and grades of 18,175 students. The most significant findings of the study are the following: There is a moderate correlation between low grades and low evaluations, but no correlation between high grades and high evaluations when all cases are considered together. Analysis and interpretation of the data suggests that SETs should not be used to compare language instructors. In addition, since the relationship between student evaluations and the actual merits of teaching performance has not been clearly identified, numerical values of those evaluations should not be used in critical personnel decisions such as retention, tenure and promotion of faculty, unless they are properly interpreted within a sound theory of teaching effectiveness.

[1]  M. Dunkin,et al.  Novice and award-winning teachers' concepts and beliefs about teaching in higher education : effectiveness, efficacy and evaluation , 2002 .

[2]  P. Ramsden,et al.  The development, validation and application of the Course Experience Questionnaire , 1997 .

[3]  H. Marsh,et al.  Making students' evaluations of teaching effectiveness effective: The critical issues of validity, bias, and utility. , 1997 .

[4]  J. A. Neal,et al.  The Validity and Accuracy of Student Ratings of Instruction: A Reply to Peter A. Cohen , 1983 .

[5]  Robin Wilson,et al.  New Research Casts Doubt on Value of Student Evaluations of Professors. , 1998 .

[6]  P. Abrami,et al.  Students' Evaluations of University Teaching: Research Findings, Methodological Issues, and Directions for Future Research , 1987 .

[7]  Wendy M. Williams,et al.  “How'm I Doing?” Problems with Student Ratings of Instructors and Courses , 1997 .

[8]  Z. Kunda,et al.  Motivated Stereotyping of Women: She’s Fine if She Praised Me but Incompetent if She Criticized Me , 2000 .

[9]  Ian Neath,et al.  How to Improve Your Teaching Evaluations without Improving Your Teaching , 1996 .

[10]  A. Greenwald,et al.  Grading leniency is a removable contaminant of student ratings. , 1997, The American psychologist.

[11]  Ahindra Ghosh.  Appendix 5.1 , 2000 .

[12]  D. Hamermesh,et al.  Beauty in the Classroom: Professors&Apos; Pulchritude and Putative Pedagogical Productivity , 2003 .

[13]  N. Ambady,et al.  Half a minute: Predicting teacher evaluations from thin slices of nonverbal behavior and physical attractiveness. , 1993 .

[14]  Ellyn Kaschak.  Sex Bias in Student Evaluations of College Professors , 1978 .

[15]  Fadia Nasser,et al.  Faculty Views of Student Evaluation of College Teaching , 2002 .

[16]  H. Marsh.  Students’ Evaluations of University Teaching: Dimensionality, Reliability, Validity, Potential Biases and Usefulness , 1984 .

[17]  James A. Anderson,et al.  Student evaluation: The faculty responds , 1980 .

[18]  J. Ware,et al.  Effects of expressiveness, content coverage, and incentive on multidimensional student rating scales: new interpretations of the Dr. Fox effect , 1982 .

[19]  Robert E. Haskell,et al.  Academic Freedom, Tenure, and Student Evaluation of Faculty: Galloping Polls in the 21st Century. , 1997 .

[20]  Howard K Wachtel,et al.  Student Evaluation of College Teaching Effectiveness: a brief review , 1998 .

[21]  P. Ramsden.  A performance indicator of teaching quality in higher education: The Course Experience Questionnaire , 1991 .

[22]  David D. Williams,et al.  Learning from Others: Service-Learning in Costa Rica and Indonesia. , 1997 .

[23]  Rachel Johnson,et al.  The Authority of the Student Evaluation Questionnaire , 2000 .

[24]  L. Jones.  Generation X Goes to College. , 1995 .