How Fair are Student Ratings in Assessing the Teaching Performance of University Teachers

ABSTRACT This paper examines the effects of course characteristics on student ratings of university teaching. The multivariate effects of various course characteristics on student ratings of university teachers were examined by a 5×4×3×2×2 multivariate analysis of variance (MANOVA) with academic discipline, class size, level of course, type of course, and mode of study as independent variables and a set of six composite student ratings as the dependent variable. Data were obtained from a university in Hong Kong and consisted of 4996 course average ratings collected from 25 departments over two academic years. Significant differences were found in course average student ratings across academic disciplines, class size groups, course levels, types of course, and modes of study. The effect sizes of the largest differences between sub‐groups within each of the factors were also estimated. Academic discipline differences and class size were found to have the largest effect on student ratings, with effect sizes ...

[1]  B. Mathews,et al.  Student Rating of Courses in HE: further challenges and opportunities , 1998 .

[2]  Michael Theall,et al.  Who Reads Ratings: Knowledge, Attitude, and Practice of Users of Student Ratings of Instruction. , 1989 .

[3]  John C. Ory,et al.  Evaluating Teaching Effectiveness: A Practical Guide , 1984 .

[4]  Kenneth A. Feldman,et al.  Course characteristics and college students' ratings of their teachers: What we know and what we don't , 1978 .

[5]  D. Brandenburg,et al.  Student ratings of instruction: Validity and normative interpretations , 1977 .

[6]  James A. Anderson,et al.  Student evaluation: The faculty responds , 1980 .

[7]  Wendy M. Williams,et al.  “How'm I Doing?” Problems with Student Ratings of Instructors and Courses , 1997 .

[8]  W. McKeachie.  Student ratings: The validity of use. , 1997 .

[9]  P. Cranton,et al.  Students' perceptions of teaching skills and overall effectiveness across instructional settings , 1992 .

[10]  A. Greenwald,et al.  Grading leniency is a removable contaminant of student ratings. , 1997, The American psychologist.

[11]  P. Abrami,et al.  Navigating student ratings of instruction. , 1997 .

[12]  A. Biglan.  The characteristics of subject matter in different academic areas. , 1973 .

[13]  Yoram Neumann,et al.  Determinants of Students' Instructional Evaluation: A Comparison of Four Levels of Academic Areas -A , 1985 .

[14]  Robert E. Haskell,et al.  Academic Freedom, Tenure, and Student Evaluation of Faculty: Galloping Polls in the 21st Century. , 1997 .

[15]  William E. Cashin.  Student Ratings of Teaching: The Research Revisited. IDEA Paper No. 32. , 1995 .

[16]  John F. Newport,et al.  Rating Teaching in the USA: probing the qualifications of student raters and novice teachers , 1996 .

[17]  Herbert W. Marsh,et al.  Class Size, Students’ Evaluations, and Instructional Effectiveness , 1979 .

[18]  Kenneth A. Feldman,et al.  Class size and college students' evaluations of teachers and courses: A closer look , 1984 .

[19]  P. Abrami,et al.  Students' Evaluations of University Teaching: Research Findings, Methodological Issues, and Directions for Future Research , 1987 .