I Liked Your Course because You Taught Me Well: The Influence of Grades, Workload, Expectations and Goals on Students' Evaluations of Teaching.

There has been considerable debate as to whether course evaluations are valid measures of teaching quality, or whether students instead reward tutors who give them high grades and assign low levels of work. To assess the factors that influence course evaluations, we measured university students' achievement goals and expectations at the beginning of the semester and also obtained information on grades and workload. Although grades and course difficulty did have a small influence on end-of-semester course ratings, structural modelling revealed that ratings were largely determined by how much students enjoyed or felt stimulated by the course content, which in turn depended on the perceived quality of teaching. Students with a mastery goal were more likely to look forward to the course, and this also contributed to positive course evaluations, but the effect was small. Overall, the results suggested that by far the largest determinant of student evaluation of courses is the quality of the teaching.

[1]  R. MacCallum,et al.  Power analysis and determination of sample size for covariance structure modeling. , 1996 .

[2]  C. Dweck,et al.  A social-cognitive approach to motivation and personality , 1988 .

[3]  Anthony G. Greenwald,et al.  No pain, no gain? The importance of measuring course workload in student ratings of instruction , 1997 .

[4]  Joseph Berger,et al.  Status Characteristics and Social Interaction , 1972 .

[5]  J. Hoelter.  The Analysis of Covariance Structures , 1983 .

[6]  Bryan W. Griffin,et al.  Grading leniency, grade discrepancy, and student ratings of instruction , 2004 .

[7]  D. A. Lieberman,et al.  The effects of grades on course enjoyment: did you get the grade you wanted? , 2000, The British journal of educational psychology.

[8]  H. Marsh.  Multidimensional ratings of teaching effectiveness by students from different academic settings and their relation to student/course/instructor characteristics. , 1983 .

[9]  M. Browne,et al.  Alternative Ways of Assessing Model Fit , 1992 .

[10]  R. F. Sarmiento,et al.  Liberal Grading Improves Evaluations But Not Performance. , 1979 .

[11]  N. Feather,et al.  Effects of prior success and failure on expectations of success and subsequent performance. , 1966, Journal of personality and social psychology.

[12]  Herbert W. Marsh,et al.  Effects of Grading Leniency and Low Workload on Students' Evaluations of Teaching: Popular Myth, Bias, Validity, or Innocent Bystanders? , 2000 .

[13]  C. Dweck,et al.  Goals: an approach to motivation and achievement. , 1988, Journal of personality and social psychology.

[14]  W. McKeachie.  Student ratings: The validity of use. , 1997 .

[15]  P. Bentler,et al.  Cutoff criteria for fit indexes in covariance structure analysis : Conventional criteria versus new alternatives , 1999 .

[16]  P. Abrami,et al.  Students' Evaluations of University Teaching: Research Findings, Methodological Issues, and Directions for Future Research , 1987 .

[17]  B. Byrne.  Structural equation modeling with EQS : basic concepts, applications, and programming , 2000 .

[18]  Andrew J. Elliot,et al.  Approach-avoidance motivation in personality: approach and avoidance temperaments and goals. , 2002, Journal of personality and social psychology.

[19]  Robert W. Powell,et al.  Grades, learning, and student evaluation of instruction , 1977 .

[20]  B. Tabachnick,et al.  Using Multivariate Statistics , 1983 .

[21]  P. Abrami,et al.  Navigating student ratings of instruction. , 1997 .

[22]  Paul T. P. Wong,et al.  Effects of earned and assigned grades on student evaluations of an instructor. , 1979 .

[23]  Andrew J. Elliot,et al.  Short-term and long-term consequences of achievement goals: Predicting interest and performance over time. , 2000 .

[24]  B. Fischoff.  Hindsight (Not Equal To) Foresight: The Effect of Outcome Knowledge on Judgment Under Uncertainty. , 1975 .

[25]  A. Greenwald,et al.  Grading leniency is a removable contaminant of student ratings. , 1997, The American psychologist.

[26]  K. E. Barron,et al.  Predicting Success in College: A Longitudinal Study of Achievement Goals and Ability Measures as Predictors of Interest and Performance From Freshman Year Through Graduation , 2002 .

[27]  A. Elliot,et al.  A HIERARCHICAL MODEL OF APPROACH AND AVOIDANCE ACHIEVEMENT MOTIVATION , 1997 .

[28]  H. Marsh,et al.  Making students' evaluations of teaching effectiveness effective: The critical issues of validity, bias, and utility. , 1997 .

[29]  Kenneth A. Feldman,et al.  Grades and college students' evaluations of their courses and teachers , 1976 .

[30]  Stephen A. Stumpf,et al.  Expected Grade Covariation with Student Ratings of Instruction: Individual versus Class Effects. , 1979 .

[31]  Edward L. Deci,et al.  Intrinsic Motivation and Self-Determination in Human Behavior , 1975, Perspectives in Social Psychology.

[32]  Kenneth A. Bollen,et al.  Structural Equations with Latent Variables , 1989 .

[33]  Andrew J. Elliot,et al.  Goal setting, achievement orientation, and intrinsic motivation: a mediational analysis. , 1994 .

[34]  N. Feather,et al.  The relationship of persistence at a task to expectation of success and achievement related motives. , 1961, Journal of abnormal and social psychology.

[35]  Orlando J. Olivares.  Student Interest, Grading Leniency, and Teacher Ratings: A Conceptual Analysis. , 2001, Contemporary educational psychology.

[36]  Jonathan D. Casper,et al.  Cognitions, Attitudes and Decision‐Making in Search and Seizure Cases 1 , 1988 .

[37]  B. Fischhoff,et al.  I knew it would happen: Remembered probabilities of once—future things , 1975 .

[38]  N. Feather,et al.  The relationship of expectation of success to reported probability, task structure, and achievement related motivation. , 1963, Journal of abnormal and social psychology.

[39]  R. Z. Norman,et al.  Status Characteristics and Social Interaction. , 1978 .

[40]  THE EFFECT OF DIFFERENTIAL FAILURE ON EXPECTATION OF SUCCESS, REPORTED ANXIETY, AND RESPONSE UNCERTAINTY. , 1963, Journal of personality.

[41]  Karl G. Jöreskog,et al.  Lisrel 8: User's Reference Guide , 1997 .

[42]  A. Elliot,et al.  A 2 X 2 achievement goal framework. , 2001, Journal of personality and social psychology.

[43]  Adrian Blunt,et al.  The Effects of Anonymity and Manipulated Grades on Student Ratings of Instructors , 1991 .

[44]  Philip C. Abrami,et al.  Instructor Reputation: An Expectancy Relationship Involving Student Ratings and Achievement. , 1979 .

[45]  Shirley MacLaine,et al.  You can get there from here , 1975 .

[46]  J. Harackiewicz,et al.  Approach and avoidance achievement goals and intrinsic motivation: A mediational analysis. , 1996 .