Improvement of instruction and teacher effectiveness: are student ratings reliable and valid?

This paper reviews the evidence on whether student ratings are reliable and valid enough to be used for the purpose of the improvement of instruction and teacher effectiveness. A consensus of evidence available in the literature tends to show a measure of consistency, stability and validity of student ratings. Several variables such as sex of rater and ratee, class size, mood of students, rank of instructors, grades students were expecting, time of the day courses are taught, to mention only a few, have been found to have a low to high positive relationship, with student ratings. It also appears that the use of student ratings leads to the improvement of instruction, provided the evaluation data are fed back to the instructor and that an expert or consultant provides assistance to the instructor.

[1]  Joel R. Levin,et al.  DETERMINING THE CHARACTERISTICS OF THE IDEAL PROFESSOR: AN ALTERNATIVE APPROACH , 1974 .

[2]  Richard A. Swanson,et al.  The Development, Evaluation, and Utilization of a Departmental Faculty Appraisal System. , 1971 .

[3]  Richard G. Kohlan.  A Comparison of Faculty Evaluations Early and Late in the Course. , 1973 .

[4]  Gerald M. Gillmore,et al.  Estimates of Reliability Coefficients for Items and Subscales of the Illinois Course Evaluation Questionnaire. Report #341. , 1973 .

[5]  Lawrence M. Aleamoni,et al.  A review of the research on student evaluation and a report on the effect of different sets of instructions on student course and instructor evaluation , 1973 .

[6]  P. A. Cohen.  Student Ratings of Instruction and Student Achievement: A Meta-analysis of Multisection Validity Studies , 1981 .

[7]  Chen-Lin C. Kulik,et al.  Student Ratings of Instruction , 1974 .

[8]  J. Sassenrath,et al.  Student personality correlates of teacher ratings. , 1968, Journal of educational psychology.

[9]  K. J. White,et al.  Teaching and Publishing as Determinants of Academic Salaries , 1973 .

[10]  A. Rotem,et al.  On the Effectiveness of Students’ Evaluative Feedback to University Instructors , 1979 .

[11]  L. C. Branscomb.  With the Technicians , 1953 .

[12]  J. Soper,et al.  Economic Man in the Classroom , 1972, Journal of Political Economy.

[13]  Richard I. Miller,et al.  Evaluating faculty performance , 1973 .

[14]  Joseph M. Hillery,et al.  Convergent and Discriminant Validation of Student Ratings of College Instructors. , 1971 .

[15]  Donald P. Schwab,et al.  Course and student characteristic correlates of the course evaluation instrument. , 1975 .

[16]  J. Pohlmann.  A DESCRIPTION OF TEACHING EFFECTIVENESS AS MEASURED BY STUDENT RATINGS , 1975 .

[17]  James A. Anderson,et al.  Student evaluation: The faculty responds , 1980 .

[18]  Peter W. Frey,et al.  Student Ratings of Teaching: Validity of Several Rating Factors , 1973, Science.

[19]  E. L. Harris.  Student Ratings of Faculty Performance: Should Departmental Committees Construct the Instruments? , 1982 .

[20]  E. Arubayi.  STUDENTS’ EVALUATIONS OF INSTRUCTION IN HIGHER EDUCATION: A REVIEW , 1986 .

[21]  J. Mclean,et al.  Student Evaluation of College Teaching Behaviors Instrument: A Factor Analysis , 1973 .

[22]  H. Marsh.  The Validity of Students’ Evaluations: Classroom Evaluations of Instructors Independently Nominated As Best and Worst Teachers by Graduating Seniors , 1977 .

[23]  Lawrence M. Aleamoni,et al.  The Relationship Between CEQ Ratings and Instructor's Rank, Class Size and Course Level. , 1974 .

[24]  R. Barnoski,et al.  A Validation Study of the Faculty and Course Evaluation (Face) Instrument , 1976 .

[25]  Student Ratings of Instruction and Their Relationship to Student Learning , 1977 .

[26]  A. Small,et al.  A Survey of Faculty Opinions about Student Evaluations of Instructors , 1979 .

[27]  Frank Costin,et al.  Student Ratings of College Teaching: Reliability, Validity, and Usefulness , 1971 .

[28]  Rudolph A. White,et al.  Some Evidence on the Variables Associated with Student Evaluations of Teachers , 1976 .

[29]  A survey of selected administrative practices supporting student evaluation of instruction programs , 1975 .

[30]  K. Crittenden,et al.  Size of University Classes and Student Evaluations of Teaching. , 1975 .

[31]  A. Perlberg.  Evaluation of instruction in higher education: Some critical issues , 1979 .

[32]  Hugh H. Carberry.  A Search for a Child Study Team Model. , 1975 .

[33]  Hagop S. Pambookian.  Initial Level of Student Evaluation of Instruction as a Source of Influence on Instructor Change After Feedback. , 1974 .

[34]  A. Rotem,et al.  Evaluation of university instructors in the United States: The context , 1977 .

[35]  Kenneth O. Doyle,et al.  Student Ratings as Criteria for Effective Teaching , 1974 .

[36]  Robert H. Ashton.  Correlates of Ratings of Teaching Effectiveness: Gordon's Survey of Interpersonal Values , 1975 .

[37]  David A. Payne,et al.  The effect of college course evaluation feedback on instructor and student perceptions of instructional climate and effectiveness , 1979 .

[38]  Burton Rodin,et al.  Student evaluations of teachers. , 1972 .

[39]  James O'Hanlon,et al.  Making Teacher Evaluation Work. , 1980 .

[40]  M. Goldschmid.  The evaluation and improvement of teaching in higher education , 1978 .

[41]  Patricia B. Elmore,et al.  Effects of teacher sex and student sex on the evaluation of college instructors. , 1974 .

[42]  John A. Centra,et al.  Effectiveness of Student Feedback in Modifying College Instruction. , 1973 .

[43]  J. Comer.  The Influence of Mood on Student Evaluations of Teaching. , 1980 .

[44]  P. W. Frey,et al.  Validity of Student Instructional Ratings: Does Timing Matter?. , 1976 .

[45]  Y. Hsu,et al.  Prediction of Student Ratings of College Instructors from Multiple Achievement Test Variables , 1978 .

[46]  W. R. Kennedy,et al.  GRADES EXPECTED AND GRADES RECEIVED. THEIR RELATIONSHIP TO STUDENTS'EVALUATIONS OF FACULTY PERFORMANCE , 1975 .

[47]  J. G. Holland,et al.  Blackout ratio and overt responses in programmed instruction: resolution of disparate results. , 1966, Journal of educational psychology.

[48]  E. Arubayi.  Subject disciplines and student evaluation of a degree programme in education , 1985 .

[49]  Lawrence M. Aleamoni,et al.  The usefulness of student evaluations in improving college teaching , 1974 .

[50]  Martin T. Miller,et al.  Instructor Attitudes Toward, and Their Use of, Student Ratings of Teachers. , 1971 .

[51]  M. Miron,et al.  “The good university teacher” as perceived by the students , 1978 .

[52]  Herbert W. Marsh,et al.  Long-term stability of students' evaluations: A note on Feldman's “consistency and variability among college students in rating their teachers and courses” , 1979 .

[53]  Thomas P. Hogan,et al.  Similarity of student ratings across instructors, courses, and time , 1973 .

[54]  Herbert W. Marsh,et al.  Validity and Usefulness of Student Evaluations of Instructional Quality. , 1975 .

[55]  Robert O. Riggs,et al.  The Prevalence and Purposes of Student And Subordinate Evaluations among AACTE Member Institutions , 1975 .

[56]  Herbert W. Marsh,et al.  The Relative Influence of Course Level, Course Type, and Instructor on Students' Evaluations of College Teaching , 1981 .

[57]  K. Doyle.  Student evaluation of instruction , 1972 .

[58]  Barak Rosenshine,et al.  Correlates of Student Preference Ratings. , 1973 .

[59]  M. Goldschmid.  Teaching and learning in higher education: Recent trends , 1976 .

[60]  H. G. Murray,et al.  THE IMPACT OF FORMATIVE AND SUMMATIVE EVALUATION OF TEACHING IN NORTH AMERICAN UNIVERSITIES , 1984 .

[61]  C. Valentine.  Student Evaluation of Instruction. By Kenneth O. Doyle, Jr. Lexington, Mass.: D.C. Heath and Co., 1975 , 1975 .

[62]  L. M. Aleamoni.  Typical Faculty Concerns About Student Evaluation of Instruction. , 1974 .

[63]  M. Y. Quereshi,et al.  STUDENTS' PERCEPTION OF A COLLEGE TEACHER AS A FUNCTION OF THEIR SEX AND ACHIEVEMENT LEVEL , 1973 .

[64]  J. Derry.  Can Students' Ratings of Instruction Serve Rival Purposes?. , 1979 .

[65]  G. Meredith.  Toward a Systems Approach to Student-Based Ratings of Instruction , 1975 .

[66]  T. Avi-Itzhak.  Teaching effectiveness as measured by student ratings and instructor self-evaluation , 1982 .

[67]  Kenneth O. Doyle,et al.  Implicit Theories in Student Ratings , 1976 .

[68]  Peter W. Frey,et al.  Student Ratings of Instruction: Validation Research1 , 1975 .

[69]  Lawrence M. Aleamoni,et al.  An Investigation of the Relationship between Colleague Rating, Student Rating, Research Productivity, and Academic Rank in Rating Instructional Effectiveness. , 1973 .

[70]  C. Scott.  Student Ratings and Instructor-Defined Extenuating Circumstances. , 1977 .

[71]  B. Tuckman,et al.  Effectiveness of feedback to teachers as a function of source. , 1968, Journal of educational psychology.

[72]  A. Sullivan,et al.  Validity of student evaluation of teaching and the characteristics of successful instructors. , 1974 .

[73]  Herbert W. Marsh,et al.  Midterm feedback from students: Its relationship to instructional improvement and students' cognitive and affective outcomes. , 1979 .

[74]  R. Berk.  The Construction of Rating Instruments for Faculty Evaluation: A Review of Methodological Issues. , 1979 .

[75]  Albert B. Smith,et al.  A Comparison of Student Ratings of Teaching Assistants and Faculty Members , 1978 .

[76]  N. Gage,et al.  The Appraisal of College Teaching , 1961 .

[77]  T. M. Sherman,et al.  A Formative Approach to Student Evaluation of Instruction. , 1975 .

[78]  N. Gage,et al.  The Appraisal of College Teaching: An Analysis of Ends and Means , 1961 .

[79]  Peter A. Cohen,et al.  Effectiveness of student-rating feedback for improving college instruction: A meta-analysis of findings , 1980 .