The Use of Student Evaluations of University Teaching in Different Settings: The Applicability Paradigm

The applicability paradigm has been used in five studies to evaluate the applicability of items from two North American instruments designed to measure students' evaluations of teaching effectiveness. In the present investigation, the paradigm is used at the new University of Western Sydney, Macarthur (UWSM). Items from both instruments were seen as appropriate and important, and differentiated among lecturers chosen as good, average and poor teachers. A multitrait-multimethod analysis of responses from the two instruments supported their convergent and divergent validity. The pattern of items judged to be most important at UWSM was more similar to patterns found at two research universities than patterns in the technical and further education sector or at two other institutions. These results support the applicability of the instruments at UWSM and across a diversity of educational settings.

[1]  Herbert W. Marsh,et al.  Multidimensional students' evaluations of teaching effectiveness : a test of alternative higher-order structures , 1991 .

[2]  Herbert W. Marsh,et al.  Students' evaluations of teaching effectiveness: The stability of mean ratings of the same teachers over a 13-year period , 1991 .

[3]  Herbert W. Marsh,et al.  The multidimensionality of students' evaluations of teaching effectiveness: The generality of factor structures across academic discipline, instructor level, and course level , 1991 .

[4]  V. Meek,et al.  Organizational change in Australian higher education: Process and outcome , 1990 .

[5]  Michael Prosser,et al.  Student evaluations of teaching and courses: Student study strategies as a criterion of validity , 1990 .

[6]  M. Dunkin.  Willingness to Obtain Student Evaluations as a Criterion of Academic Staff Performance. , 1990 .

[7]  Changes in ratings for staff who evaluated their teaching more than once , 1989 .

[8]  David Watkins,et al.  Evaluating tertiary teaching: A New Zealand perspective , 1987 .

[9]  P. Abrami,et al.  Students' Evaluations of University Teaching: Research Findings, Methodological Issues, and Directions for Future Research , 1987 .

[10]  Herbert W. Marsh,et al.  Applicability Paradigm: Students' Evaluations of Teaching Effectiveness in Different Countries. , 1986 .

[11]  I. Moses.  Student Evaluation of Teaching in an Australian University--Staff Perceptions and Reactions. , 1986 .

[12]  I. Moses.  Self and Student Evaluation of Academic Staff. , 1986 .

[13]  Herbert W. Marsh,et al.  Students' Evaluations of University Instructors: The Applicability of American Instruments in a Spanish Setting. , 1985 .

[14]  P. Clarkson,et al.  Papua New Guinea Students' Perceptions of Mathematics Lecturers. , 1984 .

[15]  Kenneth A. Feldman,et al.  Class size and college students' evaluations of teachers and courses: A closer look , 1984 .

[16]  Kenneth A. Feldman,et al.  Seniority and experience of college teachers as related to evaluations they receive from students , 1983 .

[17]  H. Marsh.  Multidimensional ratings of teaching effectiveness by students from different academic settings and their relation to student/course/instructor characteristics. , 1983 .

[18]  H. Marsh.  Validity of Students' Evaluations of College Teaching: A Multitrait-Multimethod Analysis. , 1982 .

[19]  Herbert W. Marsh,et al.  SEEQ: A Reliable, Valid, and Useful Instrument for Collecting Students' Evaluations of University Teaching. , 1982 .

[20]  Herbert W. Marsh,et al.  The Use of Path Analysis to Estimate Teacher and Course Effects in Student Ratings of Instructional Effectiveness , 1982 .

[21]  P. A. Cohen.  Student Ratings of Instruction and Student Achievement: A Meta-analysis of Multisection Validity Studies , 1981 .

[22]  Herbert W. Marsh,et al.  Students' Evaluations of Tertiary Instruction: Testing the Applicability of American Surveys in an Australian Setting , 1981 .

[23]  Herbert W. Marsh,et al.  The Relative Influence of Course Level, Course Type, and Instructor on Students' Evaluations of College Teaching , 1981 .

[24]  Peter A. Cohen,et al.  Effectiveness of student-rating feedback for improving college instruction: A meta-analysis of findings , 1980 .

[25]  Herbert W. Marsh,et al.  Validity of Students' Evaluations of Teaching Effectiveness: Cognitive and Affective Criteria. , 1980 .

[26]  Herbert W. Marsh,et al.  Students' Evaluations of Instruction: A Longitudinal Study of Their Stability. , 1980 .

[27]  Herbert W. Marsh,et al.  The Influence of Student, Course, and Instructor Characteristics in Evaluations of University Teaching , 1980 .

[28]  Herbert W. Marsh,et al.  Midterm feedback from students: Its relationship to instructional improvement and students' cognitive and affective outcomes. , 1979 .

[29]  Wilbert J. McKeachie,et al.  Student Ratings of Faculty: A Reprise. , 1979 .

[30]  Herbert W. Marsh,et al.  Validity of Student Evaluations of Instructional Effectiveness: A Comparison of Faculty Self-Evaluations and Evaluations by Their Students. , 1979 .

[31]  P. Frey.  A two-dimensional analysis of student ratings of instruction , 1978 .

[32]  H. Marsh.  The Validity of Students’ Evaluations: Classroom Evaluations of Instructors Independently Nominated As Best and Worst Teachers by Graduating Seniors , 1977 .

[33]  K. Feldman.  The superior college teacher from the students' view , 1976 .

[34]  Herbert W. Marsh,et al.  Validity and Usefulness of Student Evaluations of Instructional Quality. , 1975 .

[35]  Peter W. Frey,et al.  Student Ratings of Instruction: Validation Research1 , 1975 .

[36]  Peter W. Frey,et al.  Student Ratings of Teaching: Validity of Several Rating Factors , 1973, Science.

[37]  D. Campbell,et al.  Convergent and discriminant validation by the multitrait-multimethod matrix. , 1959, Psychological bulletin.