Further evidence supporting the validity of both a multidimensional profile and an overall evaluation of teaching effectiveness

The purpose of this research is to provide additional empirical evidence supporting the use of both a multidimensional profile and an overall evaluation of teaching effectiveness as valid indicators of student perceptions of effective classroom instruction. A factor analytic teaching evaluation instrument was used that also included open‐ended comments on four questions. Numerical scores from 208 classes were matched with the average valence of the open‐ended comments. It was found that the average valences were highly positively correlated with the numerical factor scores that make up the multidimensional profile of teaching effectiveness and with the second‐order factor that serves as an overall evaluation of teaching effectiveness. The implications of these results for the usefulness of student evaluations are discussed.

[1]  Peter W. Frey,et al.  Student Ratings of Teaching: Validity of Several Rating Factors , 1973, Science.

[2]  Philip C. Abrami,et al.  Multidimensional students' evaluations of teaching effectiveness: Generalizability of "N = 1" research: Comment on Marsh (1991). , 1991 .

[3]  H. Marsh.  A Multidimensional Perspective on Students' Evaluations of Teaching Effectiveness: Reply to Abrami and d'Apollonia (1991). , 1991 .

[4]  Joseph M. Ryan,et al.  The relationship between individual instructional characteristics and the overall assessment of teaching effectiveness across different instructional contexts , 1995 .

[5]  J. M. Ryan,et al.  College students' self-insight and common implicit theories in ratings of teaching effectiveness , 1996 .

[6]  Kathleen M. Quinlan,et al.  The Teaching Portfolio , 2023 .

[7]  Philip C. Abrami,et al.  The Dimensionality of Ratings and Their Use in Personnel Decisions. , 1990 .

[8]  Philip C. Abrami,et al.  Current concerns are past concerns. , 1999 .

[9]  Jacob Cohen.  A Coefficient of Agreement for Nominal Scales , 1960 .

[10]  John C. Ory,et al.  Faculty perceptions of the quality and usefulness of three types of evaluative information , 1981 .

[11]  Herbert W. Marsh,et al.  The Use of Students’ Evaluations and an Individually Structured Intervention to Enhance University Teaching Effectiveness , 1993 .

[12]  H. Marsh,et al.  Making students' evaluations of teaching effectiveness effective: The critical issues of validity, bias, and utility. , 1997 .

[13]  J. Bardo,et al.  Measuring Student's Perceptions of Teaching: Dimensions of Evaluation , 1986 .

[14]  Cayla R. Teal,et al.  The Dimensions of Students’ Perceptions of Teaching Effectiveness , 1999 .

[15]  Herbert W. Marsh,et al.  The multidimensionality of students' evaluations of teaching effectiveness: The generality of factor structures across academic discipline, instructor level, and course level , 1991 .

[16]  Herbert W. Marsh,et al.  Weighting for the right criteria in the Instructional Development and Effectiveness Assessment (IDEA) system: Global and specific ratings of teaching effectiveness and their relation to course objectives. , 1994 .

[17]  P. A. Cohen.  Student Ratings of Instruction and Student Achievement: A Meta-analysis of Multisection Validity Studies , 1981 .

[18]  H. Marsh,et al.  The Use of Student Evaluations of University Teaching in Different Settings: The Applicability Paradigm , 1992 .

[19]  H. Marsh.  Still weighting for the right criteria to validate student evaluations of teaching in the IDEA system , 1995 .

[20]  P. Abrami,et al.  Navigating student ratings of instruction. , 1997 .

[21]  L. Braskamp,et al.  Congruency of Student Evaluation Information Collected by Three Methods. , 1980 .

[22]  P. Abrami,et al.  Students' Evaluations of University Teaching: Research Findings, Methodological Issues, and Directions for Future Research , 1987 .

[23]  Herbert W. Marsh,et al.  SEEQ: A Reliable, Valid, and Useful Instrument for Collecting Students' Evaluations of University Teaching. , 1982 .

[24]  P. Frey.  A two-dimensional analysis of student ratings of instruction , 1978 .

[25]  H. Marsh,et al.  Reply upon SET research. , 1999 .

[26]  Charles A. Burdsal,et al.  The Relative Merits of Different Types of Overall Evaluations of Teaching Effectiveness , 2004 .

[27]  Philip C. Abrami,et al.  How should we use student ratings to evaluate teaching? , 1989 .

[28]  Kenneth A. Feldman,et al.  Effective college teaching from the students' and faculty's view: Matched or mismatched priorities? , 1988 .

[29]  H. Marsh.  Multidimensional ratings of teaching effectiveness by students from different academic settings and their relation to student/course/instructor characteristics. , 1983 .

[30]  Herbert W. Marsh,et al.  Multidimensional students' evaluations of teaching effectiveness : a test of alternative higher-order structures , 1991 .

[31]  P. Abrami.  Dimensions of Effective College Instruction , 2017 .

[32]  William E. Cashin,et al.  Using global student rating items for summative evaluation. , 1992 .