Understanding Student Judgments of Teaching Effectiveness: A “Policy Capturing” Approach

Abstract The influence of five dimensions of teaching (organization, knowledge acquired, encouragement of questions, instructor's knowledge, and presentation clarity) on 40 undergraduate students' judgments of teaching effectiveness was investigated. The students rated completed evaluation forms (each with a different configuration of responses) as to the teaching effectiveness of an instructor who might receive that given pattern of evaluation responses. The students' subjective reports of the dimensions they believed most influential (subjective weights) were compared with their statistically derived judgment “policies” (statistical weights). Analyses revealed that there were significant differences between the mean statistical and subjective weights on two of the five evaluation items (knowledge acquired and presentation clarity).

[1]  P. Cranton,et al.  Reconsidering the Unit of Analysis: A Model of Student Ratings of Instruction. , 1990 .

[2]  Jr. James R. Larson.  The Limited Utility of Factor Analytic Techniques for the Study of Implicit Theories in Student Ratings of Teacher Behavior , 1979 .

[3]  David R. Drews,et al.  Teacher Self-Ratings as a Validity Criterion for Student Evaluations , 1987 .

[4]  K. R. Hammond,et al.  Representative vs. systematic design in clinical psychology. , 1954, Psychological bulletin.

[5]  P. Abrami,et al.  Validity of student ratings of instruction : what we know and what we do not , 1990 .

[6]  Phillip Gardner.  Will the Real Prescreening Criteria Please Stand Up , 1991 .

[7]  William H. Clover,et al.  Can we learn anything about interviewing real people from “interviews” of paper people? Two studies of the external validity of a paradigm☆ , 1978 .

[8]  K. R. Hammond.  Probabilistic functioning and the clinical method. , 1955, Psychological review.

[9]  J. P. Rushton,et al.  Teacher personality traits and student instructional ratings in six types of university courses , 1990 .

[10]  Wilbert J. McKeachie,et al.  Student Ratings of Faculty: A Reprise. , 1979 .

[11]  R. Gigliotti,et al.  Attributional bias and course evaluations. , 1990 .

[12]  J. S. Baird.  Perceived learning in relation to student evaluation of university instruction. , 1987 .

[13]  Carla W. Hess,et al.  Satisfaction with processes of collecting student opinions about instruction: The student perspective. , 1990 .

[14]  Daniel Kahneman,et al.  Judgment and Decision Making: A Personal View , 1991 .

[15]  Kenneth O. Doyle,et al.  Implicit Theories in Student Ratings , 1976 .