Using Conjoint Analysis to Evaluate and Reward Teaching Performance

Although widely used, student evaluations of teaching do not address several factors that should be considered in evaluating teaching performance such as new course preparations, teaching larger classes, and inconvenient class times. Consequently, the incentive exists to avoid certain teaching assignments to achieve high SET scores while minimizing workload. This hinders curriculum innovation and development and potentially creates dysfunction in the college. The authors demonstrate how conjoint analysis can be applied to create a model of teaching evaluation that simultaneously considers many aspects of teaching performance and increases fairness in the appraisal process. Findings from a pilot implementation are discussed.

[1]  J. Scott Armstrong,et al.  JUDGMENTAL BOOTSTRAPPING: INFERRING EXPERTS' RULES FOR FORECASTING , 2001 .

[2]  T. Judge,et al.  Personnel/Human Resources Management: A Political Influence Perspective , 1991 .

[3]  Kim A. Stewart,et al.  A New Tool for Identifying Research Standards and Evaluating Research Performance , 2012 .

[4]  Dennis E. Clayson,et al.  Are Students Telling Us the Truth? A Critical Look at the Student Evaluation of Teaching , 2011 .

[5]  William P. Wagner,et al.  Analysis Of Online Student Ratings Of University Faculty , 2011 .

[6]  Katherine B. Hartman,et al.  What Ratemyprofessors.com Reveals About How and Why Students Evaluate Their Professors: A Glimpse Into the Student Mind-Set , 2013 .

[7]  H. P. Sims,et al.  Behind the Mask: The Politics of Employee Appraisal , 1987 .

[8]  D. Comer A Model of Social Loafing in Real Work Groups , 1995 .

[9]  B. Orme Getting Started with Conjoint Analysis: Strategies for Product Design and Pricing Research , 2005 .

[10]  W. Wilhelm The Relative Influence of Published Teaching Evaluations and Other Instructor Attributes on Course Choice , 2004 .

[11]  Robin Wilson,et al.  New Research Casts Doubt on Value of Student Evaluations of Professors. , 1998 .

[12]  D. Bacon,et al.  Exploring Achievement Striving as a Moderator of the Grading Leniency Effect , 2002 .

[13]  James R. Otto,et al.  Does ratemyprofessor.com really rate my professor? , 2008 .

[14]  C. David Shepherd,et al.  An Exploratory Investigation of the Periodic Performance Evaluation Processes for Marketing Faculty , 2009 .

[15]  J. Poon,et al.  Effects of performance appraisal politics on job satisfaction and turnover intention , 2004 .

[16]  Laurie A. Babin,et al.  Teaching Portfolios: Uses and Development , 2002 .

[17]  Peter Seldin,et al.  Successful use of teaching portfolios , 1993 .

[18]  Thomas R. Stewart,et al.  Improving Reliability of Judgmental Forecasts , 2001 .

[19]  Dennis F. X. Mathaisel,et al.  Evaluating Teaching Effectiveness in America's Business Schools: Implications for Service Marketers , 1998 .

[20]  Dennis E. Clayson,et al.  Student Evaluations of Teaching: Are They Related to What Students Learn? , 2009 .

[21]  L. Beach,et al.  The service quality improvement strategy , 1995 .

[22]  H. Marsh,et al.  Making students' evaluations of teaching effectiveness effective: The critical issues of validity, bias, and utility. , 1997 .