Accounting for economies of scope in performance evaluations of university professors

Teaching and research are widely regarded as the two key activities of academics. We propose a tailored version of the popular Data Envelopment Analysis methodology to evaluate the overall performance of university faculty. The methodology enables accounting for the potential presence of economies of scope between the teaching and research activities. It is illustrated with a dataset of professors working at a Business and Administration department of a university college. The estimation results reveal that overall the performance scores of faculty decrease if we allow for spillovers from research to teaching and vice-versa.

[1]  T. Wolfer,et al.  Re-Evaluating Student Evaluation of Teaching , 2003 .

[2]  Peter Seldin,et al.  Changing practices in faculty evaluation , 1985 .

[3]  P. Abrami,et al.  Navigating student ratings of instruction. , 1997 .

[4]  John M. Braxton.  Contrasting perspectives on the relationship between teaching and research , 1996 .

[5]  K. Feldman.  Research productivity and scholarly accomplishment of college teachers as related to their instructional effectiveness: A review and exploration , 1987 .

[6]  J. Westergaard,et al.  Scholarship, research and teaching: A view from the social sciences , 1991 .

[7]  Sun-Geun Baek,et al.  Multilevel analysis of the effects of student and course characteristics on satisfaction in undergraduate liberal arts courses , 2008 .

[8]  A. H. Halsey,et al.  Decline of Donnish Dominion: The British Academic Professions in the Twentieth Century , 1992 .

[9]  Mike Allen,et al.  Research Productivity and Positive Teaching Evaluations: Examining the Relationship Using Meta-Analysis. , 1995 .

[10]  Peter E. Kennedy,et al.  Does Teaching Enhance Research in Economics , 2005 .

[11]  Alfred J. Lotka,et al.  The frequency distribution of scientific productivity , 1926 .

[12]  M. Farrell,et al.  THE MEASUREMENT OF PRODUCTIVITY EFFICIENCY , 1957 .

[13]  Teck Meng Tan,et al.  Empirical investigation of the factors affecting SET results , 1997 .

[14]  John F. Kremer.  Identifying faculty types using peer ratings of teaching, research, and service , 1991 .

[15]  William F. Massy,et al.  Faculty Discretionary Time: Departments and the "Academic Ratchet.". , 1994 .

[16]  Léopold Simar,et al.  Introducing Environmental Variables in Nonparametric Frontier Models: a Probabilistic Approach , 2005 .

[17]  J. Florens,et al.  Nonparametric frontier estimation: a robust approach , 2002 .

[18]  Oliver Fabel,et al.  Research Productivity in Business Economics: An Investigation of Austrian, German and Swiss Universities , 2008 .

[19]  Ellyn Kaschak.  Another Look at Sex Bias in Students’ evaluations of Professors: Do Winners Get the Recognition that They Have Been Given? , 1981 .

[20]  Nicky Rogge,et al.  Accounting for Exogenous Influences in a Benevolent Performance Evaluation of Teachers , 2009 .

[21]  Joachim Zietz,et al.  Student Evaluations of Teaching: Does Pedagogy Matter? , 2003 .

[22]  Mika Kortelainen,et al.  Blaming the Exogenous Environment? Conditional Efficiency Estimation with Continuous and Discrete Environmental Variables , 2008 .

[23]  Nicky Rogge,et al.  Granting Teachers the "Benefit of the Doubt" in Performance Evaluations. , 2009 .

[24]  B. M. Gupta,et al.  A comparision of productivity of male and female scientists of CSIR , 1999, Scientometrics.

[25]  Barry Bozeman,et al.  The Impact of Research Collaboration on Scientific Productivity , 2005 .

[26]  Stanley J. Michalak,et al.  Why Doesn't Research Improve Teaching? Some Answers from a Small Liberal Arts College. , 1983 .

[27]  Nicky Rogge,et al.  Accounting for exogenous influences in performance evaluations of teachers , 2011 .

[28]  James S. Fairweather,et al.  Faculty Rewards Reconsidered: The Nature of Tradeoffs. , 1993 .

[29]  Ruth Neumann,et al.  Perceptions of the teaching-research nexus: a framework for analysis , 1992 .

[30]  Ellyn Kaschak,et al.  Another look at sex bias in students' evaluations of professors: Do winners get the recognition that they have been given? , 1981 .

[31]  S. Simmons.  Reflective faculty evaluation: Enhancing teaching and determining faculty effectiveness , 1996 .

[32]  Yining Chen,et al.  Factors That Motivate Business Faculty to Conduct Research: An Expectancy Theory Analysis , 2006 .

[33]  Léopold Simar,et al.  Advanced Robust and Nonparametric Methods in Efficiency Analysis: Methodology and Applications , 2007 .

[34]  Jens-Christian Smeby,et al.  Knowledge Production and Knowledge Transmission. The interaction between research and teaching at universities , 1998 .

[35]  John Hattie,et al.  The Relation between Research Productivity and Teaching Effectiveness , 2002 .

[36]  Bram De Rock,et al.  Analyzing Cost Efficient Production Behavior Under Economies of Scope: A Nonparametric Methodology , 2006, Oper. Res..

[37]  Linda Serra Hagedorn,et al.  Faculty Research Productivity: Exploring the Role of Gender and Family-Related Factors , 2002 .

[38]  John Hattie,et al.  The Relationship Between Research and Teaching: A Meta-Analysis , 1996 .

[39]  John F. Kremer,et al.  Construct Validity of Multiple Measures in Teaching, Research, and Service and Reliability of Peer Ratings. , 1990 .

[40]  Armando Rugarcia,et al.  The Link between Teaching and Research: Myth or Possibility?. , 1991 .

[41]  Ruth Neumann,et al.  Researching the Teaching-Research Nexus: A Critical Review , 1996 .

[42]  S. Basow.  Best and Worst Professors: Gender Patterns in Students' Choices , 2000 .

[43]  J. Centra,et al.  Is There Gender Bias in Student Evaluations of Teaching? , 2000 .

[44]  Kevin J. Fox,et al.  What Determines Research Output of Academic Economists , 1999 .

[45]  R. K. Toutkoushian,et al.  Faculty Time Allocations and Research Productivity: Gender, Race and Family Effects , 1999 .

[46]  John R. Tanner,et al.  Research productivity and perceived teaching effectiveness: A survey of economics faculty , 1996 .

[47]  Peter Scott,et al.  Beyond the dual-support system: Scholarship, research and teaching in the context of academic autonomy , 1991 .

[48]  Anthony C. Krautmann,et al.  Grades and student evaluations of teachers , 1999 .

[49]  Roger Lindsay,et al.  Teaching and research: Student perspectives and policy implications , 1998 .

[50]  Nicky Rogge,et al.  To publish or not to publish? On the aggregation and drivers of research performance , 2010, Scientometrics.

[51]  Patricia E. Gaynor,et al.  Determinants of Scholarly Productivity among Male and Female Economists , 2003 .

[52]  Mary Crawford,et al.  Gender in the college classroom: An assessment of the “chilly climate” for women , 1990 .

[53]  L. Simar,et al.  Conditional nonparametric frontier models for convex and nonconvex technologies: a unifying approach , 2007 .

[54]  Miguel A. Quintanilla,et al.  The teaching and research relationship within an institutional evaluation , 2000 .

[55]  Ronald Barnett,et al.  Linking Teaching and Research: A Critical Inquiry. , 1992 .

[56]  Erin E Leahey,et al.  Parenting and research productivity: New evidence and methods , 2010 .

[57]  Vicente Royuela,et al.  An analysis of the determinants in Economics and Business publications by Spanish universities between 1994 and 2004 , 2007, Scientometrics.

[58]  Lee Ellis,et al.  Student Grades and Average Ratings of Instructional Quality: The Need for Adjustment , 2003 .

[59]  Kenneth A. Feldman,et al.  College students' views of male and female college teachers: Part I—Evidence from the social laboratory and experiments , 1992 .

[60]  Roger Lindsay,et al.  Academic Research and Teaching Quality: The views of undergraduate and postgraduate students , 2002 .

[61]  Abraham Charnes,et al.  Measuring the efficiency of decision making units , 1978 .

[62]  Stephen Rowland,et al.  Relationships Between Teaching and Research , 1996 .

[63]  Joe C. Davis,et al.  The scholarly output of economists: A description of publishing patterns , 2001 .

[64]  P. Ramsden.  Describing and explaining research productivity , 1994 .

[65]  Hans-Dieter Daniel,et al.  Research performance evaluation in the German university sector , 1990, Scientometrics.

[66]  Ruth Neumann,et al.  Academic work: Perceptions of senior academic administrators , 1993 .

[67]  Laurens Cherchye,et al.  An Afriat Theorem for the Collective Model of Household Consumption , 2008, J. Econ. Theory.

[68]  Angela Brew,et al.  The nature of research : inquiry in academic contexts , 2001 .

[69]  Mary Frank Fox,et al.  Research, Teaching, and Publication Productivity: Mutuality Versus Competition in Academia. , 1992 .

[70]  John R. Tanner,et al.  Management-Faculty Research Productivity and Perceived Teaching Effectiveness , 1992 .

[71]  Peter Bogetoft,et al.  DEA on relaxed convexity assumptions , 1996 .

[72]  H. Marsh.  Students’ Evaluations of University Teaching: Dimensionality, Reliability, Validity, Potential Biases and Usefulness , 1984 .

[73]  Jane Robertson,et al.  Experiences of the Relation between Teaching and Research: What do academics value? , 2001 .

[74]  Michael A. McPherson.  Determinants of How Students Evaluate Teachers , 2006 .

[75]  J. P. Rushton,et al.  Personality, research creativity, and teaching effectiveness in university professors , 1983, Scientometrics.

[76]  Kim-Leng Goh,et al.  Evidence and control of biases in student evaluations of teaching , 2003 .