Looking Inside the Black Box of Performance Funding for Higher Education: Policy Instruments, Organizational Obstacles, and Intended and Unintended Impacts

For several decades, policymakers have been concerned about increasing the efficiency and effectiveness of postsecondary institutions. In recent years, performance funding—which directly connects state funding to an institution's performance on indicators such as student persistence, credit accrual, and college completion—has become a particularly attractive way of pursuing better college outcomes. But even as states have made an enormous investment in performance funding, troubling questions have been raised about whether performance funding has the effects intended and whether it also produces substantial negative side effects in the form of restrictions in access for underrepresented students and weakening of academic standards. This paper addresses these troubling questions by drawing on data richer than heretofore available. In addition to drawing on the existing body of research on performance funding, it reports data from a study of the implementation of performance funding in three leading states (Indiana, Ohio, and Tennessee) and its impacts on three universities and three community colleges in each state.

[1]  Russell L. Hanson,et al.  Politics in the American States: A Comparative Analysis , 1990 .

[2]  David A. Tandberg,et al.  State Higher Education Performance Funding: Data, Outcomes, and Policy Implications* , 2014 .

[3]  Sheila Nataraj Kirby,et al.  Organizational Improvement and Accountability: Lessons for Education from Other Sectors , 2004 .

[4]  Christopher A. Baldwin,et al.  Measuring Student Success. , 2011 .

[5]  W. Powell,et al.  The iron cage revisited institutional isomorphism and collective rationality in organizational fields , 1983 .

[6]  T. Nodine,et al.  Changing Course: A Guide to Increasing Student Completion in Community Colleges. , 2011 .

[7]  Clive Bean,et al.  Parties and elections , 1997 .

[8]  Dall W. Forsythe Quicker, Better, Cheaper? Managing Performance in American Government. , 2001 .

[9]  David A. Tandberg,et al.  State Higher Education Performance Funding for Community Colleges: Diverse Effects and Policy Implications , 2014, Teachers College Record: The Voice of Scholarship in Education.

[10]  Beryl A. Radin,et al.  Challenging the Performance Movement: Accountability, Complexity, and Democratic Values , 2006 .

[11]  Thomas S. Dee,et al.  The Impact of No Child Left Behind on Student Achievement , 2009 .

[12]  Susan P. Choy,et al.  Descriptive Summary of 2003-04 Beginning Postsecondary Students: Three Years Later , 2008 .

[13]  Donald P. Moynihan,et al.  The Dynamics of Performance Management: Constructing Information and Reform , 2008 .

[14]  R. Merton Social Theory and Social Structure , 1958 .

[15]  Kevin J. Dougherty,et al.  Unintended Impacts of Performance Funding on Community Colleges and Universities in Three States , 2014 .

[16]  R. Hinze-Pifer,et al.  Grading Education: Getting Accountability Right , 2010 .

[17]  Mark Smith,et al.  Performance Based Funding in Higher Education , 2015, Journal of Collective Bargaining in the Academy.

[18]  Andrew M. Penner,et al.  Print Article , 2014 .

[19]  Massimo Marraffa,et al.  Organizational learning II: Theory, method and practice , 1998 .

[20]  Meredith I. Honig Complexity and Policy Implementation Challenges and Opportunities for the Field , 2006 .

[21]  David N. Figlio,et al.  Feeling the Florida Heat? How Low-Performing Schools Respond to Voucher and Accountability Pressure. Working Paper 13. , 2007 .

[22]  S. S. Jaggars,et al.  Bringing Developmental Education to Scale: Lessons from the Developmental Education Initiative. , 2013 .

[23]  H. Jacob,et al.  Politics in the American States , 1965 .

[24]  W. Powell,et al.  The New Institutionalism in Organizational Analysis , 1993 .

[25]  Kevin J. Dougherty,et al.  Policy Instruments in Service of Performance Funding: A Study of Performance Funding in Three States , 2014 .

[26]  J. Cohen Public Opinion in State Politics , 2006 .

[27]  S. Milton,et al.  The Effects of Performance Budgeting and Funding Programs on Graduation Rate in Public Four-Year Colleges and Universities. , 2004 .

[28]  T. Dee,et al.  The impact of no Child Left Behind on student achievement: The Impact of No Child Left Behind on Student Achievement , 2011 .

[29]  A. Rutherford,et al.  Evaluating Impacts of Performance Funding Policies on Student Outcomes in Higher Education , 2014 .

[30]  Matthew G. Springer,et al.  A Big Apple for Educators: New York City's Experiment with Schoolwide Performance Bonuses. Final Evaluation Report. Monograph. , 2011 .

[31]  D. Commerce Statistical abstract of the United States , 1978 .

[32]  Susan J. Wells,et al.  Selecting outcome measures for child welfare settings: lessons for use in performance management , 2001 .

[33]  Meredith I. Honig New directions in education policy implementation : confronting complexity , 2006 .

[34]  Kevin J. Dougherty,et al.  Performance Funding for Higher Education: What Are the Mechanisms What Are the Impacts , 2013 .

[35]  Keith E. Hamm,et al.  Legislative Politics in the States , 2012 .

[36]  Gerald Marschke,et al.  Incentives and their dynamics in public sector performance management systems , 2010 .

[37]  J. C. Smart,et al.  Higher Education: Handbook of Theory and Research , 2001, Higher Education: Handbook of Theory and Research.

[38]  Alicia C. Dowd,et al.  Accountability, Assessment, and the Scholarship of “Best Practice” , 2007 .

[39]  Sarah R. Cohodes,et al.  School Accountability, Postsecondary Attainment, and Earnings , 2013, Review of Economics and Statistics.

[40]  U. Jayakumar,et al.  Creating campus cultures: Fostering success among racially diverse student populations , 2012 .

[41]  Lynne M. Wiley Achieving Accountability in Higher Education: Balancing Public, Academic, and Market Demands , 2005 .

[42]  Robert K. Merton,et al.  Sociological ambivalence and other essays , 1976 .

[43]  Oscar S. Cerna,et al.  Turning the Tide: Five Years of Achieving the Dream in Community Colleges , 2011 .

[44]  Angela Boatman Evaluating Institutional Efforts to Streamline Postsecondary Remediation: The Causal Effects of the Tennessee Developmental Course Redesign Initiative on Early Student Academic Success. An NCPR Working Paper. , 2012 .

[45]  L. Mcdonnell,et al.  Getting the Job Done: Alternative Policy Instruments , 1987 .

[46]  J. Shin Impacts of performance-based accountability on institutional performance in the U.S. , 2010 .

[47]  Davis Jenkins,et al.  Metrics, Dollars, and Systems Change: Learning From Washington State's Student Achievement Initiative to Design Effective Postsecondary Performance Funding Policies , 2013 .

[48]  Davis Jenkins,et al.  Performance Incentives to Improve Community College Completion: Learning from Washington State's Student Achievement Initiative , 2011 .

[49]  Carolyn J. Heinrich,et al.  Do Short-run performance measures predict long-run impacts? , 2011 .

[50]  Donald E. Heller,et al.  The States and Public Higher Education Policy: Affordability, Access, and Accountability , 2011 .

[51]  Adrianna Kezar,et al.  What campuses need to know about organizational learning and the learning organization , 2005 .

[52]  Jonathan Nakamoto,et al.  Examining Organizational Contextual Features That Affect Implementation of Equity Initiatives , 2008 .

[53]  Justin C. Ortagus,et al.  An Examination of the (Un)Intended Consequences of Performance Funding in Higher Education , 2017 .

[54]  Ryan Reyna,et al.  Complete to Compete: From Information to Action--Revamping Higher Education Accountability Systems. , 2011 .

[55]  Kevin J. Dougherty,et al.  Obstacles to the Effective Implementation of Performance Funding: A Multistate Cross-Case Analysis , 2014 .

[56]  Henry Braun,et al.  Reconsidering the Impact of High-stakes Testing , 2004 .

[57]  K. Mortimer Accountability in Higher Education. , 1972 .

[58]  E. Bensimon,et al.  Creating a Culture of Inquiry around Equity and Student Success , 2012 .

[59]  Kevin J. Dougherty,et al.  Envisioning Performance Funding Impacts: The Espoused Theories of Action for State Higher Education Performance Funding in Three States , 2014 .

[60]  Literature Review : Using Quality Information for Health Care Decisions and Quality Improvement Final Report , 2005 .

[61]  Peter T. Ewell,et al.  Linking Performance Measures to Resource Allocation: exploring unmapped terrain , 1999 .

[62]  Davis Jenkins Redesigning Community Colleges for Completion: Lessons from Research on High-Performance Organizations. CCRC Brief. Number 48. , 2011 .

[63]  Jason E. Lane,et al.  Interests, Information, and Incentives in Higher Education: Principal-Agent Theory and Its Potential Applications to the Study of Higher Education Governance , 2008 .

[64]  Michael Cragg,et al.  Performance Incentives in the Public Sector: Evidence from the Job Training Partnership Act , 1997 .

[65]  Michael N. Bastedo The Organization of Higher Education: Managing Colleges for a New Era , 2012 .

[66]  Affectivity, expertise, and inequality: three foundations of trust in education. Reflections on presuppositions, (unintended) consequences, and possible alternatives , 2012 .

[67]  David N. Figlio,et al.  Feeling the Florida Heat? How Low-Performing Schools Respond to Voucher and Accountability Pressure , 2007 .

[68]  L. Naylor Degrees of Inequality: How the Politics of Higher Education Sabotaged the American Dream , 2015 .

[69]  L. Renzulli The Politics of Performance Funding for Higher Education: Origins, Discontinuations, and Transformations , 2016 .

[70]  Customer Liaison Statistical Abstract of the United States: 2012 CD-ROM - Census Product Catalog - U.S. Census Bureau , 2008 .

[71]  Davis Jenkins,et al.  Washington State Student Achievement Initiative Policy Study: Final Report. , 2012 .

[72]  Donald A. Schön,et al.  Organizational Learning II: Theory, Method, and Practice , 1995 .

[73]  Jeffrey N. Jones,et al.  The Kalamazoo Promise and Perceived Changes in School Climate , 2011 .

[74]  David A. Tandberg,et al.  Performance Funding in Higher Education: Do Financial Incentives Impact College Completions? , 2014 .

[75]  R. Rothstein Holding Accountability to Account: How Scholarship and Experience in Other Fields Inform Exploration of Performance Incentives in Education. Working Paper 2008-04. , 2008 .

[76]  Institutional Changes to Organizational Policies, Practices, and Programs Following the Adoption of State-Level Performance Funding Policies , 2014 .

[77]  T. Sanford,et al.  Impact of Performance Funding on Retention and Graduation Rates , 2011 .

[78]  Kevin J. Dougherty,et al.  Organizational Learning by Colleges Responding to Performance Funding: Deliberative Structures and Their Challenges , 2014 .

[79]  Kevin J. Dougherty,et al.  Performance Funding for Higher Education , 2014 .

[80]  J. Pfeffer,et al.  The External Control of Organizations. , 1978 .

[81]  David A. Tandberg,et al.  Evaluating the Impacts of “New” Performance Funding in Higher Education , 2015 .