Testing the accuracy of DEA for measuring efficiency in education under endogeneity

DEA is the most common and well known technique to evaluate efficiency in education because it easily allows dealing with a complex multi-output multi-input production framework. After an interesting debate in this journal with Ruggiero (2003), Bifulco and Bretschneider (2001, 2003) concluded that DEA does not perform well to measure efficiency in the presence of endogeneity and measurement error because it leads to quite biased efficiency estimates. However, their experiment was conducted considering a one-output framework, constant returns to scale and a simple Cobb-Douglas specification. Following Bifulco and Bretschneiders’ original idea, in this paper we update the adequacy of DEA in the presence of endogeneity and measurement error in a scenario closer to the educational context. To do this we perform a Monte Carlo experimentation in a flexible multi-output multi input translog context. Our results point out that DEA obtains quite accurate measures of technical efficiency when the sample size is large enough even in the presence of endogeneity.

[1]  Ana Cárcaba García,et al.  Value Efficiency Analysis of Health Systems , 2008 .

[2]  José Enrique Devesa Carpio,et al.  La deuda implícita y el desequilibrio financiero-actuarial de un sistema de pensiones: el caso del régimen general de la seguridad social en España , 2008 .

[3]  David Matesanz Gómez,et al.  Economic growth and currency crisis: A real exchange rate entropic approach , 2005 .

[4]  E. Wailand Bessent,et al.  Determining the Comparative Efficiency of Schools through Data Envelopment Analysis , 1980 .

[5]  Daniel Santín,et al.  Measuring educational efficiency at student level with parametric stochastic distance functions: an application to Spanish PISA results , 2011 .

[6]  M. H. Franco,et al.  Migración interna de extranjeros y ¿nueva fase en la convergencia? , 2007 .

[7]  Tommaso Agasisti,et al.  Cross-Country Efficiency Comparison between Italian and Spanish Public Universities in the period 2000-2005 , 2008 .

[8]  José Manuel Cordero-Ferrera,et al.  Measuring efficiency in education: an analysis of different approaches for incorporating non-discretionary inputs , 2008 .

[9]  Daniel Santín,et al.  Alternative approaches to include exogenous variables in DEA measures: A comparison using Monte Carlo , 2009, Comput. Oper. Res..

[10]  Frank Engert,et al.  The Reporting of School District Efficiency: The Adequacy of Ratio Measures , 1996 .

[11]  F. M. I. Coma,et al.  Does social spending increase support for free trade in advanced democracies , 2008 .

[12]  R. Banker,et al.  A Monte Carlo comparison of two production frontier estimation methods: Corrected ordinary least squares and data envelopment analysis , 1993 .

[13]  Carlos Fernández Méndez,et al.  Corporate governance structure and board of directors remuneration policies: evidence from Spain , 2008 .

[14]  John Ruggiero,et al.  Evaluating alternative DEA models used to control for non-discretionary inputs , 2006, Comput. Oper. Res..

[15]  Jordi Perdiguero,et al.  Does Accessibility Affect Retail Prices and Competition? An Empirical Application , 2011 .

[16]  Antonio Díaz,et al.  Determinants of abnormal liquidity after rating actions in the Corporate Debt Market , 2008 .

[17]  A. U.S.,et al.  Measuring the efficiency of decision making units , 2003 .

[18]  Robert Meneu Gaya Convergencia regional en renta y bienestar en España , 2007 .

[19]  Emilio Domínguez Irastorza,et al.  Effects of a reduction of working hours on a model with job creation and job destruction , 2007 .

[20]  A. F. Sainz,et al.  Analyzing Semiparametrically the Trends in the Gender Pay Gap - The Example of Spain , 2008 .

[21]  Eric R. Eide,et al.  The effect of school quality on student performance: A quantile regression approach , 1998 .

[22]  Carlos Llano Verduras,et al.  El comercio intra e inter-regional del sector Turismo en España , 2009 .

[23]  Jaime Gómez Villascuerna,et al.  An empirical assessment of the impact of switching costs and first mover advantages on firm performance , 2008 .

[24]  B. Balk Scale Efficiency and Productivity Change , 2001 .

[25]  John Ruggiero,et al.  Measurement error, education production and data envelopment analysis , 2006 .

[26]  Lucía Avella Camarero,et al.  El medioambiente y los objetivos de fabricación: un análisis de los modelos estratégicos para su consecución , 2008 .

[27]  Stuart Bretschneider,et al.  Response to comment on estimating school efficiency , 2003 .

[28]  Esteban Fernández Vázquez,et al.  Estimating regional variations of R&D effects on productivity growth by entropy econometrics , 2009 .

[29]  María Leticia Santos Vijande,et al.  El marketing interno como impulsor de las habilidades comerciales de las pyme españolas: efectos en los resultados empresariales , 2008 .

[30]  Manuel González Díaz,et al.  Complejidad y perfeccionamiento contractual para la contención del oportunismo en los acuerdos de franquicia , 2007 .

[31]  A. Worthington An Empirical Survey of Frontier Efficiency Measurement Techniques in Education , 2001 .

[32]  Daniel Santín,et al.  How to generate regularly behaved production data? A Monte Carlo experimentation on DEA scale efficiency measurement , 2009, Eur. J. Oper. Res..

[33]  S. Bretschneider,et al.  Estimating school efficiency: A comparison of methods using simulated data , 2001 .

[34]  Philip A. Trostel Returns to scale in producing human capital from schooling , 2004 .

[35]  M. Farrell The Measurement of Productive Efficiency , 1957 .

[36]  T. M. Ñíguez,et al.  Multivariate Gram-Charlier Densities , 2008 .

[37]  J. G. Benito,et al.  The environment as a determinant factor of the purchasing and supply strategy: an empirical ana-lysis , 2008 .

[38]  Ana Cristina Mingorance Arnáiz Convergencia económica en España y coordinación de políticas económicas: un estudio basado en la estructura productiva de las CC.AA. , 2009 .

[39]  Enrique José Jiménez Rodríguez,et al.  El capital económico por riesgo operacional: una aplicación del modelo de distribución de pérdidas , 2009 .

[40]  Juan Eugenio Jiménez González,et al.  ¿Esconde la rigidez de precios la existencia de colusión? El caso del mercado de carburantes en las Islas Canarias , 2009 .

[41]  Begoña Font Belaire Modelización de las expectativas y estrategias de inversión en mercados de derivados , 2007 .

[42]  Ignacio Álvarez Peralta La inserción financiera externa de la economía francesa: inversores institucionales y nueva gestión empresarial , 2008 .

[43]  Bernard Fingleton,et al.  Regional productivity variation and the impact of public capital stock: an analysis with spatial interaction, with reference to Spain , 2012 .

[44]  José Antonio Belso Martínez,et al.  Outsourcing decision, product innovation and the spatial dimension: evidence from the Spanish footwear industry , 2009 .

[45]  Carlos Rodríguez,et al.  Spanish post-earnings announcement drift and behavioral finance models , 2008 .

[46]  Stefan Sperlich,et al.  Smooth Transition from Fixed Effects to Mixed Effects Models in Multi-level regression Models , 2008 .

[47]  José Yagüe,et al.  Stock split size, signaling and earnings management: Evidence from the Spanish market , 2007 .

[48]  John Ruggiero,et al.  Comment on estimating school efficiency , 2003 .

[49]  P. W. Wilson,et al.  Sensitivity Analysis of Efficiency Scores: How to Bootstrap in Nonparametric Frontier Models , 1998 .

[50]  Borja Montaño Sanz,et al.  Una visión cooperativa de las medidas ante el posible daño ambiental de la desalación , 2008 .

[51]  John Ruggiero,et al.  Efficiency estimation and error decomposition in the stochastic frontier model: A Monte Carlo analysis , 1999, Eur. J. Oper. Res..

[52]  F Pedraja-Chaparro,et al.  On the quality of the data envelopment analysis model , 1999, J. Oper. Res. Soc..

[53]  Julio López Laborda,et al.  Efectos externos del endeudamiento sobre la calificación crediticia de las Comunidades Autónomas , 2008 .

[54]  Xingyuan Zhang,et al.  A Monte Carlo Study on the Finite Sample Properties of the Gibbs Sampling Method for a Stochastic Frontier Model , 2000 .

[55]  D. Aigner,et al.  FORMULATION AND ESTIMATION OF STOCHASTIC PRODUCTION FUNCTION MODELS , 1977 .

[56]  Jesús Mur Lacambra,et al.  Inestabilidad y convergencia entre las regiones europeas , 2008 .

[57]  Kwabena Gyimah-Brempong,et al.  Elasticities of factor substitution in the production of education , 1992 .

[58]  Javier Rodrigo Hitos,et al.  Generalización del concepto de equilibrio en juegos de competición política , 2008 .

[59]  David Abad Díaz,et al.  Understanding Warrants Pricing: A case study of the financial market in Spain , 2008 .

[60]  Lawrence M. Seiford,et al.  Recent developments in dea : the mathematical programming approach to frontier analysis , 1990 .

[61]  Timothy Coelli,et al.  A Bayesian Approach to Imposing Curvature on Distance Functions , 2005 .

[62]  C. Barros,et al.  A Revenue-Neutral Tax Reform to Increase Demand for Public Transport Services , 2008 .

[63]  R. Bartels,et al.  The Effect of Sample Size on the Mean Efficiency in DEA with an Application to Electricity Distribution in Australia, Sweden and New Zealand , 1998 .

[64]  Francisco Pedraja-Chaparro,et al.  On the Role of Weight Restrictions in Data Envelopment Analysis , 1997 .

[65]  W. Meeusen,et al.  Efficiency Estimation from Cobb-Douglas Production Functions with Composed Error , 1977 .

[66]  Waymond Rodgers,et al.  Auditors¿ ethical dilemmas in the going concern evaluation , 2007 .

[67]  James J. Heckman,et al.  A Life-Cycle Model of Earnings, Learning, and Consumption , 1976, Journal of Political Economy.

[68]  John Ruggiero,et al.  Data envelopment analysis with stochastic data , 2004, J. Oper. Res. Soc..

[69]  Sergio Perelman,et al.  Imposing monotonicity on outputs in parametric distance function estimations , 2011 .

[70]  M. García-Goñi,et al.  Hybrid risk adjustment for pharmaceutical benefits , 2009, The European Journal of Health Economics.

[71]  Alfonso Echazarra de Gregorio Cuando el tamaño importa: estudio sobre la influencia de los sujetos políticos en la balanza de bienes y servicios , 2008 .

[72]  Carmen Almansa Sáez,et al.  Análisis espacial del cierre de explotaciones agrarias , 2008 .

[73]  J. Paz,et al.  Acercando posturas sobre el descuento ambiental: sondeo Delphi a expertos en el ámbito internacional , 2008 .

[74]  E. Rodríguez,et al.  Determining operational capital at risk: an empirical application to the retail banking , 2009 .

[75]  Bruce Hollingsworth,et al.  Use of ratios in data envelopment analysis , 2003 .

[76]  D. Primont,et al.  Multi-Output Production and Duality: Theory and Applications , 1994 .

[77]  Antonio Manuel Martínez Arias,et al.  La presión fiscal por impuesto sobre sociedades en la unión europea , 2008 .

[78]  Jeff Kennington,et al.  An Application of Mathematical Programming to Assess Productivity in the Houston Independent School District , 1982 .

[79]  Subhash C. Ray,et al.  Measuring Scale Efficiency from a Translog Production Function , 1999 .

[80]  Constantino García Ramos,et al.  Una visión panorámica de las entidades de crédito en España en la última década , 2006 .

[81]  Scott J. Callan,et al.  The Production Characteristics of Local Public Education: A Multiple Product and Input Analysis , 1990 .

[82]  Eric A. Hanushek,et al.  Assessing the Effects of School Resources on Student Performance: An Update , 1997 .

[83]  Bruce D. Baker,et al.  Can Flexible Non-Linear Modeling Tell Us Anything New about Educational Productivity?. , 2001 .

[84]  C. Lovell,et al.  RESOURCES AND FUNCTIONINGS: A NEW VIEW OF INEQUALITY IN AUSTRALIA , 1994 .

[85]  M. Pérez,et al.  Including non-cognitive outputs in a multidimensional evaluation of education production: an international comparison , 2009 .

[86]  Antonio Sánchez-Braza,et al.  Average effect of training programs on the time needed to find a job: the case of the training schools program in the south of Spain (Seville, 1997-1999) , 2008 .

[87]  G. Battese,et al.  Prediction of firm-level technical efficiencies with a generalized frontier production function and panel data , 1988 .

[88]  Juan Eugenio Jiménez González,et al.  ANÁLISIS DE FUSIONES, VARIACIONES CONJETURALES Y LA FALACIA DEL ESTIMADOR EN DIFERENCIAS , 2008 .

[89]  José Manuel Cansino Muñoz-Repiso y Antonio Sánchez Braza José Manuel Cansino Muñoz-Repiso y Antonio Sánchez Braza , 2010 .

[90]  Leâ Opold Simar,et al.  A general methodology for bootstrapping in non-parametric frontier models , 2000 .

[91]  David Cantarero Prieto,et al.  Analysing health limitations in Spain: an empirical approach based on the european community household panel , 2008 .

[92]  Raúl Íñiguez Sánchez,et al.  Persistencia del resultado contable y sus componentes: implicaciones de la medida de ajustes por devengo , 2008 .

[93]  Chris D. Orme,et al.  The Potential for Endogeneity Bias in Data Envelopment Analysis , 1996 .

[94]  A. Tsybakov,et al.  Efficient Estimation of Monotone Boundaries , 1995 .

[95]  R. Banker Maximum likelihood, consistency and data envelopment analysis: a statistical foundation , 1993 .

[96]  Miguel Angel Negrín Hernández,et al.  Equidad en la utilización de servicios sanitarios públicos por Comunidades Autónomas en España: un análisis multinivel* , 2008 .

[97]  Luis Fernando Muga Caperos,et al.  Riesgo asimétrico y estrategias de "momentum" en el mercado de valores español , 2007 .

[98]  Andrés J. Picazo-Tadeo,et al.  Does playing several competitions influence a team’s league performance? Evidence from Spanish professional football , 2010, Central Eur. J. Oper. Res..

[99]  Cristina López Duarte,et al.  INCERTIDUMBRE EXTERNA Y ELECCIÓN DEL MODO DE ENTRADA EN EL MARCO DE LA INVERSIÓN DIRECTA EN EL EXTERIOR , 2009 .

[100]  John Ruggiero,et al.  Non-discretionary inputs in data envelopment analysis , 1998, Eur. J. Oper. Res..

[101]  Sergio Perelman,et al.  Technical efficiency of European railways: a distance function approach , 2000 .

[102]  Amelia Bilbao-Terol,et al.  Selecting Portfolios Given Multiple Eurostoxx-Based Uncertainty Scenarios: A Stochastic Goal Programming Approach from Fuzzy Betas , 2009, INFOR Inf. Syst. Oper. Res..

[103]  Mariano Matilla García,et al.  La Integración del Mercado Español a Finales del Siglo XIX: Los Precios del Trigo Entre 1891 y 1905* , 2009, Revista de Historia Económica / Journal of Iberian and Latin American Economic History.

[104]  Silviano Esteve Pérez,et al.  The dynamics of trade and innovation: a joint approach , 2009 .

[105]  William J. Haley Estimation of the Earnings Profile from Optimal Human Capital Accumulation , 1976 .

[106]  D. Forrest,et al.  Impact on competitive balance from allowing foreign players in a sports league: an analytical model and an empirical test , 2008 .

[107]  V. Vandenberghe Economics of Education. The Need to go Beyond Human Capital Theory and Production-Function Analysis , 1999 .

[108]  J. Castro,et al.  Measurement of intra-distribution dynamics: An application of different approaches to the European regions , 2008 .

[109]  Mike González,et al.  Costes de mitigación y escenarios post-kyoto en España: un análisis de equilibro general para España , 2009 .

[110]  A. Díaz,et al.  How bank capital buffers vary across countries: the influence of cost of deposits, market power and bank regulation , 2010 .

[111]  Carmen Pérez Esparrells,et al.  Convergencia en capital humano en España. Un análisis regional para el periodo 1970-2004 , 2007 .

[112]  David Matesanz,et al.  Network analysis of exchange data: interdependence drives crisis contagion , 2014 .

[113]  W. Eichhorn,et al.  Models and Measurement of Welfare and Inequality , 1994 .

[114]  R. Shepherd Theory of cost and production functions , 1970 .

[115]  A. Noya,et al.  Governance Decisions in the R&D Process: An Integrative Framework Based on TCT and Know-ledge View of The Firm. , 2007 .

[116]  Dale W. Jorgenson,et al.  CONJUGATE DUALITY AND THE TRANSCENDENTAL LOGARITHMIC FUNCTION , 1971 .

[117]  Alan Wall,et al.  On measuring the effect of demand uncertainty on costs: an application to port terminals , 2009 .

[118]  A. Charnes,et al.  Some Models for Estimating Technical and Scale Inefficiencies in Data Envelopment Analysis , 1984 .

[119]  E. Hanushek,et al.  The Failure of Input-Based Schooling Policies , 2002 .

[120]  Juan Lopez,et al.  ORDER OF MARKET ENTRY, MARKET AND TECHNOLOGICAL EVOLUTION AND FIRM COMPETITIVE PERFORMANCE , 2009 .

[121]  Byeong-Ho Gong,et al.  Finite sample evidence on the performance of stochastic frontiers and data envelopment analysis using panel data , 1992 .

[122]  William W. Cooper,et al.  A Simulation Study of Joint Uses of Data Envelopment Analysis and Statistical Regressions for Production Function Estimation and Efficiency Evaluation , 1998 .

[123]  David N. Figlio Functional form and the estimated effects of school resources , 1999 .

[124]  José María Durán Cabré,et al.  Key issues when using tax data for concentration analysis: an application to the Spanish wealth tax , 2009 .

[125]  Mikel González Ruiz de Eguino,et al.  Instrumentos de mercado para reducir emisiones de co2: un análisis de equilibrio general para España , 2009 .

[126]  D. S. Holland,et al.  Impacts of Random Noise and Specification on Estimates of Capacity Derived from Data Envelopment Analysis , 2001, Eur. J. Oper. Res..

[127]  Jorge Guardiola,et al.  WHY DO LOCAL GOVERNMENTS PRIVATIZE THE PROVISION OF WATER SERVICES? EMPIRICAL EVIDENCE FROM SPAIN , 2011 .