Cross-efficiency evaluation in the presence of flexible measures with an application to healthcare systems

In recent years, most countries around the world have struggled with the consequences of budget cuts in health expenditure, obliging them to utilize their resources efficiently. In this context, performance evaluation facilitates the decision-making process in improving the efficiency of the healthcare system. However, the performance evaluation of many sectors, including the healthcare systems, is, on the one hand, a challenging issue and on the other hand a useful tool for decision- making with the aim of optimizing the use of resources. This study proposes a new methodology comprising two well-known analytical approaches: (i) data envelopment analysis (DEA) to measure the efficiencies and (ii) data science to complement the DEA model in providing insightful recommendations for strategic decision making on productivity enhancement. The suggested method is a first attempt to combine two DEA extensions: flexible measure and cross-efficiency. We develop a pair of benevolent and aggressive scenarios aiming at evaluating cross-efficiency in the presence of flexible measures. Next, we perform data mining cluster analysis to create groups of homogeneous countries. Organizing the data in similar groups facilitates identifying a set of benchmarks that perform similarly in terms of operating conditions. Comparing the benchmark set with poorly performing countries we can obtain attainable goals for performance enhancement which will assist policymakers to strategically act upon it. A case study of healthcare systems in 120 countries is taken as an example to illustrate the potential application of our new method.

[1]  O. Zaim,et al.  Estimating the efficiency of the system of healthcare financing in achieving better health , 2006 .

[2]  B. Hollingsworth,et al.  Cross-country comparisons of technical efficiency of health production: a demonstration of pitfalls , 2009 .

[3]  Marion S. Rauner,et al.  A cross-national comparison and taxonomy of DEA-based hospital efficiency studies , 2008 .

[4]  Mehdi Toloo,et al.  Selective measures in data envelopment analysis , 2015, Ann. Oper. Res..

[5]  J. MacQueen Some methods for classification and analysis of multivariate observations , 1967 .

[6]  Bülent Sezen,et al.  Analyzing the ambiguous relationship between efficiency, quality and patient satisfaction in healthcare services: the case of public hospitals in Turkey. , 2013, Health policy.

[7]  Hanif D. Sherali,et al.  Linear Programming and Network Flows , 1977 .

[8]  Y A Ozcan,et al.  Efficiency Analysis of Federally Funded Hospitals: Comparison of DoD and VA Hospitals Using Data Envelopment Analysis , 1995, Health services management research.

[9]  M. Farrell The Measurement of Productive Efficiency , 1957 .

[10]  Joe Zhu,et al.  Dual-role factors in data envelopment analysis , 2006 .

[11]  Nelson F. F. Ebecken,et al.  A genetic algorithm for cluster analysis , 2003, Intell. Data Anal..

[12]  Mehdi Toloo,et al.  Two alternative approaches for selecting performance measures in data envelopment analysis , 2015 .

[13]  Y. Ozcan Health Care Benchmarking and Performance Evaluation , 2008 .

[14]  Yauheniya Varabyova,et al.  International comparisons of the technical efficiency of the hospital sector: panel data analysis of OECD countries using parametric and non-parametric approaches. , 2013, Health policy.

[15]  Yossi Hadad,et al.  Determinants of healthcare system’s efficiency in OECD countries , 2013, The European Journal of Health Economics.

[16]  Andrés L. Medaglia,et al.  A robust DEA-centric location-based decision support system for expanding Recreovía hubs in the city of Bogotá (Colombia) , 2019, Int. Trans. Oper. Res..

[17]  Miguel St. Aubyn,et al.  Non-Parametric Approaches to Education and Health Expenditure Efficiency in OECD Countries , 2004 .

[18]  Carmela Di Mauro,et al.  The impact of managerial and organizational aspects on hospital wards' efficiency: Evidence from a case study , 2009, Eur. J. Oper. Res..

[19]  Mehdi Toloo A cost efficiency approach for strategic vendor selection problem under certain input prices assumption , 2016 .

[20]  B. Hollingsworth The measurement of efficiency and productivity of health care delivery. , 2008, Health economics.

[21]  Dimitrios Niakas,et al.  Employing post-DEA Cross-evaluation and Cluster Analysis in a Sample of Greek NHS Hospitals , 2010, Journal of Medical Systems.

[22]  Josef Jablonsky,et al.  A new robust DEA model and super-efficiency measure , 2017 .

[23]  Mehdi Toloo,et al.  A non-radial directional distance method on classifying inputs and outputs in DEA: Application to banking industry , 2018, Expert Syst. Appl..

[24]  Mehdi Toloo,et al.  Selecting most efficient information system projects in presence of user subjective opinions: a DEA approach , 2018, Central Eur. J. Oper. Res..

[25]  Yasar A. Ozcan,et al.  Assessing efficiency of public health and medical care provision in OECD countries after a decade of reform , 2017, Central Eur. J. Oper. Res..

[26]  Jaume Puig-Junoy,et al.  Measuring health production performance in the OECD , 1998 .

[27]  Mehdi Toloo,et al.  Robust optimization with nonnegative decision variables: A DEA approach , 2019, Comput. Ind. Eng..

[28]  Joe Zhu,et al.  Service Productivity Management: Improving Service Performance Using Data Envelopment Analysis (Dea) , 2006 .

[29]  Mehdi Toloo On classifying inputs and outputs in DEA: A revised model , 2009, Eur. J. Oper. Res..

[30]  Bruce Hollingsworth,et al.  The efficiency of health production: re-estimating the WHO panel data using parametric and non-parametric approaches to provide additional information. , 2003, Health economics.

[31]  Mehdi Toloo,et al.  The most cost efficient automotive vendor with price uncertainty: A new DEA approach , 2014 .

[32]  Yasar A. Ozcan,et al.  Health Care Benchmarking and Performance Evaluation: An Assessment Using Data Envelopment Analysis (DEA) , 2007 .

[33]  Rodney H. Green,et al.  Efficiency and Cross-efficiency in DEA: Derivations, Meanings and Uses , 1994 .

[34]  John E. Beasley,et al.  Comparing university departments , 1990 .

[35]  Adel Hatami-Marbini,et al.  Dual-role factors for imprecise data envelopment analysis , 2017, Omega.

[36]  Donna L. Retzlaff-Roberts,et al.  Technical efficiency in the use of health care resources: a comparison of OECD countries. , 2004, Health policy.

[37]  D. Shinjo,et al.  Geographic distribution of healthcare resources, healthcare service provision, and patient flow in Japan: a cross sectional study. , 2012, Social science & medicine.

[38]  P. Zweifel,et al.  Measuring and comparing the (in)efficiency of German and Swiss hospitals , 2004, The European Journal of Health Economics, formerly: HEPAC.

[39]  A. Charnes,et al.  Some Models for Estimating Technical and Scale Inefficiencies in Data Envelopment Analysis , 1984 .

[40]  Andrés L. Medaglia,et al.  A DEA-centric decision support system for evaluating Ciclovía-Recreativa programs in the Americas , 2018 .

[41]  Yasar A. Ozcan,et al.  Efficiency Evaluation of Community-Based Youth Services in Virginia , 2004, Community Mental Health Journal.

[42]  C. Barros,et al.  An analysis of hospital efficiency and productivity growth using the Luenberger indicator , 2008, Health care management science.

[43]  Walter Ricciardi,et al.  The measurement of relative efficiency of general practice and the implications for policy makers. , 2012, Health policy.

[44]  Yasar A. Ozcan,et al.  Are hospitals producing quality care efficiently? An analysis using Dynamic Network Data Envelopment Analysis (DEA) , 2017 .

[45]  Robert G. Dyson,et al.  On comparing the performance of primary care providers , 2008, Eur. J. Oper. Res..

[46]  M. Ghazizadeh,et al.  Eco-efficiency considering the issue of heterogeneity among power plants , 2016 .

[47]  Sebastián Lozano,et al.  Measuring the performance of nations at the Summer Olympics using data envelopment analysis , 2002, J. Oper. Res. Soc..

[48]  H. Sherman Hospital Efficiency Measurement and Evaluation: Empirical Test of a New Technique , 1984, Medical care.

[49]  Marcos Pereira Estellita Lins,et al.  Financing reform and productivity change in Brazilian teaching hospitals: Malmquist approach , 2010, Central Eur. J. Oper. Res..

[50]  Anil K. Jain,et al.  Algorithms for Clustering Data , 1988 .

[51]  Mehdi Toloo,et al.  A polynomial-time algorithm for finding epsilon in DEA models , 2004, Comput. Oper. Res..

[52]  Mehdi Toloo Notes on classifying inputs and outputs in data envelopment analysis: A comment , 2014, Eur. J. Oper. Res..

[53]  Abraham Charnes,et al.  Measuring the efficiency of decision making units , 1978 .

[54]  Joe Zhu,et al.  Classifying inputs and outputs in data envelopment analysis , 2007, Eur. J. Oper. Res..

[55]  Vipin Kumar,et al.  Introduction to Data Mining , 2022, Data Mining and Machine Learning Applications.

[56]  Yasar A. Ozcan,et al.  Electronic medical record use and efficiency: A DEA and windows analysis of hospitals , 2009 .

[57]  T. Sexton,et al.  Data Envelopment Analysis: Critique and Extensions , 1986 .

[58]  Claude Giorno,et al.  Improving the Performance of the Public Health Care System in Greece , 2009 .

[59]  Vasanthakumar N. Bhat,et al.  Institutional arrangements and efficiency of health care delivery systems , 2005, The European Journal of Health Economics.

[60]  Miika Linna,et al.  Cost efficiency of university hospitals in the Nordic countries: a cross-country analysis , 2011, European Journal of Health Economics.

[61]  Yasar A. Ozcan,et al.  An Assessment of the Health Care Safety Net , 2015 .

[62]  George Dimas,et al.  Productive performance and its components in Greek public hospitals , 2010, Operational Research.

[63]  W. Cooper,et al.  Data Envelopment Analysis: A Comprehensive Text with Models, Applications, References and DEA-Solver Software , 1999 .

[64]  Rowena Jacobs,et al.  An international comparison of efficiency of inpatient mental health care systems. , 2013, Health policy.

[65]  Lee R. Mobley,et al.  An international comparison of hospital efficiency: does institutional environment matter? , 1998 .

[66]  Nunamaker Tr,et al.  Measuring routine nursing service efficiency: a comparison of cost per patient day and data envelopment analysis models. , 1983 .

[67]  Sergio Orlando Antoun Netto,et al.  Multimethodology applied to the evaluation of Healthcare in Brazilian municipalities , 2019, Health care management science.

[68]  Jie Wu,et al.  Achievement and benchmarking of countries at the Summer Olympics using cross efficiency evaluation method , 2009, Eur. J. Oper. Res..

[69]  P. Kaya Samut,et al.  Analysis of the Efficiency Determinants of Health Systems in OECD Countries by DEA and Panel Tobit , 2016 .

[70]  Mehdi Toloo,et al.  On considering dual-role factor in supplier selection problem , 2015, Math. Methods Oper. Res..

[71]  Ronaldo Goldschmidt,et al.  Data Mining: um Guia Prático , 2005 .

[72]  Mehdi Toloo,et al.  LU Decomposition in DEA with an Application to Hospitals , 2016 .

[73]  Ali Emrouznejad,et al.  A survey and analysis of the first 40 years of scholarly literature in DEA: 1978–2016 , 2018 .

[74]  Jan Schoenfelder,et al.  The use of Data Envelopment Analysis (DEA) in healthcare with a focus on hospitals , 2019, Health care management science.

[75]  Mehdi Toloo Alternative solutions for classifying inputs and outputs in data envelopment analysis , 2012, Comput. Math. Appl..

[76]  Malika Charrad,et al.  NbClust: An R Package for Determining the Relevant Number of Clusters in a Data Set , 2014 .

[77]  Jan Schoenfelder,et al.  Correction to: The use of Data Envelopment Analysis (DEA) in healthcare with a focus on hospitals , 2018, Health care management science.