Integrating quality into the nonparametric analysis of efficiency: a simulation comparison of popular methods

Measuring efficiency in service-producing industries is challenging, because output quality may have to be considered in addition to output quantity. Previous studies have relied on different nonparametric methods to model the relationship between efficiency and quality; however, limited work has been done so far to compare and integrate these methods. Our literature search identified the following popular methods: a one-stage approach, a congestion analysis, and a two-stage approach. The first two methods treat quality as an additional output (or input) of the production process, whereas the two-stage approach first estimates efficiency without considering quality and then regresses the efficiency estimates on quality in the second stage. In this study, we compare the performance of these three conventional methods to a fairly novel method, the so-called conditional approach, that can also be used to incorporate quality into the analysis of efficiency. We simulate data using eight data generating processes that reflect potential relationships between efficiency and quality in empirical settings. Our simulation exercise illustrates the dominance of the conditional approach over the conventional methods in terms of both predicting the true efficiency scores and capturing the original relationship between efficiency and quality. The conditional approach represents a powerful and flexible tool that can be used when the theoretical link between efficiency and quality is unclear.

[1]  Léopold Simar,et al.  Introducing Environmental Variables in Nonparametric Frontier Models: a Probabilistic Approach , 2005 .

[2]  Josef Jablonsky Efficiency analysis in multi-period systems: an application to performance evaluation in Czech higher education , 2016, Central Eur. J. Oper. Res..

[3]  Dennis L. Bricker,et al.  Profit Incentives and Technical Efficiency in the Production of Nursing Home Care , 1989 .

[4]  P. W. Wilson,et al.  Estimation and inference in two-stage, semi-parametric models of production processes , 2007 .

[5]  D Prieto,et al.  An operational epidemiological model for calibrating agent-based simulations of pandemic influenza outbreaks , 2016, Health care management science.

[6]  Gary D. Ferrier,et al.  Rural hospital performance and its correlates , 1996 .

[7]  Subhash C. Ray,et al.  Quantity, Quality, and Efficiency for a Partially Super-Additive Cost Function: Connecticut Public Schools Revisited , 1998 .

[8]  Tooraj Jamasb,et al.  Social cost-efficient service quality—Integrating customer valuation in incentive regulation: Evidence from the case of Norway , 2010 .

[9]  Po-Chi Chen,et al.  Efficiency and productivity change in Taiwan’s hospitals: a non-radial quality-adjusted measurement , 2013, Central Eur. J. Oper. Res..

[10]  Léopold Simar,et al.  Statistical Approaches for Non‐parametric Frontier Models: A Guided Tour , 2015 .

[11]  Miika Linna,et al.  The association between quality of care and technical efficiency in long-term care. , 2005, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[12]  M. L. Lenard,et al.  Benchmarking nursing home performance at the state level , 2009, Health services management research.

[13]  Léopold Simar,et al.  Testing the "Separability" Condition in Two-Stage Nonparametric Models of Production , 2015 .

[14]  Menderes Tarcan,et al.  Risk-Adjusted Mortality, varieties of congestion and patient satisfaction in Turkish provincial general hospitals , 2012 .

[15]  William L. Weber,et al.  A note on efficiency and productivity growth in the Korean Banking Industry, 1992–2002 , 2006 .

[16]  V. Valdmanis,et al.  Hospital quality, efficiency, and input slack differentials. , 2008, Health services research.

[17]  M. Hassan,et al.  Efficiency, Ownership and Market Structure, Corporate Control and Governance in the Turkish Banking Industry , 2003 .

[18]  Yauheniya Varabyova,et al.  Erratum to: Using nonparametric conditional approach to integrate quality into efficiency analysis: empirical evidence from cardiology departments , 2017, Health care management science.

[19]  Léopold Simar,et al.  Advanced Robust and Nonparametric Methods in Efficiency Analysis: Methodology and Applications , 2007 .

[20]  V. Valdmanis,et al.  Is more better? An analysis of hospital outcomes and efficiency with a DEA model of output congestion , 2008, Health care management science.

[21]  Tooraj Jamasb,et al.  Benchmarking and incentive regulation of quality of service: an application to the UK electricity distribution networks , 2005 .

[22]  Léopold Simar,et al.  Optimal bandwidth selection for conditional efficiency measures: A data-driven approach , 2010, Eur. J. Oper. Res..

[23]  James R. Webb,et al.  Nursing Home Quality, Chain Affiliation, Profit Status and Performance , 2007 .

[24]  A. Donabedian Evaluating the quality of medical care. 1966. , 1966, The Milbank quarterly.

[25]  Daniel G Shimshak,et al.  Incorporating Quality into Data Envelopment Analysis of Nursing Home Performance: A Case Study. , 2009, Omega.

[26]  Gary D. Ferrier,et al.  Incorporating quality into the measurement of hospital efficiency: a double DEA approach , 2013 .

[27]  E. Lettieri,et al.  Efficiency and quality of care in nursing homes: an Italian case study , 2011, Health care management science.

[28]  Yauheniya Varabyova,et al.  International comparisons of the technical efficiency of the hospital sector: panel data analysis of OECD countries using parametric and non-parametric approaches. , 2013, Health policy.

[29]  Ole Bent Olesen,et al.  Incorporating quality into data envelopment analysis: a stochastic dominance approach , 1995 .

[30]  R. Färe,et al.  Measuring output efficiency , 1983 .

[31]  M. Hall,et al.  The Impact of Macroeconomic and Regulatory Factors on Bank Efficiency: A Non-Parametric Analysis of Hong Kong's Banking System , 2005 .

[32]  Bülent Sezen,et al.  Analyzing the ambiguous relationship between efficiency, quality and patient satisfaction in healthcare services: the case of public hospitals in Turkey. , 2013, Health policy.

[33]  Calogero Guccio,et al.  Evaluating the impact of the Bologna Process on the efficiency convergence of Italian universities: a non-parametric frontier approach , 2016 .

[34]  Léopold Simar,et al.  How to measure the impact of environmental factors in a nonparametric production model , 2012, Eur. J. Oper. Res..

[35]  Tooraj Jamasb,et al.  International benchmarking and regulation: an application to European electricity distribution utilities , 2003 .

[36]  Joe Zhu,et al.  Benchmarking with quality-adjusted DEA (Q-DEA) to seek lower-cost high-quality service: Evidence from a U.S.bank application , 2006, Ann. Oper. Res..

[37]  Nurhan Davutyan,et al.  Hospital efficiency with risk adjusted mortality as undesirable output: the Turkish case , 2014, Ann. Oper. Res..

[38]  Vivian Valdmanis,et al.  High versus lower quality hospitals: a comparison of environmental characteristics and technical efficiency , 2010, Health Services and Outcomes Research Methodology.

[39]  M. Hall,et al.  Efficiency in Japanese banking: An empirical analysis , 2003 .

[40]  J. L. Navarro-Espigares,et al.  Efficiency and quality in health services: a crucial link , 2011 .

[41]  Metka Tekavcic,et al.  Efficiency in the hotel industry: an empirical examination of the most influential factors , 2016 .

[42]  L. Wasserman All of Nonparametric Statistics , 2005 .

[43]  Andreas Kappeler,et al.  Efficiency analysis of German electricity distribution utilities – non-parametric and parametric tests , 2006 .

[44]  Valentin Zelenyuk,et al.  Comparative analysis of banking production frameworks in eastern european financial markets , 2009, Eur. J. Oper. Res..

[45]  Diego Prior,et al.  Efficiency and total quality management in health care organizations: A dynamic frontier approach , 2006, Ann. Oper. Res..

[46]  J. Florens,et al.  Nonparametric frontier estimation: a robust approach , 2002 .

[47]  Cheryl B. Jones,et al.  An Examination of Technical Efficiency, Quality, and Patient Safety in Acute Care Nursing Units , 2009, Policy, politics & nursing practice.

[48]  Chien-Ming Chen,et al.  A critique of non-parametric efficiency analysis in energy economics studies , 2013 .

[49]  Saibal Ghosh,et al.  Financial deregulation and efficiency: An empirical analysis of Indian banks during the post reform period , 2006 .

[50]  Wing Hong Chan,et al.  University Efficiency: A Comparison and Consolidation of Results from Stochastic and Non‐stochastic Methods , 2006 .

[51]  Emmanuel Thanassoulis,et al.  Exploring output quality targets in the provision of perinatal care in England using data envelopment analysis , 1995 .

[52]  Domenica Matranga,et al.  Congestion analysis to evaluate the efficiency and appropriateness of hospitals in Sicily. , 2015, Health policy.

[53]  M. Pollitt,et al.  Willingness-to-pay for quality of service: An application to efficiency analysis of the UK electricity distribution utilities , 2009 .

[54]  E. N. Özkan-Günay,et al.  The Impact of Regulatory Policies on Risk Taking and Scale Efficiency of Commercial Banks in an Emerging Banking Sector , 2013 .

[55]  Wu Zeng,et al.  The trade-offs between efficiency and quality in the hospital production: Some evidence from Shenzhen, China , 2014 .

[56]  Endre Bjørndal,et al.  Productivity change and innovation in Norwegian electricity distribution companies , 2012, J. Oper. Res. Soc..

[57]  P. Kooreman Nursing home care in The Netherlands: a nonparametric efficiency analysis. , 1994, Journal of health economics.

[58]  Ning Jackie Zhang,et al.  Has the Medicare prospective payment system led to increased nursing home efficiency? , 2007, Health services research.

[59]  Joe Zhu,et al.  Incorporating health outcomes in Pennsylvania hospital efficiency: an additive super-efficiency DEA approach , 2014, Ann. Oper. Res..

[60]  Larissa S. Kyj,et al.  Bank x-efficiency in Ukraine: An analysis of service characteristics and ownership , 2008 .

[61]  Joris van de Klundert,et al.  Productivity and quality of Dutch hospitals during system reform , 2015, Health care management science.

[62]  Hsihui Chang,et al.  Taiwan quality indicator project and hospital productivity growth , 2010, Omega.

[63]  Allen N. Berger,et al.  Problem Loans and Cost Efficiency in Commercial Banks , 1997 .

[64]  Rajiv D. Banker,et al.  Efficiency Analysis for Exogenously Fixed Inputs and Outputs , 1986, Oper. Res..

[65]  A. Charnes,et al.  Some Models for Estimating Technical and Scale Inefficiencies in Data Envelopment Analysis , 1984 .

[66]  Vania Sena,et al.  Is there a Trade-Off between Quality and Productivity? The Case of Diagnostic Technologies in Portugal , 2001, Ann. Oper. Res..

[67]  P. W. Wilson,et al.  Two-stage DEA: caveat emptor , 2011 .

[68]  Byron Gajewski,et al.  Modeling efficiency at the process level: an examination of the care planning process in nursing homes. , 2009, Health services research.

[69]  Vikas Mittal,et al.  Assessing the Service-Profit Chain , 2002 .

[70]  Yasar A. Ozcan,et al.  Data Envelopment Analysis Comparison of Hospital Efficiency and Quality , 2008, Journal of Medical Systems.

[71]  Kankana Mukherjee,et al.  Market Structure and Technical Efficiency in the Hospital Services Industry: A DEA Approach , 2006, Medical care research and review : MCRR.

[72]  J. Schreyögg,et al.  Effects of Ownership on Hospital Efficiency in Germany , 2009 .

[73]  Léopold Simar,et al.  Explaining inefficiency in nonparametric production models: the state of the art , 2014, Ann. Oper. Res..

[74]  E. Fumagalli,et al.  Output-based incentive regulation in electricity distribution: evidence from Italy , 2014 .

[75]  C. Storto The trade-off between cost efficiency and public service quality: A non-parametric frontier analysis of Italian major municipalities , 2016 .

[76]  J. Newhouse Toward a Theory of Nonprofit Institutions: An Economic Model of a Hospital , 1970 .