Resolving Trade-Offs In Service Performance Benchmarking Using Data Envelopment Analysis

The purpose of this paper is to make an argument for utilizing the Data Envelopment Analysis (DEA) as a method to resolve conflicting goals in service performance management systems. Service businesses are faced with two particular challenges that introduce the need to trade-off metrics against each other. First, their rather intangible and perishable properties require incorporating nonfinancial performance indicators such as perceived quality or resource utilization into the calculus. Second, the nature of service systems as open systems makes performance calculations subject to different perspectives on value creation. Traditional approaches to resolve these conflicts are mostly based on weighting the metrics a priori based translating management strategies into action, which might lead to biased performance calculations. With a comparative example, we demonstrate to what extend the DEA is able to resolve these trade-offs without specifying a priori weights which offers the chance to compare unbiased data with current strategic objectives.

[1]  James R. Evans An exploratory study of performance measurement systems and relationships with performance results , 2004 .

[2]  Boaz Golany,et al.  Evaluating Efficiency-Effectiveness-Equality Trade-Offs: A Data Envelopment Analysis Approach , 1995 .

[3]  Alan Wilson,et al.  The use of performance information in the management of service delivery , 2000 .

[4]  Mik Wisniewski,et al.  Developing balanced scorecards in local authorities: a comparison of experience , 2004 .

[5]  M. Yasin,et al.  An assessment of performance-related practices in service operational settings: measures and utilization patterns , 2013 .

[6]  Abraham Charnes,et al.  Measuring the efficiency of decision making units , 1978 .

[7]  Lawrence M. Seiford,et al.  Data envelopment analysis (DEA) - Thirty years on , 2009, Eur. J. Oper. Res..

[8]  Emmanuel Thanassoulis,et al.  Weights restrictions and value judgements in Data Envelopment Analysis: Evolution, development and future directions , 1997, Ann. Oper. Res..

[9]  Ming-Lu Wu,et al.  Balancing productivity and consumer satisfaction for profitability: Statistical and fuzzy regression analysis , 2007, Eur. J. Oper. Res..

[10]  Kevin Cullinane,et al.  The technical efficiency of container ports: Comparing data envelopment analysis and stochastic frontier analysis , 2006 .

[11]  Ashraf Labib,et al.  World‐class maintenance using a computerised maintenance management system , 1998 .

[12]  R. Johnston,et al.  Performance Measurement in Service Businesses , 1992 .

[13]  C. Grönroos,et al.  Service productivity: Towards a conceptualization of the transformation of inputs into economic results in services , 2004 .

[14]  Denis Bouyssou Data Envelopment Analysis, A comprehensive text with models, applications, references and DEA-solver software, W.W. Cooper, L.M. Seiford and K. Tone; Kluwer, 1999, ISBN 0-7923-8693-0, 318 pages , 2003, Eur. J. Oper. Res..

[15]  Joan Ballantine,et al.  Performance measurement in service businesses revisited , 1996 .

[16]  Mahmoud M. Yasin,et al.  Performance management in service operational settings: a selective literature examination , 2010 .

[17]  David Otley,et al.  Performance Management: A Framework for Management Control Systems Research , 1999 .

[18]  Lin Fitzgerald,et al.  Management Performance Measurement in Service Industries , 1988 .

[19]  Joseph Moses Juran,et al.  Quality-control handbook , 1951 .

[20]  A. Neely,et al.  A literature review and research agenda , 1995 .

[21]  Christian Grönroos,et al.  Adopting a service logic in manufacturing: Conceptual foundation and metrics for mutual value creation , 2010 .

[22]  Umit Bititci,et al.  Quantitative models for performance measurement system , 2000 .

[23]  T. J. Brignall,et al.  Performance Measurement and Management in Public Health Services: A Comparison of UK and Swedish Practice , 1998 .

[24]  Antonio Davila,et al.  Performance Measurement and Control Systems for Implementing Strategy: Text and Cases , 1999 .

[25]  T. Saaty Analytic Hierarchy Process , 2005 .

[26]  Valerie Belton,et al.  Adding value to performance measurement by using system dynamics and multicriteria analysis , 2002 .

[27]  R. Kaplan,et al.  The balanced scorecard--measures that drive performance. , 2015, Harvard business review.

[28]  Timothy Coelli,et al.  An Introduction to Efficiency and Productivity Analysis , 1997 .

[29]  Steve Mason,et al.  Towards a definition of a business performance measurement system , 2007 .

[30]  W. Cooper,et al.  Data Envelopment Analysis: A Comprehensive Text with Models, Applications, References and DEA-Solver Software , 1999 .

[31]  N. Avkiran,et al.  Benchmarking firm performance from a multiple-stakeholder perspective with an application to Chinese banking , 2010 .

[32]  Fernando A. F. Ferreira,et al.  Adding value to bank branch performance evaluation using cognitive maps and MCDA: a case study , 2011, J. Oper. Res. Soc..

[33]  Andy Neely,et al.  Performance measurement system design , 1995 .

[34]  Ali Emrouznejad,et al.  COOPER-framework: A unified process for non-parametric projects , 2010, Eur. J. Oper. Res..

[35]  G. D. Silveira,et al.  Exploring the trade‐off concept , 2001 .

[36]  John D. Gilleard,et al.  Benchmarking facility management: applying analytic hierarchy process , 2004 .

[37]  Mahmoud M. Yasin,et al.  A literature review of maintenance performance measurement: A conceptual framework and directions for future research , 2011 .

[38]  G. Keong Leong,et al.  The operations management role in hospital strategic planning , 1996 .

[39]  Vania Sena,et al.  Is there a Trade-Off between Quality and Productivity? The Case of Diagnostic Technologies in Portugal , 2001, Ann. Oper. Res..

[40]  Cláudia S. Sarrico,et al.  Restricting virtual weights in data envelopment analysis , 2004, Eur. J. Oper. Res..

[41]  Sanjay Jain,et al.  Manufacturing performance measurement and target setting: A data envelopment analysis approach , 2011, Eur. J. Oper. Res..

[42]  J. Kohnen,et al.  Business Process Benchmarking: Finding and Implementing Best Practices , 1995 .

[43]  M. Pidd Perversity in public service performance measurement , 2005 .

[44]  R. Rust,et al.  Customer Satisfaction, Productivity, and Profitability: Differences Between Goods and Services , 1997 .

[45]  Emmanuel Thanassoulis,et al.  DEA and its use in the regulation of water companies , 2000, Eur. J. Oper. Res..

[46]  J. March Bounded rationality, ambiguity, and the engineering of choice , 1978 .

[47]  Carlos Francisco Simões Gomes,et al.  Assessing operational effectiveness in healthcare organizations: a systematic approach. , 2010, International journal of health care quality assurance.

[48]  Peter Kueng,et al.  Performance measurement systems in the service sector: the potential of IT is not yet utilised , 2002 .

[49]  Valerie Belton,et al.  Enhanced performance measurement using OR: a case study , 2008, J. Oper. Res. Soc..