Supporting performance appraisal in ELECTRE based stepwise benchmarking model

Abstract In this paper, we propose a way to enhance the accuracy of input data in ELECTRE (ELimination Et Choix Traduisant la REalite – ELimination and Choice Expressing REality) based stepwise benchmarking model. We expand stepwise benchmarking algorithm with data pre-processing procedure based on the decision maker's judgments about the performance levels. For this purpose, we devised a new module in stepwise benchmarking model, which translates the sequence of descriptive, non-numerical decision maker's assertions into scoring parameters. The proposed preference elicitation procedure enables to accommodate decision maker's perception on performance of benchmarking units. Thereby distinct performance characteristics are acknowledged and practical feasibility of benchmarking paths is enhanced. The important feature of the proposed procedure is that it allows proceeding with more scoring options, which can occur with some performance indicators. The model is implemented among European Union member states in the field of digital connectivity.

[1]  Johannes M. Bauer.  Learning from each other: promises and pitfalls of benchmarking in communications policy , 2010 .

[2]  Peter Nijkamp,et al.  Benchmarking of world cities through self-organizing maps , 2013 .

[3]  Caroline Maria de Miranda Mota,et al.  Human Development Index Based on ELECTRE TRI-C Multicriteria Method: An Application in the City of Recife , 2016 .

[4]  David L. Baker,et al.  Advancing E-Government performance in the United States through enhanced usability benchmarks , 2009, Gov. Inf. Q..

[5]  James R. Lewis,et al.  Psychometric Evaluation of the PSSUQ Using Data from Five Years of Usability Studies , 2002, Int. J. Hum. Comput. Interact..

[6]  Siba Sankar Mahapatra,et al.  Green supplier appraisement in fuzzy environment , 2014 .

[7]  Lei Fang.  Centralized resource allocation based on efficiency analysis for step-by-step improvement paths , 2015 .

[8]  Marijana Petrovic,et al.  Benchmarking the digital divide using a multi-level outranking framework: Evidence from EBRD countries of operation , 2012, Gov. Inf. Q..

[9]  A. Hatami-Marbini,et al.  An Extension of the Electre I Method for Group Decision-Making Under a Fuzzy Environment , 2011 .

[10]  Shih-Hsu Wang,et al.  An analytical model for benchmarking the development of national infrastructure items against those in similar countries , 2016, Int. J. Crit. Infrastructure Prot..

[11]  T. Papaioannou,et al.  Policy benchmarking: a tool of democracy or a tool of authoritarianism? , 2007 .

[12]  Song Jin Yu,et al.  Performance based stratification and clustering for benchmarking of container terminals , 2009, Expert Syst. Appl..

[13]  Ting-Yu Chen,et al.  An ELECTRE-based outranking method for multiple criteria group decision making using interval type-2 fuzzy sets , 2014, Inf. Sci..

[14]  B. Lundvall,et al.  International benchmarking as a policy learning tool , 2002 .

[15]  Abraham Charnes,et al.  Measuring the efficiency of decision making units , 1978 .

[16]  Fred Wegman,et al.  Benchmarking Road Safety Performances of Countries , 2010 .

[17]  Saurabh Gupta,et al.  An overview of sustainability assessment methodologies , 2009 .

[18]  Lawrence M. Seiford,et al.  Models for performance benchmarking: Measuring the effect of e-business activities on banking performance , 2004 .

[19]  John D. Nelson,et al.  The Benchmarking Handbook , 2000 .

[20]  Gerard B. M. Heuvelink,et al.  Web-based tool for expert elicitation of the variogram , 2013, Comput. Geosci..

[21]  Jeffrey W. Alstete.  Measurement benchmarks or “real” benchmarking? , 2008 .

[22]  Amir Mosavi,et al.  Multiple Criteria Decision-Making Preprocessing Using Data Mining Tools , 2010, ArXiv.

[23]  Rajashree Dash,et al.  Comparative Analysis of Supervised and Unsupervised Discretization Techniques , 2011 .

[24]  E. P. Michael.  Strategy and the Internet. , 2001 .

[25]  Milosz Kadzinski,et al.  Post factum analysis for robust multiple criteria ranking and sorting , 2015, Journal of Global Optimization.

[26]  Petri Niemi,et al.  An approach to improving logistical performance with cross‐unit benchmarking , 2008 .

[27]  A. Malik,et al.  International benchmarking: Politics and policy , 2013 .

[28]  Marijana Petrovic,et al.  An ELECTRE-based decision aid tool for stepwise benchmarking: An application over EU Digital Agenda targets , 2014, Decis. Support Syst..

[29]  Robert C. Camp,et al.  Benchmarking: The Search for Industry Best Practices That Lead to Superior Performance , 1989 .

[30]  Nataša Bojković,et al.  One solution for cross-country transport-sustainability evaluation using a modified ELECTRE method , 2010 .

[31]  David N. Ammons.  A Proper Mentality for Benchmarking , 1999 .

[32]  Luis C. Dias,et al.  An aggregation/disaggregation approach to obtain robust conclusions with ELECTRE TRI , 2002, Eur. J. Oper. Res..

[33]  Salvatore Greco,et al.  An Overview of ELECTRE Methods and their Recent Extensions , 2013 .

[34]  Young Ae Kim,et al.  A method of stepwise benchmarking for inefficient DMUs based on the proximity-based target selection , 2009, Expert Syst. Appl..

[35]  Sungmook Lim,et al.  A DEA-BASED METHOD OF STEPWISE BENCHMARK TARGET SELECTION WITH PREFERENCE, DIRECTION AND SIMILARITY CRITERIA , 2012 .

[36]  Vassilis Moustakis,et al.  Measuring and benchmarking the innovativeness of SMEs: A three-dimensional fuzzy logic approach , 2006 .

[37]  L. Seiford,et al.  Profitability and Marketability of the Top 55 U.S. Commercial Banks , 1999 .

[38]  Si-Il Sung,et al.  Integrated Approach to Construction of Benchmarking Network in DEA-Based Stepwise Benchmark Target Selection , 2016 .

[39]  Sebastián Lozano,et al.  Determining a sequence of targets in DEA , 2005, J. Oper. Res. Soc..

[40]  Han Kook Hong,et al.  Evaluating the efficiency of system integration projects using data envelopment analysis (DEA) and machine learning , 1999 .

[41]  Jian-Bo Yang,et al.  Interval efficiency assessment using data envelopment analysis , 2005, Fuzzy Sets Syst..

[42]  Paul Marginson,et al.  What can ‘benchmarking’ offer the open method of co-ordination? , 2004 .

[43]  Milosz Kadzinski,et al.  Robust ordinal regression in preference learning and ranking , 2013, Machine Learning.

[44]  Marijn Janssen,et al.  Measurement and benchmarking foundations: Providing support to organizations in their development and growth using dashboards , 2013, Gov. Inf. Q..

[45]  J. Figueira,et al.  A note on the paper, “Ranking irregularities when evaluating alternatives by using some ELECTRE methods”, by Wang and Triantaphyllou, Omega (2008) , 2009 .

[46]  Daniel Palm,et al.  Predicting site-specific overwintering of juvenile brown trout (Salmo trutta) using a habitat suitability index , 2009 .

[47]  Christoph Böhringer,et al.  Measuring the Immeasurable: A Survey of Sustainability Indices , 2007 .

[48]  John Bessant,et al.  Benchmarking as a policy-making tool: From the private to the public sector , 2006 .

[49]  E. Triantaphyllou,et al.  Ranking irregularities when evaluating alternatives by using some ELECTRE methods , 2008 .

[50]  Isabelle Bruno,et al.  Europeanization through its instrumentation: benchmarking, mainstreaming and the open method of co-ordination … toolbox or Pandora's box? , 2006 .

[51]  Diego Prior,et al.  A learning ladder toward efficiency: Proposing network-based stepwise benchmark selection , 2016 .

[52]  Veljko Jeremic,et al.  Two-phased composite I-distance indicator approach for evaluation of countries' information development , 2015 .

[53]  Huan Liu,et al.  Discretization: An Enabling Technique , 2002, Data Mining and Knowledge Discovery.

[54]  Susana Borrás,et al.  The open method of co-ordination and new governance patterns in the EU , 2004 .

[55]  J. Gourdon,et al.  Paths to success: Benchmarking cross-country sustainable tourism , 2012 .

[56]  Domenico Laise,et al.  Benchmarking and learning organizations: ranking methods to identify “best in class” , 2004 .

[57]  Loo Hay Lee,et al.  A study on the selection of benchmarking paths in DEA , 2011, Expert Syst. Appl..

[58]  Pekka Leskinen,et al.  Towards more non-compensatory sustainable society index , 2015, Environment, Development and Sustainability.

[59]  Soung Hie Kim,et al.  Interactive group decision making procedure under incomplete information , 1999, Eur. J. Oper. Res..

[60]  Gomes Pj.  Is success a sin? A conversation with the reverend Peter J. Gomes. Interview by David A. Light. , 2001 .

[61]  L. V. Tavares,et al.  An acyclic outranking model to support group decision making within organizations , 2012 .

[62]  Peter Glavič,et al.  Fuzzy Logic Model for the performance benchmarking of sugar plants by considering best available techniques , 2007 .

[63]  Gianluca Misuraca,et al.  Institutional isomorphism, policy networks, and the analytical depreciation of measurement indicators , 2015 .

[64]  Marijana Petrovic,et al.  An ELECTRE approach for evaluating secondary education profiles: evidence from PISA survey in Serbia , 2016, Ann. Oper. Res..