The quality of service: An overall performance assessment for water utilities

Over the last decades, the delivery of water supply services has changed among regions and actors, in order to meet the changing needs. Those services can be balanced based on the relation between the obligations they must fulfill, the quality offered, and the associated price/value for money. Furthermore, due to the water services inherent characteristics, they are prone to poor quality of service (in general terms). Thus, global performance assessments are of paramount relevance under those constraints. In Portugal, the water regulator has developed a system of performance indicators (partial measures of performance) and, therefore, it is not possible to achieve the desired holistic performance evaluation (global measure). To enable such assessment, we propose an application based on the ELECTRE TRI-nC method to define quality of service categories and aggregate performance indicators. To obtain a coherent family of criteria (i.e., exhaustive, cohesive, and non-redundant) we apply an iso-preference logic. The results obtained are presented through a geographical information system allowing for a clearer visualization of the overall performance of water utilities. The method proposed can be considered a suitable decision support system and useful regulatory tool able to provide policy relevant outputs.

[1]  L. Phillips.  A theory of requisite decision models , 1984 .

[2]  F. S. Pinto,et al.  Contracting water services with public and private partners: a case study approach , 2015 .

[3]  Pedro Simões,et al.  Performance Benchmarking in Utility Regulation: the Worldwide Experience , 2011 .

[4]  Adel Guitouni,et al.  Tentative guidelines to help choosing an appropriate MCDA method , 1998, Eur. J. Oper. Res..

[5]  Bernard Roy,et al.  Determining the weights of criteria in the ELECTRE type methods with a revised Simos' procedure , 2002, Eur. J. Oper. Res..

[6]  José Rui Figueira,et al.  A Multiple Criteria Decision Analysis Model Based on ELECTRE TRI-C for Erosion Risk Assessment in Agricultural Areas , 2014, Environmental Modeling & Assessment.

[7]  K. Matthews,et al.  Reprint of: Dynamic efficiency in the English and Welsh water and sewerage industry , 2016 .

[8]  Matthias Ehrgott,et al.  Multiple criteria decision analysis: state of the art surveys , 2005 .

[9]  Juscelino Almeida Dias,et al.  Laboratoire D'analyse Et Modélisation De Systèmes Pour L'aide À La Décision Cahier Du Lamsade 274 Electre Tri-c: a Multiple Criteria Sorting Method Based on Characteristic Reference Actions Electre Tri-c: a Multiple Criteria Sorting Method Based on Characteristic Reference Actions , 2022 .

[10]  Manuel P. Teodoro,et al.  When Governments Regulate Governments , 2015 .

[11]  Rui Cunha Marques,et al.  Assessing the sustainability of water companies: A synthetic indicator approach , 2016 .

[12]  F. S. Pinto,et al.  Tariff recommendations: A Panacea for the Portuguese water sector? , 2015 .

[13]  B. Roy.  THE OUTRANKING APPROACH AND THE FOUNDATIONS OF ELECTRE METHODS , 1991 .

[14]  Solomon Tesfamariam,et al.  Selecting performance indicators for small and medium sized water utilities: Multi-criteria analysis using ELECTRE method , 2015 .

[15]  Rui A. R. Ramos,et al.  A global service quality index to evaluate the performance and sustainability in water supply utilities , 2009 .

[16]  Simon Cowan.  Competition in the Water Industry , 1997 .

[17]  Trinidad Gómez,et al.  Assessing the sustainability of small wastewater treatment systems: a composite indicator approach. , 2014, The Science of the total environment.

[18]  Stefano Tarantola,et al.  Handbook on Constructing Composite Indicators: Methodology and User Guide , 2005 .

[19]  Rui Cunha Marques,et al.  Tariff Suitability Framework for Water Supply Services , 2016, Water Resources Management.

[20]  R. Marques,et al.  Measuring the sustainability of urban water services , 2015 .

[21]  S. Greco,et al.  Combining analytical hierarchy process and Choquet integral within non-additive robust ordinal regression ☆ , 2016 .

[22]  José Rui Figueira,et al.  Dealing with a multiple criteria environmental problem with interaction effects between criteria through an extension of the Electre III method , 2015, Eur. J. Oper. Res..

[23]  S. Greco,et al.  Multiple Criteria Hierarchy Process with ELECTRE and PROMETHEE , 2013 .

[24]  A. J. Monteiro,et al.  Application of performance indicators in water utilities management--a case-study in Portugal. , 2001, Water science and technology : a journal of the International Association on Water Pollution Research.

[25]  David K. Lambert,et al.  Ownership and sources of inefficiency in the provision of water services , 1993 .

[26]  L. Joe Moffitt,et al.  The IBNET Water Supply and Sanitation Blue Book 2014: The International Benchmarking Network for Water and Sanitation Utilities Databook , 2014 .

[27]  P. Schwartz.  John Stuart Mill and Laissez Faire: London Water , 1966 .

[28]  Roman Słowiński,et al.  Questions guiding the choice of a multicriteria decision aiding method , 2013 .

[29]  Thomas L. Saaty,et al.  When is a Decision-Making Method Trustworthy? Criteria for Evaluating Multi-Criteria Decision-Making Methods , 2015, Int. J. Inf. Technol. Decis. Mak..

[30]  Solomon Tesfamariam,et al.  Performance indicators for small- and medium-sized water supply systems: a review , 2014 .

[31]  Salvatore Greco,et al.  An Overview of ELECTRE Methods and their Recent Extensions , 2013 .

[32]  R. L. Keeney,et al.  Decisions with Multiple Objectives: Preferences and Value Trade-Offs , 1977, IEEE Transactions on Systems, Man, and Cybernetics.

[33]  S French,et al.  Multicriteria Methodology for Decision Aiding , 1996 .

[34]  Giovanni De Feo,et al.  Using MCDA and GIS for hazardous waste landfill siting considering land scarcity for waste disposal. , 2014 .

[35]  Hau L. Lee,et al.  Carrots or Sticks? Improving Social and Environmental Compliance at Suppliers Through Incentives and Penalties , 2015 .

[36]  Bingzhen Sun,et al.  An approach to consensus measurement of linguistic preference relations in multi-attribute group decision making and application , 2015 .

[37]  Pedro Simões,et al.  Does the sunshine regulatory approach work?: Governance and regulation model of the urban waste services in Portugal , 2008 .

[38]  José Rui Figueira,et al.  Discriminating thresholds as a tool to cope with imperfect knowledge in multiple criteria decision aiding: Theoretical results and practical issues , 2014 .

[39]  Enrique Cabrera,et al.  Performance Indicators for Water Supply Services: Third Edition , 2006 .

[40]  Sanford V. Berg,et al.  Water Utility Benchmarking: Measurement, Methodologies, and Performance Incentives , 2010 .

[41]  S. Walle.  What services are public? What aspects of performance are to be ranked? The case of "Services of General Interest" , 2008 .

[42]  Salvatore Greco,et al.  Multiple Criteria Hierarchy Process for ELECTRE Tri methods , 2016, Eur. J. Oper. Res..

[43]  N. Malys,et al.  Comparative analysis of MCDM methods for the assessment of sustainable housing affordability , 2016 .

[44]  Matthias Ehrgott,et al.  Multiple criteria decision making for engineering , 2008 .

[45]  J. Figueira,et al.  Robust multi-criteria sorting with the outranking preference model and characteristic profiles , 2015 .

[46]  Juscelino Almeida Dias,et al.  A multiple criteria sorting method where each category is characterized by several reference actions: The Electre Tri-nC method , 2012, Eur. J. Oper. Res..

[47]  Amir Nafi,et al.  Comprehensive Methodology for Overall Performance Assessment of Water Utilities , 2015, Water Resources Management.

[48]  Jiuping Xu,et al.  Multi-criteria group individual research output evaluation based on context-free grammar judgments with assessing attitude , 2015 .