Identification and prioritization of stage-level KPIs for BOT projects – evidence from Turkey

The purpose of this paper is to identify and prioritize key performance indicators (KPIs) that can be used for stage-based performance assessment of build-operate-transfer (BOT) projects.,This research was conducted through focus group discussions and face-to-face questionnaires. Firstly, stage-level KPIs for BOT projects were identified by conducting a literature survey. The list of KPIs that can be used for measuring performance at different stages of a BOT project was finalized by conducting focus group discussions with 12 participants. The data related to the importance of identified KPIs were collected via a face-to-face questionnaire in which 30 high-level managers participated. Based on these data, KPIs were prioritized considering eight different stages of a BOT project by using Technique for Order of Preference by Similarity to Ideal Solution (TOPSIS).,The research findings reveal that 63 stage-level KPIs can be used for measuring the performance of BOT projects at eight different stages, which are “feasibility study and preliminary plan,” “announcement and submission of application,” “evaluation and selection,” “negotiation and signing of concession agreement,” “design,” “construction,” “operation” and “transfer.” The most important KPIs were determined as “comprehensiveness of project technical feasibility,” “detailed tendering procedure,” “effectiveness of concessionaires' technical knowledge/capability evaluation,” “good relationships between government and concessionaire,” “technology transfer,” “effectiveness of quality control,” “effectiveness of facility management” and “effectiveness of hand-back management” for each stage. The findings can be used by companies to evaluate performance at each stage of a BOT project and, if necessary, take the necessary actions for performance improvement at the stage level.,The main limitation is the size of the sample, which represents the perspectives of 30 Turkish high-level managers on KPIs in BOT projects. Besides, the selected method, namely, TOPSIS, does not provide quality measures related to the outputs; therefore, it is difficult to see the inconsistencies among the experts.,The study findings will help in devising appropriate performance evaluation practices for BOT projects to overcome the shortfalls of the existing practices and systems proposed in the literature and help in achieving the superior performance while developing infrastructure through the BOT route.,This paper proposes a process-based approach for measuring the performance of a BOT project considering eight different stages. It fills a research gap in the public–private partnership literature by focusing on stages rather than phases. The results can be used by practitioners to establish stage-level performance management systems for BOT projects.

[1]  Leentje Volker,et al.  Flexibility in PPP contracts – Dealing with potential change in the pre-contract phase of a construction project , 2017 .

[2]  Ming Xu,et al.  Comparative performance of PPPs and traditional procurement in Australia , 2007 .

[3]  A. Neely,et al.  Measuring performance in a changing business environment , 2003 .

[4]  Arash Shahin,et al.  Prioritization of key performance indicators: An integration of analytical hierarchy process and goal setting , 2007 .

[5]  Patricia M. Carrillo,et al.  Technology transfer on joint venture projects in developing countries , 1996 .

[6]  B. B. Zaidan,et al.  Survey on fuzzy TOPSIS state-of-the-art between 2007 and 2017 , 2019, Comput. Oper. Res..

[7]  Kumar Neeraj Jha,et al.  An Empirical Study on Performance Measurement Factors for Construction Organizations , 2018 .

[8]  N. Vajdic,et al.  Use of key performance indicators for PPP transport projects to meet stakeholders’ performance objectives , 2013 .

[9]  Turkish experience with public private partnerships in infrastructure: Opportunities and challenges , 2015 .

[10]  Honglei Yi,et al.  Research trends of post disaster reconstruction: The past and the future , 2014 .

[11]  Chi-Cheng Yang,et al.  Evaluating schedule delay causes for private participating public construction works under the Build-Operate-Transfer model , 2010 .

[12]  R. Kaplan,et al.  Linking the Balanced Scorecard to Strategy , 1996 .

[13]  Mei-yung Leung,et al.  Managing the Stress of Hong Kong Expatriate Construction Professionals in Mainland China: Focus Group Study Exploring Individual Coping Strategies and Organizational Support , 2012 .

[14]  Tahir Masood Qureshi,et al.  Significance of project management performance assessment (PMPA) model , 2009 .

[15]  Mladen Radujković,et al.  Application of key performance indicators in South‐Eastern European construction , 2010 .

[16]  Robert Eadie,et al.  BIM implementation throughout the UK construction project lifecycle: An analysis , 2013 .

[17]  Ross Guest,et al.  Performance indicators of public private partnership in Bangladesh , 2019, International Journal of Productivity and Performance Management.

[18]  Umit Bititci,et al.  Integrated performance measurement systems: a development guide , 1997 .

[19]  G. Shen,et al.  Stakeholder management studies in mega construction projects: A review and future directions , 2015 .

[20]  Xueqing Zhang,et al.  Factor Analysis of Public Clients’ Best-Value Objective in Public–Privately Partnered Infrastructure Projects , 2006 .

[21]  Aditya Parida,et al.  Maintenance performance metrics a state of the art review , 2013 .

[22]  Changiz Valmohammadi,et al.  Key performance indicators measurement in service business: a fuzzy VIKOR approach , 2016 .

[23]  Hans Wilhelm Alfen,et al.  A comparison of Project Finance and the Forfeiting Model as financing forms for PPP projects in Germany , 2008 .

[24]  Mohan M. Kumaraswamy,et al.  Identifying the critical success factors for relationship management in PPP projects , 2014 .

[25]  Nilesh Agarchand,et al.  Sustainable infrastructure development challenges through PPP procurement process: Indian perspective , 2017 .

[26]  A. Akintoye,et al.  Critical success factors for PPP/PFI projects in the UK construction industry , 2005 .

[27]  Van Truong Luu,et al.  Improving project management performance of large contractors using benchmarking approach , 2008 .

[28]  M. Loosemore,et al.  Implementing systems thinking to manage risk in public private partnership projects , 2015 .

[29]  Peter E.D. Love,et al.  From design to operations: a process management life-cycle performance measurement system for Public-Private Partnerships , 2018 .

[30]  Champika Lasanthi Liyanage,et al.  Implications of the use of different payment models: The context of PPP Road Projects in the UK , 2016 .

[31]  Qiming Li,et al.  Selection of performance objectives and key performance indicators in public–private partnership projects to achieve value for money , 2009 .

[32]  P. Love,et al.  Public-Private Partnerships: A Review of Theory and Practice of Performance Measurement , 2014 .

[33]  Yusuf Tansel İç,et al.  An experimental design approach using TOPSIS method for the selection of computer-integrated manufacturing technologies , 2012 .

[34]  A. Akintoye,et al.  Perceptions of positive and negative factors influencing the attractiveness of PPP/PFI procurement for construction projects in the UK: Findings from a questionnaire survey , 2005 .

[35]  A. Hope,et al.  Review of studies on the public–private partnerships (PPP) for infrastructure projects , 2018, International Journal of Project Management.

[36]  Felix Villalba-Romero,et al.  Evaluating Success in PPP Road Projects in Europe: A Comparison of Performance Measurement Approaches , 2016 .

[37]  S. Wilkinson,et al.  Identifying critical factors affecting the effectiveness and efficiency of tendering processes in Public–Private Partnerships (PPPs): A comparative analysis of Australia and China , 2016 .

[38]  A. Neely,et al.  WHY MEASUREMENT INITIATIVES FAIL , 2000 .

[39]  Yusuf Arayici,et al.  Social cost in construction projects , 2017 .

[40]  Saad H.S. Al-Jibouri,et al.  Proposed System for Measuring Project Performance Using Process-Based Key Performance Indicators , 2012 .

[41]  Soo-Yong Kim,et al.  Performance measurement of construction firms in developing countries , 2008 .

[42]  Ghassan Aouad,et al.  Performance management in construction: a conceptual framework , 2001 .

[43]  Rosnani Mohamad,et al.  Performance indicators for public private partnership (PPP) projects in Malaysia , 2018, Journal of Economic and Administrative Sciences.

[44]  Ekambaram Palaneeswaran,et al.  Concessionaire Selection for Build-Operate-Transfer Tunnel Projects in Hong Kong , 2002 .

[45]  Robert L. K. Tiong BOT projects: Risks and securities , 1990 .

[46]  Albert P.C. Chan,et al.  Key performance indicators for measuring construction success , 2004 .

[47]  Peter E. D. Love,et al.  Construction business performance measurement: the SPM alternative , 2000, Bus. Process. Manag. J..

[48]  Tony Lawson,et al.  Reorienting Economics: On heterodox economics, themata and the use of mathematics in economics , 2004 .

[49]  S. Rane,et al.  Ranking the risk categories in international projects using the TOPSIS method , 2018 .

[50]  A. Neely,et al.  The performance prism in practice , 2001 .

[51]  Paris A. Fokaides,et al.  Multicriteria analysis for the selection of the most appropriate energy crops: the case of Cyprus , 2016 .

[52]  Iain Black,et al.  The presentation of interpretivist research , 2006 .

[53]  A. Chan,et al.  Comparative Analysis of the Success Criteria for Public–Private Partnership Projects in Ghana and Hong Kong , 2017 .

[54]  Yu-Jie Wang,et al.  Applying FMCDM to evaluate financial performance of domestic airlines in Taiwan , 2008, Expert Syst. Appl..

[55]  Peter E.D. Love,et al.  Future Proofing PPPs: Life-Cycle Performance Measurement and Building Information Modelling , 2015 .

[56]  Dongping Fang,et al.  A life‐cycle risk management framework for PPP infrastructure projects , 2008 .

[57]  R. Levitt,et al.  Beyond 'one size fits all': how local conditions shape PPP-enabling field development , 2011 .

[58]  Raja R. A. Issa,et al.  Management’s Perception of Key Performance Indicators for Construction , 2003 .

[59]  Catherine L. Wang,et al.  Commitment or contract: what drives performance in public private partnerships? , 2008 .

[60]  J. Kitzinger The methodology of focus groups: the importance of interaction between research participants , 1994 .

[61]  Chimay J. Anumba,et al.  A Knowledge Transfer Framework: the PFI context , 2006 .

[62]  Andy Neely,et al.  The success and failure of performance measurement initiatives: Perceptions of participating managers , 2002 .

[63]  Graeme Bowles,et al.  Public–private partnerships and contract negotiations: an empirical study , 2004 .

[64]  Khalid S. Al-Gahtani,et al.  Indicators for measuring performance of building construction companies in Kingdom of Saudi Arabia , 2013 .

[65]  Samuel Laryea,et al.  Nature of Tender Review Meetings , 2013 .

[66]  Sangyoon Chin,et al.  Comparable Performance Measurement System for Construction Companies , 2007 .

[67]  Jingfeng Yuan,et al.  Developing Key Performance Indicators for Public-Private Partnership Projects: Questionnaire Survey and Analysis , 2012 .

[68]  A. Gunasekaran,et al.  Performance measures and metrics in logistics and supply chain management: a review of recent literature (1995–2004) for research and applications , 2007 .

[69]  K. Verhoest,et al.  The challenge of using standard contracts in public–private partnerships , 2016 .

[70]  K. Nkrumah,et al.  Reasons for adopting Public–Private Partnership (PPP) for construction projects in Ghana , 2014 .

[71]  Andrew D.F. Price,et al.  Performance Measurement in Construction , 2004 .

[72]  T. Thorpe,et al.  KPIs: a critical appraisal of their use in construction , 2004 .

[73]  Xianhai Meng,et al.  Involvement of Facilities Management Specialists in Building Design: United Kingdom Experience , 2013 .