A three tier evaluation mixed method research model aiming to select an adequate MCDA method for public sector procurement

Abstract This paper presents the three tier mixed-method (TTMM) design, discusses it in relation to more traditional mixed method approaches and presents a summary of the findings of the research that originated it. This research design emerged from a project that aimed to identify a suitable multi-criteria decision analysis (MCDA) method according to legal, operational and performance requirements associated with public procurement in the Maldives. This design followed a sequential method and perspective triangulation that encompasses three different methods, namely a systematic literature review, focus group interviews and a quantitative performance analysis. The design was found to be particularly useful in enabling the systematic and evidence-based selection of one MCDA method out of more than 80 potential candidates. TTMM as a general mixed method research framework is applicable to similar research studies where the understanding of legal, operational and performance factors inform the selection of IT artefacts in specific contexts.

[1]  A. U.S.,et al.  Measuring the efficiency of decision making units , 2003 .

[2]  Ricardo Mateus,et al.  Full disclosure of tender evaluation models: Background and application in Portuguese public procurement , 2010 .

[3]  Xiaowei Xu,et al.  Multi-criteria decision making approaches for supplier evaluation and selection: A literature review , 2010, Eur. J. Oper. Res..

[4]  R. Fidel.  Are we there yet?: Mixed methods research in library and information science , 2008 .

[5]  Christian Tabi Amponsah.  APPLICATION OF MULTI-CRITERIA DECISION MAKING PROCESS TO DETERMINE CRITICAL SUCCESS FACTORS FOR PROCUREMENT OF CAPITAL PROJECTS UNDER PUBLIC-PRIVATE PARTNERSHIPS , 2011 .

[6]  Adel Guitouni,et al.  Tentative guidelines to help choosing an appropriate MCDA method , 1998, Eur. J. Oper. Res..

[7]  John W. Creswell,et al.  Designing and Conducting Mixed Methods Research , 2006 .

[8]  A. Onwuegbuzie,et al.  Mixed Methods Research: A Research Paradigm Whose Time Has Come , 2004 .

[9]  Gary R. Reeves,et al.  A multiple criteria approach to data envelopment analysis , 1999, Eur. J. Oper. Res..

[10]  Matthias Ehrgott,et al.  Multiple criteria decision analysis: state of the art surveys , 2005 .

[11]  K. Peters,et al.  Interviews in qualitative research. , 2015, Nurse researcher.

[12]  A. Weele,et al.  Purchasing and supply chain management : analysis, planning and practice , 2000 .

[13]  Wan Lung Ng,et al.  An efficient and simple model for multiple criteria supplier selection problem , 2008, Eur. J. Oper. Res..

[14]  J. Creswell,et al.  Editorial: The New Era of Mixed Methods , 2007 .

[15]  P. Fraser Johnson,et al.  Purchasing and Supply Management , 2001 .

[16]  A. Weele.  Purchasing and Supply Chain Management: Analysis, Strategy, Planning and Practice , 2009 .

[17]  Fabio Sciancalepore,et al.  Using a DEA-cross efficiency approach in public procurement tenders , 2012, Eur. J. Oper. Res..

[18]  A. Bryman.  Barriers to Integrating Quantitative and Qualitative Research , 2007 .

[19]  Evangelos Triantaphyllou,et al.  Multi-criteria Decision Making Methods: A Comparative Study , 2000 .

[20]  Guo Chao Alex Peng,et al.  Information Systems Evaluation: Methodologies and Practical Case Studies , 2013 .

[21]  Wilbur B. England.  The purchasing system , 1967 .

[22]  Valentinas Podvezko,et al.  The Comparative Analysis of MCDA Methods SAW and COPRAS , 2011 .

[23]  J. Kitzinger,et al.  Developing Focus Group Research: Politics, Theory and Practice , 1998 .

[24]  S. Chen,et al.  Information systems evaluation methodologies , 2011 .

[25]  José Ramón San Cristóbal,et al.  A multi criteria data envelopment analysis model to evaluate the efficiency of the Renewable Energy technologies , 2011 .