Understanding the Success of Strategic IT/IS Benchmarking: Results from a Multiple-Case Study

IT organizations use strategic IT/IS benchmarking to assess their performance and identify starting points to improve IT strategy, processes, or operations. However, recent studies report that they are often unable to translate benchmarking results into action and therefore do not gain performance improvements. Research has not yet offered explanations for this discrepancy. Consequently, this study has two objectives: First, we want to understand what factors impact a successful strategic IT/IS benchmarking. Second, we want to determine how knowledge of these factors can be translated into a model for explaining the success of IT/IS benchmarking. We use a qualitative research design, analyzing three cases from different industries. We found that trust, participatory leadership style, methodological transparency, and top management support are causal for stakeholder commitment. The latter, together with management support, generates willingness to act. In turn, willingness to act and the benchmarking’s integration into the strategic planning process are factors explaining the success of benchmarking. We show that for benchmarking instruments, databases, and processes, methodological excellence is a necessary but not sufficient condition for benchmarking success. Therefore, we recommend that executives establish a systemic environment assuring management support and a high level of stakeholder participation fostered by a participatory leadership.

[1]  Zahir Irani,et al.  Editorial: Benchmarking: information and communication technologies , 2003 .

[2]  Satyanarayana Parayitam,et al.  The interplay between cognitive- and affective conflict and cognition- and affect-based trust in influencing decision outcomes , 2009 .

[3]  Robert S. Dooley,et al.  Attaining Decision Quality and Commitment From Dissent: The Moderating Effects of Loyalty and Competence in Strategic Decision-Making Teams , 1999 .

[4]  Bradley L. Kirkman,et al.  Beyond Self-Management: Antecedents and Consequences of Team Empowerment , 1999 .

[5]  K. Eisenhardt Building theories from case study research , 1989, STUDI ORGANIZZATIVI.

[6]  Martin Mocker,et al.  Towards a Comprehensive Model of Information Strategy , 2005 .

[7]  Cheng-Hwai Liou,et al.  Changes in MIS research: status and themes from 1989 to 2000 , 2006, Int. J. Inf. Syst. Chang. Manag..

[8]  L. Dooley Case Study Research and Theory Building , 2002 .

[9]  Robert W. Zmud,et al.  Information Technology Planning in the 1990's: Directions for Practice and Research , 1987, MIS Q..

[10]  Clive Smallman,et al.  En route to a theory of benchmarking , 2009 .

[11]  Stephen A.W. Drew,et al.  From knowledge to action: the impact of benchmarking on organizational performance , 1997 .

[12]  Matthew Hinton,et al.  Best practice benchmarking: Delivering the goods? , 1998 .

[13]  Philipp Mayring,et al.  Combination and Integration of Qualitative and Quantitative Analysis , 2001 .

[14]  Michael D. Myers,et al.  A Set of Principles for Conducting and Evaluating Interpretive Field Studies in Information Systems , 1999, MIS Q..

[15]  Line Dubé,et al.  Rigor in Information Systems Positivist Case Research: Current Practices , 2003, MIS Q..

[17]  M. Gibbert,et al.  What passes as a rigorous case study , 2008 .

[18]  Bonnie Kaplan,et al.  Combining Qualitative and Quantitative Methods in Information Systems Research: A Case Study , 1988, MIS Q..

[19]  K. Parry,et al.  Consensual commitment: A grounded theory of the meso-level influence of organizational design on leadership and decision-making , 2009 .

[20]  Paul B. Cragg,et al.  Benchmarking information technology practices in small firms , 2002, Eur. J. Inf. Syst..

[21]  A. Langley Strategies for Theorizing from Process Data , 1999 .

[22]  Matthew Hinton,et al.  Best practice benchmarking in the UK , 2000 .

[23]  Albert Boonstra,et al.  Managing Information Systems: An Organisational Perspective , 2002 .

[24]  Izak Benbasat,et al.  The Case Research Strategy in Studies of Information Systems , 1987, MIS Q..

[25]  Gerold Riempp,et al.  A Framework for Strategic Positioning in IT Management , 2009, Wirtschaftsinformatik.

[26]  Luiz Cesar Ribeiro Carpinetti,et al.  What to benchmark , 2002 .

[27]  John Mingers,et al.  Combining IS Research Methods: Towards a Pluralist Methodology , 2001, Inf. Syst. Res..

[28]  Sandra Moffett,et al.  Benchmarking and performance measurement: a statistical analysis , 2008 .

[29]  Gerold Riempp,et al.  Towards a Framework to Structure and Assess Strategic IT/IS Management , 2008, ECIS.

[30]  Jacky Holloway,et al.  What Have We Learned? Themes from the Literature on Best-Practice Benchmarking , 2007 .

[31]  S. Raghu Raman,et al.  Middle Managers' Involvement in Strategic Planning: An Examination of Roles and Influencing Factors , 2009 .

[32]  D. Schweiger,et al.  Building Commitment, Attachment, and Trust in Strategic Decision-Making Teams: The Role of Procedural Justice , 1995 .

[33]  Pervaiz K. Ahmed,et al.  Integrated benchmarking: a holistic examination of select techniques for benchmarking analysis , 1998 .

[34]  Gerold Riempp,et al.  Towards a Strategic Positioning Method for IT Management , 2009, ICIS.

[35]  Shelley D. Dionne,et al.  Transformational leadership and team performance , 2004 .

[36]  Andy Neely,et al.  The success and failure of performance measurement initiatives: Perceptions of participating managers , 2002 .

[37]  K. Eisenhardt Better Stories and Better Constructs: The Case for Rigor and Comparative Logic , 1991 .

[38]  Barrie Dale,et al.  Benchmarking in water supply services: the lessons learnt , 1998 .

[39]  Robert C. Camp,et al.  Benchmarking: The Search for Industry Best Practices That Lead to Superior Performance , 1989 .

[40]  Gregory H. Watson,et al.  Strategic Benchmarking: How to Rate Your Company's Performance against the World's Best , 1993 .

[41]  Varun Grover,et al.  Strategic Information Systems Planning: Planning System Dimensions, Internal Coalignment, and Implications for Planning Effectiveness , 1998 .

[42]  Okke Braadbaart,et al.  Collaborative benchmarking, transparency and performance: Evidence from The Netherlands water supply industry , 2007 .

[43]  B. Pentland Building Process Theory with Narrative: from Description to Explanation , 1999 .

[44]  Patrick Dawson,et al.  Reflective decisions: the use of Socratic dialogue in managing organizational change , 2007 .

[45]  J. H. Davis,et al.  An Integrative Model Of Organizational Trust , 1995 .