Endless Bad Projects or Evidence-Based Practice? An Agenda for Action

This short position paper promotes the need for more evidence based practice to underpin the successful execution of information systems (IS) projects. This research responds to the high numbers of IS projects that are seen to have failed in terms of either one or many success criteria such as: not meeting original objectives, running over budget, negatively impacting on people, processes or organizations, to name but a few. We advocate the need for the development of a more rigorous evidence base for IS research similar to those used in medicine or more recently in social studies and software engineering. For example, Systematic Literature Reviews (SLRs) and also Meta-Analysis of empirical research studies could be used more extensively within IS to compile more coherent, consistent and referable bodies of evidence and knowledge. We conclude with a 7 point action plan and suggestions for further research.

[1]  Darrel C. Ince,et al.  A Chronicling System for Children's Social Work: Learning from the ICS Failure , 2011 .

[2]  Teresa Waring,et al.  The information management and technology strategy of the UK National Health Service – Determining progress in the NHS acute hospital sector , 2000 .

[3]  S. Goldfinch,et al.  Pessimism, Computer Failure, and Information Systems Development in the Public Sector , 2007 .

[4]  Wendy L. Currie,et al.  Institutional isomorphism and change: the national programme for IT – 10 years on , 2012, J. Inf. Technol..

[5]  Sebastian K. Boell,et al.  Are systematic reviews better, less biased and of higher quality? , 2011, ECIS.

[6]  Clare Atkins,et al.  Reclaiming Knowledge: A Case for Evidence-Based Information Systems , 2000, ECIS.

[7]  Daniel Stucke.  Evidence-Based Teaching , 2019, Encyclopedia of Sustainability in Higher Education.

[8]  S. Brophy,et al.  Interventions for latent autoimmune diabetes (LADA) in adults. , 2011, The Cochrane database of systematic reviews.

[9]  Richard Heeks.  Most eGovernment-for-Development Projects Fail: How Can Risks be Reduced? , 2003 .

[10]  Elena Parmelli,et al.  The effectiveness of strategies to change organisational culture to improve healthcare performance: a systematic review , 2011, Implementation science : IS.

[11]  D. Anthony.  Evidence-based Policy: A Realist Perspective , 2007 .

[12]  Ray Pawson,et al.  Evidence-based policy: a realist perspective. , 2006 .

[13]  Daniela Cruzes,et al.  Research synthesis in software engineering: A tertiary study , 2011, Inf. Softw. Technol..

[14]  J. Eldredge.  Evidence-based librarianship: an overview. , 2000, Bulletin of the Medical Library Association.

[15]  J. Furedy,et al.  A realist perspective. , 1990 .

[16]  Daniel L. Moody,et al.  Building links between IS research and professional practice: improving the relevance and impact of IS research , 2000, ICIS.

[17]  G. Guyatt,et al.  Progress in evidence-based medicine. , 2008, JAMA.

[18]  David Wastell,et al.  Managers as Designers in the Public Services: Beyond Technomagic , 2011 .

[19]  Briony J. Oates,et al.  Evidence-based information systems: a decade later , 2011, ECIS.

[20]  David W. Wainwright,et al.  The Information Management and Technology Strategy of the UK National Health Service: Quo Vadis? , 2013, UKAIS.

[21]  Helen M. Edwards,et al.  A Model-Driven Method for the Systematic Literature Review of Qualitative Empirical Research , 2012, ICIS.

[22]  Richard Baskerville,et al.  Fashion Waves in Information Systems Research and Practice , 2009, MIS Q..

[23]  David G. Wastell.  Enabling partnership work in crime reduction: tales from the trenches of evidence-based policy , 2005 .

[24]  S. Satya‐Murti.  Evidence-based Medicine: How to Practice and Teach EBM , 1997 .

[25]  J. Car,et al.  Interventions for promoting information and communication technologies adoption in healthcare professionals. , 2009, The Cochrane database of systematic reviews.

[26]  Daniel L. Moody,et al.  Informing Science Special Series: Informing Each Other Using the World Wide Web to Connect Research and Professional Practice: towards Evidence-based Practice , 2022 .

[27]  Elena Parmelli,et al.  The effectiveness of strategies to change organisational culture to improve healthcare performance: a systematic review , 2011, Implementation science : IS.