A Guide to Conducting a Standalone Systematic Literature Review

Many scholars are not well trained in conducting a standalone literature review, a scholarly paper that in its entirety summarizes and synthesizes knowledge from a prior body of research. Numerous guides that exist for information systems (IS) research mainly concentrate on only certain parts of the process; few span the entire process. This paper introduces the rigorous, standardized methodology for the systematic literature review (also called systematic review) to IS scholars. This comprehensive guide extends the base methodology from the health sciences and other fields with numerous adaptations to meet the needs of methodologically diverse fields such as IS research, especially those that involve including and synthesizing both quantitative and qualitative studies. Moreover, this guide provides many examples from IS research and provides references to guides with further helpful details for conducting a rigorous and valuable literature review. Although tailored to IS research, it is sufficiently broad to be applicable and valuable to scholars from any social science field.

[1]  John L. Cotton,et al.  Employee Turnover: A Meta-Analysis and Review with Implications for Research , 1986 .

[2]  J. Temple Conducting Research Literature Reviews: from the Internet to Paper, 2nd edn , 2006 .

[3]  Elena Gorbacheva,et al.  Achieving Rigor in Literature Reviews: Insights from Qualitative Data Analysis and Tool-Support , 2015, Commun. Assoc. Inf. Syst..

[4]  R. Rosenthal,et al.  Meta-analysis: recent developments in quantitative methods for literature reviews. , 2001, Annual review of psychology.

[5]  Soon Ang,et al.  Turnover of Information Technology Professionals: A Narrative Review, Meta-Analytic Structural Equation Modeling, and Model Development , 2007, MIS Q..

[6]  Vaughn F. Graham The literature review: a step-by-step guide for students , 2011 .

[7]  Julian Birkinshaw,et al.  Scientific Collaboration Results in Higher Citation Rates of Published Articles , 2006, Pharmacotherapy.

[8]  Charles Oppenheim,et al.  Online Information Review , 2015 .

[9]  Rosaline S Barbour,et al.  Checklists for improving rigour in qualitative research: a case of the tail wagging the dog? , 2001, BMJ : British Medical Journal.

[10]  Tauno Kekäle,et al.  The “dos and don'ts” of writing a journal article , 2009 .

[11]  Penny M. Beile,et al.  Scholars Before Researchers: On the Centrality of the Dissertation Literature Review in Research Preparation , 2005 .

[12]  B. Green,et al.  Quantitative methods for literature reviews. , 1984, Annual review of psychology.

[13]  Jonathan A C Sterne,et al.  Systematic reviews in health care: Investigating and dealing with publication and other biases in meta-analysis. , 2001, BMJ.

[14]  Richard T. Watson,et al.  Analyzing the Past to Prepare for the Future: Writing a Literature Review , 2002, MIS Q..

[15]  Yoram Zeira,et al.  Human Resources Management in International Joint Ventures: Directions for Research , 1987 .

[16]  Susan J. Winter,et al.  The Role of IT in the Transformation of Work: A Comparison of Post-Industrial, Industrial, and Proto-Industrial Organization , 1996, Inf. Syst. Res..

[17]  Richard D. Johnson,et al.  The Multilevel and Multifaceted Character of Computer Self-Efficacy: Toward Clarification of the Construct and an Integrative Framework for Research , 1998, Inf. Syst. Res..

[18]  Brian S. Butler,et al.  Power and Information Technology Research: A Metatriangulation Review , 2002, MIS Q..

[19]  L. Hedges,et al.  Introduction to Meta‐Analysis , 2009, International Coaching Psychology Review.

[20]  Pearl Brereton,et al.  Lessons learnt Undertaking a Large-scale Systematic Literature Review , 2008, EASE.

[21]  Izak Benbasat,et al.  A Theoretical Perspective of Negotiation Support Systems , 1992, J. Manag. Inf. Syst..

[22]  Dov Te'eni,et al.  Review: A Cognitive-Affective Model of Organizational Communication for Designing IT , 2001, MIS Q..

[23]  R. Green,et al.  Observations from the Field , 2006 .

[24]  Michael D. Myers,et al.  A Set of Principles for Conducting and Evaluating Interpretive Field Studies in Information Systems , 1999, MIS Q..

[25]  J. L. Pierce,et al.  Task Design: A Literature Review , 1976 .

[26]  Chitu Okoli,et al.  A Guide to Conducting a Systematic Literature Review of Information Systems Research , 2010 .

[27]  M. Petticrew,et al.  Systematic Reviews in the Social Sciences: A Practical Guide , 2005 .

[28]  James Jaccard,et al.  Theory Construction and Model-Building Skills: A Practical Guide for Social Scientists , 2009 .

[29]  Joseph A. Maxwell,et al.  Literature Reviews of, and for, Educational Research: A Commentary on Boote and Beile’s “Scholars Before Researchers” , 2006 .

[30]  Richard E. Ferdig,et al.  Commentary: Expanding Notions of Acceptable Research Evidence in Educational Technology--A Response to Schrum et al. , 2006 .

[31]  Ricky W. Griffin,et al.  Perceived Task Characteristics and Employee Performance: A Literature Review , 1981 .

[32]  N. Prabha Unnithan,et al.  The Researcher, the Topic, and the Literature: A Procedure for Systematizing Literature Searches , 1991 .

[33]  Jonathan Wareham,et al.  Theoretical Foundations of Empirical Research on Interorganizational Systems: Assessing Past Contributions and Guiding Future Directions , 2008, J. Assoc. Inf. Syst..

[34]  Pearl Brereton,et al.  Lessons from applying the systematic literature review process within the software engineering domain , 2007, J. Syst. Softw..

[35]  Line Dubé,et al.  Rigor in Information Systems Positivist Case Research: Current Practices , 2003, MIS Q..

[36]  James Hartley,et al.  Abstracts, introductions and discussions: How far do they differ in style? , 2003, Scientometrics.

[37]  John E. Hunter,et al.  The Discard of Study Evidence by Literature Reviewers , 1994 .

[38]  S. Erduran,et al.  TAPping into argumentation: Developments in the application of Toulmin's Argument Pattern for studying science discourse , 2004 .

[39]  T. Greenhalgh,et al.  Realist review - a new method of systematic review designed for complex policy interventions , 2005, Journal of health services research & policy.

[40]  Stephen K. Donovan,et al.  The Importance of Resubmitting Rejected Papers , 2007 .

[41]  Elfi Furtmueller,et al.  Using grounded theory as a method for rigorously reviewing literature , 2013, Eur. J. Inf. Syst..

[42]  Fred D. Davis,et al.  Dead Or Alive? The Development, Trajectory And Future Of Technology Adoption Research , 2007, J. Assoc. Inf. Syst..

[43]  M. Petty,et al.  A Meta-Analysis of the Relationships Between Individual Job Satisfaction and Individual Performance , 1984 .

[44]  Patricia Carlson,et al.  A Review of MIS Research and Disciplinary Development , 1992, J. Manag. Inf. Syst..

[45]  Ken Hyland,et al.  Self-citation and Self-reference: Credibility and Promotion in Academic Publication , 2003, J. Assoc. Inf. Sci. Technol..

[46]  Pearl Brereton,et al.  Performing systematic literature reviews in software engineering , 2006, ICSE.

[47]  Randall B. Dunham,et al.  Shift Work: A Review and Theoretical Analysis , 1977 .

[48]  Pearl Brereton,et al.  Systematic literature reviews in software engineering - A systematic literature review , 2009, Inf. Softw. Technol..

[49]  Kenneth L. Kraemer,et al.  Review: Information Technology and Organizational Performance: An Integrative Model of IT Business Value , 2004, MIS Q..

[50]  D. Bem Writing a Review Article for Psychological Bulletin , 1995 .

[51]  Björn Niehaves,et al.  Standing on the Shoulders of Giants: Challenges and Recommendations of Literature Search in Information Systems Research , 2015, Commun. Assoc. Inf. Syst..

[52]  Daniel S. Weld,et al.  Automatically refining the wikipedia infobox ontology , 2008, WWW.

[53]  Petri Mannonen,et al.  Enriching Literature Reviews with Computer-Assisted Research Mining. Case: Profiling Group Support Systems Research , 2007, 2007 40th Annual Hawaii International Conference on System Sciences (HICSS'07).

[54]  Forbes Gibb,et al.  Meaning in philosophy and meaning in information retrieval (IR) , 2009, J. Documentation.

[55]  C. Hart Doing a literature review: releasing the social science research imagination. , 1998 .

[56]  Dorothy E. Leidner,et al.  Review: Knowledge Management and Knowledge Management Systems: Conceptual Foundations and Research Issues , 2001, MIS Q..

[57]  Samuel B. Bacharach,et al.  Organizational Theories: Some Criteria for Evaluation , 1989 .

[58]  Dorothy E. Leidner,et al.  Review: A Review of Culture in Information Systems Research: Toward a Theory of Information Technology Culture Conflict , 2006, MIS Q..

[59]  Elizabeth Wolfe Morrison,et al.  Impression Management in the Feedback-Seeking Process: A Literaturereview and Research Agenda , 1991 .

[60]  Blake Ives,et al.  Review: IT-Dependent Strategic Initiatives and Sustained Competitive Advantage: A Review and Synthesis of the Literature , 2005, MIS Q..

[61]  Les Todres,et al.  Strategies for Disseminating Qualitative Research Findings: Three Exemplars , 2007 .

[62]  Robert Rosenthal,et al.  WRITING META-ANALYTIC REVIEWS , 1995 .

[63]  M. Wade,et al.  Review: the resource-based view and information systems research: review, extension, and suggestions for future research , 2004 .

[64]  Gwenn W. Gröndal,et al.  Meta-analytic procedures for social research , 1993 .

[65]  C. Chow,et al.  Are Articles in “Top” Management Journals Necessarily of Higher Quality? , 2007 .

[66]  Péter Jacsó The dimensions of cited reference enhanced database subsets , 2007, Online Inf. Rev..

[67]  D. Rousseau,et al.  Evidence in Management and Organizational Science: Assembling the Field's Full Weight of Scientific Knowledge through Syntheses , 2008 .

[68]  Yair Levy,et al.  A Systems Approach to Conduct an Effective Literature Review in Support of Information Systems Research , 2006, Informing Sci. Int. J. an Emerg. Transdiscipl..

[69]  Byung-Won On,et al.  Are your citations clean? , 2007, CACM.

[70]  Björn Niehaves,et al.  Reconstructing the giant: On the importance of rigour in documenting the literature search process , 2009, ECIS.

[71]  Arlene Fink,et al.  Conducting research literature reviews : from the internet to paper , 2014 .

[72]  Hannah Gascho Rempel,et al.  Providing Information Literacy Instruction to Graduate Students through Literature Review. , 2008, Issues in Science and Technology Librarianship.

[73]  Maryam Alavi,et al.  Revisiting DSS Implementation Research: A Meta-Analysis of the Literature and Suggestions for Researchers , 1992, MIS Q..

[74]  Teresa Moore,et al.  What Experienced Collaborators Say About Collaborative Writing , 1987 .

[75]  J. Popay,et al.  Synthesizing Qualitative and Quantitative Health Evidence: A Guide to Methods , 2007 .

[76]  Mary Tate,et al.  Beyond synthesis: re-presenting heterogeneous research literature , 2013 .

[77]  Chitu Okoli,et al.  A Critical Realist Guide to Developing Theory with Systematic Literature Reviews , 2012 .

[78]  Julia Hüttner The genre(s) of student writing: developing writing models , 2008 .

[79]  Joseph Osuji,et al.  Using Grounded theory as a method of inquiry : advantages and disadvantages , 2014 .