Externalising tacit knowledge of the systematic review process

Systematic Reviews (SRs) have recently intensified in Software Engineering. However, there is a lack of work that makes explicit how the process to perform SR is in practice. The goal of this paper is externalising the process that reflects how SRs are currently performed, transforming tacit knowledge into explicit knowledge. We describe the phases and activities that compose the process and the relationship among them, and explore the iterative characteristic of this process, focusing on intra- and inter-phase iterations that are necessary to conduct the process appropriately. To achieve the proposed goal, we devised the process based on practical experience acquired for several years by research groups in Software Engineering, which include graduate students and researchers who have applied SR. The process has been applied in several SRs and seems to be effective in keeping the focus of the review at all phases. Moreover, the externalisation of the process has been useful to help researchers improving the process execution quality. As the process reflects the practice and is explained in details, it can be used as a guide to better understand the SR process and its details. This shall contribute to improve all SR process phases, and hence the quality of SR results.

[1]  Kai Petersen,et al.  Systematic Mapping Studies in Software Engineering , 2008, EASE.

[2]  Kai Petersen,et al.  Identifying Strategies for Study Selection in Systematic Reviews and Maps , 2011, 2011 International Symposium on Empirical Software Engineering and Measurement.

[3]  Emilia Mendes,et al.  A Systematic Literature Review of Software Process Improvement in Small and Medium Web Companies , 2009, FGIT-ASEA.

[4]  Emilia Mendes,et al.  A Systematic Mapping on the use of Visual Data Mining to Support the Conduct of Systematic Literature Reviews , 2012, J. Softw..

[5]  Mehwish Riaz,et al.  Experiences Conducting Systematic Reviews from Novices' Perspective , 2010, EASE.

[6]  Mark Staples,et al.  Experiences using systematic review guidelines , 2006, J. Syst. Softw..

[7]  Muhammad Ali Babar,et al.  An Empirical Investigation of Systematic Reviews in Software Engineering , 2011, 2011 International Symposium on Empirical Software Engineering and Measurement.

[8]  Pearl Brereton,et al.  The impact of limited search procedures for systematic literature reviews — A participant-observer case study , 2009, 2009 3rd International Symposium on Empirical Software Engineering and Measurement.

[9]  Clive Jefferies,et al.  Length and readability of structured software engineering abstracts , 2008, IET Softw..

[10]  Cheng Zhang,et al.  Search Engine Overlaps : Do they agree or disagree? , 2007, Second International Workshop on Realising Evidence-Based Software Engineering (REBSE '07).

[11]  Natalia Juristo Juzgado,et al.  Developing search strategies for detecting relevant experiments , 2009, Empirical Software Engineering.

[12]  Paula Gomes Mian,et al.  Systematic Review in Software Engineering , 2005 .

[13]  Muhammad Ali Babar,et al.  Identifying relevant studies in software engineering , 2011, Inf. Softw. Technol..

[14]  Pearl Brereton,et al.  Performing systematic literature reviews in software engineering , 2006, ICSE.

[15]  O. Dieste,et al.  Developing Search Strategies for Detecting Relevant Experiments for Systematic Reviews , 2007, First International Symposium on Empirical Software Engineering and Measurement (ESEM 2007).

[16]  Daniela Cruzes,et al.  Recommended Steps for Thematic Synthesis in Software Engineering , 2011, 2011 International Symposium on Empirical Software Engineering and Measurement.

[17]  Tore Dybå,et al.  Applying Systematic Reviews to Diverse Study Types: An Experience Report , 2007, First International Symposium on Empirical Software Engineering and Measurement (ESEM 2007).

[18]  Pearl Brereton,et al.  Lessons from applying the systematic literature review process within the software engineering domain , 2007, J. Syst. Softw..

[19]  Emilia Mendes,et al.  Empirical Studies of Pair Programming for CS/SE Teaching in Higher Education: A Systematic Literature Review , 2011, IEEE Transactions on Software Engineering.

[20]  Pearl Brereton,et al.  Refining the systematic literature review process—two participant-observer case studies , 2010, Empirical Software Engineering.

[21]  Emilia Mendes,et al.  A systematic review of Web engineering research , 2005, 2005 International Symposium on Empirical Software Engineering, 2005..

[22]  Muhammad Ali Babar,et al.  Systematic reviews in software engineering: An empirical investigation , 2013, Inf. Softw. Technol..

[23]  Stephen G. MacDonell,et al.  Comparing Local and Global Software Effort Estimation Models -- Reflections on a Systematic Review , 2007, First International Symposium on Empirical Software Engineering and Measurement (ESEM 2007).

[24]  Tore Dybå,et al.  Strength of evidence in systematic reviews in software engineering , 2008, ESEM '08.

[25]  Marta López,et al.  Formalizing a Systematic Review Updating Process , 2008, 2008 Sixth International Conference on Software Engineering Research, Management and Applications.

[26]  Antonio García Cabot,et al.  Performing systematic literature review in software engineering , 2012 .

[27]  Jefferson Seide Molléri,et al.  Proposal of an Automated Approach to Support the Systematic Review of Literature Process (S) , 2013, SEKE.

[28]  Sebastian K. Boell,et al.  Are systematic reviews better, less biased and of higher quality? , 2011, ECIS.

[29]  Barbara Kitchenham,et al.  Procedures for Performing Systematic Reviews , 2004 .

[30]  Tore Dybå,et al.  A Systematic Review of Theory Use in Software Engineering Experiments , 2007, IEEE Transactions on Software Engineering.

[31]  F. C. Ferrari,et al.  A Systematic Mapping of Architectures for Embedded Software , 2012, 2012 Second Brazilian Conference on Critical Embedded Systems.