Towards Sustainability of Systematic Literature Reviews

Background: The software engineering community has increasingly conducted systematic literature reviews (SLR) as a means to summarize evidence from different studies and bring to light the state of the art of a given research topic. While SLR provide many benefits, they also present several problems with punctual solutions for some of them. However, two main problems still remain: the high time-/effort-consumption nature of SLR and the lack of an effective impact of SLR results in the industry, as initially expected for SLR. Aims: The main goal of this paper is to introduce a new view --- which we name Sustainability of SLR --- on how to deal with SLR aiming at reducing those problems. Method: We analyzed six reference studies published in the last decade to identify, group, and analyze the SLR problems and their interconnections. Based on such analysis, we proposed the view of Sustainability of SLR that intends to address these problems. Results: The proposed view encompasses three dimensions (social, economic, and technical) that could become SLR more sustainable in the sense that the four major problems and 31 barriers (i.e., possible causes for those problems) that we identified could be mitigated. Conclusions: The view of Sustainability of SLR intends to change the researchers' mindset to mitigate the inherent SLR problems and, as a consequence, achieve sustainable SLR, i.e., those that consume less time/effort to be conducted and updated with useful results for the industry.

[1]  R. Ayres,et al.  WEAK VERSUS STRONG SUSTAINABILITY , 2022 .

[2]  Emilia Mendes,et al.  Defining Protocols of Systematic Literature Reviews in Software Engineering: A Survey , 2017, 2017 43rd Euromicro Conference on Software Engineering and Advanced Applications (SEAA).

[3]  Jeffrey C. Carver,et al.  Automating Systematic Literature Review , 2020, Contemporary Empirical Methods in Software Engineering.

[4]  Apostolos Ampatzoglou,et al.  Identifying, categorizing and mitigating threats to validity in software engineering secondary studies , 2019, Inf. Softw. Technol..

[5]  Lorenz M. Hilty,et al.  Sustainability and ICT - An overview of the field , 2011 .

[6]  G. O’Brien,et al.  Environment, economy and society: fitting them together into sustainable development , 2002 .

[7]  Brian R. Keeble BSc Mbbs Mrcgp The Brundtland report: ‘Our common future’ , 1988 .

[8]  J. Spangenberg,et al.  Towards indicators for institutional sustainability: lessons from an analysis of Agenda 21 , 2002 .

[9]  Mehwish Riaz,et al.  Experiences Conducting Systematic Reviews from Novices' Perspective , 2010, EASE.

[10]  Pearl Brereton,et al.  Reporting systematic reviews: Some lessons from a tertiary study , 2017, Inf. Softw. Technol..

[11]  Maya Daneva,et al.  On the pragmatic design of literature studies in software engineering: an experience-based guideline , 2016, Empirical Software Engineering.

[12]  Pearl Brereton,et al.  Tools to Support Systematic Literature Reviews in Software Engineering: A Mapping Study , 2013, 2013 ACM / IEEE International Symposium on Empirical Software Engineering and Measurement.

[13]  K. Soini,et al.  Exploring the scientific discourse on cultural sustainability , 2014 .

[14]  O. Pérez-Maqueo,et al.  Socio–Ecosystemic Sustainability , 2019, Sustainability.

[15]  Komeil Raisian,et al.  Current challenges and conceptual model of green and sustainable software engineering , 2016 .

[16]  Fernando Brito e Abreu,et al.  Towards the Use of Machine Learning Algorithms to Enhance the Effectiveness of Search Strings in Secondary Studies , 2019, SBES.

[17]  Sérgio Soares,et al.  The Role of Rapid Reviews in Supporting Decision-Making in Software Engineering Practice , 2018, EASE.

[18]  Diana Liverman,et al.  Global sustainability: Toward definition , 1987 .

[19]  Maite Cabeza Gutés The concept of weak sustainability , 1996 .

[20]  Salma Imtiaz,et al.  A tertiary study: experiences of conducting systematic literature reviews in software engineering , 2013, EASE '13.

[21]  Pearl Brereton,et al.  Repeatability of systematic literature reviews , 2011, EASE.

[22]  Pearl Brereton,et al.  A systematic review of systematic review process research in software engineering , 2013, Inf. Softw. Technol..

[23]  Ruzanna Chitchyan,et al.  Sustainability Design and Software: The Karlskrona Manifesto , 2015, 2015 IEEE/ACM 37th IEEE International Conference on Software Engineering.

[24]  Mahmood Niazi,et al.  Do Systematic Literature Reviews Outperform Informal Literature Reviews in the Software Engineering Domain? An Initial Case Study , 2015 .

[25]  D. Robinson,et al.  Three pillars of sustainability: in search of conceptual origins , 2018, Sustainability Science.

[26]  Xin Huang,et al.  A Map of Threats to Validity of Systematic Literature Reviews in Software Engineering , 2016, 2016 23rd Asia-Pacific Software Engineering Conference (APSEC).

[27]  Paul Bowen,et al.  Sustainable construction: principles and a framework for attainment , 1997 .

[28]  Tony Gorschek,et al.  Contextualizing Research Evidence through Knowledge Translation in Software Engineering , 2019, EASE.

[29]  Xavier Franch,et al.  Systematic mapping study on software engineering for sustainability (SE4S) , 2014, EASE '14.

[30]  Pearl Brereton,et al.  Evidence-Based Software Engineering and Systematic Reviews , 2015 .

[31]  Elisa Yumi Nakagawa,et al.  Analysing the use of Graphical Abstracts to Support Study Selection in Secondary Studies , 2017, CIbSE.

[32]  Claes Wohlin,et al.  When to Update Systematic Literature Reviews in Software Engineering , 2020, J. Syst. Softw..

[33]  Pearl Brereton,et al.  Systematic review toolbox: a catalogue of tools to support systematic reviews , 2015, EASE.