Systematic reviews in requirements engineering: A tertiary study

There has been an increasing interest in conducting Systematic Literature Reviews (SLR) among Requirements Engineering (RE) researchers in recent years. However, so far there have been no tertiary studies conducted to provide a comprehensive overview of these published SLR in RE. In this paper we present a tertiary study of SLR that focus solely on RE related topics by following the guidelines of Evidence Based Software Engineering. We have conducted both automated search of major online sources and manual search of the RE and SLR related conferences and journals. Our tertiary study has identified 53 distinct systematic reviews published from 2006 to 2014 and reported in 64 publications. We have assessed the resulting SLR for their quality, and coverage of specific RE related topics thus identifying some gaps. We have observed that the quality of SLR in RE has been decreasing over the recent years. There is a strong need to replicate some of these SLR to increase the reliability of their results for future RE research.

[1]  Barbara Paech,et al.  Does Involving Users in Software Development Really Influence System Success? , 2013, IEEE Software.

[2]  Irene Garrigós,et al.  Web Engineering Approaches for Requirement Analysis - A Systematic Literature Review , 2010, WEBIST.

[3]  Edin Arnautovic,et al.  Comprehensive Integrated Checklists for Requirements Engineering and Software Project Management , 2013, 2013 International Conference on Information Science and Applications (ICISA).

[4]  Tony Gorschek,et al.  Technology transfer decision support in requirements engineering research: a systematic review of REj , 2009, Requirements Engineering.

[5]  Daniel Mellado,et al.  A systematic review of security requirements engineering , 2010, Comput. Stand. Interfaces.

[6]  Austen Rainer,et al.  An assessment of published evaluations of requirements management tools , 2009, EASE.

[7]  Liming Zhu,et al.  Preliminary results of a systematic review on requirements evolution , 2012, EASE.

[8]  Muneera Bano,et al.  Evidence in Requirements Engineering: A Systematic Literature Review Protocol , 2011, ICSEA 2011.

[9]  Márcio de Oliveira Barros,et al.  A Systematic Review of Software Requirements Selection and Prioritization Using SBSE Approaches , 2013, SSBSE.

[10]  Jeffrey C. Carver,et al.  A systematic literature review to identify and classify software requirement errors , 2009, Inf. Softw. Technol..

[11]  Dirk Basten,et al.  Knowledge Creation in Requirements Engineering - A Systematic Literature Review , 2013, Wirtschaftsinformatik.

[12]  George Valença,et al.  Accepted Manuscript Requirements Engineering for Software Product Lines: a Systematic Literature Review Accepted Manuscript Requirements Engineering for Software Product Lines: a Systematic Literature Review Accepted Manuscript , 2022 .

[13]  Marta López,et al.  Updating a Systematic Review about Selection of Software Requirements Elicitation Techniques , 2008, WER.

[14]  Paul Grünbacher,et al.  Requirements for product derivation support: Results from a systematic literature review and an expert survey , 2010, Inf. Softw. Technol..

[15]  Sabine Teufl,et al.  Requirements for a Model-based Requirements Engineering Tool for Embedded Systems : Systematic Literature Review and Survey , 2013 .

[16]  Muneera Bano,et al.  User involvement in software development and system success: a systematic literature review , 2013, EASE '13.

[17]  Maya Daneva,et al.  Cloud computing security requirements: A systematic review , 2012, 2012 Sixth International Conference on Research Challenges in Information Science (RCIS).

[18]  Barbara Paech,et al.  Understanding the Influence of User Participation and Involvement on System Success – a Systematic Mapping Study , 2015, Empirical Software Engineering.

[19]  Natalia Juristo Juzgado,et al.  Effectiveness of Requirements Elicitation Techniques: Empirical Results Derived from a Systematic Review , 2006, 14th IEEE International Requirements Engineering Conference (RE'06).

[20]  Rafael Prikladnicki,et al.  A Systematic Literature Review of Requirements Engineering in Distributed Software Development Environments , 2009, ICEIS.

[21]  Betty H. C. Cheng,et al.  Research Directions in Requirements Engineering , 2007, Future of Software Engineering (FOSE '07).

[22]  Joaquín Nicolás,et al.  Risks and Safeguards for the Requirements Engineering Process in Global Software Development , 2009, 2009 Fourth IEEE International Conference on Global Software Engineering.

[23]  Carla Pacheco,et al.  APPLYING TO STAKEHOLDER IDENTIFICATION METHODS IN REQUIREMENTS ENGINEERING , 2009 .

[24]  Pearl Brereton,et al.  Systematic literature reviews in software engineering - A tertiary study , 2010, Inf. Softw. Technol..

[25]  Martin Höst,et al.  Managing Quality Requirements: A Systematic Review , 2010, 2010 36th EUROMICRO Conference on Software Engineering and Advanced Applications.

[26]  Ricardo Melo Bastos,et al.  Systematic Review of Requirements Reuse , 2009, SEKE.

[27]  Kashif Ahmed Khan,et al.  A Systematic Review of Software Requirements Prioritization , 2006 .

[28]  Dong Sun,et al.  A Survey of RE-specific Wikis for Distributed Requirements Engineering , 2012, 2012 Eighth International Conference on Semantics, Knowledge and Grids.

[29]  Salma Imtiaz,et al.  Causes of requirement change - A systematic literature review , 2012, EASE.

[30]  Bashar Nuseibeh,et al.  Requirements engineering: a roadmap , 2000, ICSE '00.

[31]  Lionel C. Briand,et al.  A systematic review of transformation approaches between user requirements and analysis models , 2011, Requirements Engineering.

[32]  Silvia Mara Abrahão,et al.  Requirements Engineering in the Development of Multi-Agent Systems: A Systematic Review , 2009, IDEAL.

[33]  Ali Idri,et al.  Requirements engineering education: a systematic mapping study , 2013, Requirements Engineering.

[34]  Yvan Labiche,et al.  Requirement-based Software Testing With the UML: A Systematic Mapping Study , 2012, ICSEA 2012.

[35]  Phani Saripalli,et al.  Decision support material to incorporate quality requirements technologies: a systematic literature review and industrial interviews , 2010 .

[36]  Tony Gorschek,et al.  Requirements Traceability: a Systematic Review and Industry Case Study , 2012, Int. J. Softw. Eng. Knowl. Eng..

[37]  Ruth Breu,et al.  The Impact of Knowledge Sharing Platforms in Distributed Requirements Engineering Scenarios: A Systematic Review , 2013, KMO.

[38]  Daniela Cruzes,et al.  Research synthesis in software engineering: A tertiary study , 2011, Inf. Softw. Technol..

[39]  Huma Hayat Khan,et al.  Situational factors affecting Requirement Engineering process in Global Software Development , 2013, 2013 IEEE Conference on Open Systems (ICOS).

[40]  João Pimentel,et al.  25 years of Requirements Engineering in Brazil: a systematic mapping , 2013, WER.

[41]  Pearl Brereton,et al.  Performing systematic literature reviews in software engineering , 2006, ICSE.

[42]  Mario Piattini,et al.  A Systematic Literature Review of How to Introduce Data Quality Requirements into a Software Product Development , 2010, ENASE.

[43]  Klaas Sikkel,et al.  A systematic mapping study on empirical evaluation of software requirements specifications techniques , 2009, 2009 3rd International Symposium on Empirical Software Engineering and Measurement.

[44]  Alexander Maedche,et al.  The state of the art in automated requirements elicitation , 2013, Inf. Softw. Technol..

[45]  Daniel Amyot,et al.  User Requirements Notation: The First Ten Years, The Next Ten Years (Invited Paper) , 2011, J. Softw..

[46]  Salma Imtiaz,et al.  A tertiary study: experiences of conducting systematic literature reviews in software engineering , 2013, EASE '13.

[47]  Ellen Francine Barbosa,et al.  A requirements catalog for mobile learning environments , 2013, SAC '13.

[48]  P. M. Hoener.  Cloud Computing Security Requirements and Solutions: a Systematic Literature Review , 2013 .

[49]  Natalia Juristo Juzgado,et al.  A Quantitative Assessment of Requirements Engineering Publications - 1963-2006 , 2007, REFSQ.

[50]  Mahvish Khurum,et al.  Software Requirements Triage and Selection: State-of-the-Art and State-of-Practice , 2012, 2012 19th Asia-Pacific Software Engineering Conference.

[51]  Natalia Juristo Juzgado,et al.  Systematic review and aggregation of empirical studies on elicitation techniques , 2011, IEEE Transactions on Software Engineering.

[52]  Qiao Ma,et al.  The effectiveness of requirements prioritization techniques for a medium to large number of requirements: a systematic literature review , 2009 .

[53]  Naseer Jan,et al.  Systematic Mapping of Value-based Software Engineering : A Systematic Review of Value-based Requirements Engineering , 2010 .

[54]  S. K. Saha,et al.  A systematic review on creativity techniques for requirements engineering , 2012, 2012 International Conference on Informatics, Electronics & Vision (ICIEV).

[55]  Ivan A. Garcia,et al.  A systematic literature review of stakeholder identification methods in requirements elicitation , 2012, J. Syst. Softw..

[56]  Muneera Bano,et al.  Users' involvement in requirements engineering and system success , 2013, 2013 3rd International Workshop on Empirical Requirements Engineering (EmpiRE).

[57]  Pearl Brereton,et al.  Systematic literature reviews in global software development: A tertiary study , 2012, EASE.

[58]  André L. M. Santos,et al.  Six years of systematic literature reviews in software engineering: An updated tertiary study , 2011, Inf. Softw. Technol..

[59]  Joaquín Nicolás,et al.  On the generation of requirements specifications from software engineering models: A systematic literature review , 2009, Inf. Softw. Technol..

[60]  Ivan A. Garcia,et al.  Stakeholder Identification Methods in Software Requirements: Empirical Findings Derived from a Systematic Review , 2008, 2008 The Third International Conference on Software Engineering Advances.