Research Findings on Empirical Evaluation of Requirements Specifications Approaches

Numerous software requirements specification (SRS) approaches have been proposed in software engineering. However, there has been little empirical evaluation of the use of these approaches in specific contexts. This paper describes the results of a mapping study, a key instrument of the evidence-based paradigm, in an effort to understand what aspects of SRS are evaluated, in which context, and by using which research method. On the basis of 46 identified and categorized primary studies, we found that understandability is the most commonly evaluated aspect of SRS, experiments are the most commonly used research method, and the academic environment is where most empirical evaluation takes place.

[1]  J. Christian Attiogbé Tool-Assisted Multi-Facet Analysis of Formal Specifications (Using Alelier-B and ProB) , 2006, IASTED Conf. on Software Engineering.

[2]  M. Petticrew,et al.  Systematic Reviews in the Social Sciences: A Practical Guide , 2005 .

[3]  Claus Pahl Proceedings of the IASTED International Conference on Software Engineering , 2008 .

[4]  Marcela Genero,et al.  Empirical Evaluation and Review of a Metrics-Based Approach for Use Case Verification , 2004, J. Res. Pract. Inf. Technol..

[5]  Marvin V. Zelkowitz,et al.  EXPERIMENTAL MODELS FOR VALIDATING COMPUTER TECHNOLOGY , 2001 .

[6]  Natalia Juristo Juzgado,et al.  A Quantitative Assessment of Requirements Engineering Publications - 1963-2006 , 2007, REFSQ.

[7]  A. Herrmann,et al.  Requirements Prioritization Based on Benefit and Cost Prediction: An Agenda for Future Research , 2008, 2008 16th IEEE International Requirements Engineering Conference.

[8]  Tore Dybå,et al.  Strength of evidence in systematic reviews in software engineering , 2008, ESEM '08.

[9]  Betty H. C. Cheng,et al.  Research Directions in Requirements Engineering , 2007, Future of Software Engineering (FOSE '07).

[10]  Lionel C. Briand,et al.  A Controlled Experiment for Evaluating Quality Guidelines on the Maintainability of Object-Oriented Designs , 2001, IEEE Trans. Software Eng..

[11]  Pearl Brereton,et al.  Systematic literature reviews in software engineering - A systematic literature review , 2009, Inf. Softw. Technol..

[12]  Roel Wieringa,et al.  Requirements Engineering: Frameworks for Understanding , 1996 .

[13]  Guilherme Horta Travassos,et al.  Scientific research ontology to support systematic review in software engineering , 2007, Adv. Eng. Informatics.

[14]  Marta López,et al.  Obtaining Well-Founded Practices about Elicitation Techniques by Means of an Update of a Previous Systematic Review , 2008, SEKE.

[15]  D. Greenwood,et al.  Introduction to Action Research , 2007 .

[16]  D. Greenwood,et al.  Introduction to Action Research: Social Research for Social Change , 1998 .

[17]  Marta López,et al.  Formalizing a Systematic Review Updating Process , 2008, 2008 Sixth International Conference on Software Engineering Research, Management and Applications.

[18]  Marco Torchiano,et al.  Empirical studies in reverse engineering: state of the art and future trends , 2007, Empirical Software Engineering.

[19]  Ian Sommerville,et al.  Towards a classification model for component-based software engineering research , 2003, 2003 Proceedings 29th Euromicro Conference.

[20]  Natalia Juristo Juzgado,et al.  Effectiveness of Requirements Elicitation Techniques: Empirical Results Derived from a Systematic Review , 2006, 14th IEEE International Requirements Engineering Conference (RE'06).

[21]  Kashif Ahmed Khan,et al.  A Systematic Review of Software Requirements Prioritization , 2006 .