An Empirical Study on the Impact of Automation on the Requirements Analysis Process

Requirements analysis is an important phase in a software project. The analysis is often performed in an informal way by specialists who review documents looking for ambiguities, technical inconsistencies and incomplete parts. Automation is still far from being applied in requirements analyses, above all since natural languages are informal and thus difficult to treat automatically. There are only a few tools that can analyse texts. One of them, called QuARS, was developed by the Istituto di Scienza e Tecnologie dell'Informazione and can analyse texts in terms of ambiguity. This paper describes how QuARS was used in a formal empirical experiment to assess the impact in terms of effectiveness and efficacy of the automation in the requirements review process of a software company.

[1]  Thomas Gilb,et al.  Software Inspection , 1994 .

[2]  Norman E. Fenton,et al.  Software Metrics: A Rigorous Approach , 1991 .

[3]  Victor R. Basili,et al.  Evolving and packaging reading technologies , 1997, J. Syst. Softw..

[4]  Barbara Ann Kitchenham,et al.  Evaluating software engineering methods and tool part 1: The evaluation context and evaluation methods , 1996, SOEN.

[5]  Stefania Gnesi,et al.  An automatic tool for the analysis of natural language requirements , 2005, Comput. Syst. Sci. Eng..

[6]  Claes Wohlin,et al.  Experimentation in software engineering: an introduction , 2000 .

[7]  Victor R. Basili,et al.  The TAME Project: Towards Improvement-Oriented Software Environments , 1988, IEEE Trans. Software Eng..

[8]  Barbara Paech,et al.  Detecting Ambiguities in Requirements Documents Using Inspections , 2001 .

[9]  M. Coleman,et al.  A computer readability formula designed for machine scoring. , 1975 .

[10]  Carolyn B. Seaman,et al.  Qualitative Methods in Empirical Studies of Software Engineering , 1999, IEEE Trans. Software Eng..

[11]  B. Kitchenham,et al.  Case Studies for Method and Tool Evaluation , 1995, IEEE Softw..

[12]  Jeffrey G. Gray,et al.  Constraint animation using an object-oriented declarative language , 2000, ACM-SE 38.

[13]  Giuseppe Lami.  QuARS: A Tool for Analyzing Requirements , 2005 .

[14]  Pete Sawyer,et al.  Requirements Engineering: A Good Practice Guide , 1997 .

[15]  KitchenhamBarbara Ann,et al.  Evaluating software engineering methods and toolpart 4 , 1996 .

[16]  Stefania Gnesi,et al.  The linguistic approach to the natural language requirements quality: benefit of the use of an automatic tool , 2001, Proceedings 26th Annual NASA Goddard Software Engineering Workshop.