Addressing the challenges of requirements ambiguity: A review of empirical literature

Ambiguity in natural language requirements has long been recognized as an inevitable challenge in requirements engineering (RE). Various initiatives have been taken by RE researchers to address the challenges of ambiguity. In this paper the results of a mapping study are presented that focus on the application of Natural Language Processing (NLP) techniques for addressing ambiguity in requirements. Systematic review of the literature resulted in 174 studies on the subject published during 1995 to 2015, and out of these only 28 are empirically evaluated studies that were selected. From of the resulting set of papers, 81% have focused on detecting ambiguity; whereas 4% and 5% are focusing on reducing and removing ambiguity respectively. Addressing syntactic, semantic, and lexical ambiguities has attracted more attention than other types. In spite of all the research efforts, there is a lack of empirical evaluation of NLP tools and techniques for addressing ambiguity in requirements. The results have pointed out some gaps in empirical results and have raised questions the designing of an analytical framework for research in this field.

[1]  Naveed Ikram,et al.  Systematic reviews in requirements engineering: A tertiary study , 2014, 2014 IEEE 4th International Workshop on Empirical Requirements Engineering (EmpiRE).

[2]  Alistair Mavin,et al.  Easy Approach to Requirements Syntax (EARS) , 2009, 2009 17th IEEE International Requirements Engineering Conference.

[3]  Daniel M. Berry,et al.  Ambiguity in Natural Language Requirements Documents , 2008, Monterey Workshop.

[4]  Giuseppe Lami,et al.  An Empirical Study on the Impact of Automation on the Requirements Analysis Process , 2007, Journal of Computer Science and Technology.

[5]  Pearl Brereton,et al.  Performing systematic literature reviews in software engineering , 2006, ICSE.

[6]  Didar Zowghi,et al.  On the Role of Ambiguity in RE , 2010, REFSQ.

[7]  Olga Ormandjieva,et al.  Toward a text classification system for the quality assessment of software requirements written in natural language , 2007, SOQUA '07.

[8]  Alistair Mavin,et al.  Big Ears (The Return of "Easy Approach to Requirements Engineering") , 2010, 2010 18th IEEE International Requirements Engineering Conference.

[9]  Luisa Mich,et al.  Market research for requirements analysis using linguistic tools , 2004, Requirements Engineering.

[10]  Benedikt Gleich,et al.  Ambiguity Detection: Towards a Tool Explaining Ambiguity Sources , 2010, REFSQ.

[11]  Mehrdad Sabetzadeh,et al.  Automatic Checking of Conformance to Requirement Boilerplates via Text Chunking: An Industrial Case Study , 2013, 2013 ACM / IEEE International Symposium on Empirical Software Engineering and Measurement.

[12]  Giuseppe Lipari,et al.  Pragmatic ambiguity detection in natural language requirements , 2014, 2014 IEEE 1st International Workshop on Artificial Intelligence for Requirements Engineering (AIRE).

[13]  Stefania Gnesi,et al.  Using collective intelligence to detect pragmatic ambiguities , 2012, 2012 20th IEEE International Requirements Engineering Conference (RE).

[14]  Giuseppe Lami,et al.  An Empirical Study on the Relationship between Defective Requirements and Test Failures , 2006, 2006 30th Annual IEEE/NASA Software Engineering Workshop.

[15]  Bashar Nuseibeh,et al.  Extending Nocuous Ambiguity Analysis for Anaphora in Natural Language Requirements , 2010, 2010 18th IEEE International Requirements Engineering Conference.

[16]  Colin J. Neill,et al.  Requirements Engineering: The State of the Practice , 2003, IEEE Softw..

[17]  Bashar Nuseibeh,et al.  Automatic detection of nocuous coordination ambiguities in natural language requirements , 2010, ASE '10.

[18]  Francis Chantree,et al.  Identifying Nocuous Ambiguities in Natural Language Requirements , 2006, 14th IEEE International Requirements Engineering Conference (RE'06).

[19]  Erik Kamsties,et al.  Ambiguity in Requirements Specification , 2004 .

[20]  Barbara Paech,et al.  Detecting Ambiguities in Requirements Documents Using Inspections , 2001 .

[21]  Annie I. Antón,et al.  Identifying and classifying ambiguity for regulatory requirements , 2014, 2014 IEEE 22nd International Requirements Engineering Conference (RE).

[22]  Didar Zowghi,et al.  Reasoning about inconsistencies in natural language requirements , 2005, TSEM.

[23]  Luisa Mich,et al.  On the Use of Ambiguity Measures in Requirements Analysis , 2001, NLDB.

[24]  Fabian de Bruijn,et al.  Ambiguity in Natural Language Software Requirements: A Case Study , 2010, REFSQ.

[25]  Giuseppe Lami.  QuARS: A Tool for Analyzing Requirements , 2005 .

[26]  Imran Sarwar Bajwa,et al.  Minimizing ambiguity in natural language software requirements specification , 2011, 2011 Sixth International Conference on Digital Information Management.

[27]  Miles Osborne,et al.  Processing natural language software requirement specifications , 1996, Proceedings of the Second International Conference on Requirements Engineering.

[28]  Stephen P. Boyd,et al.  Measuring the expressiveness of a constrained natural language: an empirical study , 2005, 13th IEEE International Conference on Requirements Engineering (RE'05).

[29]  Jantima Polpinij.  An ontology-based text processing approach for simplifying ambiguity of requirement specifications , 2009, 2009 IEEE Asia-Pacific Services Computing Conference (APSCC).

[30]  Luisa Mich,et al.  NL-OOPS: from natural language to object oriented requirements using the natural language processing system LOLITA , 1996, Natural Language Engineering.

[31]  Michel R. V. Chaudron,et al.  Requirement Ambiguity Not as Important as Expected - Results of an Empirical Evaluation , 2013, REFSQ.

[32]  Gerald M. Weinberg,et al.  Exploring Requirements: Quality Before Design , 1989 .

[33]  Kai Petersen,et al.  Systematic Mapping Studies in Software Engineering , 2008, EASE.

[34]  Elena Gabriela Barrantes,et al.  Automated Detection of Language Issues Affecting Accuracy, Ambiguity and Verifiability in Software Requirements Written in Natural Language , 2010, NAACL.

[35]  Erik Kamsties,et al.  Understanding Ambiguity in Requirements Engineering , 2005 .

[36]  Daniel M. Berry,et al.  The Design of SREE - A Prototype Potential Ambiguity Finder for Requirements Specifications and Lessons Learned , 2013, REFSQ.

[37]  Antonio Bucchiarone,et al.  An experience in using a tool for evaluating a large set of natural language requirements , 2010, SAC '10.

[38]  Alistair Mavin,et al.  EARS (Easy Approach to Requirements Syntax) , 2009 .

[39]  Tor Stålhane,et al.  The DODT tool applied to sub-sea software , 2014, 2014 IEEE 22nd International Requirements Engineering Conference (RE).

[40]  Noraini Ibrahim,et al.  Documenting requirements specifications using natural language requirements boilerplates , 2014, 2014 8th. Malaysian Software Engineering Conference (MySEC).