Semantic Frames for Classifying Temporal Requirements: An Exploratory Study

Temporal requirements express the time-related system behaviors and properties. In engineering critical systems, experience has shown that temporal requirements are the most problematic type of requirements to verify. Researchers have thus used natural language processing (NLP) techniques—most notably, part-of-speech (PoS) tagging—to develop practical classifiers to distinguish temporal requirements from non-temporal ones. In this paper, we explore frame semantics—a linguistic approach to labeling a word’s role in a sentence with respect to the events of interest—to augment the temporal requirements classification task. Our experiments of 111 requirements sentences from the regulatory documents show that the best classification accuracy of 90.9% is achieved when PoS features are replaced with, rather than combined with, frame semantics features. The results suggest the promising role of semantics-augmented NLP support in an understudied requirements engineering task.

[1]  Nan Niu,et al.  So, You Think You Know Others' Goals? A Repertory Grid Study , 2007, IEEE Software.

[2]  Allen P. Nikora,et al.  Automated Identification of LTL Patterns in Natural Language Requirements , 2009, 2009 20th International Symposium on Software Reliability Engineering.

[3]  Kevin Ryan,et al.  The role of natural language in requirements engineering , 1993, [1993] Proceedings of the IEEE International Symposium on Requirements Engineering.

[4]  Juha Savolainen,et al.  A Novel Approach to Tracing Safety Requirements and State-Based Design Models , 2020, 2020 IEEE/ACM 42nd International Conference on Software Engineering (ICSE).

[5]  Noah A. Smith,et al.  SEMAFOR 1.0: A Probabilistic Frame-Semantic Parser , 2010 .

[6]  Andreas Bollin,et al.  Requirements Engineering Fundamentals , 2015 .

[7]  Juha Savolainen,et al.  Leveraging topic modeling and part-of-speech tagging to support combinational creativity in requirements engineering , 2015, Requirements Engineering.

[8]  John B. Lowe,et al.  The Berkeley FrameNet Project , 1998, ACL.

[9]  Natarajan Shankar,et al.  ARSENAL: Automatic Requirements Specification Extraction from Natural Language , 2014, NFM.

[10]  Linda Newman,et al.  Advancing Repeated Research in Requirements Engineering: A Theoretical Replication of Viewpoint Merging , 2016, 2016 IEEE 24th International Requirements Engineering Conference (RE).

[11]  Nan Niu,et al.  Detecting Software Security Vulnerabilities Via Requirements Dependency Analysis , 2022, IEEE Transactions on Software Engineering.

[12]  Virginijus Marcinkevičius,et al.  Comparison of Naive Bayes, Random Forest, Decision Tree, Support Vector Machines, and Logistic Regression Classifiers for Text Reviews Classification , 2017, Balt. J. Mod. Comput..

[13]  C. Fillmore FRAME SEMANTICS AND THE NATURE OF LANGUAGE * , 1976 .

[14]  Allen P. Nikora,et al.  Classifying requirements: towards a more rigorous analysis of natural-language specifications , 2005, 16th IEEE International Symposium on Software Reliability Engineering (ISSRE'05).

[15]  Nan Niu,et al.  ReCVisu: A tool for clustering-based visual exploration of requirements , 2012, 2012 20th IEEE International Requirements Engineering Conference (RE).

[16]  Nan Niu,et al.  Safety Patterns for SysML: What Does OMG Specify? , 2020, ICSR.

[17]  Linda Newman,et al.  Advancing viewpoint merging in requirements engineering: a theoretical replication and explanatory study , 2017, Requirements Engineering.

[18]  Zhendong Niu,et al.  Complementarity in Requirements Tracing , 2020, IEEE Transactions on Cybernetics.

[19]  Noah A. Smith,et al.  Frame-Semantic Parsing , 2014, CL.

[20]  Zhendong Niu,et al.  Automatically Tracing Dependability Requirements via Term-Based Relevance Feedback , 2018, IEEE Transactions on Industrial Informatics.

[21]  Nan Niu,et al.  Gray links in the use of requirements traceability , 2016, SIGSOFT FSE.

[22]  Juha Savolainen,et al.  Using Obstacle Analysis to Support SysML-Based Model Testing for Cyber Physical Systems , 2018, 2018 IEEE 8th International Model-Driven Requirements Engineering Workshop (MoDRE).

[23]  Anna Sulfianti So , 2018, I Threw a Star in a Wine Glass.

[24]  Nan Niu,et al.  Extracting and Modeling Product Line Functional Requirements , 2008, 2008 16th IEEE International Requirements Engineering Conference.

[25]  Yijun Yu,et al.  On Goal-based Variability Acquisition and Analysis , 2006, 14th IEEE International Requirements Engineering Conference (RE'06).

[26]  Ling Li,et al.  A Clustering-Based Approach to Enriching Code Foraging Environment , 2016, IEEE Transactions on Cybernetics.