Finding Component State Transition Model Elements Using Neural Networks: An Empirical Study

Use cases are popular for writing specifications of a system. However, despite their semi-structured nature, it is often time consuming and error-prone to generate component state transition diagrams from use case documents as it is done manually. While attempts to automate model generation from requirements have increased with the advent of deep neural networks (DNNs), there are limited studies in which a neural network architecture successfully extracts information used to construct a component state transition diagram from use cases. In this paper, we investigate the effectiveness of four different neural network architectures using glove and dependency embeddings to find model elements of component state transition diagrams from use case descriptions. Our results from the study show that we may achieve performance equivalent to humans with F1-scores greater than 0.80 for each model element on test data.

[1]  Sabine Buchholz,et al.  Introduction to the CoNLL-2000 Shared Task Chunking , 2000, CoNLL/LLL.

[2]  Anders Krogh,et al.  Introduction to the theory of neural computation , 1994, The advanced book program.

[3]  Raja Touahni,et al.  Automatic generation of UML sequence diagrams from user stories in Scrum process , 2015, 2015 10th International Conference on Intelligent Systems: Theories and Applications (SITA).

[4]  Yue Zhang,et al.  Automatic early defects detection in use case documents , 2014, ASE.

[5]  Raja Touahni,et al.  Automatic Transformation of User Stories into UML Use Case Diagrams using NLP Techniques , 2018, ANT/SEIT.

[6]  Sebastian Ruder,et al.  An Overview of Multi-Task Learning in Deep Neural Networks , 2017, ArXiv.

[7]  Hyunsook Do,et al.  Exposing the susceptibility of off-nominal behaviors in reactive system requirements , 2015, 2015 IEEE 23rd International Requirements Engineering Conference (RE).

[8]  Hang Li,et al.  Convolutional Neural Network Architectures for Matching Natural Language Sentences , 2014, NIPS.

[9]  Jan Mendling,et al.  Process Model Generation from Natural Language Text , 2011, CAiSE.

[10]  John Mylopoulos,et al.  GaiusT: supporting the extraction of rights and obligations for regulatory compliance , 2013, Requirements Engineering.

[11]  Luisa Mich,et al.  Market research for requirements analysis using linguistic tools , 2004, Requirements Engineering.

[12]  Irem Y. Tumer,et al.  A Graph-Based Fault Identification and Propagation Framework for Functional Design of Complex Systems , 2008 .

[13]  Wojciech Zaremba,et al.  An Empirical Exploration of Recurrent Network Architectures , 2015, ICML.

[14]  Peter Jansen,et al.  Creating Causal Embeddings for Question Answering with Minimal Supervision , 2016, EMNLP.

[15]  Lionel C. Briand,et al.  aToucan: An Automated Framework to Derive UML Analysis Models from Use Case Models , 2015, TSEM.

[16]  Hyunsook Do,et al.  A Combinatorial Approach for Exposing Off-Nominal Behaviors , 2018, 2018 IEEE/ACM 40th International Conference on Software Engineering (ICSE).

[17]  Hyunsook Do,et al.  Automated Identification of Component State Transition Model Elements from Requirements , 2017, 2017 IEEE 25th International Requirements Engineering Conference Workshops (REW).

[18]  Jason Weston,et al.  A unified architecture for natural language processing: deep neural networks with multitask learning , 2008, ICML '08.

[19]  Clémentine Nebut,et al.  Model-Driven Engineering for Requirements Analysis , 2007, 11th IEEE International Enterprise Distributed Object Computing Conference (EDOC 2007).

[20]  Imran Sarwar Bajwa,et al.  NL2 Alloy: A Tool to Generate Alloy from NL Constraints , 2012, J. Digit. Inf. Manag..

[21]  Ron Artstein,et al.  Inter-annotator Agreement , 2017 .

[22]  Yinglin Wang,et al.  Extracting Software Functional Requirements from Free Text Documents , 2009, 2009 International Conference on Information and Multimedia Technology.

[23]  Rebecca J. Passonneau,et al.  Relation between Agreement Measures on Human Labeling and Machine Learning Performance: Results from an Art History Domain , 2008, LREC.

[24]  Xiaochen Li,et al.  Deep Learning in Software Engineering , 2018, ArXiv.

[25]  Sjaak Brinkkemper,et al.  Automated Extraction of Conceptual Models from User Stories via NLP , 2016, 2016 IEEE 24th International Requirements Engineering Conference (RE).

[26]  Omer Levy,et al.  Dependency-Based Word Embeddings , 2014, ACL.

[27]  Ying Chen,et al.  Detection of Entity Mentions Occuring in English and Chinese Text , 2005, HLT.

[28]  Wojciech Zaremba,et al.  Recurrent Neural Network Regularization , 2014, ArXiv.

[29]  Jeffrey Pennington,et al.  GloVe: Global Vectors for Word Representation , 2014, EMNLP.