Automatically Tracing Dependability Requirements via Term-Based Relevance Feedback

In many critical industrial information systems, tracking a dependability requirement is instrumental to the verification and validation (V&V) of security, privacy, and other dependability concerns. Automated traceability tools employ information retrieval methods to recover candidate links, which saves much manual effort. Integrating relevance feedback (RF) could potentially improve the retrieval effectiveness by soliciting the relevance judgments on a subset of the retrieval results and then incorporating the feedback into subsequent retrieval. However, little is known about how to use RF to trace dependability requirements. In this paper, we propose a novel term-based RF algorithm that leverages the term usage context to recommend positive and negative feedback. Experiments on two software datasets show that our algorithm significantly outperforms the contemporary link-based RF tracing method. Our work not only contributes a new solution to dependability requirements’ V&V, but also enables further automation to reduce the manual effort in the development life cycle of dependable industrial systems.

[1]  Riccardo Muradore,et al.  Energy-Efficient Intrusion Detection and Mitigation for Networked Control Systems Security , 2015, IEEE Transactions on Industrial Informatics.

[2]  Nan Niu,et al.  Departures from optimality: Understanding human analyst's information foraging in assisted requirements tracing , 2013, 2013 35th International Conference on Software Engineering (ICSE).

[3]  Yingying Chen,et al.  Advanced Pattern Discovery-based Fuzzy Classification Method for Power System Dynamic Security Assessment , 2015, IEEE Transactions on Industrial Informatics.

[4]  A. Vargha,et al.  A Critique and Improvement of the CL Common Language Effect Size Statistics of McGraw and Wong , 2000 .

[5]  Insup Lee,et al.  Model-Driven Safety Analysis of Closed-Loop Medical Systems , 2014, IEEE Transactions on Industrial Informatics.

[6]  Nan Niu,et al.  Extracting and Modeling Product Line Functional Requirements , 2008, 2008 16th IEEE International Requirements Engineering Conference.

[7]  Mounia Lalmas,et al.  A survey on the use of relevance feedback for information access systems , 2003, The Knowledge Engineering Review.

[8]  Hossein Pedram,et al.  Software-Based Control Flow Checking Against Transient Faults in Industrial Environments , 2014, IEEE Transactions on Industrial Informatics.

[9]  Nan Niu,et al.  Analysis of Early Aspects in Requirements Goal Models: A Concept-Driven Approach , 2007, LNCS Trans. Aspect Oriented Softw. Dev..

[10]  Nan Niu,et al.  Unified Profiling of Attackers via Domain Modeling , 2016, 2016 IEEE 24th International Requirements Engineering Conference Workshops (REW).

[11]  Jane Huffman Hayes,et al.  Advancing candidate link generation for requirements tracing: the study of methods , 2006, IEEE Transactions on Software Engineering.

[12]  Andrea De Lucia,et al.  Adaptive User Feedback for IR-Based Traceability Recovery , 2015, 2015 IEEE/ACM 8th International Symposium on Software and Systems Traceability.

[13]  Taylor Jackson Scott,et al.  Adapting grounded theory to construct a taxonomy of affect in collaborative online chat , 2012, SIGDOC '12.

[14]  J. J. Rocchio,et al.  Relevance feedback in information retrieval , 1971 .

[15]  Jane Cleland-Huang,et al.  A comparative evaluation of two user feedback techniques for requirements trace retrieval , 2012, SAC '12.

[16]  Neil A. Ernst,et al.  Aspects across Software Life Cycle: A Goal-Driven Approach , 2009, LNCS Trans. Aspect Oriented Softw. Dev..

[17]  Nan Niu,et al.  Tagging in Assisted Tracing , 2015, 2015 IEEE/ACM 8th International Symposium on Software and Systems Traceability.

[18]  Key-Sun Choi,et al.  Taxonomy Learning using Term Specificity and Similarity , 2006, OntologyLearning@COLING/ACL.

[19]  Zhendong Su,et al.  On the naturalness of software , 2012, ICSE 2012.

[20]  Lida Xu,et al.  Enterprise Information Systems Architecture—Analysis and Evaluation , 2013, IEEE Transactions on Industrial Informatics.

[21]  Carl E. Landwehr,et al.  Basic concepts and taxonomy of dependable and secure computing , 2004, IEEE Transactions on Dependable and Secure Computing.

[22]  Nan Niu,et al.  Gray links in the use of requirements traceability , 2016, SIGSOFT FSE.