Requirements Socio-Technical Graphs for Managing Practitioners’ Traceability Questions

To understand requirements traceability in practice, we contribute, in this paper, an automated approach to identifying questions from requirements repositories and examining their answering status. Applying our approach to 345 open-source projects results in 20 622 questions, among which 53% and 15% are classified as successfully and unsuccessfully answered, respectively. By constructing a novel requirements socio-technical graph, we explore the impact of stakeholder–artifact relationships on traceability. The number of people, surprisingly, has little influence compared to other graph-theoretic measures like the clustering coefficient. Based on the repository mining results, we formulate a set of novel hypotheses about traceability. A case study supports some hypotheses while offering new insights.

[1]  Nan Niu,et al.  Creating Socio-Technical Patches for Information Foraging: A Requirements Traceability Case Study , 2018, 2018 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC).

[2]  Gilad Mishne,et al.  Finding high-quality content in social media , 2008, WSDM '08.

[3]  Xiaoyu Jin,et al.  On the impact of social network information diversity on end-user programming productivity: a foraging-theoretic study , 2016, SSE@SIGSOFT FSE.

[4]  Mihai Surdeanu,et al.  The Stanford CoreNLP Natural Language Processing Toolkit , 2014, ACL.

[5]  Nan Niu,et al.  Tagging in Assisted Tracing , 2015, 2015 IEEE/ACM 8th International Symposium on Software and Systems Traceability.

[6]  Ilka Philippow,et al.  A Survey on Usage Scenarios for Requirements Traceability in Practice , 2013, REFSQ.

[7]  Khobaib Zaamout,et al.  Structure of Crowdsourcing Community Networks , 2018, IEEE Transactions on Computational Social Systems.

[8]  Antonio Iera,et al.  SIoT: Giving a Social Structure to the Internet of Things , 2011, IEEE Communications Letters.

[9]  Allan Collins,et al.  A spreading-activation theory of semantic processing , 1975 .

[10]  Nan Niu,et al.  Extracting and Modeling Product Line Functional Requirements , 2008, 2008 16th IEEE International Requirements Engineering Conference.

[11]  Sjaak Brinkkemper,et al.  Requirements Engineering and Continuous Deployment , 2018, IEEE Software.

[12]  Gareth J. F. Jones,et al.  The good, the bad and their kins: Identifying questions with negative scores in StackOverflow , 2015, 2015 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining (ASONAM).

[13]  Frederick P. Brooks,et al.  No Silver Bullet: Essence and Accidents of Software Engineering , 1987 .

[14]  Alex Pentland,et al.  Sensing, Understanding, and Shaping Social Behavior , 2014, IEEE Transactions on Computational Social Systems.

[15]  Yi Zhang,et al.  Strategic Traceability for Safety-Critical Projects , 2013, IEEE Software.

[16]  Christopher D. Manning,et al.  Introduction to Information Retrieval , 2010, J. Assoc. Inf. Sci. Technol..

[17]  Collin McMillan,et al.  Portfolio: Searching for relevant functions and their usages in millions of lines of code , 2013, TSEM.

[18]  Fei-Yue Wang Computational Dissemination: Toward Precision and Smart Impacts for Computational Social Systems , 2017, IEEE Trans. Comput. Soc. Syst..

[19]  Zhendong Niu,et al.  Automatically Tracing Dependability Requirements via Term-Based Relevance Feedback , 2018, IEEE Transactions on Industrial Informatics.

[20]  Andrew Begel,et al.  Codebook: discovering and exploiting relationships in software repositories , 2010, 2010 ACM/IEEE 32nd International Conference on Software Engineering.

[21]  Nan Niu,et al.  Traceability for Automated Production Systems: A Position Paper , 2017, 2017 IEEE 25th International Requirements Engineering Conference Workshops (REW).

[22]  Prem Prakash Jayaraman,et al.  Scalable Energy-Efficient Distributed Data Analytics for Crowdsensing Applications in Mobile Environments , 2015, IEEE Transactions on Computational Social Systems.

[23]  Zhendong Niu,et al.  Traceability-enabled refactoring for managing just-in-time requirements , 2014, 2014 IEEE 22nd International Requirements Engineering Conference (RE).

[24]  Chen Lin,et al.  Question microblog identification and answer recommendation , 2014, Multimedia Systems.

[25]  Shou-De Lin,et al.  Social Flocks: Simulating Crowds to Discover the Connection Between Spatial-Temporal Movements of People and Social Structure , 2018, IEEE Transactions on Computational Social Systems.

[26]  Chanchal Kumar Roy,et al.  An Insight into the Unresolved Questions at Stack Overflow , 2015, 2015 IEEE/ACM 12th Working Conference on Mining Software Repositories.

[27]  Juha Savolainen,et al.  Answering the requirements traceability questions , 2018, ICSE.

[28]  Hui Liu,et al.  Enhancing Automated Requirements Traceability by Resolving Polysemy , 2018, 2018 IEEE 26th International Requirements Engineering Conference (RE).

[29]  Christos Faloutsos,et al.  Graph mining: Laws, generators, and algorithms , 2006, CSUR.

[30]  Ling Li,et al.  Optimal Group Size for Software Change Tasks: A Social Information Foraging Perspective , 2016, IEEE Transactions on Cybernetics.

[31]  Patrick Mäder,et al.  Preventing Defects: The Impact of Requirements Traceability Completeness on Software Quality , 2017, IEEE Transactions on Software Engineering.

[32]  Tommi Mikkonen,et al.  Long-Term Product Line Sustainability with Planned Staged Investments , 2013, IEEE Software.

[33]  Audris Mockus,et al.  An Empirical Study of Speed and Communication in Globally Distributed Software Development , 2003, IEEE Trans. Software Eng..

[34]  Kathleen McKeown,et al.  Detection of Question-Answer Pairs in Email Conversations , 2004, COLING.

[35]  Jane Cleland-Huang,et al.  What Questions do Requirements Engineers Ask? , 2017, 2017 IEEE 25th International Requirements Engineering Conference (RE).

[36]  Bashar Nuseibeh,et al.  Requirements engineering: a roadmap , 2000, ICSE '00.

[37]  Nan Niu,et al.  Gray links in the use of requirements traceability , 2016, SIGSOFT FSE.

[38]  Yoginder S. Dandass,et al.  Research toward a Partially-Automated, and Crime Specific Digital Triage Process Model , 2012, Comput. Inf. Sci..

[39]  Nan Niu,et al.  On the Role of Structural Holes in Requirements Identification , 2015, ACM Trans. Manag. Inf. Syst..

[40]  Olly Gotel,et al.  An analysis of the requirements traceability problem , 1994, Proceedings of IEEE International Conference on Requirements Engineering.

[41]  Nan Niu,et al.  Departures from optimality: Understanding human analyst's information foraging in assisted requirements tracing , 2013, 2013 35th International Conference on Software Engineering (ICSE).

[42]  James D. Herbsleb,et al.  Building a socio-technical theory of coordination: why and how (outstanding research award) , 2016, SIGSOFT FSE.

[43]  Olly Gotel,et al.  Extended requirements traceability: results of an industrial case study , 1997, Proceedings of ISRE '97: 3rd IEEE International Symposium on Requirements Engineering.

[44]  Antonio Iera,et al.  The Social Internet of Things (SIoT) - When social networks meet the Internet of Things: Concept, architecture and network characterization , 2012, Comput. Networks.

[45]  Kamal Taha,et al.  Disjoint Community Detection in Networks Based on the Relative Association of Members , 2018, IEEE Transactions on Computational Social Systems.

[46]  Sugandha Lohar Supporting Natural Language Queries across the Requirements Engineering Process , 2016, REFSQ Workshops.