Visual requirements analytics: a framework and case study

For many software projects, keeping requirements on track needs an effective and efficient path from data to decision. Visual analytics creates such a path that enables the human to extract insights by interacting with the relevant information. While various requirements visualization techniques exist, few have produced end-to-end value to practitioners. In this paper, we advance the literature on visual requirements analytics by characterizing its key components and relationships in a framework. We follow the goal–question–metric paradigm to define the framework by teasing out five conceptual goals (user, data, model, visualization, and knowledge), their specific operationalizations, and their interconnections. The framework allows us to not only assess existing approaches, but also create tool enhancements in a principled manner. We evaluate our enhanced tool support through a case study where massive, heterogeneous, and dynamic requirements are processed, visualized, and analyzed. Working together with practitioners on a contemporary software project within its real-life context leads to the main finding that visual analytics can help tackle both open-ended visual exploration tasks and well-structured visual exploitation tasks in requirements engineering. In addition, the study helps the practitioners to reach actionable decisions in a wide range of areas relating to their project, ranging from theme and outlier identification, over requirements tracing, to risk assessment. Overall, our work illuminates how the data-to-decision analytical capabilities could be improved by the increased interactivity of requirements visualization.

[1]  Seok-Won Lee,et al.  Visual Analytics for Requirements-driven Risk Assessment , 2007, Second International Workshop on Requirements Engineering Visualization (REV 2007).

[2]  Björn Regnell,et al.  A linguistic-engineering approach to large-scale requirements management , 2005, IEEE Software.

[3]  A. F. Adams,et al.  The Survey , 2021, Dyslexia in Higher Education.

[4]  Daniela E. Damian,et al.  Selecting Empirical Methods for Software Engineering Research , 2008, Guide to Advanced Empirical Software Engineering.

[5]  Korbinian Herrmann,et al.  Visualization of Release Planning , 2006, 2006 First International Workshop on Requirements Engineering Visualization (REV'06 - RE'06 Workshop).

[6]  Daniel A. Keim,et al.  Visual Analytics: Scope and Challenges , 2008, Visual Data Mining.

[7]  Olivier Zendra,et al.  Visualization of the Static Aspects of Software: A Survey , 2011, IEEE Transactions on Visualization and Computer Graphics.

[8]  Jane Wood,et al.  Joint application development (2. ed.) , 1995 .

[9]  Michael Gertz,et al.  A Model and Framework for Visualization Exploration , 2007, IEEE Transactions on Visualization and Computer Graphics.

[10]  Charles Hansen,et al.  The Visualization Handbook , 2011 .

[11]  Ethem Alpaydin,et al.  Introduction to machine learning , 2004, Adaptive computation and machine learning.

[12]  Jane Huffman Hayes,et al.  Advancing candidate link generation for requirements tracing: the study of methods , 2006, IEEE Transactions on Software Engineering.

[13]  Eric S. K. Yu,et al.  Towards modelling and reasoning support for early-phase requirements engineering , 1997, Proceedings of ISRE '97: 3rd IEEE International Symposium on Requirements Engineering.

[14]  Stephen Clark,et al.  Best Practices for Automated Traceability , 2007, Computer.

[15]  Nan Niu,et al.  So, You Think You Know Others' Goals? A Repertory Grid Study , 2007, IEEE Software.

[16]  Songhua Xu,et al.  Automatic labeling of software requirements clusters , 2012, 2012 4th International Workshop on Search-Driven Development: Users, Infrastructure, Tools, and Evaluation (SUITE).

[17]  Donald J. McCubbrey,et al.  Management Information Systems for the Information Age , 1997 .

[18]  Lucian Voinea,et al.  Case study: Visual analytics in software product assessments , 2009, 2009 5th IEEE International Workshop on Visualizing Software for Understanding and Analysis.

[19]  Daniela Damian,et al.  Visualizing a Requirements-centred Social Network to Maintain Awareness Within Development Teams , 2006, 2006 First International Workshop on Requirements Engineering Visualization (REV'06 - RE'06 Workshop).

[20]  Jennifer Horkoff,et al.  Visualizations to support interactive goal model analysis , 2010, 2010 Fifth International Workshop on Requirements Engineering Visualization.

[21]  Björn Regnell,et al.  What Happened to Our Features? Visualization and Understanding of Scope Change Dynamics in a Large-Scale Industrial Setting , 2009, 2009 17th IEEE International Requirements Engineering Conference.

[22]  Nan Niu,et al.  ReCVisu: A tool for clustering-based visual exploration of requirements , 2012, 2012 20th IEEE International Requirements Engineering Conference (RE).

[23]  Nan Niu,et al.  Extracting and Modeling Product Line Functional Requirements , 2008, 2008 16th IEEE International Requirements Engineering Conference.

[24]  Nan Niu,et al.  Keeping requirements on track via visual analytics , 2013, 2013 21st IEEE International Requirements Engineering Conference (RE).

[25]  Daniel Amyot,et al.  Visualizing Early Aspects with Use Case Maps , 2007, LNCS Trans. Aspect Oriented Softw. Dev..

[26]  J. Ziegler,et al.  Graph-based Visualization of Requirements Relationships , 2008, 2008 Requirements Engineering Visualization.

[27]  Daniel Jackson,et al.  Requirement progression in problem frames: deriving specifications from requirements , 2007, Requirements Engineering.

[28]  Peter Sawyer,et al.  BEST PAPERS OF RE’10: REQUIREMENTS ENGINEERING IN A MULTI-FACETED WORLD Relevance-based abstraction identification: technique and evaluation , 2022 .

[29]  Malcolm Munro,et al.  Software Architecture Visualization: An Evaluation Framework and Its Application , 2008, IEEE Transactions on Software Engineering.

[30]  Patrick Heymans,et al.  Visual notation design 2.0: Towards user comprehensible requirements engineering notations , 2013, 2013 21st IEEE International Requirements Engineering Conference (RE).

[31]  Goetz Botterweck,et al.  Applying visualisation techniques in software product lines , 2008, SOFTVIS.

[32]  R. Suganya,et al.  Data Mining Concepts and Techniques , 2010 .

[33]  Nan Niu,et al.  A semantic relatedness approach for traceability link recovery , 2012, 2012 20th IEEE International Conference on Program Comprehension (ICPC).

[34]  Francis T. Marchese,et al.  The Potential for Synergy between Information Visualization and Software Engineering Visualization , 2008, 2008 12th International Conference Information Visualisation.

[35]  Qinbao Song,et al.  Data Quality: Some Comments on the NASA Software Defect Datasets , 2013, IEEE Transactions on Software Engineering.

[36]  Daniel L. Moody,et al.  The “Physics” of Notations: Toward a Scientific Basis for Constructing Visual Notations in Software Engineering , 2009, IEEE Transactions on Software Engineering.

[37]  J. Cleland-Huang,et al.  Visual Support In Automated Tracing , 2007, Second International Workshop on Requirements Engineering Visualization (REV 2007).

[38]  Nan Niu,et al.  Source code indexing for automated tracing , 2011, TEFSE '11.

[39]  Robin A. Gandhi,et al.  Requirements Engineering Visualization: A Survey on the State-of-the-Art , 2009, 2009 Fourth International Workshop on Requirements Engineering Visualization.

[40]  Patrick Heymans,et al.  Visually Effective Goal Models Using KAOS , 2007, ER Workshops.

[41]  Daniel Amyot,et al.  Evaluating goal models within the goal‐oriented requirement language , 2010, Int. J. Intell. Syst..

[42]  Denise Silver,et al.  Joint Application Development , 1995 .

[43]  Richard C. Holt,et al.  The Orphan Adoption problem in architecture maintenance , 1997, Proceedings of the Fourth Working Conference on Reverse Engineering.

[44]  Ben Shneiderman,et al.  Readings in information visualization - using vision to think , 1999 .

[45]  Patrick Heymans,et al.  Improving the Effectiveness of Visual Representations in Requirements Engineering: An Evaluation of i* Visual Syntax , 2009, 2009 17th IEEE International Requirements Engineering Conference.

[46]  Kristin A. Cook,et al.  Illuminating the Path: The Research and Development Agenda for Visual Analytics , 2005 .

[47]  Patrick Heymans,et al.  Visual syntax does matter: improving the cognitive effectiveness of the i* visual notation , 2010, Requirements Engineering.

[48]  Tim Menzies,et al.  Software Analytics: So What? , 2013, IEEE Softw..

[49]  Thomas Zimmermann,et al.  Information needs for software development analytics , 2012, 2012 34th International Conference on Software Engineering (ICSE).

[50]  Tim Menzies,et al.  Experiences using Visualization Techniques to Present Requirements, Risks to Them, and Options for Risk Mitigation , 2006, 2006 First International Workshop on Requirements Engineering Visualization (REV'06 - RE'06 Workshop).

[51]  S. T. Buckland,et al.  An Introduction to the Bootstrap. , 1994 .

[52]  Ben Shneiderman,et al.  The eyes have it: a task by data type taxonomy for information visualizations , 1996, Proceedings 1996 IEEE Symposium on Visual Languages.

[53]  S. Meier,et al.  An Improved Fisheye Zoom Algorithm for Visualizing and Editing Hierarchical Models , 2007, Second International Workshop on Requirements Engineering Visualization (REV 2007).

[54]  Andreas Noack,et al.  Energy Models for Graph Clustering , 2007, J. Graph Algorithms Appl..

[55]  Daniel M. Berry,et al.  AbstFinder, A Prototype Natural Language Text Abstraction Finder for Use in Requirements Elicitation , 1997, Automated Software Engineering.

[56]  Mark Pearson,et al.  Handling Qualitative Data: A Practical Guide , 2005 .