Advancing Repeated Research in Requirements Engineering: A Theoretical Replication of Viewpoint Merging

Compared to building a single requirements view, modeling stakeholder viewpoints and then merging them is shown to improve the understanding of the problem domain, but also very time consuming. How has the situation changed? This paper reports our replication of a case study, where we take theoretical replication's advantage to mitigate the original study design's threat and to embrace an important evolving factor, namely automated tool support for producing i* models. Our replicate case study verifies the rich domain understanding gained through viewpoint-based modeling, and updates the prior results by showing the time saving enabled by the tool. Our work offers operational insights into independent, theoretical replications. These insights, we believe, can advance requirements engineering research toward an empirically backed body of knowledge.

[1]  Peter Loos,et al.  Towards a Viewpoint-based Modeling Method to Foster Collaborative Modeling - Conceptual Design and Implementation , 2013, PACIS.

[2]  Oscar Pastor,et al.  Empirical research methodologies and studies in Requirements Engineering: How far did we come? , 2014, J. Syst. Softw..

[3]  Eric S. K. Yu,et al.  Interactive goal model analysis for early requirements engineering , 2014, Requirements Engineering.

[4]  Björn Regnell,et al.  An experiment on linguistic tool support for consolidation of requirements from multiple sources in market-driven product development , 2006, Empirical Software Engineering.

[5]  Steve M. Easterbrook.  Empirical research methods for software engineering , 2007, ASE '07.

[6]  Ping-Jung Hsieh,et al.  Key success factors for clinical knowledge management systems: Comparing physician and hospital manager viewpoints. , 2015, Technology and health care : official journal of the European Society for Engineering and Medicine.

[7]  Jeffrey C. Carver,et al.  A Framework for Software Engineering Experimental Replications , 2008, 13th IEEE International Conference on Engineering of Complex Computer Systems (iceccs 2008).

[8]  Fabio Q. B. da Silva,et al.  Replication of empirical studies in software engineering research: a systematic mapping study , 2012, Empirical Software Engineering.

[9]  Patrick Heymans,et al.  Improving the Effectiveness of Visual Representations in Requirements Engineering: An Evaluation of i* Visual Syntax , 2009, 2009 17th IEEE International Requirements Engineering Conference.

[10]  Markus Strohmaier,et al.  Can Patterns Improve i* Modeling? Two Exploratory Studies , 2008, REFSQ.

[11]  Amela Karahasanovic,et al.  A survey of controlled experiments in software engineering , 2005, IEEE Transactions on Software Engineering.

[12]  Babak Abedin,et al.  Investigating the Role of Business Analysts Competencies into Strategic Business Requirements Gathering , 2014, PACIS.

[13]  Annie I. Antón,et al.  Identifying and classifying ambiguity for regulatory requirements , 2014, 2014 IEEE 22nd International Requirements Engineering Conference (RE).

[14]  Markus Borg,et al.  Confounding factors when conducting industrial replications in requirements engineering , 2013, 2013 1st International Workshop on Conducting Empirical Studies in Industry (CESI).

[15]  Nan Niu,et al.  Using soft systems methodology to improve requirements practices: an exploratory case study , 2011, IET Softw..

[16]  Vinay Kulkarni,et al.  Intentional Modeling for Problem Solving in Enterprise Architecture , 2013, ICEIS.

[17]  Birgit Penzenstadler,et al.  Understanding the Impact of Artefact-Based RE -- Design of a Replication Study , 2013, 2013 ACM / IEEE International Symposium on Empirical Software Engineering and Measurement.

[18]  Charles D. Knutson,et al.  A Case for Replication : Synthesizing Research Methodologies in Software Engineering , 2010 .

[19]  Gregory V. Wilson,et al.  On the difficulty of replicating human subjects studies in software engineering , 2008, 2008 ACM/IEEE 30th International Conference on Software Engineering.

[20]  Forrest Shull,et al.  Building Knowledge through Families of Experiments , 1999, IEEE Trans. Software Eng..

[21]  Zhendong Niu,et al.  A Systems Approach to Product Line Requirements Reuse , 2014, IEEE Systems Journal.

[22]  João Araújo,et al.  A Systematic Comparison of i* Modelling Tools Based on Syntactic and Well-formedness Rules , 2013, iStar.

[23]  A. Brooks,et al.  Replication's Role in Software Engineering , 2008, Guide to Advanced Empirical Software Engineering.

[24]  Yijun Yu,et al.  Variability Modeling for Product Line Viewpoints Integration , 2010, 2010 IEEE 34th Annual Computer Software and Applications Conference.

[25]  Eric S. K. Yu,et al.  Towards modelling and reasoning support for early-phase requirements engineering , 1997, Proceedings of ISRE '97: 3rd IEEE International Symposium on Requirements Engineering.

[26]  Daniela E. Damian,et al.  Selecting Empirical Methods for Software Engineering Research , 2008, Guide to Advanced Empirical Software Engineering.

[27]  Natalia Juristo Juzgado,et al.  The role of non-exact replications in software engineering experiments , 2011, Empirical Software Engineering.

[28]  Jeffrey C. Carver,et al.  The role of replications in Empirical Software Engineering , 2008, Empirical Software Engineering.

[29]  R. Yin.  Case Study Research: Design and Methods , 1984 .

[30]  Birgit Penzenstadler,et al.  A case study on the application of an artefact-based requirements engineering approach , 2011, EASE.

[31]  Bashar Nuseibeh,et al.  Expressing the relationships between multiple views in requirements specification , 1993, ICSE '93.

[32]  Asai Asaithambi,et al.  Ethnographic field work in requirements engineering , 2017, Enterp. Inf. Syst..

[33]  Eric S. K. Yu,et al.  Do viewpoints lead to better conceptual models? An exploratory case study , 2005, 13th IEEE International Conference on Requirements Engineering (RE'05).

[34]  Xiaohong Chen,et al.  Capturing Requirements from Expected Interactions Between Software and Its Interactive Environment: An Ontology Based Approach , 2016, Int. J. Softw. Eng. Knowl. Eng..

[35]  Sagar Sunkle,et al.  Visual and Ontological Modeling Support for Extended Enterprise Models , 2014, CAiSE.

[36]  Mike Cohn,et al.  User Stories Applied: For Agile Software Development , 2004 .

[37]  Natalia Juristo Juzgado,et al.  Replications types in experimental disciplines , 2010, ESEM '10.

[38]  John Mylopoulos,et al.  The Evolution of Tropos , 2013, Seminal Contributions to Information Systems Engineering.

[39]  Birgit Penzenstadler,et al.  Two Replication Studies for Evaluating Artefact Models in RE: Results and Lessons Learnt , 2013, 2013 3rd International Workshop on Replication in Empirical Software Engineering Research.

[40]  Roel Wieringa,et al.  The Journal of Systems and Software , 2013 .

[41]  Martin Höst,et al.  Replication of an experiment on linguistic tool support for consolidation of requirements from multiple sources , 2011, Empirical Software Engineering.

[42]  Nan Niu,et al.  Analysis of Early Aspects in Requirements Goal Models: A Concept-Driven Approach , 2007, LNCS Trans. Aspect Oriented Softw. Dev..

[43]  Michael Jackson,et al.  The meaning of requirements , 1997, Ann. Softw. Eng..

[44]  Carina Alves,et al.  A Systematic Mapping Study on Business Process Variability , 2013 .

[45]  Neil A. Ernst,et al.  Finding incremental solutions for evolving requirements , 2011, 2011 IEEE 19th International Requirements Engineering Conference.

[46]  Eric S. K. Yu,et al.  Analyzing goal models: different approaches and how to choose among them , 2011, SAC.