Two Replication Studies for Evaluating Artefact Models in RE: Results and Lessons Learnt

Artefact-based requirements engineering (RE) describes the idea of establishing a company-wide reference model by putting the focus on the RE artefacts and their dependencies rather than dictating a strict process with interconnected methods. Although we could make first empirical studies on the benefits and shortcomings of artefact-based RE, however, we still have little evidence for our first results. The reason is that the conducted case studies focus on the isolated application of artefact-based RE approaches in individual socio-economic contexts and, thus, the findings can hardly be generalised. The contribution of this paper is to report on two conducted replication studies to strengthen our confidence on the benefits and shortcomings of applying artefact orientation in RE. To this end, we replicated an industrial case study with partners from two companies. Those replications form part of a research project where all partners are working with the same artefact-based RE approach and its tool-supported realisation. Our results give deeper insights into artefact-based RE and contribute to a reliable database due to comparability among the studies. This allows for first conclusions on the actual impact artefact orientation has on RE.

[1]  Manfred Broy,et al.  A meta model for artefact-orientation: fundamentals and lessons learned in requirements engineering , 2010, MODELS'10.

[2]  Gary James Jason,et al.  The Logic of Scientific Discovery , 1988 .

[3]  Birgit Penzenstadler,et al.  A case study on the application of an artefact-based requirements engineering approach , 2011, EASE.

[4]  Natalia Juristo Juzgado,et al.  Replications types in experimental disciplines , 2010, ESEM '10.

[5]  Birgit Penzenstadler,et al.  A Requirements Engineering content model for Cyber-Physical Systems , 2012, 2012 Second IEEE International Workshop on Requirements Engineering for Systems, Services, and Systems-of-Systems (RESS).

[6]  Klaus Pohl,et al.  A Requirements Reference Model for Model-Based Requirements Engineering in the Automotive Domain , 2009, REFSQ.

[7]  Jeffrey C. Carver,et al.  Replicating software engineering experiments: addressing the tacit knowledge problem , 2002, Proceedings International Symposium on Empirical Software Engineering.

[8]  Brian Berenbach,et al.  Software & Systems Requirements Engineering: In Practice , 2009 .

[9]  A. Brooks,et al.  Replication's Role in Software Engineering , 2008, Guide to Advanced Empirical Software Engineering.

[10]  Klaas Sikkel,et al.  A systematic mapping study on empirical evaluation of software requirements specifications techniques , 2009, 2009 3rd International Symposium on Empirical Software Engineering and Measurement.

[11]  Per Runeson,et al.  Guidelines for conducting and reporting case study research in software engineering , 2009, Empirical Software Engineering.

[12]  Birgit Penzenstadler,et al.  Understanding the Impact of Artefact-Based RE -- Design of a Replication Study , 2013, 2013 ACM / IEEE International Symposium on Empirical Software Engineering and Measurement.

[13]  Natalia Juristo Juzgado,et al.  Using differences among replications of software engineering experiments to gain knowledge , 2009, 2009 3rd International Symposium on Empirical Software Engineering and Measurement.