Learning Requirements Elicitation Interviews with Role-Playing, Self-Assessment and Peer-Review

Interviews are largely used in the practice of requirements elicitation. Nevertheless, performing an effective interview often depends on soft-skills, and on knowledge acquired through experience. When it comes to requirements engineering education and training (REET), limited resources and few well-founded pedagogical approaches are available to allow students to acquire and improve their skills as interviewers. This paper presents a novel pedagogical approach that combines role-playing, peer-review and self-assessment to enable students to reflect on their mistakes, and improve their interview skills. We evaluate the approach through a controlled quasi-experiment. The study shows that the approach significantly reduces the amount of mistakes made by the students. Feedback from the participants confirms the usefulness and easiness of the proposed training. This work contributes to the body of knowledge of REET with an empirically evaluated method for teaching inter-views. Furthermore, we share the pedagogical material used, to enable other educators to apply and possibly tailor the approach.

[1]  Jacob L. Moreno,et al.  Psychodrama, first volume. , 1946 .

[2]  Judithe Sheard,et al.  Contributing student pedagogy , 2012, Comput. Sci. Educ..

[3]  D. Sluijsmans,et al.  The use of self-, peer and co-assessment in higher education: A review , 1999 .

[4]  Daniel M. Berry,et al.  An industrial case study of the impact of domain ignorance on the effectiveness of requirements idea generation during requirements elicitation , 2013, 2013 21st IEEE International Requirements Engineering Conference (RE).

[5]  D. Sluijsmans,et al.  Effective peer assessment processes: Research findings and future directions , 2010 .

[6]  K. Topping Self and Peer Assessment in School and University: Reliability, Validity and Utility , 2003 .

[7]  Christian Bird,et al.  Code Reviewing in the Trenches: Challenges and Best Practices , 2018, IEEE Software.

[8]  D. Boud,et al.  Peer Learning and Assessment , 1999 .

[9]  Muneera Bano,et al.  Teaching requirements elicitation interviews: an empirical study of learning from mistakes , 2019, Requirements Engineering.

[10]  Glenn J. Browne,et al.  Improving requirements elicitation: an empirical investigation of procedural prompts , 2007, Inf. Syst. J..

[11]  Neelke Doorn,et al.  Using and Developing Role Plays in Teaching Aimed at Preparing for Social Responsibility , 2011, Sci. Eng. Ethics.

[12]  J. Dewey Experience and Education , 1938 .

[13]  Natalia Juristo Juzgado,et al.  Effectiveness of Requirements Elicitation Techniques: Empirical Results Derived from a Systematic Review , 2006, 14th IEEE International Requirements Engineering Conference (RE'06).

[14]  Krassie Petrova,et al.  Bridging the Research-Practice Gap in Requirements Engineering through Effective Teaching and Peer Learning , 2009, 2009 Sixth International Conference on Information Technology: New Generations.

[15]  Janice Singer,et al.  Ethical Issues in Empirical Studies of Software Engineering , 2002, IEEE Trans. Software Eng..

[16]  David Boud,et al.  Enhancing learning through self assessment , 1995 .

[17]  Petra Kaufmann,et al.  Experimental And Quasi Experimental Designs For Research , 2016 .

[18]  Roel Wieringa,et al.  Six strategies for generalizing software engineering theories , 2015, Sci. Comput. Program..

[19]  C. Greenblat Teaching with Simulation Games: A Review of Claims and Evidence. , 1973 .

[20]  Natalia Juristo Juzgado,et al.  Effect of Domain Knowledge on Elicitation Effectiveness: An Internally Replicated Controlled Experiment , 2016, IEEE Transactions on Software Engineering.

[21]  Holger Giese,et al.  Teaching requirements engineering with virtual stakeholders without software engineering knowledge , 2010, 2010 5th International Workshop on Requirements Engineering Education and Training.

[22]  Jerald Greenberg,et al.  The Role of Role Playing in Organizational Research , 1993 .

[23]  Alberto Bacchelli,et al.  Expectations, outcomes, and challenges of modern code review , 2013, 2013 35th International Conference on Software Engineering (ICSE).

[24]  J. Fowler Experiential learning and its facilitation. , 2008, Nurse education today.

[25]  Austen Rainer,et al.  Case Study Research in Software Engineering - Guidelines and Examples , 2012 .

[26]  Jon M. Pearce,et al.  Involving students in peer review: Case studies and practical strategies for university teaching , 2010 .

[27]  D. Boud Developing Student Autonomy in Learning. , 1981 .

[28]  Harri Haapasalo,et al.  The Engagement between Knowledge Transfer and Requirements Engineering , 2012 .

[29]  Didar Zowghi,et al.  Teaching requirements engineering through role playing: lessons learnt , 2003, Proceedings. 11th IEEE International Requirements Engineering Conference, 2003..

[30]  Jessica To,et al.  Peer assessment effects on the self-assessment process of first-year undergraduates , 2019, Assessment & Evaluation in Higher Education.

[31]  S. Adams Interviewing for Journalists , 2001 .

[32]  Merryl Hammond,et al.  Self-Directed Learning: Critical Practice , 1991 .

[33]  Didar Zowghi,et al.  Requirements Elicitation: A Survey of Techniques, Approaches, and Tools , 2005 .

[34]  Claes Wohlin,et al.  State‐of‐the‐art: software inspections after 25 years , 2002, Softw. Test. Verification Reliab..

[35]  Ban Al-Ani,et al.  1 Teaching Requirements Engineering in Global Software Development : A report on a three-University collaboration , 2005 .

[36]  Irit Hadar,et al.  The role of domain knowledge in requirements elicitation via interviews: an exploratory study , 2012, Requirements Engineering.

[37]  P. Black,et al.  Assessment and Classroom Learning , 1998 .

[38]  Ali Idri,et al.  Requirements engineering education: a systematic mapping study , 2013, Requirements Engineering.

[39]  Stefania Gnesi,et al.  Common Mistakes of Student Analysts in Requirements Elicitation Interviews , 2017, REFSQ.

[40]  Shane McIntosh,et al.  An empirical study of the impact of modern code review practices on software quality , 2015, Empirical Software Engineering.

[41]  Kenneth A. Bruffee,et al.  Collaborative Learning: Higher Education, Interdependence, and the Authority of Knowledge , 1999 .

[42]  G. Finnerty Qualitative Research Practice. A Guide for Social Science Students and Researchers , 2003 .

[43]  Muneera Bano,et al.  Interview Review: An Empirical Study on Detecting Ambiguities in Requirements Elicitation Interviews , 2018, REFSQ.

[44]  Ritu Agarwal,et al.  Knowledge Acquisition Using Structured Interviewing: An Empirical Investigation , 1990, J. Manag. Inf. Syst..

[45]  D. Boud,et al.  Peer Learning in Higher Education: Learning from and with Each Other , 2014 .

[46]  Gavin T. L. Brown,et al.  Opportunities and obstacles to consider when using peer- and self-assessment to improve student learning: Case studies into teachers' implementation , 2013 .

[47]  Muneera Bano,et al.  Learning from Mistakes: An Empirical Study of Elicitation Interviews Performed by Novices , 2018, 2018 IEEE 26th International Requirements Engineering Conference (RE).

[48]  Jeffrey C. Carver,et al.  Issues in using students in empirical studies in software engineering education , 2003, Proceedings. 5th International Workshop on Enterprise Networking and Computing in Healthcare Industry (IEEE Cat. No.03EX717).

[49]  Alain Wegmann,et al.  Experiential learning approach for requirements engineering education , 2009, Requirements Engineering.

[50]  Björn Regnell,et al.  Is role playing in Requirements Engineering Education increasing learning outcome? , 2017, Requirements Engineering.

[51]  Tracy Hall,et al.  Ethical Issues in Software Engineering Research: A Survey of Current Practice , 2001, Empirical Software Engineering.

[52]  Jean-Yves Fourniols,et al.  Teaching requirements skills within the context of a physical engineering project , 2008, 2008 Requirements Engineering Education and Training.

[53]  Jeffrey C. Carver,et al.  Using error abstraction and classification to improve requirement quality: conclusions from a family of four empirical studies , 2012, Empirical Software Engineering.

[54]  Use of Dyadic Role-playing to Increase Student Participation , 2002, Nurse educator.

[55]  Chong Wang,et al.  Understanding what industry wants from requirements engineers: an exploration of RE jobs in Canada , 2018, ESEM.