Inspectors Academy : Pedagogical Design for Requirements Inspection Training

The core aim of requirements inspection is to ensure the high quality of already elicited requirements in the Software Requirements Specification. Teaching requirements inspection to novices is challenging, as inspecting requirements needs several skills as well as knowledge of the product and process that is hard to achieve in a classroom environment. Published studies about pedagogical design specifically for teaching requirements inspection are scarce. Our objective is to present the design and evaluation of a postgraduate course for requirements inspection training. We conducted an empirical study with 138 postgraduate students, teamed up in 34 groups to conduct requirements inspection. We performed qualitative analysis on the data collected from students’ reflection reports to assess the effects of the pedagogical design in terms of benefits and challenges. We also quantitatively analyze the correlation between the students’ performance in conducting inspections and their ability of writing specifications. From the analysis of students’ reflections, several themes emerged such as their difficulty of working with limited information, but also revealed the benefits of learning teamwork and writing good requirements. This qualitative analysis also provides recommendations for improving the related activities. The results revealed a moderate positive correlation between the performance in writing specification and inspection.

[1]  Didar Zowghi,et al.  Interview Review: Detecting Latent Ambiguities to Improve the Requirements Elicitation Process , 2017, 2017 IEEE 25th International Requirements Engineering Conference (RE).

[2]  Lin Ma,et al.  Unpacking Tacit Knowledge for Requirements Engineering , 2013, Managing Requirements Knowledge.

[3]  Frank Salger,et al.  Requirements reviews revisited: Residual challenges and open research questions , 2013, 2013 21st IEEE International Requirements Engineering Conference (RE).

[4]  Gillian Xiao-Lian Authentic assessment strategies in problem based learning , 2007 .

[5]  Didar Zowghi,et al.  Teaching requirements engineering through role playing: lessons learnt , 2003, Proceedings. 11th IEEE International Requirements Engineering Conference, 2003..

[6]  Norazlin Yusop,et al.  The Role of Conducting Stakeholder Meeting in Requirements Engineering Techniques , 2007 .

[7]  Thomas M. Duffy,et al.  Problem Based Learning: An instructional model and its constructivist framework , 1995 .

[8]  Jeffrey C. Carver,et al.  A systematic literature review to identify and classify software requirement errors , 2009, Inf. Softw. Technol..

[9]  Robert O. Briggs,et al.  Surfacing tacit knowledge in requirements negotiation: experiences using EasyWinWin , 2001, Proceedings of the 34th Annual Hawaii International Conference on System Sciences.

[10]  Giuseppe Visaggio,et al.  A Replicated Experiment to Assess Requirements Inspection Techniques , 2004, Empirical Software Engineering.

[11]  Didar Zowghi,et al.  The Role of Conducting Stakeholder Meetings in Requirements Engineering Training , 2012 .

[12]  Jeffrey C. Carver,et al.  Effectiveness of Human Error Taxonomy during Requirements Inspection: An Empirical Investigation , 2016, SEKE.

[13]  Ray Dawson,et al.  Twenty dirty tricks to train software engineers , 2000, Proceedings of the 2000 International Conference on Software Engineering. ICSE 2000 the New Millennium.

[14]  Muneera Bano,et al.  Learning from Mistakes: An Empirical Study of Elicitation Interviews Performed by Novices , 2018, 2018 IEEE 26th International Requirements Engineering Conference (RE).

[15]  Zahra Shakeri Hossein Abad,et al.  How Much Authenticity can be Achieved in Software Engineering Project Based Courses? , 2019, 2019 IEEE/ACM 41st International Conference on Software Engineering: Software Engineering Education and Training (ICSE-SEET).

[16]  Roger C. Schank,et al.  Virtual Learning: A Revolutionary Approach to Building a Highly Skilled Workforce , 1997 .

[17]  Gursimran S. Walia,et al.  Teaching Software Requirements Inspections to Software Engineering Students through Practical Training and Reflection , 2016 .

[18]  Sebastian Eder,et al.  Quality Assurance of Requirements Artifacts in Practice: A Case Study and a Process Proposal , 2016, PROFES.

[19]  Roseanne Tesoriero Tvedt,et al.  The Software Factory: combining undergraduate computer science and software engineering education , 2001, Proceedings of the 23rd International Conference on Software Engineering. ICSE 2001.

[20]  Jeffrey C. Carver,et al.  The Impact of Educational Background on the Effectiveness of Requirements Inspections: An Empirical Study , 2008, IEEE Transactions on Software Engineering.

[21]  O. Laitenberger A Survey of Software Inspection Technologies , 2001 .

[22]  Michael Fagan Design and Code Inspections to Reduce Errors in Program Development , 1976, IBM Syst. J..

[23]  Walter W. Schilling Teaching software inspection effectiveness: An active learning exercise , 2012, 2012 Frontiers in Education Conference Proceedings.

[24]  Dean Ashenden,et al.  Education and Democracy , 1972 .

[25]  Muneera Bano,et al.  Teaching requirements elicitation interviews: an empirical study of learning from mistakes , 2019, Requirements Engineering.

[26]  Neil A. M. Maiden,et al.  Determining socio-technical systems requirements: experiences with generating and walking through scenarios , 2003, Proceedings. 11th IEEE International Requirements Engineering Conference, 2003..

[27]  Muneera Bano,et al.  Learning Requirements Elicitation Interviews with Role-Playing, Self-Assessment and Peer-Review , 2019, 2019 IEEE 27th International Requirements Engineering Conference (RE).

[28]  Rodina Ahmad,et al.  Developing a teaching framework to support software inspection , 2015, 2015 2nd International Conference on Knowledge-Based Engineering and Innovation (KBEI).

[29]  Ali Idri,et al.  Requirements engineering education: a systematic mapping study , 2013, Requirements Engineering.

[30]  Stefania Gnesi,et al.  Common Mistakes of Student Analysts in Requirements Elicitation Interviews , 2017, REFSQ.

[31]  Stefania Gnesi,et al.  Ambiguity and tacit knowledge in requirements elicitation interviews , 2016, Requirements Engineering.

[32]  Julio Cesar Sampaio do Prado Leite,et al.  Facing the Challenges of Teaching Requirements Engineering , 2016, 2016 IEEE/ACM 38th International Conference on Software Engineering Companion (ICSE-C).

[33]  Kurt Schneider,et al.  Supporting Requirements Elicitation by Tool-Supported Video Analysis , 2016, 2016 IEEE 24th International Requirements Engineering Conference (RE).

[34]  Roel Wieringa,et al.  Status Quo in Requirements Engineering: A Theory and a Global Family of Surveys , 2021, Software Engineering.

[35]  Barry Boehm,et al.  Top 10 list [software development] , 2001 .

[36]  Claes Wohlin,et al.  State‐of‐the‐art: software inspections after 25 years , 2002, Softw. Test. Verification Reliab..

[37]  KatasonovArtem,et al.  Requirements quality control: a unifying framework , 2005 .

[38]  T. Germain,et al.  Process activities in a project based course in software engineering , 2002, 32nd Annual Frontiers in Education.

[39]  J. Lave Cognition in Practice: Outdoors: a social anthropology of cognition in practice , 1988 .

[40]  Jan Herrington,et al.  Authentic Assessment and Multimedia: how university students respond to a model of authentic assessment , 1998 .

[41]  Forrest Shull,et al.  How perspective-based reading can improve requirements inspections , 2000, Computer.

[42]  P. Kirschner,et al.  A five-dimensional framework for authentic assessment , 2004 .

[43]  Adam A. Porter,et al.  Comparing Detection Methods for Software Requirements Inspections: A Replicated Experiment , 1995, IEEE Trans. Software Eng..

[44]  Emily Oh Navarro,et al.  On the Role of Learning Theories in Furthering Software Engineering Education , 2009 .

[45]  Geoffrey L. Herman Designing contributing student pedagogies to promote students' intrinsic motivation to learn , 2012, Comput. Sci. Educ..

[46]  Simone C. dos Santos,et al.  Authentic assessment in Software Engineering education based on PBL principles a case study in the telecom market , 2013, 2013 35th International Conference on Software Engineering (ICSE).

[47]  Rubin Gotesky,et al.  On knowing; essays for the left hand , 1963 .

[48]  Michael E. Fagan Design and Code Inspections to Reduce Errors in Program Development , 1976, IBM Syst. J..

[49]  Colin Potts,et al.  Learning by Doing: Goals & Experience of Two Software Engineering Project Courses , 1994, CSEE.

[50]  Artem Katasonov,et al.  Requirements quality control: a unifying framework , 2005, Requirements Engineering.

[51]  Björn Regnell,et al.  Is role playing in Requirements Engineering Education increasing learning outcome? , 2017, Requirements Engineering.