The educational value of mapping studies of software engineering literature

We identify three challenges related to the provenance of the material we use in teaching software engineering. We suggest that these challenges can be addressed by using evidence-based software engineering (EBSE) and its primary tool of systematic literature reviews (SLRs). This paper aims to assess the educational and scientific value of undergraduate and postgraduate students undertaking a specific form of SLR called a mapping study. Using a case study methodology, we asked three postgraduate students and three undergraduates and their supervisor to complete a questionnaire concerning the educational value of mapping studies and any problems they experienced. Students found undertaking a mapping study to be a valuable experience providing both reusable research skills and a good overview of a research topic. Postgraduates found it useful as a starting point for their studies. Undergraduates reported problems undertaking the study in the required timescales. Searching and classifying the literature was difficult.

[1]  A. Fink Conducting research literature reviews , 1998 .

[2]  R. Yin Case Study Research: Design and Methods, 3rd Edition , 2002 .

[3]  Raeburn Forbes,et al.  Systematic Reviews to Support Evidence-based Medicine , 2003, The Ulster Medical Journal.

[4]  Tore Dybå,et al.  Evidence-based software engineering , 2004, Proceedings. 26th International Conference on Software Engineering.

[5]  Jean Hartley,et al.  Case study research , 2004 .

[6]  Tore Dybå,et al.  Evidence-Based Software Engineering for Practitioners , 2005, IEEE Softw..

[7]  Tore Dybå,et al.  Teaching evidence-based software engineering to university students , 2005, 11th IEEE International Software Metrics Symposium (METRICS'05).

[8]  M. Petticrew,et al.  Systematic Reviews in the Social Sciences: A Practical Guide , 2005 .

[9]  Austen Rainer,et al.  A preliminary empirical investigation of the use of evidence based software engineering by under-graduate students , 2006 .

[10]  Pearl Brereton,et al.  Large-scale software engineering questions expert opinion or empirical evidence? , 2007, IET Softw..

[11]  Maria Teresa Baldassarre,et al.  A Hands-On Approach for Teaching Systematic Review , 2008, PROFES.

[12]  Clive Jefferies,et al.  Length and readability of structured software engineering abstracts , 2008, IET Softw..

[13]  Austen Rainer,et al.  A follow-up empirical evaluation of evidence based software engineering by undergraduate students , 2008, EASE.

[14]  Pearl Brereton,et al.  Presenting software engineering results using structured abstracts: a randomised experiment , 2008, Empirical Software Engineering.

[15]  David S. Janzen,et al.  Engaging the net generation with evidence-based software engineering through a community-driven web database , 2009, J. Syst. Softw..

[16]  Briony J. Oates,et al.  Using systematic reviews and evidence-based software engineering with masters students , 2009, EASE.

[17]  Pearl Brereton,et al.  Systematic literature reviews in software engineering - A systematic literature review , 2009, Inf. Softw. Technol..