Guidelines for industrially-based multiple case studies in software engineering

Without careful methodological guidance, case studies in software engineering are difficult to plan, design and execute. While there are a number of broad guidelines for case study research, there are none that specifically address the needs of a software engineer undertaking multiple case studies in an industrial setting. Through a synthesis of existing best practices in case study research, we provide a set of comprehensive guidelines for conducting multiple case studies in software engineering research. Our guidelines can assist software engineering researchers with all stages of multiple case study research, although in this paper we concentrate on the early phases, such as focusing the case study and detailed plan design. To date, three exploratory research projects found our guidelines very useful. We illustrate our guidelines with examples from one of these projects.

[1]  Jennifer Sampson,et al.  Critical Appraisal Guidelines for Single Case Study Research , 2002, ECIS.

[2]  Paul R. Lawrence,et al.  The Information Systems Research Challenge: Qualitative Research Methods , 1990 .

[3]  Petronella C. de Weerd-Nederhof,et al.  Qualitative case study research. The case of a PhD research project on organising and managing new product development systems , 2001 .

[4]  Graeme G. Shanks,et al.  Successfully completing case study research: combining rigour, relevance and pragmatism , 1998, Inf. Syst. J..

[5]  R. Yin.  The Case Study Crisis: Some Answers , 1981 .

[6]  Allen S. Lee,et al.  Information systems and qualitative research , 1997 .

[7]  Barbara Ann Kitchenham,et al.  Evaluating software engineering methods and tools: part 9: quantitative case study methodology , 1998, SOEN.

[8]  Allen S. Lee.  A Scientific Methodology for MIS Case Studies , 1989, MIS Q..

[9]  Michael D. Myers,et al.  A Set of Principles for Conducting and Evaluating Interpretive Field Studies in Information Systems , 1999, MIS Q..

[10]  Angèle L. M. Cavaye,et al.  Case study research: a multi‐faceted research approach for IS , 1996, Inf. Syst. J..

[11]  Graeme G. Shanks,et al.  Positivist single case study research in information systems: a critical analysis , 2003, ECIS.

[12]  Susan Elliott Sim,et al.  Case studies for software engineers , 2006, ICSE '06.

[13]  R. Yin.  Enhancing the quality of case studies in health services research. , 1999, Health services research.

[14]  Yvonna S. Lincoln,et al.  Judging the quality of case study reports , 1990 .

[15]  Geoff Walsham,et al.  Interpretive case studies in IS research: nature and method , 1995 .

[16]  Activité ad‐hoc Types de tâches.  Introduction to BPMN , 2004 .

[17]  Pearl Brereton,et al.  Using a Protocol Template for Case Study Planning , 2008, EASE.

[18]  Dorothy Leonard-Barton,et al.  A Dual Methodology for Case Studies: Synergistic Use of a Longitudinal Single Site with Replicated Multiple Sites , 1990 .

[19]  Lawrence R. Jauch,et al.  Structured Content Analysis of Cases: A Complementary Method for Organizational Research , 1980 .

[20]  Robert L. Glass,et al.  Pilot Studies: What, Why, and How , 1997, J. Syst. Softw..

[21]  R. Yin.  Case Study Research: Design and Methods , 1984 .

[22]  Allen S. Lee.  Case Studies as Natural Experiments , 1989 .

[23]  Line Dubé,et al.  Rigor in Information Systems Positivist Case Research: Current Practices , 2003, MIS Q..

[24]  J. Creswell.  Qualitative inquiry and research design: choosing among five traditions. , 1998 .

[25]  B. Kitchenham,et al.  Case Studies for Method and Tool Evaluation , 1995, IEEE Softw..

[26]  Guy Paré,et al.  Using case study research to build theories of IT implementation , 1997 .

[27]  K. Eisenhardt.  Better Stories and Better Constructs: The Case for Rigor and Comparative Logic , 1991 .

[28]  S. T. Buckland,et al.  An Introduction to the Bootstrap. , 1994 .

[29]  Jason L. Jensen,et al.  Cumulating the Intellectual Gold of Case Study Research , 2001 .

[30]  B. Flyvbjerg.  Five Misunderstandings About Case-Study Research , 2006, 1304.1186.

[31]  Per Runeson,et al.  Case studies on software engineering PhD programmes , 2007 .

[32]  Guy Paré,et al.  Investigating Information Systems with Positivist Case Research , 2004, Commun. Assoc. Inf. Syst..

[33]  G. Paré.  Investigating Information Systems with Positivist Case Study Research , 2004 .

[34]  Craig Smith.  The case study: a useful research method for information management , 1990, J. Inf. Technol..

[35]  Rens Scheepers,et al.  Contexts of Relevance in Explanatory Case Studies in Information Systems: Ubiquitous Information Technology Implementation in Organizations , 2003, ICIS.

[36]  Janice Singer,et al.  Studying Software Engineers: Data Collection Techniques for Software Field Studies , 2005, Empirical Software Engineering.

[37]  Izak Benbasat,et al.  The Case Research Strategy in Studies of Information Systems , 1987, MIS Q..

[38]  Bonnie Kaplan,et al.  Combining Qualitative and Quantitative Methods in Information Systems Research: A Case Study , 1988, MIS Q..

[39]  Arch G. Woodside,et al.  Case study research methods for theory building , 2003 .

[40]  Barbara Ann Kitchenham,et al.  Evaluating software eng. methods and tools part 10: designing and running a quantitative case study , 1998, SOEN.

[41]  K. Eisenhardt.  Building theories from case study research , 1989, STUDI ORGANIZZATIVI.

[42]  R. Stake.  The art of case study research , 1995 .

[43]  Robert K. Yin,et al.  Applications of case study research , 1993 .