Empirical methodologies in software engineering

The collection and use of evidence in software engineering practice and research are essential elements in the development of the discipline. This paper discusses the need for evidence-based software engineering, the nature of evidence in its various forms and some of the research methodologies used in other disciplines for the collection of evidence, which are also relevant to software engineering. Two frameworks or models are proposed which illustrate the relationships between the methodologies discussed. In particular, the paper highlights the importance and roles of both positivist and interpretivist methods of investigation.

[1]  Jean Hartley,et al.  Case study research , 2004 .

[2]  Shari Lawrence Pfleeger,et al.  Preliminary Guidelines for Empirical Research in Software Engineering , 2002, IEEE Trans. Software Eng..

[3]  Wanda J. Orlikowski,et al.  Studying Information Technology in Organizations: Research Approaches and Assumptions , 1991, Inf. Syst. Res..

[4]  Enid Mumford,et al.  Research methods in information systems : proceedings of the IFIP WG 8.2 Colloquium, Manchester Business School, 1-3 September, 1984 , 1985 .

[5]  Richard Baskerville,et al.  Action Research For Information Systems , 1999 .

[6]  Peter Checkland,et al.  Soft Systems Methodology in Action , 1990 .

[7]  Guy Fitzgerald,et al.  Research methods in information systems , 1985 .

[8]  Trevor Wood-Harper,et al.  A critical perspective on action research as a method for information systems research , 1996, J. Inf. Technol..

[9]  S. L. Star.  The Cultures of Computing , 1995 .

[10]  John Mingers,et al.  The paucity of multimethod research: a review of the information systems literature , 2003, Inf. Syst. J..

[11]  P. Checkland.  From framework through experience to learning: The essential nature of action research , 1991 .

[12]  Rudy Hirschheim,et al.  Symbolism and Information Systems Development: Myth, Metaphor and Magic , 1991, Inf. Syst. Res..

[13]  Geoff Walsham,et al.  The Emergence of Interpretivism in IS Research , 1995, Inf. Syst. Res..

[14]  J. Whitney.  Case Study Research , 1999 .

[15]  Kostas Kontogiannis,et al.  Proceedings of the Eleventh International Workshop on Software Technology and Engineering Practice , 2003 .

[16]  Shari Lawrence Pfleeger,et al.  Principles of survey research: part 1: turning lemons into lemonade , 2001, SOEN.

[17]  Robert K. Yin,et al.  Applications of case study research , 1993 .