If you want better empirical research, value your theory: On the importance of strong theories for progress in empirical software engineering research

Scientific progress comes from creating sound theories. However, current software engineering still mostly falls short of this goal, although its importance is widely accepted. Thus, in this paper, we discuss the importance of a successful interaction of empirical research with a strong theoretical basis and the ramifications this has. In particular, we will extensively discuss the implications on theory building and the empirical vs. theory interaction, etc. While not everything we will discuss is novel, we present a number of insights, which we at least did not see in software engineering literature. We strongly believe that a careful consideration of the insights discussed in this paper has the potential to lead to a significant improvement in software engineering research.

[1]  Ian R. McChesney,et al.  Observations on the Linear Order of Program Code Reading Patterns in Programmers with Dyslexia , 2020, EASE.

[2]  T. Kuhn,et al.  Die Struktur wissenschaftlicher Revolutionen , 1973 .

[3]  Albert Endres,et al.  A handbook of software and systems engineering - empirical observations, laws and theories , 2003, The Fraunhofer IESE series on software engineering.

[4]  Peter Struss,et al.  Current Topics in Qualitative Reasoning , 2004, AI Mag..

[5]  Daniel Méndez Fernández,et al.  Empirical Software Engineering: From Discipline to Interdiscipline , 2018, J. Syst. Softw..

[6]  Monya Baker,et al.  Over half of psychology studies fail reproducibility test , 2015, Nature.

[7]  Dietmar Pfahl,et al.  Reflections on 10 Years of Software Process Simulation Modeling: A Systematic Review , 2008, ICSP.

[8]  Jon Doyle,et al.  A Truth Maintenance System , 1979, Artif. Intell..

[9]  Jürgen Münch,et al.  Studying the impact of global software development characteristics on project goals: a causal model , 2010 .

[10]  Paul Ralph,et al.  Grounded Theory in Software Engineering Research: A Critical Review and Guidelines , 2016, 2016 IEEE/ACM 38th International Conference on Software Engineering (ICSE).

[11]  Manoel G. Mendonça,et al.  Surveying Software Practitioners on Technical Debt Payment Practices and Reasons for not Paying off Debt Items , 2020, EASE.

[12]  Brian Fitzgerald,et al.  Uncovering theories in software engineering , 2013, 2013 2nd SEMAT Workshop on a General Theory of Software Engineering (GTSE).

[13]  Victor R. Basili,et al.  The Experience Factory and its Relationship to Other Improvement Paradigms , 1993, ESEC.

[14]  Mehrdad Sabetzadeh,et al.  The Case for Context-Driven Software Engineering Research: Generalizability Is Overrated , 2017, IEEE Softw..

[15]  Iftekhar Ahmed,et al.  A Multiple Case Study of Artificial Intelligent System Development in Industry , 2020, EASE.