An Evidence Profile for Software Engineering Research and Practice

Evidence-based software engineering has emerged as an important part of software engineering. The need for empirical evaluation and hence evidence when developing new models, methods, techniques and tools in research has grown in the last couple of decades. Furthermore, industrial decision-making ought to become more evidence-based. The objective here is to develop and present an evidence-based profile, which could be used to divide pieces of evidence into different types and hence create an overall picture of evidence in a specific case. The evidence profile is developed in such a way that it allows evidence to be judged in context. The evidence profile consists of five types of evidence, and it is illustrated for perspective-based reading. It is shown how pieces of evidence can be classified into the different types. It is concluded that this type of approach may be useful for capturing the evidence with respect to a specific topic and in a specific context. Further work will include applying the evidence profile to evidence collected from different types of studies and contexts.

[2]  Daniela Cruzes,et al.  Recommended Steps for Thematic Synthesis in Software Engineering , 2011, 2011 International Symposium on Empirical Software Engineering and Measurement.

[3]  Forrest Shull,et al.  Building Knowledge through Families of Experiments , 1999, IEEE Trans. Software Eng..

[4]  Colin Atkinson,et al.  An experimental comparison of reading techniques for defect detection in UML design documents , 2000, J. Syst. Softw..

[5]  Will Hayes,et al.  Research synthesis in software engineering: a case for meta-analysis , 1999, Proceedings Sixth International Software Metrics Symposium (Cat. No.PR00403).

[6]  Filippo Lanubile,et al.  Investigating the active guidance factor in reading techniques for defect detection , 2004, Proceedings. 2004 International Symposium on Empirical Software Engineering, 2004. ISESE '04..

[7]  Albert Endres,et al.  A handbook of software and systems engineering - empirical observations, laws and theories , 2003, The Fraunhofer IESE series on software engineering.

[8]  Sabaliauskaite Giedre,et al.  Investigating defect detection in object-oriented design and cost-effectiveness of software inspection , 2004 .

[9]  Pearl Brereton,et al.  Performing systematic literature reviews in software engineering , 2006, ICSE.

[10]  Tore Dybå,et al.  Evidence-based software engineering , 2004, Proceedings. 26th International Conference on Software Engineering.

[11]  Lefteris Angelis,et al.  The Success Factors Powering Industry-Academia Collaboration , 2012, IEEE Software.

[12]  D. Sackett,et al.  Evidence based medicine: what it is and what it isn't , 1996, BMJ.

[13]  Marcus Ciolkowski,et al.  What do we know about perspective-based reading? An approach for quantitative aggregation in software engineering , 2009, 2009 3rd International Symposium on Empirical Software Engineering and Measurement.

[14]  Stefan Biffl,et al.  Investigating the accuracy of defect estimation models for individuals and teams based on inspection data , 2003, 2003 International Symposium on Empirical Software Engineering, 2003. ISESE 2003. Proceedings..

[15]  Jeffrey C. Carver,et al.  Perspective-Based Reading: A Replicated Experiment Focused on Individual Reviewer Effectiveness , 2006, Empirical Software Engineering.

[16]  Filippo Lanubile,et al.  Assessing the impact of active guidance for defect detection: a replicated experiment , 2004 .

[17]  Oliver Laitenberger,et al.  Perspective-based reading of code documents at Robert Bosch GmbH , 1997, Inf. Softw. Technol..

[18]  James Miller Can results from software engineering experiments be safely combined? , 1999, Proceedings Sixth International Software Metrics Symposium (Cat. No.PR00403).

[19]  Giuseppe Visaggio,et al.  Evaluating Defect Detection Techniques for Software Requirements Inspections , 2000 .

[20]  Tore Dybå,et al.  Evidence-Based Software Engineering for Practitioners , 2005, IEEE Softw..

[21]  Stefan Biffl Analysis of the impact of reading technique and inspector capability on individual inspection performance , 2000, Proceedings Seventh Asia-Pacific Software Engeering Conference. APSEC 2000.

[22]  Forrest Shull,et al.  The empirical investigation of Perspective-Based Reading , 1995, Empirical Software Engineering.

[23]  Claes Wohlin,et al.  Context in industrial software engineering research , 2009, 2009 3rd International Symposium on Empirical Software Engineering and Measurement.

[24]  Barbara A. Kitchenham,et al.  Combining empirical results in software engineering , 1998, Inf. Softw. Technol..

[25]  Claes Wohlin,et al.  Classification of Software Transfers , 2012, 2012 19th Asia-Pacific Software Engineering Conference.

[26]  V. Goel,et al.  Meaning and measurement: an inclusive model of evidence in health care. , 2001, Journal of evaluation in clinical practice.

[27]  Shari Lawrence Pfleeger,et al.  Soup or Art? The Role of Evidential Force in Empirical Software Engineering , 2005, IEEE Softw..

[28]  Tony Gorschek,et al.  Success Factors Powering Industry-Academia Collaboration in Software Research , 2012 .

[29]  Daniela Cruzes,et al.  Research synthesis in software engineering: A tertiary study , 2011, Inf. Softw. Technol..