A Retrospective Study of Software Analytics Projects: In-Depth Interviews with Practitioners

Software analytics guide practitioners in decision making throughout the software development process. In this context, prediction models help managers efficiently organize their resources and identify problems by analyzing patterns on existing project data in an intelligent and meaningful manner. Over the past decade, the authors have worked with software organizations to build metric repositories and predictive models that address process-, product-, and people-related issues in practice. This article shares their experience over the years, reflecting the expectations and outcomes both from practitioner and researcher viewpoints.

[1]  Ronald Czaja,et al.  Designing Surveys: A Guide to Decisions and Procedures , 1995 .

[2]  Bora Caglayan,et al.  Dione: an integrated measurement and defect prediction solution , 2012, SIGSOFT FSE.

[3]  Dongmei Zhang,et al.  Software analytics as a learning case in practice: approaches and experiences , 2011, MALETS '11.

[4]  C. Boyce,et al.  Conducting in-depth interviews: a guide for designing and conducting in-depth interviews for evaluation input. , 2006 .

[5]  Ayse Basar Bener,et al.  AI-Based Models for Software Effort Estimation , 2010, 2010 36th EUROMICRO Conference on Software Engineering and Advanced Applications.

[6]  Jacek Czerwonka,et al.  CRANE: Failure Prediction, Change Analysis and Test Prioritization in Practice -- Experiences from Windows , 2011, 2011 Fourth IEEE International Conference on Software Testing, Verification and Validation.

[7]  Julia Eichmann,et al.  Making Software - What Really Works, and Why We Believe It , 2011, Making Software.

[8]  Bora Caglayan,et al.  Usage of multiple prediction models based on defect categories , 2010, PROMISE '10.

[9]  Ayse Basar Bener,et al.  AI-Based Software Defect Predictors : Applications and Benefits in a Case Study , 2011 .

[10]  Forrest Shull,et al.  The Quest for Convincing Evidence , 2011, Making Software.

[11]  Ayse Basar Bener,et al.  Practical considerations in deploying statistical methods for defect prediction: A case study within the Turkish telecommunications industry , 2010, Inf. Softw. Technol..

[12]  Dongmei Zhang,et al.  XIAO: tuning code clones at hands of engineers in practice , 2012, ACSAC '12.