Defect Density Measurements Using COSMIC - Experiences with Mobile Apps and Embedded Systems

Defect Density Measurements based on functional size have big advantages over traditional approaches based on counting entries in defect repositories. Using structural information, defects can be located within data movements using the ISO/IEC 19761 COSMIC framework. Consequently, defect counts and defect density indicators become comparable among different projects and products, and can even be used for contracting purposes and in acceptance criteria. This article explores modern defect density measurements in two different areas: first, in mobile apps, where functionality spreads between server and devices and defects might arise at communication interfaces between server and devices, and second, in instruments with embedded software ("Internet of Things"), where defects occur when interfacing between different functional users. This yields new insights into origin of defects, and, consequently, leads to defect avoidance strategies. Also, it is shown how ISO/IEC 20926 IFPUG can be used to identify layered application boundaries within the counting scope, establishing effective test scenarios useful for counting defects with ISO/IEC 19761 COSMIC. A best practice for setting application boundaries is proposed that applies both to IFPUG and COSMIC.

[1]  N. Bourbaki Elements of mathematics : algebra , 2003 .

[2]  Thomas Fehlmann,et al.  Exponentially Weighted Moving Average (EWMA) Prediction in the Software Development Process , 2014, 2014 Joint Conference of the International Workshop on Software Measurement and the International Conference on Software Process and Product Measurement.

[3]  Ieee Std,et al.  Systems and Software Engineering— Systems and Software Assurance— Part 1: Concepts and Vocabulary , 2011 .

[4]  Alain Abran,et al.  COSMIC Function Points: Theory and Advanced Practices , 2011 .

[5]  Rick L. Edgeman,et al.  Design for Six Sigma , 2011, International Encyclopedia of Statistical Science.

[6]  Thomas Fehlmann,et al.  Early Software Project Estimation the Six Sigma Way , 2014, XP Workshops.

[7]  Mehmet Söylemez,et al.  Using Process Enactment Data Analysis to Support Orthogonal Defect Classification for Software Process Improvement , 2013, 2013 Joint Conference of the 23rd International Workshop on Software Measurement and the 8th International Conference on Software Process and Product Measurement.

[8]  Sanjay Kumar Dubey,et al.  Software Defect Prediction Models for Quality Improvement : A Literature Study , 2012 .

[9]  Said Ilias Function point counting practices manual , 2000 .

[10]  Khaled Hamdan,et al.  Practical software project total cost estimation methods , 2010, 2010 International Conference on Multimedia Computing and Information Technology (MCIT).

[11]  Yoji Akao,et al.  Quality Function Deployment : Integrating Customer Requirements into Product Design , 1990 .

[12]  A. Abran,et al.  The COSMIC Functional Size Measurement Method version 3.0, Measurement Manual , 2007 .

[13]  Thomas Fehlmann,et al.  Quality of Estimations - How to Assess Reliability of Cost Predictions , 2012, 2012 Joint Conference of the 22nd International Workshop on Software Measurement and the 2012 Seventh International Conference on Software Process and Product Measurement.

[14]  Thomas Fehlmann,et al.  COSMIC Functional Sizing based on UML Sequence Diagrams , 2011 .

[15]  Thomas Fehlmann When use COSMIC FFP? When use IFPUG FPA? A Six Sigma View , 2006 .