An Empirical Analysis of IFPUG FPA and COSMIC FFP Measurement Methods

The accuracy of functional size measuring is critical in software project management, because it is one of the key inputs for effort and cost estimation models. The functional size measurement (FSM) process is performed based on standardized methods; however, the accuracy of the FSM results is still based mostly on the knowledge of the measurers. In this paper, an empirical study was conducted to analyze the accuracy, reproducibility, and acceptance properties of the IFPUG FPA and COSMIC FFP functional size measurement methods. Results show that the performance of participants in measuring the requirement specifications using IFPUG FPA and COSMIC FFP did not differ significantly in terms of accuracy and reproducibility. Likewise, acceptance properties such as perceived ease of use, perceived usefulness, and intention to use did not present significant differences. Our results suggest that novice measurers could apply both methods with similar results.

[1]  Onur Demirörs,et al.  Towards the Development of a Defect Detection Tool for COSMIC Functional Size Measurement , 2013, 2013 Joint Conference of the 23rd International Workshop on Software Measurement and the 8th International Conference on Software Process and Product Measurement.

[2]  Fred D. Davis User Acceptance of Information Technology: System Characteristics, User Perceptions and Behavioral Impacts , 1993, Int. J. Man Mach. Stud..

[3]  Chris F. Kemerer,et al.  Reliability of function points measurement: a field experiment , 2015, CACM.

[4]  D. Ross Jeffery,et al.  Function Points in the Estimation and Evaluation of the Software Process , 1990, IEEE Trans. Software Eng..

[5]  Natalia Juristo Juzgado,et al.  The effect of noise on software engineers' performance , 2018, ESEM.

[6]  Onur Demirörs,et al.  Reliability of COSMIC Functional Size Measurement Results: A Multiple Case Study on Industry Cases , 2009, 2009 35th Euromicro Conference on Software Engineering and Advanced Applications.

[7]  Christian Quesada-López,et al.  An Empirical Evaluation of Automated Function Points , 2016, CIbSE.

[8]  Gabriela Robiolo How Simple is It to Measure Software Size and Complexity for an IT Practitioner? , 2011, 2011 International Symposium on Empirical Software Engineering and Measurement.

[9]  Onur Demirörs,et al.  An Experimental Study on the Reliability of COSMIC Measurement Results , 2009, IWSM/Mensura.

[10]  Thomas Fetcke,et al.  The Warehouse Software Portfolio A Case Study in Functional Size Measurement , 1999 .

[11]  Christian Quesada-López,et al.  Towards the automation of a defect detection protocol for functional size measurements , 2018, CIbSE.

[12]  Natalia Juristo Juzgado,et al.  Crossover Designs in Software Engineering Experiments: Benefits and Perils , 2016, IEEE Transactions on Software Engineering.

[13]  Claes Wohlin,et al.  Experimentation in Software Engineering , 2012, Springer Berlin Heidelberg.

[14]  Chris F. Kemerer,et al.  Improving the Reliability of Function Point Measurement: An Empirical Study , 1992, IEEE Trans. Software Eng..

[15]  Onur Demirörs,et al.  The Effect of Entity Generalization on Software Functional Sizing: A Case Study , 2008, PROFES.

[16]  Alain Abran,et al.  Verifying the Accuracy of Automation Tools for the Measurement of Software with COSMIC -- ISO 19761 Including an AUTOSAR-Based Example and a Case Study , 2014, 2014 Joint Conference of the International Workshop on Software Measurement and the International Conference on Software Process and Product Measurement.

[17]  Christian Quesada-López,et al.  An Evaluation of Functional Size Measurement Methods , 2015, CIbSE.

[18]  Onur Demirörs,et al.  The Impact of Individual Assumptions on Functional Size Measurement , 2008, IWSM/Metrikon/Mensura.

[19]  Manfred Bundschuh,et al.  The IT measurement compendium - estimating and benchmarking success with functional size measurement , 2008 .

[20]  Christian Quesada-López,et al.  Applying a Verification Protocol to Evaluate the Accuracy of Functional Size Measurement Procedures: An Empirical Approach , 2015, PROFES.

[21]  Silvia Mara Abrahao Gonzales On the functional size measurement of object-oriented conceptual schemas: design and evaluation issues , 2004 .