Assessing the reproducibility and accuracy of functional size measurement methods through experimentation

A number of functional size measurement (FSM) methods have been proposed in the literature, but so far there has been little systematic evaluation of these methods. This paper describes a controlled experiment which compares function point analysis, a standard FSM method supported by the International Function Point Users Group (IFPUG FPA) and OO-method function points (OOmFP), a recently proposed FSM method for sizing object-oriented software systems that are developed using the OO-Method approach. The goal is to investigate whether OOmFP results in better size assessments within the context of an OO-Method development process. The methods are compared using two criteria defined in the ISO 14143-3: reproducibility and accuracy. The results show that, within its context, OOmFP is more consistent and accurate than IFPUG FPA.

[1]  Jeffrey C. Carver,et al.  Issues in using students in empirical studies in software engineering education , 2003, Proceedings. 5th International Workshop on Enterprise Networking and Computing in Healthcare Industry (IEEE Cat. No.03EX717).

[2]  D. Janaki Ram,et al.  Object oriented design function points , 2000, Proceedings First Asia-Pacific Conference on Quality Software.

[3]  Marvin V. Zelkowitz,et al.  Experimental Models for Validating Technology , 1998, Computer.

[4]  Shari Lawrence Pfleeger,et al.  Preliminary Guidelines for Empirical Research in Software Engineering , 2002, IEEE Trans. Software Eng..

[5]  Ernie Rains.  Function points in an Ada object-oriented design? , 1991, OOPS.

[6]  Vicente Pelechano,et al.  The OO-method approach for information systems modeling: from object-oriented conceptual modeling to automated programming , 2001, Inf. Syst..

[7]  Lionel C. Briand,et al.  An assessment and comparison of common software cost estimation modeling techniques , 1999, Proceedings of the 1999 International Conference on Software Engineering (IEEE Cat. No.99CB37002).

[8]  Alain Abran,et al.  From software metrics to software measurement methods: a process model , 1997, Proceedings of IEEE International Symposium on Software Engineering Standards.

[9]  Allen S. Parrish,et al.  An Empirical Study Using Task Assignment Patterns to Improve the Accuracy of Software Effort Estimation , 2001, IEEE Trans. Software Eng..

[10]  Walter F. Tichy,et al.  Should Computer Scientists Experiment More? , 1998, Computer.

[11]  F KemererChris.  Reliability of function points measurement , 1993 .

[12]  Shinji Kusumoto,et al.  Function point measurement tool for UML design specification , 1999, Proceedings Sixth International Software Metrics Symposium (Cat. No.PR00403).

[13]  H. E. Dunsmore,et al.  Software engineering metrics and models , 1986 .

[15]  Alain Abran,et al.  Function point analysis for the OO-Jacobson method: a mapping approach , 1998 .

[16]  Claes Wohlin,et al.  Using Students as Subjects—A Comparative Study of Students and Professionals in Lead-Time Impact Assessment , 2000, Empirical Software Engineering.

[17]  Giuliano Antoniol,et al.  Adapting Function Points to Object-Oriented Information Systems , 1998, CAiSE.

[18]  Otto-von-Guericke-Universitä Magdeburg.  A Generalized Representation for selected Functional Size Measurement Methods , 2001 .

[19]  D. Ross Jeffery,et al.  Function Points in the Estimation and Evaluation of the Software Process , 1990, IEEE Trans. Software Eng..

[20]  Vojislav B. Misic,et al.  Cost estimation based on business models , 1999, J. Syst. Softw..

[21]  Luiz A. Laranjeira.  Software Size Estimation of Object-Oriented Systems , 1990, IEEE Trans. Software Eng..

[22]  Claes Wohlin,et al.  Experimentation in software engineering: an introduction , 2000 .

[23]  Victor R. Basili,et al.  The TAME Project: Towards Improvement-Oriented Software Environments , 1988, IEEE Trans. Software Eng..

[24]  Stephen G. MacDonell.  Comparative review of functional complexity assessment methods for effort estimation , 1994, Softw. Eng. J..

[25]  Chris F. Kemerer,et al.  Improving the Reliability of Function Point Measurement: An Empirical Study , 1992, IEEE Trans. Software Eng..