Towards a Framework for Software Measurement Validation

In this paper we propose a framework for validating software measurement. We start by defining a measurement structure model that identifies the elementary component of measures and the measurement process, and then consider five other models involved in measurement: unit definition models, instrumentation models, attribute relationship models, measurement protocols and entity population models. We consider a number of measures from the viewpoint of our measurement validation framework and identify a number of shortcomings; in particular we identify a number of problems with the construction of function points. We also compare our view of measurement validation with ideas presented by other researchers and identify a number of areas of disagreement. Finally, we suggest several rules that practitioners and researchers can use to avoid measurement problems, including the use of measurement vectors rather than artificially contrived scalars.

[1]  Shari Lawrence Pfleeger,et al.  Experimental design and analysis in software engineering , 1995, Ann. Softw. Eng..

[2]  Norman F. Schneidewind,et al.  Methodology For Validating Software Metrics , 1992, IEEE Trans. Software Eng..

[3]  Barbara A. Kitchenham,et al.  An evaluation of some design metrics , 1990, Softw. Eng. J..

[4]  Sallie M. Henry,et al.  Software Structure Metrics Based on Information Flow , 1981, IEEE Transactions on Software Engineering.

[5]  Norman Fenton,et al.  Software engineering metrics. Vol. 1: Measures and validations. Martin Shepperd, Published by McGraw‐Hill Book Company Europe, Maidenhead, U.K., 1993. ISBN 0‐07‐707410‐6, 302 pages. Price: £35.00, hard cover , 1994 .

[6]  Horst Zuse,et al.  Support of Experimentation by Measurement Theory , 1992, Experimental Software Engineering Issues.

[7]  Norman E. Fenton,et al.  Software Metrics: A Rigorous Approach , 1991 .

[8]  A. A. Kaposi,et al.  A Generalised Mathematical Theory of Structured Programming , 1985, Theor. Comput. Sci..

[9]  Yinka R. Adebayo,et al.  Some issues surrounding air pollution problems in Africa , 1990 .

[10]  Maurice H. Halstead,et al.  Elements of software science (Operating and programming systems series) , 1977 .

[11]  Albert L. Baker,et al.  A mathematical perspective for software measures research , 1990, Softw. Eng. J..

[12]  Charles R. Symons,et al.  Function Point Analysis: Difficulties and Improvements , 1988, IEEE Trans. Software Eng..

[13]  Martin Sheppard Design metrics: an empirical analysis , 1990, Softw. Eng. J..

[14]  Barbara A. Kitchenham,et al.  Validating software measures , 1991, Softw. Test. Verification Reliab..

[15]  J. Fleiss Measuring nominal scale agreement among many raters. , 1971 .

[16]  Elaine J. Weyuker,et al.  Evaluating Software Complexity Measures , 2010, IEEE Trans. Software Eng..

[17]  Norman E. Fenton,et al.  Measurement : A Necessary Scientific Basis , 2004 .

[18]  Shari Lawrence Pfleeger Experimental design and analysis in software engineering, part 5: analyzing the data , 1995, SOEN.

[19]  S. Siegel,et al.  Nonparametric Statistics for the Behavioral Sciences , 2022, The SAGE Encyclopedia of Research Design.

[20]  Chris F. Kemerer,et al.  A Metrics Suite for Object Oriented Design , 2015, IEEE Trans. Software Eng..