Methodology For Validating Software Metrics

A comprehensive metrics validation methodology is proposed that has six validity criteria, which support the quality functions assessment, control, and prediction, where quality functions are activities conducted by software organizations for the purpose of achieving project quality goals. Six criteria are defined and illustrated: association, consistency, discriminative power, tracking, predictability, and repeatability. The author shows that nonparametric statistical methods such as contingency tables play an important role in evaluating metrics against the validity criteria. Examples emphasizing the discriminative power validity criterion are presented. A metrics validation process is defined that integrates quality factors, metrics, and quality functions. >

[1]  John E. Gaffney,et al.  Software Function, Source Lines of Code, and Development Effort Prediction: A Software Science Validation , 1983, IEEE Transactions on Software Engineering.

[2]  H. E. Dunsmore,et al.  Software engineering metrics and models , 1986 .

[3]  Elaine J. Weyuker,et al.  Evaluating Software Complexity Measures , 2010, IEEE Trans. Software Eng..

[4]  Norman E. Fenton,et al.  Software measurement: A conceptual framework , 1990, J. Syst. Softw..

[5]  Victor R. Basili,et al.  The TAME Project: Towards Improvement-Oriented Software Environments , 1988, IEEE Trans. Software Eng..

[6]  David N. Card,et al.  Criteria for software modularization , 1985, ICSE '85.

[7]  Austin Melton,et al.  Deriving structurally based software measures , 1990, Journal of Systems and Software.

[8]  Victor R. Basili,et al.  An Empirical Study of a Syntactic Complexity Family , 1983, IEEE Transactions on Software Engineering.

[9]  Albert L. Baker,et al.  A philosophy for software measurement , 1990, J. Syst. Softw..

[10]  Leonardo Felician,et al.  Validating Halstead's Theory for Pascal Programs , 1989, IEEE Trans. Software Eng..

[11]  Victor R. Basili,et al.  Metric Analysis and Data Validation Across Fortran Projects , 1983, IEEE Transactions on Software Engineering.

[12]  W. J. Conover,et al.  Practical Nonparametric Statistics , 1972 .

[13]  Adam A. Porter,et al.  Empirically guided software development using metric-based classification trees , 1990, IEEE Software.