On the use of weighted sums in the definition of measures

Several widely used functionality measures, quality models, and other measures have been defined in Empirical Software Engineering by using weighted sums. The apparent simplicity in the definition and interpretation of weighted sums make them one of the preferred ways for defining new measures. However, they have a few inherent issues that may make their definition and use quite problematic. This paper provides a critical investigation about the intuition behind weighted sums and their theoretical and empirical validation pitfalls that may make them questionable when used in the definition of meaningful and practically useful measures. Using estimation models may alleviate at least some of the problems with weighted sums.

[1]  Kari Känsälä,et al.  Inter-item correlations among function points , 1993, [1993] Proceedings First International Software Metrics Symposium.

[2]  Sandro Morasca,et al.  Refining the axiomatic definition of internal software attributes , 2008, ESEM '08.

[3]  A. Tversky,et al.  Foundations of Measurement, Vol. I: Additive and Polynomial Representations , 1991 .

[4]  Charles R. Symons,et al.  Function Point Analysis: Difficulties and Improvements , 1988, IEEE Trans. Software Eng..

[5]  Sandro Morasca,et al.  How the trustworthiness of OSS products and artifacts can be assessed and predicted , 2011 .

[6]  Genny Tortora,et al.  Class point: an approach for the size estimation of object-oriented systems , 2005, IEEE Transactions on Software Engineering.

[7]  Capers Jones,et al.  Applied software measurement (2nd ed.): assuring productivity and quality , 1996 .

[8]  Shari Lawrence Pfleeger,et al.  Software Metrics : A Rigorous and Practical Approach , 1998 .

[9]  Brian Henderson-Sellers,et al.  Object-Oriented Metrics , 1995, TOOLS.

[10]  Barry Boehm,et al.  Characteristics of software quality , 1978 .

[11]  Barry W. Boehm,et al.  Cost models for future software life cycle processes: COCOMO 2.0 , 1995, Ann. Softw. Eng..

[12]  Sandro Morasca,et al.  A probability-based approach for measuring external attributes of software artifacts , 2009, 2009 3rd International Symposium on Empirical Software Engineering and Measurement.

[13]  Sandro Morasca,et al.  OpenBQR: a framework for the assessment of OSS , 2007, OSS.

[14]  Bernard Golden.  Making Open Source Ready for the Enterprise: The Open Source Maturity Model , 2008 .

[15]  Sandro Morasca,et al.  Property-Based Software Engineering Measurement , 1996, IEEE Trans. Software Eng..

[16]  Sallie M. Henry,et al.  Object-oriented metrics that predict maintainability , 1993, J. Syst. Softw..

[17]  Elaine J. Weyuker,et al.  Evaluating Software Complexity Measures , 2010, IEEE Trans. Software Eng..

[18]  F. Roberts.  Measurement Theory with Applications to Decisionmaking, Utility, and the Social Sciences: Measurement Theory , 1984 .

[19]  John E. Gaffney,et al.  Software Function, Source Lines of Code, and Development Effort Prediction: A Software Science Validation , 1983, IEEE Transactions on Software Engineering.

[20]  Giuliano Antoniol,et al.  Object-Oriented Function Points: An Empirical Validation , 2003, Empirical Software Engineering.

[21]  Kenneth W. Boyer.  Function point analysis: measurement practices for successful software projects , 2001, SOEN.