Metrics for database systems: an empirical study

An important task for any software project manager is to be able to predict and control project size and development effort. Unfortunately, there is comparatively little work, other than function points, that tackles the problem of building prediction systems for software that is dominated by data considerations, in particular systems developed using 4GLs. We describe an empirical investigation of 70 such systems. Various easily obtainable counts were extracted from data models (e.g. number of entities) and from specifications (e.g. number of screens). Using simple regression analysis, a prediction system of implementation size with accuracy of MMRE=21% was constructed. This approach offers several advantages. First there tend to be fewer counting problems than with function points since the metrics we used were based upon simple counts. Second, the prediction systems were calibrated to specific local environments rather than being based upon industry weights. We believe this enhanced their accuracy. Our work shows that it is possible to develop simple and useful local prediction systems based upon metrics easily derived from functional specifications and data models, without recourse to overly complex metrics or analysis techniques. We conclude that this type of use of metrics can provide valuable support for the management and control of 4GL and database projects.

[1]  Chris F. Kemerer,et al.  An empirical validation of software cost estimation models , 1987, CACM.

[2]  Paul Rook,et al.  Controlling software projects , 1986, Softw. Eng. J..

[3]  Pierre N. Robillard,et al.  Factor analysis of source code metrics , 1990, J. Syst. Softw..

[4]  Barbara A. Kitchenham,et al.  Towards a constructive quality model. Part 2: Statistical techniques for modelling software quality in the ESPRIT REQUEST project , 1987, Softw. Eng. J..

[5]  John E. Gaffney,et al.  Software Function, Source Lines of Code, and Development Effort Prediction: A Software Science Validation , 1983, IEEE Transactions on Software Engineering.

[6]  Vianney Côté,et al.  An experiment in software sizing with structured analysis metrics , 1991, J. Syst. Softw..

[7]  Kari Känsälä,et al.  Inter-item correlations among function points , 1993, [1993] Proceedings First International Software Metrics Symposium.

[8]  Charles R. Symons,et al.  Software sizing and estimating - Mk II FPA, function point analysis , 1991, Wiley series in software engineering practice.

[9]  D. Ross Jeffery,et al.  A Comparison of Function Point Counting Techniques , 1993, IEEE Trans. Software Eng..

[10]  Chris F. Kemerer,et al.  Reliability of function points measurement: a field experiment , 2015, CACM.

[11]  D. Ross Jeffery,et al.  Function Points in the Estimation and Evaluation of the Software Process , 1990, IEEE Trans. Software Eng..

[12]  Barry W. Boehm,et al.  Software Engineering Economics , 1993, IEEE Transactions on Software Engineering.

[13]  Lesley M. Pickard,et al.  Statistical techniques for modelling software quality in the ESPIRIT REQUEST project , 1987 .

[14]  June M. Verner,et al.  Estimating size and effort in fourth-generation development , 1988, IEEE Software.

[15]  L. Leemis Applied Linear Regression Models , 1991 .

[16]  Stephen G. MacDonell Comparative review of functional complexity assessment methods for effort estimation , 1994, Softw. Eng. J..

[17]  TateGraham,et al.  Estimating Size and Effort in Fourth-Generation Development , 1988 .