A Survey:A Multiple Comparisons Algorithm based Ranking and Clustering of COCOMO and Putnam's Software Cost Estimation Models

Software project can be completely predicting the most realistic effort using Software Cost Estimation. There are variety of methods and models trying to improve the estimation procedure of Software project development and application. From the variety of methods emerged the need for comparisons to determine the best model. Here, we propose a statistical framework based on a multiple comparisons algorithm in order to rank several cost estimation models, identifying those which have significant differences in accuracy, and clustering them in non overlapping groups. The proposed framework is applied in a large scale setup of comparing prediction models over datasets.

[1]  A. Scott,et al.  A Cluster Analysis Method for Grouping Means in the Analysis of Variance , 1974 .

[2]  Stephen G. MacDonell,et al.  What accuracy statistics really measure , 2001, IEE Proc. Softw..

[3]  Victor R. Basili,et al.  Scope error detection and handling concerning software estimation models , 2009, 2009 3rd International Symposium on Empirical Software Engineering and Measurement.

[4]  Magne Jørgensen,et al.  A Systematic Review of Software Development Cost Estimation Studies , 2007, IEEE Transactions on Software Engineering.

[5]  Martin J. Shepperd,et al.  Comparing Software Prediction Techniques Using Simulation , 2001, IEEE Trans. Software Eng..

[6]  Ingunn Myrtveit,et al.  Reliability and validity in comparative studies of software prediction models , 2005, IEEE Transactions on Software Engineering.

[7]  Iman Attarzadeh,et al.  A Novel Algorithmic Cost Estimation Model Based on Soft Computing Technique , 2010 .

[8]  Lefteris Angelis,et al.  Ranking and Clustering Software Cost Estimation Models through a Multiple Comparisons Algorithm , 2013, IEEE Transactions on Software Engineering.

[9]  Lefteris Angelis,et al.  Comparing cost prediction models by resampling techniques , 2008, J. Syst. Softw..

[10]  Barbara A. Kitchenham,et al.  A Simulation Study of the Model Evaluation Criterion MMRE , 2003, IEEE Trans. Software Eng..

[11]  Magne Jørgensen,et al.  A Systematic Review of Software Development Cost Estimation Studies , 2007 .

[12]  Harris Papadopoulos,et al.  Feature Subset Selection for Software Cost Modelling and Estimation , 2012, ArXiv.