Functional versus design measures for model-driven Web applications: A case study in the context of Web effort estimation

In the literature we can identify two main approaches for sizing model-driven Web applications: one based on design measures and another based on functional measures. Design measures take into account the modeling primitives characterizing the models of the specific model-driven approach. On the other hand, the functional measures are obtained by applying functional size measurement procedures specifically conceived to map the modeling primitives of the model-driven approach into concepts of a functional size measurement method. In this paper, we focus our attention on the Object-Oriented Hypermedia (OO-H) method, a model-driven approach to design and develop Web applications. We report on the results of an empirical study carried out to compare the ability of some design measures and OO-HFP (a model-driven functional size measurement procedure) to predict the development effort of Web applications. To this aim, we exploited a dataset with 30 Web projects developed using OO-H. The analysis highlighted that each design measure was positively correlated with the Web application development effort. However, the best estimation model obtained by exploiting the Manual Stepwise Regression employed only the measure Internal Links (IL). Furthermore, the study highlighted that the estimates obtained with the IL based prediction model were significantly better than those achieved using the OO-HFP based prediction model. These results seem to confirm previous investigations suggesting that Function Point Analysis can fail to capture some specific features of Web applications.

[1]  Michael Lang,et al.  A Survey of Multimedia and Web Development Techniques and Methodology Usage , 2001, IEEE Multim..

[2]  Lionel C. Briand,et al.  Modeling Development Effort in Object-Oriented Systems Using Design Properties , 2001, IEEE Trans. Software Eng..

[3]  Silvia Mara Abrahão,et al.  A family of experiments to evaluate a functional size measurement procedure for Web applications , 2009, J. Syst. Softw..

[4]  Katrina D. Maxwell,et al.  Applied Statistics for Software Managers , 2002 .

[5]  Oscar Pastor,et al.  Towards an accurate functional size measurement procedure for conceptual models in an MDA environment , 2010, Data Knowl. Eng..

[6]  Stephen G. MacDonell,et al.  What accuracy statistics really measure , 2001, IEE Proc. Softw..

[7]  Donald J. Reifer Estimating Web Development Costs: There Are Differences , 2002 .

[8]  Cristina Cachero,et al.  OO-H Method: extending UML to model web interfaces , 2003 .

[9]  Ronald H. Rnndles Nonparametric Statistical Inference (2nd ed.) , 1986 .

[10]  Barbara A. Kitchenham,et al.  A Procedure for Analyzing Unbalanced Datasets , 1998, IEEE Trans. Software Eng..

[11]  Jim Conallen,et al.  Building Web applications with UML , 1999 .

[12]  Silvia Mara Abrahão,et al.  A model-driven measurement procedure for sizing web applications: design, automation and validation , 2007, MODELS'07.

[13]  Emilia Mendes,et al.  Further comparison of cross-company and within-company effort estimation models for Web applications , 2004, 10th International Symposium on Software Metrics, 2004. Proceedings..

[14]  Luciano Baresi,et al.  From Web Sites to Web Applications: New Issues for Conceptual Modeling , 2000, ER.

[15]  Piero Fraternali,et al.  Automating function point analysis with model driven development , 2006, CASCON.

[16]  Oscar Pastor,et al.  Measuring the functional size of web applications , 2003, Int. J. Web Eng. Technol..

[17]  R. Forthofer,et al.  Rank Correlation Methods , 1981 .

[18]  Claes Wohlin,et al.  Experimentation in software engineering: an introduction , 2000 .

[19]  Silvia Mara Abrahão,et al.  Validating a size measure for effort estimation in model-driven Web development , 2010, Inf. Sci..

[20]  A. Abran,et al.  The COSMIC Functional Size Measurement Method version 3.0, Measurement Manual , 2007 .

[21]  S. Abrahão,et al.  A COSMIC measurement procedure for sizing web applications developed using the OO-H method , 2010 .

[22]  Subhabrata Chakraborti,et al.  Nonparametric Statistical Inference , 2011, International Encyclopedia of Statistical Science.

[23]  Antonio Vallecillo,et al.  Towards interoperable Web engineering methods , 2008, J. Assoc. Inf. Sci. Technol..

[24]  Luciano Baresi,et al.  Three empirical studies on estimating the design effort of Web applications , 2007, TSEM.

[25]  Stefano Ceri,et al.  Web Modeling Language (WebML): a modeling language for designing Web sites , 2000, Comput. Networks.