Evaluation of Reproducibility and Accuracy of the Business Process Point Analysis Technique

Techniques of functional size measurement are easily found in the literature, however, in the evaluation process of these techniques is not always approached which makes its validity questionable. The evaluation of the Business Process Point Analysis (BPPA) technique is the object of study of this article that aims to consistently evaluate its reproducibility and accuracy, identifying its limitations. BPPA was proposed so that project managers can systematically estimate the functional size of a business process automation project. Thus, this article presents the execution of a quasi-experiment realized with 58 graduate and postgraduate students, who measured the functional size of three business process models. The results of this experiment present the low reproducibility and accuracy of the technique as well as its limitations.

[1]  Guilherme Horta Travassos,et al.  Introdução à Engenharia de Software Experimental , 2002 .

[2]  Zarinah M. Kasirun,et al.  Automating Function Points analysis based on functional and non functional requirements text , 2010, 2010 The 2nd International Conference on Computer and Automation Engineering (ICCAE).

[3]  Geoffrey Muchiri Muketha.  A survey of business processes complexity metrics , 2010 .

[4]  Marcelo Fantinato,et al.  Business Process Points - A Proposal To Measure BPM Projects , 2013, ECIS.

[5]  Shinji Kusumoto,et al.  Function point measurement from Web application source code based on screen transitions and database accesses , 2011, J. Syst. Softw..

[6]  Marcelo Fantinato,et al.  Business process point analysis: survey experiments , 2017, Bus. Process. Manag. J..

[7]  Jorge S. Cardoso,et al.  Business Process Control-Flow Complexity: Metric, Evaluation, and Validation , 2008, Int. J. Web Serv. Res..

[8]  Oscar Pastor,et al.  Comparative Evaluation of Functional Size Measurement Methods: An Experimental Analysis , 2004 .

[9]  Maria Beatriz Felgar de Toledo,et al.  Product Line in the Business Process Management Domain , 2009 .

[10]  Alain Abran,et al.  Measuring Software Functional Size from Business Process Models , 2011, Int. J. Softw. Eng. Knowl. Eng..

[11]  Oscar Pastor,et al.  Faculteit Economie En Bedrijfskunde Hoveniersberg 24 B-9000 Gent Functional Size Measurement Method for Object-oriented Conceptual Schemas: Design and Evaluation Issues a Functional Size Measurement Method for Object-oriented Conceptual Schemas: Design and Evaluation Issues , 2022 .

[12]  Thangavel Chandrakumar,et al.  An approach to estimate the size of ERP package using package points , 2016, Comput. Stand. Interfaces.

[13]  Silvia Mara Abrahão,et al.  A Metamodeling Approach to Estimate Software Size from Requirements Specifications , 2008, 2008 34th Euromicro Conference Software Engineering and Advanced Applications.

[14]  Michael J. Connolley.  An empirical study of function points analysis reliability , 1990 .

[15]  Mathias Weske,et al.  Business Process Management: Concepts, Languages, Architectures , 2007 .

[16]  Sho Ho,et al.  Measuring function points from VDM-SL specifications , 2008, 2008 International Conference on Service Systems and Service Management.

[17]  Nikos E. Mastorakis,et al.  Cost effective software test metrics , 2008 .

[18]  Shari Lawrence Pfleeger,et al.  Software Metrics : A Rigorous and Practical Approach , 1998 .

[19]  Silvia Mara Abrahão,et al.  A model-driven measurement procedure for sizing web applications: design, automation and validation , 2007, MODELS'07.

[20]  Evelina Lamma,et al.  A System for Measuring Function Points from an ER-DFD Specification , 2004, Comput. J..

[21]  Piero Fraternali,et al.  Automating function point analysis with model driven development , 2006, CASCON.

[22]  R. Köhler,et al.  The International Vocabulary of Metrology, 3rd Edition: Basic and General Concepts and Associated Terms. Why? How? , 2010 .

[23]  Marcelo Fantinato,et al.  FPA4BPM: function point analysis for business process management (v.1.0) , 2012 .

[24]  Chris F. Kemerer,et al.  Reliability of function points measurement: a field experiment , 2015, CACM.

[25]  D. Ross Jeffery,et al.  Function Points in the Estimation and Evaluation of the Software Process , 1990, IEEE Trans. Software Eng..

[26]  Shinji Kusumoto,et al.  Function-point analysis using design specifications based on the Unified Modelling Language , 2001, J. Softw. Maintenance Res. Pract..