An Examination of Determinants of Software Testing and Project Management Effort

ABSTRACT Software estimation research has primarily focused on software effort involved in direct software development. As more and more organizations buy instead of building software, more effort is spent on software testing and project management. In this empirical study, the effect of program duration, computer platform, and software development tool (SDT) on program testing effort and project management effort is studied. The study results point to program duration and software tool as significant determinants of testing and management effort. Computer platform, however, does not have an effect on testing and management effort. Furthermore, the mean testing effort for third generation (3G) development environment was significantly higher than the mean testing effort for fourth generation (4G) environments that used IDE. In addition, the management effort for 4G environment projects without the use of IDE was lower than nonprogramming report generation projects.

[1]  Colin J Burgess,et al.  Can genetic programming improve software effort estimation? A comparative evaluation , 2001, Inf. Softw. Technol..

[2]  Earl Chrysler,et al.  Some basic determinants of computer programming productivity , 1978, CACM.

[3]  Donald J. Reifer.  SoftCost-R: User experiences and lessons learned at the age of one , 1987, J. Syst. Softw..

[4]  Chris F. Kemerer,et al.  An empirical validation of software cost estimation models , 1987, CACM.

[5]  Shari Lawrence Pfleeger,et al.  Software metrics (2nd ed.): a rigorous and practical approach , 1997 .

[6]  Stephen G. MacDonell,et al.  Factors systematically associated with errors in subjective estimates of software development effort: the stability of expert judgment , 1999, Proceedings Sixth International Software Metrics Symposium (Cat. No.PR00403).

[7]  Li-Wei Chen,et al.  Integration of the grey relational analysis with genetic algorithm for software effort estimation , 2008, Eur. J. Oper. Res..

[8]  Magne Jørgensen,et al.  A review of studies on expert estimation of software development effort , 2004, J. Syst. Softw..

[9]  Peter Naudé,et al.  The Effects of Software Size on Development Effort and Software Quality , 2007 .

[10]  Barry W. Boehm,et al.  Software development cost estimation approaches — A survey , 2000, Ann. Softw. Eng..

[11]  Barry W. Boehm,et al.  Bayesian Analysis of Empirical Software Engineering Cost Models , 1999, IEEE Trans. Software Eng..

[12]  John E. Gaffney,et al.  Software Function, Source Lines of Code, and Development Effort Prediction: A Software Science Validation , 1983, IEEE Transactions on Software Engineering.

[13]  Marvin V. Zelkowitz.  Resource utilization during software development , 1988, J. Syst. Softw..

[14]  Girish H. Subramanian,et al.  An empirical analysis of software effort estimate alterations , 1995, J. Syst. Softw..

[15]  Chin-Yu Huang,et al.  Enhancing and measuring the predictive capabilities of testing-effort dependent software reliability models , 2008, J. Syst. Softw..

[16]  Albert L. Lederer,et al.  Nine management guidelines for better cost estimating , 1992, CACM.

[17]  Parag C. Pendharkar,et al.  An empirical study of ICASE learning curves and probability bounds for software development effort , 2007, Eur. J. Oper. Res..

[18]  Frank Elberzhager,et al.  Reducing test effort: A systematic mapping study on existing approaches , 2012, Inf. Softw. Technol..

[19]  Hema Srikanth,et al.  Improving test efficiency through system test prioritization , 2012, J. Syst. Softw..

[20]  Girish H. Subramanian,et al.  An Examination of Some Software Development Effort and Productivity Determinants in ICASE Tool Projects , 1996, J. Manag. Inf. Syst..

[21]  Saurabh Sinha,et al.  Global software testing under deadline pressure: Vendor-side experiences , 2014, Inf. Softw. Technol..

[22]  Ioannis Stamelos,et al.  Software productivity and effort prediction with ordinal regression , 2005, Inf. Softw. Technol..

[23]  Girish H. Subramanian,et al.  Software Effort Estimation Using a Neural Network Ensemble , 2013, J. Comput. Inf. Syst..

[24]  C. Jones,et al.  By popular demand: Software estimating rules of thumb , 1996, Computer.

[25]  Albert L. Lederer,et al.  Information system cost estimating: a management perspective , 1990 .

[26]  Parag C. Pendharkar,et al.  Connectionist Models for Learning, Discovering, and Forecasting Software Effort: An Empirical Study , 2002, J. Comput. Inf. Syst..

[27]  Douglas Fisher,et al.  Machine Learning Approaches to Estimating Software Development Effort , 1995, IEEE Trans. Software Eng..

[28]  Mika Mäntylä,et al.  Are test cases needed? Replicated comparison between exploratory and test-case-based software testing , 2014, Empirical Software Engineering.

[29]  Shari Lawrence Pfleeger,et al.  Software Metrics : A Rigorous and Practical Approach , 1998 .

[30]  Omar Shatnawi.  Testing-Effort Dependent Software Reliability Model for Distributed Systems , 2013, Int. J. Distributed Syst. Technol..

[31]  S DexterAlbert,et al.  A model for measuring information system size , 1991 .

[32]  Abbas Heiat,et al.  Comparison of artificial neural network and regression models for estimating software development effort , 2002, Inf. Softw. Technol..

[33]  Jean-Marc Desharnais,et al.  A comparison of software effort estimation techniques: Using function points with neural networks, case-based reasoning and regression models , 1997, J. Syst. Softw..

[34]  Bart Baesens,et al.  Data Mining Techniques for Software Effort Estimation: A Comparative Study , 2012, IEEE Transactions on Software Engineering.

[35]  Stephen G. MacDonell,et al.  A comparison of techniques for developing predictive models of software metrics , 1997, Inf. Softw. Technol..

[36]  Barry W. Boehm,et al.  Cost models for future software life cycle processes: COCOMO 2.0 , 1995, Ann. Softw. Eng..

[37]  Ilene Burnstein,et al.  Practical Software Testing: A Process-Oriented Approach , 2003 .

[38]  Richard E. Fairley.  Recent advances in software estimation techniques , 1992, International Conference on Software Engineering.

[39]  Alaa F. Sheta,et al.  Development of software effort and schedule estimation models using Soft Computing Techniques , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[40]  Vahid Garousi,et al.  A survey of software testing practices in Canada , 2013, J. Syst. Softw..

[41]  Parag C. Pendharkar,et al.  An empirical study of the effect of complexity, platform, and program type on software development effort of business applications , 2006, Empirical Software Engineering.

[42]  John Jenkins,et al.  Cost-estimation by analogy as a good management practice , 1988 .

[43]  Barry W. Boehm,et al.  Software Engineering Economics , 1993, IEEE Transactions on Software Engineering.

[44]  Paolo Nesi,et al.  Effort estimation and prediction of object-oriented systems , 1998, J. Syst. Softw..

[45]  Albert S. Dexter,et al.  A Model for Measuring Information Systems Size , 1990, MIS Q..

[46]  Charles R. Symons,et al.  Function Point Analysis: Difficulties and Improvements , 1988, IEEE Trans. Software Eng..

[47]  Lawrence H. Putnam,et al.  A General Empirical Solution to the Macro Software Sizing and Estimating Problem , 1978, IEEE Transactions on Software Engineering.

[48]  Ioannis Stamelos,et al.  On the use of Bayesian belief networks for the prediction of software productivity , 2003, Inf. Softw. Technol..

[49]  Rajiv D. Banker,et al.  A Field Study of Scale Economies in Software Maintenance , 1997 .

[50]  Robert M. Hayes,et al.  Systems analysis and design , 1970, ACM '70.

[51]  Lionel C. Briand,et al.  The impact of design properties on development cost in object-oriented systems , 2001, Proceedings Seventh International Software Metrics Symposium.

[52]  Ning Nan,et al.  Impact of Budget and Schedule Pressure on Software Development Cycle Time and Effort , 2009, IEEE Transactions on Software Engineering.

[53]  Allen S. Parrish,et al.  An Empirical Study Using Task Assignment Patterns to Improve the Accuracy of Software Effort Estimation , 2001, IEEE Trans. Software Eng..

[54]  Michael J. Prietula,et al.  Examining the Feasibility of a Case-Based Reasoning Model for Software Effort Estimation , 1992, MIS Q..

[55]  Barbara A. Kitchenham,et al.  Software project development cost estimation , 1985, J. Syst. Softw..

[56]  Gary Klein,et al.  Balancing four factors in system development projects , 2009, CACM.

[57]  Emilia Mendes,et al.  A comparison of development effort estimation techniques for Web hypermedia applications , 2002, Proceedings Eighth IEEE Symposium on Software Metrics.

[58]  Parag C. Pendharkar,et al.  A Probabilistic Model for Predicting Software Development Effort , 2003, ICCSA.