Prediction Interval of Cumulative Number of Software Faults Using Multilayer Perceptron

Software reliability is one of the most important attributes in software quality metrics. To predict the number of software faults detected in testing phase, many approaches have been applied during the last four decades. Among them, the neural network approach plays a significant role to estimate and predict the number of software fault counts. In this paper, we focus on a prediction problem with the common multilayer perceptron neural networks, and derive the predictive interval of the cumulative number of software faults in sequential software testing. We apply the well-known back propagation algorithm for feed forward neural network architectures and the delta method to construct the prediction intervals. In numerical experiments with four real software development project data sets, we evaluate the one-stage look ahead prediction interval of the cumulative number of software faults, and compare three data transform methods, which are needed for pre-processing the underlying data, in terms of average relative error, coverage rate and predictive interval width.

[1]  Abhijit S. Pandya,et al.  A neural network approach for predicting software development faults , 1992, [1992] Proceedings Third International Symposium on Software Reliability Engineering.

[2]  Taghi M. Khoshgoftaar,et al.  Application of neural networks to software quality modeling of a very large telecommunications system , 1997, IEEE Trans. Neural Networks.

[3]  Taghi M. Khoshgoftaar,et al.  Using neural networks to predict software faults during testing , 1996, IEEE Trans. Reliab..

[4]  J. T. Hwang,et al.  Prediction Intervals for Artificial Neural Networks , 1997 .

[5]  John D. Musa,et al.  Software reliability - measurement, prediction, application , 1987, McGraw-Hill series in software engineering and technology.

[6]  A. Weigend,et al.  Estimating the mean and variance of the target probability distribution , 1994, Proceedings of 1994 IEEE International Conference on Neural Networks (ICNN'94).

[7]  F. J. Anscombe,et al.  THE TRANSFORMATION OF POISSON, BINOMIAL AND NEGATIVE-BINOMIAL DATA , 1948 .

[8]  Bimal K. Bose,et al.  Neural Network Applications in Power Electronics and Motor Drives—An Introduction and Perspective , 2007, IEEE Transactions on Industrial Electronics.

[9]  Amir F. Atiya,et al.  Comprehensive Review of Neural Network-Based Prediction Intervals and New Advances , 2011, IEEE Transactions on Neural Networks.

[10]  Liang Tian,et al.  On-line prediction of software reliability using an evolutionary connectionist model , 2005, J. Syst. Softw..

[11]  Tong-Seng Quah,et al.  Application of neural networks for software quality prediction using object-oriented metrics , 2005, J. Syst. Softw..

[12]  Thong Ngee Goh,et al.  A study of the connectionist models for software reliability prediction , 2003 .

[13]  Abhijit S. Pandya,et al.  A neural network modeling methodology for the detection of high-risk programs , 1993, Proceedings of 1993 IEEE International Symposium on Software Reliability Engineering.

[14]  David J. C. MacKay,et al.  The Evidence Framework Applied to Classification Networks , 1992, Neural Computation.

[15]  R. Sitte Comparison of software-reliability-growth predictions: neural networks vs parametric-recalibration , 1999 .

[16]  Taghi M. Khoshgoftaar,et al.  Evolutionary neural networks: a robust approach to software reliability problems , 1997, Proceedings The Eighth International Symposium on Software Reliability Engineering.

[17]  L. Darrell Whitley,et al.  Using neural networks in reliability prediction , 1992, IEEE Software.

[18]  M. Fisz The limiting distribution of a function of two independent random variables and its statistical application , 1955 .

[19]  L. Darrell Whitley,et al.  Prediction of Software Reliability Using Connectionist Models , 1992, IEEE Trans. Software Eng..

[20]  Thong Ngee Goh,et al.  Neural network modeling with confidence bounds: a case study on the solder paste deposition process , 2001 .

[21]  Tadashi Dohi,et al.  Optimal software release scheduling based on artificial neural networks , 1999, Ann. Softw. Eng..

[22]  M. Bartlett The Square Root Transformation in Analysis of Variance , 1936 .

[23]  Taghi M. Khoshgoftaar,et al.  PREDICTING SOFTWARE QUALITY, DURING TESTING, USING NEURAL NETWORK MODELS: A COMPARATIVE STUDY , 1994 .

[24]  David Zhang,et al.  On the neural network approach in software reliability modeling , 2001, J. Syst. Softw..

[25]  R. D. Veaux,et al.  Prediction intervals for neural networks via nonlinear regression , 1998 .

[26]  Tadashi Dohi,et al.  Heuristic self-organization algorithms for software reliability assessment and their application , 2000, Proceedings 11th International Symposium on Software Reliability Engineering. ISSRE 2000.

[27]  Chin-Yu Huang,et al.  Neural-network-based approaches for software reliability estimation using dynamic weighted combinational models , 2007, J. Syst. Softw..

[28]  Liang Tian,et al.  Evolutionary neural network modeling for software cumulative failure time prediction , 2005, Reliab. Eng. Syst. Saf..

[29]  Yashwant K. Malaiya,et al.  Neural networks for software reliability engineering , 1996 .