Predicting software reliability with neural network ensembles

Software reliability is an important factor for quantitatively characterizing software quality and estimating the duration of software testing period. Traditional parametric software reliability growth models (SRGMs) such as nonhomogeneous Poisson process (NHPP) models have been successfully utilized in practical software reliability engineering. However, no single such parametric model can obtain accurate prediction for all cases. In addition to the parametric models, non-parametric models like neural network have shown to be effective alternative techniques for software reliability prediction. In this paper, we propose a non-parametric software reliability prediction system based on neural network ensembles. The effects of system architecture on the performance are investigated. The comparative studies between the proposed system with the single neural network based system and three parametric NHPP models are carried out. The experimental results demonstrate that the system predictability can be significantly improved by combing multiple neural networks.

[1]  L. Darrell Whitley,et al.  Prediction of Software Reliability Using Connectionist Models , 1992, IEEE Trans. Software Eng..

[2]  David Zhang,et al.  On the neural network approach in software reliability modeling , 2001, J. Syst. Softw..

[3]  John D. Musa,et al.  Software reliability engineering : more reliable software, faster development and testing , 1999 .

[4]  R. E. Abdel-Aal Improving electric load forecasts using network committees , 2005 .

[5]  David West,et al.  Neural network ensemble strategies for financial decision applications , 2005, Comput. Oper. Res..

[6]  Michael R. Lyu,et al.  Handbook of software reliability engineering , 1996 .

[7]  Martin T. Hagan,et al.  Gauss-Newton approximation to Bayesian learning , 1997, Proceedings of International Conference on Neural Networks (ICNN'97).

[8]  Simon Haykin,et al.  Neural Networks: A Comprehensive Foundation , 1998 .

[9]  Yu-Bin Yang,et al.  Lung cancer cell identification based on artificial neural network ensembles , 2002, Artif. Intell. Medicine.

[10]  Thong Ngee Goh,et al.  A study of the connectionist models for software reliability prediction , 2003 .

[11]  L. Darrell Whitley,et al.  Using neural networks in reliability prediction , 1992, IEEE Software.

[12]  Okyay Kaynak,et al.  An algorithm for fast convergence in training neural networks , 2001, IJCNN'01. International Joint Conference on Neural Networks. Proceedings (Cat. No.01CH37222).

[13]  Michael R. Lyu,et al.  A hierarchical mixture model for software reliability prediction , 2007, Appl. Math. Comput..

[14]  Lars Kai Hansen,et al.  Neural Network Ensembles , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  S. Gabel,et al.  Using Neural Networks , 2003 .

[16]  Pablo M. Granitto,et al.  Neural network ensembles: evaluation of aggregation algorithms , 2005, Artif. Intell..

[17]  Chin-Yu Huang,et al.  Neural-network-based approaches for software reliability estimation using dynamic weighted combinational models , 2007, J. Syst. Softw..

[18]  Liang Tian,et al.  Evolutionary neural network modeling for software cumulative failure time prediction , 2005, Reliab. Eng. Syst. Saf..

[19]  Liang Tian,et al.  On-line prediction of software reliability using an evolutionary connectionist model , 2005, J. Syst. Softw..

[20]  James M. Bieman,et al.  Software reliability growth with test coverage , 2002, IEEE Trans. Reliab..

[21]  A. Krogh,et al.  Statistical mechanics of ensemble learning , 1997 .

[22]  Maciej Ogorzalek,et al.  Time series prediction with ensemble models applied to the CATS benchmark , 2007, Neurocomputing.

[23]  R. Sitte Comparison of software-reliability-growth predictions: neural networks vs parametric-recalibration , 1999 .

[24]  Hoang Pham,et al.  A general imperfect-software-debugging model with S-shaped fault-detection rate , 1999 .

[25]  Fabio Roli,et al.  Design of effective neural network ensembles for image classification purposes , 2001, Image Vis. Comput..