Heuristic self-organization algorithms for software reliability assessment and their application

The GMDH (group method of data handling) network is an adaptive learning machine based on the principle of heuristic self-organization. The authors apply the GMDH networks to predict software reliability in the testing phase. Three kinds of networks: the basic GMDH and its improved versions based on PSS (prediction sum of squared) and AIC (Akaike information criterion), are introduced for the prediction of the failure-occurrence times observed in the testing phase of the software system. In numerical examples, the GMDH networks, the usual MLP (multi-layer perceptron) neural networks and existing SRGMs (software reliability growth models) are compared from the view point of predictive performance. It is shown that the GMDH networks can overcome the problem of determining a suitable network size in the use of an MLP neural network, and can provide a more accurate measure in the software reliability assessment than other prediction devices. Further, the problem of determining the optimal software release schedule, which minimizes the relevant expected total software cost, is considered in the framework of the GMDH network architecture.

[1]  Hoang Pham,et al.  A Software Cost Model with Warranty and Risk Costs , 1999, IEEE Trans. Computers.

[2]  L. Darrell Whitley,et al.  Using neural networks in reliability prediction , 1992, IEEE Software.

[3]  Sy-Yen Kuo,et al.  Optimal Release Times for Software Systems with Scheduled Delivery Time Based on the HGDM , 1997, IEEE Trans. Computers.

[4]  P. Y. Chan Software reliability prediction , 1986 .

[5]  Paul B. Moranda Event-Altered Rate Models for General Reliability Analysis , 1979, IEEE Transactions on Reliability.

[6]  George J. Schick,et al.  An Analysis of Competing Software Reliability Models , 1978, IEEE Transactions on Software Engineering.

[7]  Manoel Fernando Tenorio,et al.  Self-organizing network for optimum supervised learning , 1990, IEEE Trans. Neural Networks.

[8]  H. Akaike A new look at the statistical model identification , 1974 .

[9]  John D. Musa,et al.  Software reliability - measurement, prediction, application , 1987, McGraw-Hill series in software engineering and technology.

[10]  John D. Musa,et al.  Software-Reliability-Engineered Testing , 1996, Computer.

[11]  Tadashi Dohi,et al.  Optimal software release scheduling based on artificial neural networks , 1999, Ann. Softw. Eng..

[12]  Taghi M. Khoshgoftaar,et al.  PREDICTING SOFTWARE QUALITY, DURING TESTING, USING NEURAL NETWORK MODELS: A COMPARATIVE STUDY , 1994 .

[13]  A. Ivakhnenko Heuristic self-organization in problems of engineering cybernetics , 1970 .

[14]  Hiroyuki Tamura,et al.  Revised GMDH Algorithm of Self-Selecting Optimal Intermediate Polynomials Using AIC , 1979 .

[15]  Abhijit S. Pandya,et al.  A neural network approach for predicting software development faults , 1992, [1992] Proceedings Third International Symposium on Software Reliability Engineering.

[16]  Taghi M. Khoshgoftaar,et al.  Using neural networks to predict software faults during testing , 1996, IEEE Trans. Reliab..

[17]  James L. McClelland,et al.  Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations , 1986 .

[18]  R. Sitte Comparison of software-reliability-growth predictions: neural networks vs parametric-recalibration , 1999 .

[19]  Z. Jelinski,et al.  Software reliability Research , 1972, Statistical Computer Performance Evaluation.

[20]  A. G. Ivakhnenko,et al.  Polynomial Theory of Complex Systems , 1971, IEEE Trans. Syst. Man Cybern..

[21]  Hoang Pham Software Reliability , 1999 .

[22]  L. Darrell Whitley,et al.  Prediction of software reliability using neural networks , 1991, Proceedings. 1991 International Symposium on Software Reliability Engineering.

[23]  Taghi M. Khoshgoftaar,et al.  Using Neural Networks to Predict Software Faults During , 1996 .

[24]  Amrit L. Goel,et al.  Optimum release time for software systems based on reliability and cost criteria , 1984, J. Syst. Softw..

[25]  Yashwant K. Malaiya,et al.  Neural networks for software reliability engineering , 1996 .

[26]  L. Darrell Whitley,et al.  Prediction of Software Reliability Using Connectionist Models , 1992, IEEE Trans. Software Eng..

[27]  Yashwant K. Malaiya,et al.  The scaling problem in neural networks for software reliability prediction , 1992, [1992] Proceedings Third International Symposium on Software Reliability Engineering.

[28]  Duc Truong Pham,et al.  Neural Networks for Identification, Prediction and Control , 1995 .

[29]  Harvey S. Koch,et al.  Optimal Release Time of Computer Software , 1983, IEEE Transactions on Software Engineering.

[30]  Hiroyuki Tamura,et al.  Revised GMDH Algorithm Using Prediction Sum of Squares (PSS) as a Criterion for Model Selection , 1978 .

[31]  Bev Littlewood,et al.  Evaluation of competing software reliability predictions , 1986, IEEE Transactions on Software Engineering.