A novel fuzzy classification to enhance software regression testing

An effective system regression testing for consecutive releases of very large software systems, such as modern telecommunications systems, depends considerably on the selection of test cases for execution. Classification models can classify, early in the test planning phase, those test cases that are likely to detect faults in the upcoming regression test. Due to the high uncertainties in regression test, classification models based on fuzzy logic are very useful. Recently, methods have been proposed for automatically generating fuzzy if-then rules by applying complicated rule generation procedures to numerical data. In this research, we introduce and demonstrate a new rule-based fuzzy classification (RBFC) modeling approach as a method for identifying high effective test cases. The modeling approach, based on test case metrics and the proposed rule generation technique, is applied to extracting fuzzy rules from numerical data. In addition, it also provides a convenient way to modify rules according to the costs of different misclassification errors. We illustrate our modeling technique with a case study of large-scale industrial software systems and the results showed that test effectiveness and efficiency was significantly improved.

[1]  H. Ishibuchi,et al.  Empirical study on learning in fuzzy systems by rice taste analysis , 1994 .

[2]  Taghi M. Khoshgoftaar,et al.  Accuracy of software quality models over multiple releases , 2000, Ann. Softw. Eng..

[3]  Christof Ebert,et al.  Classification techniques for metric-based software development , 1996, Software Quality Journal.

[4]  Taghi M. Khoshgoftaar,et al.  A Comparative Study of Ordering and Classification of Fault-Prone Software Modules , 1999, Empirical Software Engineering.

[5]  John R. Koza,et al.  Genetic programming - on the programming of computers by means of natural selection , 1993, Complex adaptive systems.

[6]  Taghi M. Khoshgoftaar,et al.  Classification of Fault-Prone Software Modules: Prior Probabilities, Costs, and Model Evaluation , 1998, Empirical Software Engineering.

[7]  Gregg Rothermel,et al.  Prioritizing test cases for regression testing , 2000, ISSTA '00.

[8]  M. Sugeno,et al.  Structure identification of fuzzy model , 1988 .

[9]  Taghi M. Khoshgoftaar,et al.  Predicting fault-prone software modules in embedded systems with classification trees , 1999, Proceedings 4th IEEE International Symposium on High-Assurance Systems Engineering.

[10]  Michio Sugeno,et al.  Fuzzy identification of systems and its applications to modeling and control , 1985, IEEE Transactions on Systems, Man, and Cybernetics.

[11]  Taghi M. Khoshgoftaar,et al.  Application of a usage profile in software quality models , 1999, Proceedings of the Third European Conference on Software Maintenance and Reengineering (Cat. No. PR00090).

[12]  Isao Hayashi,et al.  A learning method of fuzzy inference rules by descent method , 1992 .

[13]  Christof Ebert,et al.  Rule-based fuzzy classification for software quality control , 1994 .

[14]  Gregg Rothermel,et al.  Incorporating varying test costs and fault severities into test case prioritization , 2001, Proceedings of the 23rd International Conference on Software Engineering. ICSE 2001.

[15]  Taghi M. Khoshgoftaar,et al.  MODELING SOFTWARE QUALITY WITH CLASSIFICATION TREES , 2001 .

[16]  Rudolf Kruse,et al.  A neuro-fuzzy method to learn fuzzy classification rules from data , 1997, Fuzzy Sets Syst..

[17]  C. L. Karr,et al.  Fuzzy control of pH using genetic algorithms , 1993, IEEE Trans. Fuzzy Syst..

[18]  Gregg Rothermel,et al.  On the Use of Mutation Faults in Empirical Assessments of Test Case Prioritization Techniques , 2006, IEEE Transactions on Software Engineering.

[19]  Mihiar Ayoubi,et al.  Application of a hybrid neuro-fuzzy system to the fault diagnosis of an automotive electromechanical actuator , 1997, Fuzzy Sets Syst..

[20]  Lefteri H. Tsoukalas,et al.  Fuzzy and neural approaches in engineering , 1997 .

[21]  M. Stone,et al.  THE ASSESSMENT OF PREDICTIVE ACCURACY AND MODEL OVERFITTING: AN ALTERNATIVE APPROACH , 1993 .

[22]  Gregg Rothermel,et al.  Putting Your Best Tests Forward , 2003, IEEE Softw..

[23]  Hahn-Ming Lee,et al.  A multiclass neural network classifier with fuzzy teaching inputs , 1997, Fuzzy Sets Syst..