Finding The Effectiveness Of Prioritized Test Suite Using Neural Networks

Objective: To find out whether a trained neural network can predict the Average percentage of Faults Detected (APFD) value for the given prioritized test suite without having the knowledge of computing APFD formula. Methods: To generate a test suite, A fault matrix containing faults and test cases is considered and for each possible permutation of test cases. The APFD value is computed for each of such test suite. The test suites with their respective APFD values are given to the neural network during training. During testing, a prioritized test suite is fed to the neural network. The APFD value predicted by the neural network is noted down. Findings: The neural network has learnt to predict APFD value of the given prioritized test suite. The predicted APFD value is compared with computed APFD value using the Root Mean Square Deviation. The deviation is found to be very low, showing that the values are very nearer. Applications/Improvements: Number of hidden layers can be increased in order to reduce the deviation further.

[1]  Gregg Rothermel,et al.  Incorporating varying test costs and fault severities into test case prioritization , 2001, Proceedings of the 23rd International Conference on Software Engineering. ICSE 2001.

[2]  Rodrigo Fernandes de Mello,et al.  A Technique to Reduce the Test Case Suites for Regression Testing Based on a Self-Organizing Neural Network Architecture , 2006, 30th Annual International Computer Software and Applications Conference (COMPSAC'06).

[3]  Mark Harman,et al.  Search Algorithms for Regression Test Case Prioritization , 2007, IEEE Transactions on Software Engineering.

[4]  Gregg Rothermel,et al.  Selecting a Cost-Effective Test Case Prioritization Technique , 2004, Software Quality Journal.

[5]  Abraham Kandel,et al.  Using a neural network in the software testing process , 2002, Int. J. Intell. Syst..

[6]  Tsong Yueh Chen,et al.  How Well Do Test Case Prioritization Techniques Support Statistical Fault Localization , 2009, 2009 33rd Annual IEEE International Computer Software and Applications Conference.

[7]  A. K. Misra,et al.  Prioritizing Test Suites Using Clustering Approach in Software Testing , 2012 .

[8]  Chengyun Chu,et al.  Test case prioritization , 1999 .

[9]  Neelam Gupta,et al.  Test Case Prioritization Using Relevant Slices , 2006, 30th Annual International Computer Software and Applications Conference (COMPSAC'06).

[10]  Taghi M. Khoshgoftaar,et al.  Using neural networks to predict software faults during testing , 1996, IEEE Trans. Reliab..

[11]  Kai-Yuan Cai,et al.  On the Gain of Measuring Test Case Prioritization , 2013, 2013 IEEE 37th Annual Computer Software and Applications Conference.

[12]  A. A. Ahmed,et al.  Software testing suite prioritization using multi-criteria fitness function , 2012, 2012 22nd International Conference on Computer Theory and Applications (ICCTA).

[13]  R. Uma Maheswari,et al.  Combined Genetic and Simulated Annealing Approach for Test Case Prioritization , 2015 .

[14]  Anneliese Amschler Andrews,et al.  On the use of neural networks to guide software testing activities , 1995, Proceedings of 1995 IEEE International Test Conference (ITC).

[15]  Mark Harman,et al.  Test prioritization using system models , 2005, 21st IEEE International Conference on Software Maintenance (ICSM'05).

[16]  Sahil Gupta,et al.  A NOVEL APPROACH FOR TEST CASE PRIORITIZATION , 2012 .

[17]  Deepti Mishra,et al.  Test case prioritization: a systematic mapping study , 2012, Software Quality Journal.

[18]  T. Sasikala,et al.  Implementation of Regression Testing of Test Case Prioritization , 2015 .

[19]  R. Uma Maheswari,et al.  A novel approach for test case prioritization , 2013, 2013 IEEE International Conference on Computational Intelligence and Computing Research.

[20]  Bogdan Korel,et al.  Application of system models in regression test suite prioritization , 2008, 2008 IEEE International Conference on Software Maintenance.

[21]  Laurie A. Williams,et al.  System test case prioritization of new and regression test cases , 2005, 2005 International Symposium on Empirical Software Engineering, 2005..

[22]  Gregg Rothermel,et al.  On the Use of Mutation Faults in Empirical Assessments of Test Case Prioritization Techniques , 2006, IEEE Transactions on Software Engineering.

[23]  Gregg Rothermel,et al.  Prioritizing test cases for regression testing , 2000, ISSTA '00.

[24]  Gregg Rothermel,et al.  Test case prioritization: an empirical study , 1999, Proceedings IEEE International Conference on Software Maintenance - 1999 (ICSM'99). 'Software Maintenance for Business Change' (Cat. No.99CB36360).