A novel test case prioritization method based on problems of numerical software code statement defect prediction

Software testing, as an indispensable stage in software development life cycle, aims to discover defects in a software artefact as much as possible to assure its quality and reliability [10]. It is a very costly and resources consuming task that accounts for higher than 50% of development costs [15]. In previous work [51], test case selection (TCS), test case minimization (TCM) and TCP are three techniques maximize the value of test suites. TCP is often used to improve the ShAo Y, Liu B, WAng S, XiAo P. A novel test case prioritization method based on problems of numerical software code statement defect prediction. Eksploatacja i niezawodnosc – Maintenance and Reliability 2020; 22 (3): 419–431, http://dx.doi.org/10.17531/ein.2020.3.4.

[1]  Amitava Datta,et al.  Test Case Prioritization Due to Database Changes in Web Applications , 2012, 2012 IEEE Fifth International Conference on Software Testing, Verification and Validation.

[2]  Gregg Rothermel,et al.  A Static Approach to Prioritizing JUnit Test Cases , 2012, IEEE Transactions on Software Engineering.

[3]  Sandro Schulze,et al.  System-Level Test Case Prioritization Using Machine Learning , 2016, 2016 15th IEEE International Conference on Machine Learning and Applications (ICMLA).

[4]  Burak Turhan,et al.  A benchmark study on the effectiveness of search-based data selection and feature selection for cross project defect prediction , 2017, Inf. Softw. Technol..

[5]  Ian H. Witten,et al.  The WEKA data mining software: an update , 2009, SKDD.

[6]  Paolo Tonella,et al.  Using the Case-Based Ranking Methodology for Test Case Prioritization , 2006, 2006 22nd IEEE International Conference on Software Maintenance.

[7]  Banu Diri,et al.  Investigating the effect of dataset size, metrics sets, and feature selection techniques on software fault prediction problem , 2009, Inf. Sci..

[8]  Lei Xu,et al.  Integrated system of health management-oriented reliability prediction for a spacecraft software system with an adaptive genetic algorithm support vector machine , 2014 .

[9]  Stefano Russo,et al.  Adaptive Coverage and Operational Profile-Based Testing for Reliability Improvement , 2017, 2017 IEEE/ACM 39th International Conference on Software Engineering (ICSE).

[10]  Song Wang,et al.  QTEP: quality-aware test case prioritization , 2017, ESEC/SIGSOFT FSE.

[11]  Ladan Tahvildari,et al.  A Prioritization Approach for Software Test Cases Based on Bayesian Networks , 2007, FASE.

[12]  Deepti Mishra,et al.  Test case prioritization: a systematic mapping study , 2012, Software Quality Journal.

[13]  Gregg Rothermel,et al.  Prioritizing test cases for regression testing , 2000, ISSTA '00.

[14]  Amri Napolitano,et al.  Software measurement data reduction using ensemble techniques , 2012, Neurocomputing.

[15]  Tim Menzies,et al.  Data Mining Static Code Attributes to Learn Defect Predictors , 2007, IEEE Transactions on Software Engineering.

[16]  Hyunsook Do,et al.  Requirements based test prioritization using risk factors: An industrial study , 2016, Inf. Softw. Technol..

[17]  Xin Yao,et al.  A Learning-to-Rank Approach to Software Defect Prediction , 2015, IEEE Transactions on Reliability.

[18]  Dayang N. A. Jawawi,et al.  Test case prioritization approaches in regression testing: A systematic literature review , 2018, Inf. Softw. Technol..

[19]  S. A. Sahaaya Arul Mary,et al.  Requirement Based System Test Case Prioritization of New and Regression Test Cases , 2009, Int. J. Softw. Eng. Knowl. Eng..

[20]  Xin Yao,et al.  Using Class Imbalance Learning for Software Defect Prediction , 2013, IEEE Transactions on Reliability.

[21]  Yves Le Traon,et al.  Comparing White-Box and Black-Box Test Prioritization , 2016, 2016 IEEE/ACM 38th International Conference on Software Engineering (ICSE).

[22]  Mary Jean Harrold,et al.  Testing: a roadmap , 2000, ICSE '00.

[23]  Bart Baesens,et al.  Benchmarking Classification Models for Software Defect Prediction: A Proposed Framework and Novel Findings , 2008, IEEE Transactions on Software Engineering.

[24]  Mohammad Alshayeb,et al.  Software defect prediction using ensemble learning on selected features , 2015, Inf. Softw. Technol..

[25]  David Hovemeyer,et al.  Finding bugs is easy , 2004, SIGP.

[26]  Bin Liu,et al.  Feedback-based integrated prediction: Defect prediction based on feedback from software testing process , 2018, J. Syst. Softw..

[27]  Qinbao Song,et al.  Using Coding-Based Ensemble Learning to Improve Software Defect Prediction , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[28]  Gregg Rothermel,et al.  Test Case Prioritization: A Family of Empirical Studies , 2002, IEEE Trans. Software Eng..

[29]  Qingqing Zhai,et al.  Modeling of software fault detection and correction processes with fault dependency , 2017 .

[30]  Jaechang Nam,et al.  CLAMI: Defect Prediction on Unlabeled Datasets , 2015, ASE 2015.

[31]  Rafael Serapilha Durelli,et al.  Machine Learning Applied to Software Testing: A Systematic Mapping Study , 2019, IEEE Transactions on Reliability.

[32]  Ayse Basar Bener,et al.  On the relative value of cross-company and within-company data for defect prediction , 2009, Empirical Software Engineering.

[33]  Gregg Rothermel,et al.  Test case prioritization: an empirical study , 1999, Proceedings IEEE International Conference on Software Maintenance - 1999 (ICSM'99). 'Software Maintenance for Business Change' (Cat. No.99CB36360).

[34]  Omar Shatnawi,et al.  Measuring commercial software operational reliability: an interdisciplinary modelling approach , 2014 .

[35]  Rui Abreu,et al.  An Empirical Study on the Use of Defect Prediction for Test Case Prioritization , 2019, 2019 12th IEEE Conference on Software Testing, Validation and Verification (ICST).

[36]  Mark Harman,et al.  Search Algorithms for Regression Test Case Prioritization , 2007, IEEE Transactions on Software Engineering.

[37]  Niclas Ohlsson,et al.  Predicting Fault-Prone Software Modules in Telephone Switches , 1996, IEEE Trans. Software Eng..

[38]  Hyunsook Do,et al.  Test Case Prioritization Using Requirements-Based Clustering , 2013, 2013 IEEE Sixth International Conference on Software Testing, Verification and Validation.

[39]  Ömer Faruk Arar,et al.  Software defect prediction using cost-sensitive neural network , 2015, Appl. Soft Comput..

[40]  Bin Liu,et al.  A novel software defect prediction based on atomic class-association rule mining , 2018, Expert Syst. Appl..

[41]  Morten Mossige,et al.  Reinforcement learning for automatic test case prioritization and selection in continuous integration , 2017, ISSTA.

[42]  Barry W. Boehm,et al.  Software Defect Reduction Top 10 List , 2001, Computer.

[43]  Qinbao Song,et al.  A General Software Defect-Proneness Prediction Framework , 2011, IEEE Transactions on Software Engineering.

[44]  Mark Harman,et al.  Regression testing minimization, selection and prioritization: a survey , 2012, Softw. Test. Verification Reliab..

[45]  Huaikou Miao,et al.  An empirical study on clustering approach combining fault prediction for test case prioritization , 2017, 2017 IEEE/ACIS 16th International Conference on Computer and Information Science (ICIS).

[46]  Lionel C. Briand,et al.  Coverage‐based regression test case selection, minimization and prioritization: a case study on an industrial system , 2015, Softw. Test. Verification Reliab..

[47]  Ömer Faruk Arar,et al.  A feature dependent Naive Bayes approach and its application to the software defect prediction problem , 2017, Appl. Soft Comput..

[48]  Xiao Liu,et al.  An empirical study on software defect prediction with a simplified metric set , 2014, Inf. Softw. Technol..

[49]  Chin-Yu Huang,et al.  Design and analysis of GUI test-case prioritization using weight-based methods , 2010, J. Syst. Softw..

[50]  J. Friedman Stochastic gradient boosting , 2002 .

[51]  Gregg Rothermel,et al.  The Effects of Time Constraints on Test Case Prioritization: A Series of Controlled Experiments , 2010, IEEE Transactions on Software Engineering.