Can Defect Prediction Be Useful for Coarse-Level Tasks of Software Testing?

It is popular to use software defect prediction (SDP) techniques to predict bugs in software in the past 20 years. Before conducting software testing (ST), the result of SDP assists on resource allocation for ST. However, DP usually works on fine-level tasks (or white-box testing) instead of coarse-level tasks (or black-box testing). Before ST or without historical execution information, it is difficult to get resource allocated properly. Therefore, a SDP-based approach, named DPAHM, is proposed to assist on arranging resource for coarse-level tasks. The method combines analytic hierarchy process (AHP) and variant incidence matrix. Besides, we apply the proposed DPAHM into a proprietary software, named MC. Besides, we conduct an up-to-down structure, including three layers for MC. Additionally, the performance measure of each layer is calculated based on the SDP result. Therefore, the resource allocation strategy for coarse-level tasks is gained according to the prediction result. The experiment indicates our proposed method is effective for resource allocation of coarse-level tasks before executing ST.

[1]  Dilip Kumar Yadav,et al.  A fuzzy logic based approach for phase-wise software defects prediction using software metrics , 2015, Inf. Softw. Technol..

[2]  Ayse Basar Bener,et al.  Defect prediction from static code features: current results, limitations, new approaches , 2010, Automated Software Engineering.

[3]  Bart Baesens,et al.  Benchmarking Classification Models for Software Defect Prediction: A Proposed Framework and Novel Findings , 2008, IEEE Transactions on Software Engineering.

[4]  Norman E. Fenton,et al.  A Critique of Software Defect Prediction Models , 1999, IEEE Trans. Software Eng..

[5]  Sinno Jialin Pan,et al.  Transfer defect learning , 2013, 2013 35th International Conference on Software Engineering (ICSE).

[6]  Bin Liu,et al.  Software defect prediction based on correlation weighted class association rule mining , 2020, Knowl. Based Syst..

[7]  Antonio Ruiz Cortés,et al.  Multi-objective test case prioritization in highly configurable systems: A case study , 2016, J. Syst. Softw..

[8]  Anas N. Al-Rabadi,et al.  A comparison of modified reconstructability analysis and Ashenhurst‐Curtis decomposition of Boolean functions , 2004 .

[9]  Elaine J. Weyuker,et al.  Predicting the location and number of faults in large software systems , 2005, IEEE Transactions on Software Engineering.

[10]  Barry W. Boehm,et al.  Understanding and Controlling Software Costs , 1988, IEEE Trans. Software Eng..

[11]  Qinbao Song,et al.  Data Quality: Some Comments on the NASA Software Defect Datasets , 2013, IEEE Transactions on Software Engineering.

[12]  Adam A. Porter,et al.  Empirically guided software development using metric-based classification trees , 1990, IEEE Software.

[13]  Victor R. Basili,et al.  Comparing the Effectiveness of Software Testing Strategies , 1987, IEEE Transactions on Software Engineering.

[14]  Tohru Matsuodani,et al.  A Test Analysis Method for Black Box Testing Using AUT and Fault Knowledge , 2013, KES.

[15]  Guangchun Luo,et al.  Transfer learning for cross-company software defect prediction , 2012, Inf. Softw. Technol..

[16]  Mojtaba Vahidi-Asl,et al.  SLDeep: Statement-level software defect prediction using deep-learning model on static code features , 2020, Expert Syst. Appl..

[17]  Rozann Whitaker.  Criticisms of the Analytic Hierarchy Process: Why they often make no sense , 2007, Math. Comput. Model..

[18]  Maria Francesca Milazzo,et al.  Prioritising investments in safety measures in the chemical industry by using the Analytic Hierarchy Process , 2020, Reliab. Eng. Syst. Saf..

[19]  Yitao Yang,et al.  Collective transfer learning for defect prediction , 2020, Neurocomputing.

[20]  Anil Kumar Tripathi,et al.  BPDET: An effective software bug prediction model using deep representation and ensemble learning techniques , 2020, Expert Syst. Appl..

[21]  Bin Liu,et al.  Feedback-based integrated prediction: Defect prediction based on feedback from software testing process , 2018, J. Syst. Softw..

[22]  Seyed-Hassan Mirian-Hosseinabadi,et al.  Incorporating fault-proneness estimations into coverage-based test case prioritization methods , 2019, Inf. Softw. Technol..

[23]  Haym Benaroya,et al.  Utilizing the Analytical Hierarchy Process to determine the optimal lunar habitat configuration , 2020 .

[24]  Aitor Arrieta,et al.  Pareto efficient multi-objective black-box test case selection for simulation-based testing , 2019, Inf. Softw. Technol..

[25]  Baowen Xu,et al.  Heterogeneous cross-company defect prediction by unified metric representation and CCA-based transfer learning , 2015, ESEC/SIGSOFT FSE.

[26]  Lu Lu,et al.  A Suitable AST Node Granularity and Multi-Kernel Transfer Convolutional Neural Network for Cross-Project Defect Prediction , 2019, IEEE Access.

[27]  Harald C. Gall,et al.  Cross-project defect prediction: a large scale experiment on data vs. domain vs. process , 2009, ESEC/SIGSOFT FSE.

[28]  Ruchika Malhotra,et al.  An empirical study to investigate oversampling methods for improving software defect prediction using imbalanced data , 2019, Neurocomputing.

[29]  Beijun Shen,et al.  Cross-Project Software Defect Prediction Using Feature-Based Transfer Learning , 2015, Internetware.

[30]  Gerardo Canfora,et al.  Multi-objective Cross-Project Defect Prediction , 2013, 2013 IEEE Sixth International Conference on Software Testing, Verification and Validation.

[31]  Cong Pan,et al.  An Improved CNN Model for Within-Project Software Defect Prediction , 2019, Applied Sciences.

[32]  Fatih Yücalar,et al.  Multiple-classifiers in software quality engineering: Combining predictors to improve software fault prediction ability , 2020 .

[33]  Kaiyuan Jiang,et al.  Heterogeneous defect prediction based on transfer learning to handle extreme imbalance , 2020 .

[34]  Ming Li,et al.  On cost-effective software defect prediction: Classification or ranking? , 2019, Neurocomputing.

[35]  Shuib Basri,et al.  Performance Analysis of Feature Selection Methods in Software Defect Prediction: A Search Method Approach , 2019, Applied Sciences.

[36]  Jinfu Chen,et al.  Test case prioritization for object-oriented software: An adaptive random sequence approach based on clustering , 2018, J. Syst. Softw..

[37]  Vahid Garousi,et al.  A survey of software testing practices in Canada , 2013, J. Syst. Softw..

[38]  Marco A. Moreno-Armendáriz,et al.  An Analytical Hierarchy Process to manage water quality in white fish (Chirostoma estor estor) intensive culture , 2019, Comput. Electron. Agric..

[39]  Premkumar T. Devanbu,et al.  Recalling the "imprecision" of cross-project defect prediction , 2012, SIGSOFT FSE.

[40]  Karl Henrik Johansson,et al.  Stability analysis for multi-agent systems using the incidence matrix: Quantized communication and formation control , 2010, Autom..

[41]  Euyseok Hong.  Fault-proneness Prediction using Module Severity Metrics , 2017 .

[42]  Cheng Gao,et al.  Technology maturity evaluation for DC-DC converter based on AHP and KPA , 2016, 2016 Prognostics and System Health Management Conference (PHM-Chengdu).

[43]  Xin Yao,et al.  A Learning-to-Rank Approach to Software Defect Prediction , 2015, IEEE Transactions on Reliability.

[44]  Burak Turhan,et al.  A benchmark study on the effectiveness of search-based data selection and feature selection for cross project defect prediction , 2017, Inf. Softw. Technol..

[45]  Ayse Basar Bener,et al.  On the relative value of cross-company and within-company data for defect prediction , 2009, Empirical Software Engineering.

[46]  Hossam Faris,et al.  Software Defect Prediction Using Heterogeneous Ensemble Classification Based on Segmented Patterns , 2020, Applied Sciences.

[47]  Man Zhang,et al.  Uncertainty-wise test case generation and minimization for Cyber-Physical Systems , 2019, J. Syst. Softw..

[48]  Qinghua Zheng,et al.  Relation-based test case prioritization for regression testing , 2020, J. Syst. Softw..

[49]  Eiji Ohno,et al.  Proposal of a benefit incidence matrix for urban development projects , 1995 .

[50]  Branson W. Murrill.  An empirical, path-oriented approach to software analysis and testing , 2008, J. Syst. Softw..

[51]  Jongmoon Baik,et al.  Effective multi-objective naïve Bayes learning for cross-project defect prediction , 2016, Appl. Soft Comput..

[52]  Wenyuan Li,et al.  Analytical model and algorithm for tracing active power flow based on extended incidence matrix , 2009 .

[53]  Feng Liu,et al.  A Novel Approach for Software Defect prediction Based on the Power Law Function , 2020 .

[54]  Ovidiu Banias,et al.  Test case selection-prioritization approach based on memoization dynamic programming algorithm , 2019, Inf. Softw. Technol..

[55]  Ruchika Malhotra,et al.  Prediction of defect severity by mining software project reports , 2017, Int. J. Syst. Assur. Eng. Manag..

[56]  Hsiao-Fan Wang,et al.  User equilibrium in traffic assignment problem with fuzzy N-A incidence matrix , 1999, Fuzzy Sets Syst..

[57]  Himali Sarangal,et al.  Quantifying reusability of software components using hybrid fuzzy analytical hierarchy process (FAHP)-Metrics approach , 2020, Appl. Soft Comput..