Using Dependency Information to Select the Test Focus in the Integration Testing Process

Existing software systems consist of thousands of software components realizing countless requirements. To fulfill these requirements, components have to interact with or depend on each other. The goal of the integration testing process is to test that the interactions between these components are correctly realized. However, it is impossible to test all dependencies because of time and budget constraints. Therefore, error-prone dependencies have to be selected as tests. This paper presents an approach to select the test focus in the integration test process. It uses dependency and error information of previous versions of the system under test. Error-prone dependency properties are identified by statistical approaches and used to select dependencies in the current version of the system. The results of two case studies with real software systems are presented.

[1]  Colin Atkinson,et al.  The MORABIT Approach to Runtime Component Testing , 2006, 30th Annual International Computer Software and Applications Conference (COMPSAC'06).

[2]  H. Abdi.  The Bonferonni and Šidák Corrections for Multiple Comparisons , 2006 .

[3]  Claude Caci,et al.  Testing object-oriented systems , 2000, SOEN.

[4]  Elaine J. Weyuker,et al.  How to measure success of fault prediction models , 2007, SOQUA '07.

[5]  Robert V. Binder,et al.  Testing object‐oriented software: a survey , 1996 .

[6]  Thomas Ball,et al.  Static analysis tools as early indicators of pre-release defect density , 2005, ICSE.

[7]  J. Martens.  Statistische Datenanalyse mit SPSS für Windows , 2003 .

[8]  Nachiappan Nagappan,et al.  Predicting defects using network analysis on dependency graphs , 2008, 2008 ACM/IEEE 30th International Conference on Software Engineering.

[9]  A. Zeller,et al.  Predicting Defects for Eclipse , 2007, Third International Workshop on Predictor Models in Software Engineering (PROMISE'07: ICSE Workshops 2007).

[10]  Barbara Paech,et al.  The Testing Process - A Decision Based Approach , 2007, International Conference on Software Engineering Advances (ICSEA 2007).

[11]  John D. McGregor,et al.  Incremental Testing Of Object-Oriented Class Structures/spl dagger/ , 1992, International Conference on Software Engineering.

[12]  Alessandro Orso.  Integration Testing of Object-Oriented Software , 1998 .

[13]  Lionel C. Briand,et al.  Using genetic algorithms and coupling measures to devise optimal integration test orders , 2002, SEKE '02.

[14]  Barbara Paech,et al.  Testfokusauswahl im Integrationstestprozess , 2009, Software Engineering.

[15]  Victor R. Basili,et al.  A Validation of Object-Oriented Design Metrics as Quality Indicators , 1996, IEEE Trans. Software Eng..

[16]  Hongyu Zhang.  An initial study of the growth of eclipse defects , 2008, MSR '08.

[17]  Andreas Zeller,et al.  Mining metrics to predict component failures , 2006, ICSE.

[18]  Abraham Bernstein,et al.  Predicting defect densities in source code files with decision tree learners , 2006, MSR '06.

[19]  John D. McGregor,et al.  Incremental testing of object-oriented class structures , 1992, ICSE '92.

[20]  Harald C. Gall,et al.  On the Relation of Refactoring and Software Defects , 2008 .

[21]  Gordon William Skelton,et al.  Integration testing of object-oriented software , 2000 .