Hybrid test language processing based framework for test case optimization

One of the major problems of software industry is its inability to develop error free software. Approximately 40–50 % of SDLC cost is spent on software testing. When applications need to be developed rapidly with changing user demands, this expenditure takes a significant value. Software testing is very important but is an effort consuming activity. Large numbers of test cases are possible and some of them may make software fail. Therefore there is a need to automate the existing manual approach to minimize the test case execution time and further optimize test cases. In this paper a keyword oriented data driven hybrid framework—HTLP (hybrid test language processing) been proposed for automatic test case execution and optimization. The HTLP is applied to an open source software based application-Vtiger CRM5. The proposed framework is compared with manual testing approach for test case execution and optimization. Based on experimental results it is concluded that (1) with iterative regression cycles the HTLP testing time is significantly very low as compared to manual testing approach and (2) a high level of test suite optimization (83.78 %) is achieved using the proposed framework.

[1]  Zoran Stojanovic,et al.  Advanced topics in database research (volume 3) , 2004 .

[2]  David W. Binkley,et al.  Semantics Guided Regression Test Cost Reduction , 1997, IEEE Trans. Software Eng..

[3]  Yogesh Singh,et al.  Radial basis function neural network based approach to test oracle , 2011, SOEN.

[4]  Stephen M. Thebaut,et al.  An approach to software fault localization and revalidation based on incremental data flow analysis , 1989, [1989] Proceedings of the Thirteenth Annual International Computer Software & Applications Conference.

[5]  Susan Horwitz,et al.  Incremental program testing using program dependence graphs , 1993, POPL '93.

[6]  Brian Foote,et al.  Designing Reusable Classes , 2001 .

[7]  Mukesh Mann,et al.  Generating and prioritizing optimal paths using ant colony optimization , 2015 .

[8]  Phyllis G. Frankl,et al.  Pythia: a regression test selection tool based on textual differencing , 1997 .

[9]  Mary Lou Soffa,et al.  Program Slicing‐Based Regression Testing Techniques , 1996 .

[10]  John Paul,et al.  Automated Software Testing: Introduction, Management, and Performance , 1999 .

[11]  Om Prakash Sangwan,et al.  Event-Coverage and Weight based Method for Test Suite Prioritization , 2014 .

[12]  Abbas Tarhini,et al.  Regression Testing Web Services-based Applications , 2006, IEEE International Conference on Computer Systems and Applications, 2006..

[13]  Suzanne M. Embury,et al.  A safe regression test selection technique for database-driven applications , 2005, 21st IEEE International Conference on Software Maintenance (ICSM'05).

[14]  Pankaj Mudholkar,et al.  Software Testing , 2002, Computer.

[15]  Tao Xie,et al.  Towards regression test selection for AspectJ programs , 2006, WTAOP '06.

[16]  Andris Zarins,et al.  SMOTL - A System to Construct Samples for Data Processing Program Debugging , 1979, IEEE Trans. Software Eng..

[17]  Karl N. Levitt,et al.  SELECT—a formal system for testing and debugging programs by symbolic execution , 1975 .

[18]  Feng Lin,et al.  Applying Safe Regression Test Selection Techniques to Java Web Services , 2006, International Conference on Next Generation Web Services Practices.

[19]  Srinivas Nidhra,et al.  BLACK BOX AND WHITE BOX TESTING TECHNIQUES -A LITERATURE REVIEW , 2012 .

[20]  Abdulazeez S. Boujarwah,et al.  Compiler test case generation methods: a survey and assessment , 1997, Inf. Softw. Technol..

[21]  Michael Ruth,et al.  A Safe Regression Test Selection Technique for Web Services , 2007, Second International Conference on Internet and Web Applications and Services (ICIW'07).

[22]  Keng Siau.  Advanced Topics in Database Research, Volume 1 , 2002 .

[23]  Baowen Xu,et al.  Regression testing for Web applications based on slicing , 2003, Proceedings 27th Annual International Computer Software and Applications Conference. COMPAC 2003.

[24]  K. K. Aggarwal,et al.  A neural net based approach to Test Oracle , 2004, SOEN.

[25]  Joseph Robert Horgan,et al.  Incremental regression testing , 1993, 1993 Conference on Software Maintenance.

[26]  Atanas Rountev,et al.  Regression Test Selection for AspectJ Software , 2007, 29th International Conference on Software Engineering (ICSE'07).

[27]  Gregg Rothermel,et al.  A safe, efficient regression test selection technique , 1997, TSEM.

[28]  Michael Ruth,et al.  Towards Automatic Regression Test Selection for Web Services , 2007, 31st Annual International Computer Software and Applications Conference (COMPSAC 2007).

[29]  Phyllis G. Frankl,et al.  Empirical evaluation of the textual differencing regression testing technique , 1998, Proceedings. International Conference on Software Maintenance (Cat. No. 98CB36272).

[30]  Gregg Rothermel,et al.  Performing data flow testing on classes , 1994, SIGSOFT '94.

[31]  David S. Rosenblum,et al.  TESTTUBE: a system for selective regression testing , 1994, Proceedings of 16th International Conference on Software Engineering.

[32]  Trevor J. Smedley,et al.  Interprocedural Data-flow Testing for Visual Dataflow Languages , 2003, IASSE.

[33]  Keng Siau,et al.  Advanced Topics In Database Research , 2005 .

[34]  Mukesh Mann,et al.  Test case prioritization using Cuscuta search , 2014 .

[35]  C. V. Ramamoorthy,et al.  On the Automated Generation of Program Test Data , 1976, IEEE Transactions on Software Engineering.

[36]  Hareton Leung,et al.  A firewall concept for both control-flow and data-flow in regression integration testing , 1992, Proceedings Conference on Software Maintenance 1992.

[37]  Swarnendu Biswas,et al.  Regression Test Selection Techniques: A Survey , 2011, Informatica.

[38]  Sean McDonald,et al.  Software Test Automation , 1999 .

[39]  Margus Veanes,et al.  Generating finite state machines from abstract state machines , 2002, ISSTA '02.

[40]  Yogesh Singh,et al.  Test Case PrioritizationUsing Fuzzy Logic for GUI based Software , 2012 .

[41]  Hareton Leung,et al.  A study of integration testing and software regression at the integration level , 1990, Proceedings. Conference on Software Maintenance 1990.