Scalability issues with using FSMWeb to test web applications

Web applications are fast becoming more widespread, larger, more interactive, and more essential to the international use of computers. It is well understood that web applications must be highly dependable, and as a field we are just now beginning to understand how to model and test Web applications. One straightforward technique is to model Web applications as finite state machines. However, large numbers of input fields, input choices and the ability to enter values in any order combine to create a state space explosion problem. This paper evaluates a solution that uses constraints on the inputs to reduce the number of transitions, thus compressing the FSM. The paper presents an analysis of the potential savings of the compression technique and reports actual savings from two case studies.

[1]  Martin Gaedke,et al.  Object-Oriented Web Application Development , 1999, IEEE Internet Comput..

[2]  Tomás Isakowitz,et al.  RMM: a methodology for structured hypermedia design , 1995, CACM.

[3]  Jeremy Dick,et al.  Automating the Generation and Sequencing of Test Cases from Model-Based Specifications , 1993, FME.

[4]  R. K. Shyamasundar,et al.  Introduction to algorithms , 1996 .

[5]  A. Jefferson Offutt,et al.  Quality Attributes of Web Software Applications , 2002, IEEE Softw..

[6]  Robert V. Binder,et al.  Testing Object-Oriented Systems: Models, Patterns, and Tools , 1999 .

[7]  Walter F. Tichy,et al.  Proceedings 25th International Conference on Software Engineering , 2003, 25th International Conference on Software Engineering, 2003. Proceedings..

[8]  Emily Hill,et al.  An empirical comparison of test suite reduction techniques for user-session-based testing of Web applications , 2005, 21st IEEE International Conference on Software Maintenance (ICSM'05).

[9]  Jakob Nielsen,et al.  Designing web usability , 1999 .

[10]  Alexandre Petrenko,et al.  Test Selection Based on Communicating Nondeterministic Finite-State Machines Using a Generalized WP-Method , 1994, IEEE Trans. Software Eng..

[11]  Giuseppe A. Di Lucca,et al.  Testing Web applications , 2002, International Conference on Software Maintenance, 2002. Proceedings..

[12]  Krishan K. Sabnani,et al.  A Protocol Test Generation Procedure , 1988, Comput. Networks.

[13]  Gregg Rothermel,et al.  Leveraging user-session data to support Web application testing , 2005, IEEE Transactions on Software Engineering.

[14]  Jim Conallen,et al.  Modeling Web application architectures with UML , 1999, CACM.

[15]  A. Jefferson Offutt,et al.  Generating Tests from UML Specifications , 1999, UML.

[16]  Paolo Tonella,et al.  Analysis and testing of Web applications , 2001, Proceedings of the 23rd International Conference on Software Engineering. ICSE 2001.

[17]  A. Jefferson Offutt,et al.  MuJava: an automated class mutation system , 2005, Softw. Test. Verification Reliab..

[18]  Emily Hill,et al.  Applying Concept Analysis to User-Session-Based Testing of Web Applications , 2007, IEEE Transactions on Software Engineering.

[19]  A. Jefferson Offutt,et al.  Testing Web applications by modeling with FSMs , 2005, Software & Systems Modeling.

[20]  Ye Wu,et al.  Modeling and Testing Web-based Applications , 2002 .

[21]  Gregg Rothermel,et al.  Improving web application testing with user session data , 2003, 25th International Conference on Software Engineering, 2003. Proceedings..

[22]  Xiaochen Du,et al.  Modeling and testing of dynamic aspects of Web applications , 2003 .

[23]  David Chenho Kung,et al.  An agent-based framework for testing Web applications , 2004, Proceedings of the 28th Annual International Computer Software and Applications Conference, 2004. COMPSAC 2004..

[24]  William E. Howden,et al.  Methodology for the Generation of Program Test Data , 1975, IEEE Transactions on Computers.

[25]  Jeffrey D. Ullman,et al.  Introduction to automata theory, languages, and computation, 2nd edition , 2001, SIGA.

[26]  A. Jefferson Offutt,et al.  Bypass testing of Web applications , 2004, 15th International Symposium on Software Reliability Engineering.

[27]  Adele E. Howe,et al.  AI Planner Assisted Test Generation , 2004, Software Quality Journal.

[28]  Eerke A. Boiten,et al.  Testing Refinements of State-based Formal Specifications , 1999, Softw. Test. Verification Reliab..

[29]  David Chenho Kung,et al.  An object-oriented web test model for testing Web applications , 2000, Proceedings First Asia-Pacific Conference on Quality Software.

[30]  Tsun S. Chow,et al.  Testing Software Design Modeled by Finite-State Machines , 1978, IEEE Transactions on Software Engineering.

[31]  A. Jefferson Offutt,et al.  Combination testing strategies: a survey , 2005, Softw. Test. Verification Reliab..

[32]  David Chenho Kung,et al.  Object state testing for object-oriented programs , 1995, Proceedings Nineteenth Annual International Computer Software and Applications Conference (COMPSAC'95).

[33]  Ye Wu,et al.  Modeling and Testing Web-based Applications , 2002 .

[34]  J.-C. Rault,et al.  A software reliability assessment based on a structural and behavioral analysis of programs , 1976, ICSE '76.

[35]  Ian Watson,et al.  The Manchester prototype dataflow computer , 1985, CACM.

[36]  David Chenho Kung,et al.  Object-based data flow testing of web applications , 2000, Proceedings First Asia-Pacific Conference on Quality Software.

[37]  Frank Manola Technologies for a Web Object Model , 1999, IEEE Internet Comput..

[38]  Je Outt Quality Attributes of Web Software Applications , 2002 .

[39]  J. C. Huang,et al.  An Approach to Program Testing , 1975, CSUR.

[40]  Ferhat Khendek,et al.  Test Selection Based on Finite State Models , 1991, IEEE Trans. Software Eng..

[41]  Lori Pollock,et al.  A scalable approach to user-session based testing of Web applications through concept analysis , 2004 .

[42]  Shaoying Liu,et al.  Generating test data from state‐based specifications , 2003, Softw. Test. Verification Reliab..

[43]  Ping Chen,et al.  Modeling Web application architecture with UML , 2000, Proceedings 36th International Conference on Technology of Object-Oriented Languages and Systems. TOOLS-Asia 2000.

[44]  Paul Ammann,et al.  Using formal methods to derive test frames in category-partition testing , 1994, Proceedings of COMPASS'94 - 1994 IEEE 9th Annual Conference on Computer Assurance.

[45]  Curtis E. Dyreson,et al.  AutoDBT: A Framework for Automatic Testing of Web Database Applications , 2004, WISE.

[46]  Richard Mark Soley,et al.  Object management architecture guide (3rd ed.) , 1995 .

[47]  Guney Gonenc,et al.  A Method for the Design of Fault Detection Experiments , 1970, IEEE Transactions on Computers.

[48]  David Chenho Kung,et al.  Structural testing of Web applications , 2000, Proceedings 11th International Symposium on Software Reliability Engineering. ISSRE 2000.

[49]  David Chenho Kung,et al.  On object state testing , 1994, Proceedings Eighteenth Annual International Computer Software and Applications Conference (COMPSAC 94).

[50]  David J. Robson,et al.  The state-based testing of object-oriented programs , 1993, 1993 Conference on Software Maintenance.

[51]  Franca Garzotto,et al.  Towards a software engineering approach to Web site development , 1998, Proceedings Ninth International Workshop on Software Specification and Design.

[52]  Baowen Xu,et al.  Regression testing for Web applications based on slicing , 2003, Proceedings 27th Annual International Computer Software and Applications Conference. COMPAC 2003.

[53]  Shaoying Liu,et al.  Criteria for generating specification-based tests , 1999, Proceedings Fifth IEEE International Conference on Engineering of Complex Computer Systems (ICECCS'99) (Cat. No.PR00434).

[54]  Bertrand Meyer,et al.  Proceedings, 36th International Conference on Technology of Object-Oriented Languages and Systems : TOOLS-Asia 2000, October 30-November 4,2000, Xi'an, China , 2000 .

[55]  Jeffrey D. Ullman,et al.  Introduction to Automata Theory, Languages and Computation , 1979 .