WebVizOr: A Visualization Tool for Applying Automated Oracles and Analyzing Test Results of Web Applications

Web applications are used extensively for a variety of critical purposes and, therefore, must be reliable. Since Web applications often contain large amounts of code and frequently undergo maintenance, testers need automated tools to execute large numbers of test cases to determine if an application is behaving correctly. Evaluating the voluminous output-typically Web pages full of content-is tedious and error-prone. To ease the difficulty, testers can apply automated oracles, which have tradeoffs in false positives and false negatives. In this paper, we present the design, implementation, and evaluation of WebVizOr, a tool that aids testers byapplying a set of oracles to the output from test cases and highlighting the symptoms of possible faults. Using WebVizOr, a tester can compare the test results from several executions of a test case and can more easily determine if a test case exposes a fault.

[1]  Claude Caci,et al.  Testing object-oriented systems , 2000, SOEN.

[2]  Elaine J. Weyuker,et al.  On Testing Non-Testable Programs , 1982, Comput. J..

[3]  Lori L. Pollock,et al.  Automated Oracle Comparators for TestingWeb Applications , 2007, The 18th IEEE International Symposium on Software Reliability (ISSRE '07).

[4]  Lori Pollock,et al.  Towards Automatically Creating Test Suites from Web Application Field Data , 2006 .

[5]  Gregg Rothermel,et al.  Leveraging user-session data to support Web application testing , 2005, IEEE Transactions on Software Engineering.

[6]  Emily Hill,et al.  Automated replay and failure detection for web applications , 2005, ASE '05.

[7]  Hector Garcia-Molina,et al.  Meaningful change detection in structured data , 1997, SIGMOD '97.

[8]  Dirk Draheim,et al.  Realistic load testing of Web applications , 2006, Conference on Software Maintenance and Reengineering (CSMR'06).

[9]  Steve Krug,et al.  Don't Make Me Think , 2000 .

[10]  Debra J. Richardson,et al.  TAOS: Testing with Analysis and Oracle Support , 1994, ISSTA '94.

[11]  Douglas Hoffman A Taxonomy for Test Oracles , 1998 .

[12]  A. Jefferson Offutt,et al.  Quality Attributes of Web Software Applications , 2002, IEEE Softw..

[13]  M. Young Test Oracles , 2001 .

[14]  Giuseppe A. Di Lucca,et al.  Testing Web applications , 2002, International Conference on Software Maintenance, 2002. Proceedings..