An Automated Testing Framework for Statistical Testing of GUI Applications

It is known to be inherently more difficult and laborintensive to functionally test software applications that employ a graphical user interface front-end, due to the vast GUI input space. We propose an automated testing framework for functional and statistical testing of GUI-driven applications, using a combination of two rigorous software specification and testing methods and integrating them with an automated testing tool suitable for testing GUI applications. With this framework we are able to achieve fully automated statistical testing and software certification. We report an elaborate case study that demonstrates a pathway towards lowered cost of testing and improved product quality for this type of applications.

[1]  James A. Whittaker,et al.  A Markov Chain Model for Statistical Software Testing , 1994, IEEE Trans. Software Eng..

[2]  Jesse H. Poore,et al.  Markov analysis of software specifications , 1993, TSEM.

[3]  Stacy J. Prowell,et al.  Sequence‐based software specification of deterministic systems , 1998 .

[4]  W. Marsden.  I and J , 2012 .

[5]  Jesse H. Poore,et al.  Planning and certifying software system reliability , 1993, IEEE Software.

[6]  Philippa J. Hopcroft,et al.  Academia and industry meet: some experiences of formal methods in practice , 2003, Tenth Asia-Pacific Software Engineering Conference, 2003..

[7]  Stacy J. Prowell,et al.  Cleanroom software engineering: technology and process , 1999 .

[8]  Ellis Horowitz,et al.  A Graphical User Interface (GUI) Testing Methodology , 2008, Int. J. Inf. Technol. Web Eng..

[9]  Jesse H. Poore,et al.  Automated Statistical Testing for Embedded Systems , 2011, Model-Based Testing for Embedded Systems.

[10]  Jesse H. Poore,et al.  Application of statistical science to testing and evaluating software intensive systems , 1999, Proceedings. Science and Engineering for Software Development: A Recognition of Harlin D. Mills Legacy (Cat. No. PR00010).

[11]  R. Eschbach,et al.  From Requirements to Statistical Testing of Embedded Systems , 2007, Fourth International Workshop on Software Engineering for Automotive Systems (SEAS '07).

[12]  S. Prowell,et al.  Sequence-Based Software Specification of Deterministic Systems , 1998, Softw. Pract. Exp..

[13]  Stacy J. Prowell,et al.  An axiom system for sequence-based specification , 2010, Theor. Comput. Sci..

[14]  Insup Lee,et al.  Model-Based Testing of GUI-Driven Applications , 2009, SEUS.

[15]  Atif M. Memon,et al.  Advances in Automated Model-Based System Testing of Software Applications with a GUI Front-End , 2010, Adv. Comput..

[16]  Stacy J. Prowell,et al.  Foundations of Sequence-Based Software Specification , 2003, IEEE Trans. Software Eng..

[17]  Rob Miller,et al.  GUI testing using computer vision , 2010, CHI.