OpenHMI-tester: an open and cross-platform architecture for GUI testing and certification

Software testing is usually used to report and/or assure about the quality, reliability and robustness of a software in the given context or scenario where it is intended to work. This is specially true in the case of user interfaces, where the testing phase is critical before the software can be accepted by the nal user and put in execution mode. This paper presents the design, and the later implementation as a contribution to the open-source community, of a Human-Machine Interface (HMI) testing architecture, named OpenHMI-Tester. The current design is aimed to support major event-based and open-source windowing systems, thus providing generality, besides some other features such as scalability and tolerance to modications in the HMI design process. The proposed architecture has been also integrated as part of a complex industrial scenario, which helped to identify a set of realistic requirements of the testing architecture, as well as to test it with real HMI developers.

[1]  Lee J. White,et al.  Generating test cases for GUI responsibilities using complete interaction sequences , 2000, Proceedings 11th International Symposium on Software Reliability Engineering. ISSRE 2000.

[2]  OrsoAlessandro,et al.  Selective capture and replay of program executions , 2005 .

[3]  Koen De Bosschere,et al.  RecPlay: a fully integrated practical record/replay system , 1999, TOCS.

[4]  Atif M. Memon,et al.  Using GUI Run-Time State as Feedback to Generate Test Cases , 2007, 29th International Conference on Software Engineering (ICSE'07).

[5]  Atif M. Memon,et al.  An event‐flow model of GUI‐based applications for testing , 2007, Softw. Test. Verification Reliab..

[6]  Mary Lou Soffa,et al.  A comprehensive framework for testing graphical user interfaces , 2001 .

[7]  Markus Lupp,et al.  Extensible Markup Language , 2008, Encyclopedia of GIS.

[8]  Atif M. Memon.  GUI Testing: Pitfalls and Process , 2002, Computer.

[9]  Lee J. White,et al.  User-based testing of GUI sequences and their interactions , 2001, Proceedings 12th International Symposium on Software Reliability Engineering.

[10]  John Steven,et al.  jRapture: A Capture/Replay tool for observation-based testing , 2000, ISSTA '00.

[11]  Partha Dasgupta,et al.  Transparent Migration of Distributed Communicating Processes , 2000 .

[12]  Atif M. Memon,et al.  Designing and comparing automated test oracles for GUI-based software applications , 2007, TSEM.

[13]  Mary Lou Soffa,et al.  Coverage criteria for GUI testing , 2001, ESEC/FSE-9.

[14]  Shi-Jinn Horng,et al.  A dynamic backdoor detection system based on Dynamic Link Libraries , 2008 .

[15]  Lee J. White,et al.  Multivariate visualization in observation-based testing , 2000, Proceedings of the 2000 International Conference on Software Engineering. ICSE 2000 the New Millennium.

[16]  Kent L. Beck.  Extreme Programming , 1999, TOOLS.

[17]  Rajesh Subramanyan,et al.  Automation of GUI testing using a model-driven approach , 2006, AST '06.

[18]  Sergiu M. Dascalu,et al.  Challenges and opportunities for improving code-based testing of graphical user interfaces , 2006, J. Comput. Methods Sci. Eng..

[19]  Rajesh Subramanyan,et al.  A survey on model-based testing approaches: a systematic review , 2007, WEASELTech '07.

[20]  Atif M. Memon,et al.  GUI ripping: reverse engineering of graphical user interfaces for testing , 2003, 10th Working Conference on Reverse Engineering, 2003. WCRE 2003. Proceedings..

[21]  Alessandro Orso,et al.  Selective capture and replay of program executions , 2005, WODA '05.

[22]  Mingsong Chen,et al.  Automatic test case generation for UML activity diagrams , 2006, AST '06.

[23]  Atif M. Memon,et al.  DART: a framework for regression testing "nightly/daily builds" of GUI applications , 2003, International Conference on Software Maintenance, 2003. ICSM 2003. Proceedings..