Improving the Accuracy of Automated GUI Testing for Embedded Systems

Automated GUIs test application user interfaces and verify their functionalities. However, due to the uncertainty of runtime execution environments, the device under test (DUT) might not reproduce GUI operations on time, resulting in test failures. The Smart Phone Automated GUI (SPAG) avoids nondeterministic events by batching event sequences and directly reproducing them on the DUT. SPAG dynamically changes the timing of following operations so that all event sequences can be performed on time. Experiments conducted on an Acer Liquid smartphone comparing SPAG to MonkeyRunner showed that SPAG can maintain up to 99.5 percent accuracy.

[1]  Tom Yeh,et al.  Associating the visual representation of user interfaces with their internal structures and metadata , 2011, UIST.

[2]  Rob Miller,et al.  GUI testing using computer vision , 2010, CHI.

[3]  Atif M. Memon,et al.  Using a pilot study to derive a GUI model for automated testing , 2008, TSEM.

[4]  Jiang Bo,et al.  MobileTest: A Tool Supporting Automatic Black Box Test for Software on Smart Mobile Devices , 2007, Second International Workshop on Automation of Software Test (AST '07).

[5]  Rob Miller,et al.  Sikuli: using GUI screenshots for search and automation , 2009, UIST '09.

[6]  Oh-Hyun Kwon,et al.  Mobile GUI Testing Tool based on Image Flow , 2008, Seventh IEEE/ACIS International Conference on Computer and Information Science (icis 2008).

[7]  Mika Katara,et al.  Experiences of System-Level Model-Based GUI Testing of an Android Application , 2011, 2011 Fourth IEEE International Conference on Software Testing, Verification and Validation.

[8]  Gao Xiao-peng,et al.  SOA Based Mobile Device Test , 2009, 2009 Second International Conference on Intelligent Computation Technology and Automation.

[9]  Iulian Neamtiu,et al.  Automating GUI testing for Android applications , 2011, AST '11.

[10]  Chen Fu,et al.  Creating GUI Testing Tools Using Accessibility Technologies , 2009, 2009 International Conference on Software Testing, Verification, and Validation Workshops.

[11]  Venkata Raghunath Vemuri,et al.  Testing Predictive Software in Mobile Devices , 2008, 2008 1st International Conference on Software Testing, Verification, and Validation.

[12]  Chen Fu,et al.  Maintaining and evolving GUI-directed test scripts , 2009, 2009 IEEE 31st International Conference on Software Engineering.

[13]  Tao Xie,et al.  A Grey-Box Approach for Automated GUI-Model Generation of Mobile Applications , 2013, FASE.

[14]  Porfirio Tramontana,et al.  Using GUI ripping for automated testing of Android applications , 2012, 2012 Proceedings of the 27th IEEE/ACM International Conference on Automated Software Engineering.