Testdroid: automated remote UI testing on Android

Open mobile platforms such as Android currently suffer from the existence of multiple versions, each with its own peculiarities. This makes the comprehensive testing of interactive applications challenging. In this paper we present Testdroid, an online platform for conducting scripted user interface tests on a variety of physical Android handsets. Testdroid allows developers and researchers to record test scripts, which along with their application are automatically executed on a variety of handsets in parallel. The platform reports the outcome of these tests, enabling developers and researchers to quickly identify platforms where their systems may crash or fail. At the same time the platform allows us to identify more broadly the various problems associated with each handset, as well as frequent programming mistakes.

[1]  Pekka Abrahamsson,et al.  Mobile-D: an agile approach for mobile application development , 2004, OOPSLA '04.

[2]  Lisa Haney,et al.  Applying User-Centered Design to Mobile Application Development , 2005 .

[3]  Albrecht Schmidt,et al.  Tracking the interaction of users with AJAX applications for usability testing , 2007, CHI.

[4]  Jiang Bo,et al.  MobileTest: A Tool Supporting Automatic Black Box Test for Software on Smart Mobile Devices , 2007, Second International Workshop on Automation of Software Test (AST '07).

[5]  Leena Arhippainen,et al.  Empirical Evaluation of User Experience in two Adaptive Mobile Application Prototypes , 2003 .

[6]  Young Bom Park,et al.  Mobile Application Compatibility Test System Design for Android Fragmentation , 2011, FGIT-ASEA/DRBC/EL.

[7]  Jacob Eisenstein,et al.  Adaptation in automated user-interface design , 2000, IUI '00.

[8]  Jiang Bo,et al.  MobileTest: A Tool Supporting Automatic Black Box Test for Software on Smart Mobile Devices , 2007, AST '07.

[9]  Gillian Dobbie,et al.  Automated Usability Testing Framework , 2008, AUIC.

[10]  Ichiro Satoh,et al.  A Testing Framework for Mobile Computing Software , 2003, IEEE Trans. Software Eng..

[11]  Anu Kankainen,et al.  Usability testing of mobile applications: a comparison between laboratory and field testing , 2005 .

[12]  Bo Jiang,et al.  MobileTest: A Tool Supporting Automatic Black Box Test for Software on Smart Mobile Devices , 2007, AST.

[13]  Denzil Ferreira,et al.  Understanding Human-Smartphone Concerns: A Study of Battery Life , 2011, Pervasive.

[14]  Dawid Weiss,et al.  Automated Integration Tests for Mobile Applications in Java 2 Micro Edition , 2007, BIS.

[15]  Jonna Häkkilä,et al.  Utilising context ontology in mobile device application personalisation , 2004, MUM '04.

[16]  David J. Kasik,et al.  Toward automatic generation of novice user test scripts , 1996, CHI.