An Experimental Study on Robustness and Responsiveness Testing of Iranian Android Games

During the last decade, many Iranian software and game developers have targeted Android as their main development framework, resulting in the availability of a large number of Android applications. Despite the opportunities that Android provides for application developers, it introduces new challenges for the development of high quality applications. In this paper, we have focused on responsiveness and fault-tolerance as two interesting quality attributes of Android applications, lack of which might result in users' dissatisfaction and leaving the application. Hence, we have conducted an experimental study, using monkey testing technique, on a set of Iranian Android games to assess their robustness and responsiveness. The results demonstrate that much more attention needs to be paid by Iranian Android developers to the responsiveness and fault-tolerance of their applications, since about 85% of the analyzed games have shown to have at least one responsiveness or robustness error.

[1]  Yue Jia,et al.  Sapienz: multi-objective automated testing for Android applications , 2016, ISSTA.

[2]  Atanas Rountev,et al.  Testing for poor responsiveness in android applications , 2013, 2013 1st International Workshop on the Engineering of Mobile-Enabled Systems (MOBS).

[3]  Jun Yan,et al.  Widget-Sensitive and Back-Stack-Aware GUI Exploration for Testing Android Apps , 2017, 2017 IEEE International Conference on Software Quality, Reliability and Security (QRS).

[4]  S. Malek,et al.  PATDroid: permission-aware GUI testing of Android , 2017, ESEC/SIGSOFT FSE.

[5]  Shingo Takada,et al.  Responsiveness analysis tool for Android application , 2014, DeMobile@SIGSOFT FSE.

[6]  Deepa Thiagarajan EFFICIENT DETECTION OF HANG BUGS IN MOBILE APPLICATIONS , 2016 .

[7]  Yu Lin,et al.  Study and Refactoring of Android Asynchronous Programming (T) , 2015, 2015 30th IEEE/ACM International Conference on Automated Software Engineering (ASE).

[8]  Michael Halper Using android as a platform for programming in the IT curriculum , 2014, SIGITE '14.

[9]  Doo-Hwan Bae,et al.  Automated model-based Android GUI testing using multi-level GUI comparison criteria , 2016, 2016 31st IEEE/ACM International Conference on Automated Software Engineering (ASE).

[10]  Gerardo Canfora,et al.  Exploring Mobile User Experience Through Code Quality Metrics , 2016, PROFES.

[11]  Xiaorui Wang,et al.  Hang doctor: runtime detection and diagnosis of soft hangs for smartphone apps , 2018, EuroSys.

[12]  Yepang Liu,et al.  Characterizing and detecting performance bugs for smartphone applications , 2014, ICSE.

[13]  Michael R. Lyu,et al.  Experience Report: Detecting Poor-Responsive UI in Android Applications , 2016, 2016 IEEE 27th International Symposium on Software Reliability Engineering (ISSRE).

[14]  Gabriele Bavota,et al.  API change and fault proneness: a threat to the success of Android apps , 2013, ESEC/FSE 2013.

[15]  David Lo,et al.  Understanding the Test Automation Culture of App Developers , 2015, 2015 IEEE 8th International Conference on Software Testing, Verification and Validation (ICST).

[16]  Michalis Faloutsos,et al.  ProfileDroid: multi-layer profiling of android applications , 2012, Mobicom '12.

[17]  Yuanyuan Zhang,et al.  A Survey of App Store Analysis for Software Engineering , 2017, IEEE Transactions on Software Engineering.

[18]  Porfirio Tramontana,et al.  A GUI Crawling-Based Technique for Android Mobile Application Testing , 2011, 2011 IEEE Fourth International Conference on Software Testing, Verification and Validation Workshops.

[19]  Jeff Huang,et al.  EHBDroid: Beyond GUI testing for Android applications , 2017, 2017 32nd IEEE/ACM International Conference on Automated Software Engineering (ASE).

[20]  Yu Lin,et al.  Study and Refactoring of Android Asynchronous Programming , 2015 .

[21]  Mario Linares Vásquez,et al.  How do Developers Test Android Applications? , 2017, 2017 IEEE International Conference on Software Maintenance and Evolution (ICSME).

[22]  Porfirio Tramontana,et al.  Using GUI ripping for automated testing of Android applications , 2012, 2012 Proceedings of the 27th IEEE/ACM International Conference on Automated Software Engineering.