On building a cloud-based mobile testing infrastructure service system

The paper described a developed mobile infrastructure service system (MTaaS).The paper provides informative perspectives and issues on cloud-based mobile TaaS.The paper gives a comparison between MTaaS and current major mobile TaaS players. With the rapid advance of mobile computing, cloud computing and wireless network, there is a significant increasing number of mobile subscriptions. This brings new business requirements and demands in mobile testing service, and causes new issues and challenges. In this paper, informative discussions about cloud-based mobile testing-as-a-service (mobile TaaS) are offered, including the essential concepts, focuses, test process, and the expected testing infrastructures. To address the need of infrastructure level service for mobile TaaS, this paper presents a developed system known as MTaaS to provide an infrastructure-as-a-service (IaaS) for mobile testing, in order to indicate the feasibility and effectiveness of cloud-based mobile testing service. In addition, the paper presents a comparison among cloud-based mobile TaaS approaches and several best practices in industry are discussed. Finally, the primary issues, challenges, and needs existed in current mobile TaaS are analyzed.

[1]  Zoltán Ádám Mann,et al.  Allocation of Virtual Machines in Cloud Data Centers—A Survey of Problem Models and Optimization Algorithms , 2015, ACM Comput. Surv..

[2]  Jiang Bo,et al.  MobileTest: A Tool Supporting Automatic Black Box Test for Software on Smart Mobile Devices , 2007, Second International Workshop on Automation of Software Test (AST '07).

[3]  Tao Zhang,et al.  Testing Location-Based Function Services for Mobile Applications , 2015, 2015 IEEE Symposium on Service-Oriented System Engineering.

[4]  Rajkumar Buyya,et al.  Modeling and simulation of scalable Cloud computing environments and the CloudSim toolkit: Challenges and opportunities , 2009, 2009 International Conference on High Performance Computing & Simulation.

[5]  Tien Van Do,et al.  Comparison of scheduling schemes for on-demand IaaS requests , 2012, J. Syst. Softw..

[6]  Porfirio Tramontana,et al.  Using GUI ripping for automated testing of Android applications , 2012, 2012 Proceedings of the 27th IEEE/ACM International Conference on Automated Software Engineering.

[7]  Ichiro Satoh,et al.  A Testing Framework for Mobile Computing Software , 2003, IEEE Trans. Software Eng..

[8]  Wei-Tek Tsai,et al.  Testing the scalability of SaaS applications , 2011, 2011 IEEE International Conference on Service-Oriented Computing and Applications (SOCA).

[9]  Anu Kankainen,et al.  Usability testing of mobile applications: a comparison between laboratory and field testing , 2005 .

[10]  Marco Dorigo.  Ant colony optimization , 2004, Scholarpedia.

[11]  Yang Yang,et al.  TESTQUAL: Conceptualizing Software Testing as a Service , 2011, AMCIS.

[12]  Marko Palola,et al.  Towards automating testing of communicational B3G applications , 2006, Mobility '06.

[13]  Henry Muccini,et al.  Software testing of mobile applications: Challenges and future research directions , 2012, 2012 7th International Workshop on Automation of Software Test (AST).

[14]  Muli Ben-Yehuda,et al.  The rise of RaaS: the resource-as-a-service cloud , 2014, CACM.

[15]  Josef Pichler,et al.  A Script-Based Testbed for Mobile Software Frameworks , 2008, 2008 1st International Conference on Software Testing, Verification, and Validation.

[16]  Hongseok Yang,et al.  Automated concolic testing of smartphone apps , 2012, SIGSOFT FSE.

[17]  Yang Liu,et al.  Collaborative Security , 2015, ACM Comput. Surv..

[18]  Wei-Tek Tsai,et al.  A cloud-based TaaS infrastructure with tools for SaaS validation, performance and scalability evaluation , 2012, 4th IEEE International Conference on Cloud Computing Technology and Science Proceedings.

[19]  Qining Wang,et al.  Concept, Principle and Application of Dynamic Configuration for Intelligent Algorithms , 2014, IEEE Systems Journal.

[20]  Manuel López-Ibáñez,et al.  Ant colony optimization , 2010, GECCO '10.

[21]  Franck Barbier,et al.  A model-driven approach for automating mobile applications testing , 2011, ECSA '11.

[22]  Sunilkumar S. Manvi,et al.  Resource management for Infrastructure as a Service (IaaS) in cloud computing: A survey , 2014, J. Netw. Comput. Appl..

[23]  Jun Zhang,et al.  Cloud Computing Resource Scheduling and a Survey of Its Evolutionary Approaches , 2015, ACM Comput. Surv..

[24]  Wei-Tek Tsai,et al.  Vee@Cloud: The virtual test lab on the cloud , 2013, 2013 8th International Workshop on Automation of Software Test (AST).

[25]  Wei-Tek Tsai,et al.  Cloud Testing- Issues, Challenges, Needs and Practice , 2011 .

[26]  Raymond A. Paul,et al.  Mobile Testing-as-a-Service (MTaaS) -- Infrastructures, Issues, Solutions and Needs , 2014, 2014 IEEE 15th International Symposium on High-Assurance Systems Engineering.

[27]  Jerry Zeyu Gao,et al.  Modeling mobile application test platform and environment: testing criteria and complexity analysis , 2014, JAMAICA 2014.

[28]  Ichiro Satoh.  Software testing for wireless mobile computing , 2004, IEEE Wireless Communications.

[29]  Jin Hyung Kim,et al.  An Integrated Test Automation Framework for Testing on Heterogeneous Mobile Platforms , 2011, 2011 First ACIS International Symposium on Software and Network Engineering.

[30]  Ossi Taipale,et al.  Software Testing as an Online Service: Observations from Practice , 2010, 2010 Third International Conference on Software Testing, Verification, and Validation Workshops.

[31]  M. Afshar Alam,et al.  An Overview of Load Balancing Techniques in Cloud Computing , 2017 .

[32]  Mohamed Adel Serhani,et al.  Performance Evaluation of Mobile Web Services , 2011, 2011 IEEE Ninth European Conference on Web Services.

[33]  Wei-Tek Tsai,et al.  Mobile Application Testing: A Tutorial , 2014, Computer.