IoT Testing-as-a-Service: A New Dimension of Automation

Internet of Things (IoT) systems has become a global trend enhancing the capabilities smart computing era involving a variety of distributed end-devices and multi- scalable applications. The collaborative nature of IoT systems connected through the Internet increases the heterogeneity of coming data streams that need to be processed for correct decision making in a real-time environment. The processing of huge data streams for remotely distributed IoT systems create loops for data breaches and open new challenges for security and scalability of system testing. Thus, the testing of IoT systems is becoming the necessity, requires automated testing framework due to the amount of IoT devices and processing of data events is prone to error by traditional software testing. An automated IoT testing service based framework is purposed in this paper, to test the distributed IoT systems by reducing cost and scalability issues of software testing. The infrastructure of IoT systems demands a large number of platforms be developed which requires systematic testing approach. Therefore, the purposed automated IoT testing as a service model performs distributed interoperability testing, oneM2M based conformance testing, security testing of distributed systems and validating semantics/syntactic testing of IoT devices in a systematic approach. Lastly, to provide more strength to the work we discussed and analyze existing IoT testing models to evaluate our proposed model.

[1]  Antonio Iera,et al.  The Internet of Things: A survey , 2010, Comput. Networks.

[2]  Christian Bonnet,et al.  Approach for Semantic Interoperability Testing in Internet of Things , 2018, 2018 Global Internet of Things Summit (GIoTS).

[3]  Ruth Breu,et al.  Towards a Model Based Security Testing Approach of Cloud Computing Environments , 2012, 2012 IEEE Sixth International Conference on Software Security and Reliability Companion.

[4]  Ling Liu,et al.  Machine to Machine Trust in the IoT Era , 2016, TRUST@AAMAS.

[5]  Fabrice Bouquet,et al.  Recent Advances in Model-Based Testing , 2016, Adv. Comput..

[6]  Mohamed Mohamed,et al.  Foggy: A Framework for Continuous Automated IoT Application Deployment in Fog Computing , 2017, 2017 IEEE International Conference on AI & Mobile Services (AIMS).

[7]  Davide Ancona,et al.  Towards an Acceptance Testing Approach for Internet of Things Systems , 2017, ICWE Workshops.

[8]  Ossi Taipale,et al.  Research Issues for Software Testing in the Cloud , 2010, 2010 IEEE Second International Conference on Cloud Computing Technology and Science.

[9]  Matthias Kovatsch,et al.  Industry adoption of the Internet of Things: A constrained application protocol survey , 2012, Proceedings of 2012 IEEE 17th International Conference on Emerging Technologies & Factory Automation (ETFA 2012).

[10]  María Bermúdez-Edo,et al.  IoT-Lite: A Lightweight Semantic Model for the Internet of Things , 2016, UIC/ATC/ScalCom/CBDCom/IoP/SmartWorld.

[11]  Ina Schieferdecker,et al.  IoT-Testware - An Eclipse Project , 2017, 2017 IEEE International Conference on Software Quality, Reliability and Security (QRS).

[12]  Fernando Magno Quintão Pereira,et al.  SIoT: Securing Internet of Things through distributed systems analysis , 2017, Future Gener. Comput. Syst..

[13]  G. Baldini,et al.  7 Large Scale IoT Security Testing , Benchmarking and Certification , 2017 .

[14]  Calton Pu,et al.  Buffer overflows: attacks and defenses for the vulnerability of the decade , 2000, Proceedings DARPA Information Survivability Conference and Exposition. DISCEX'00.

[15]  Manjit Kaur,et al.  Comparative Study of Automated Testing Tools: TestComplete and QuickTest Pro , 2011 .

[16]  Fabrice Bouquet,et al.  Model-Based Testing as a Service for IoT Platforms , 2016, ISoLA.

[17]  Ralf Tönjes,et al.  Test-Enabled Architecture for IoT Service Creation and Provisioning , 2013, Future Internet Assembly.

[18]  Xiaohong Huang,et al.  Ensuring Interoperability for the Internet of Things: Experience with CoAP Protocol Testing , 2013 .

[19]  Vikram S. Adve,et al.  LLVM: a compilation framework for lifelong program analysis & transformation , 2004, International Symposium on Code Generation and Optimization, 2004. CGO 2004..

[20]  Hamza Baqa,et al.  IoT-TaaS: Towards a Prospective IoT Testing Framework , 2018, IEEE Access.

[21]  K. Saravanan,et al.  Open Source Software Test Automation Tools: A Competitive Necessity , 2016 .

[22]  Bruno Legeard,et al.  A taxonomy of model‐based testing approaches , 2012, Softw. Test. Verification Reliab..

[23]  Mahmoud Ammar,et al.  Journal of Information Security and Applications , 2022 .

[24]  Matthias Wählisch,et al.  A Distributed Test System Architecture for Open-source IoT Software , 2015, IoT-Sys@MobiSys.

[25]  Bengt Ahlgren,et al.  Internet of Things for Smart Cities: Interoperability and Open Data , 2016, IEEE Internet Computing.

[26]  David Lee,et al.  Passive testing and applications to network management , 1997, Proceedings 1997 International Conference on Network Protocols.

[27]  Anthony Wiles,et al.  Experience within ETSI of the combined roles of conformance testing and interoperability testing , 2003, ESSDERC 2003. Proceedings of the 33rd European Solid-State Device Research - ESSDERC '03 (IEEE Cat. No. 03EX704).

[28]  Patrick D. McDaniel,et al.  Soteria: Automated IoT Safety and Security Analysis , 2018, USENIX Annual Technical Conference.