Monitoring Informed Testing for IoT

Internet of Things (IoT) systems continuously collect a large amount of data from heterogeneous "smart objects" through standardised service interfaces. A key challenge is how to use these data and relevant event logs to construct continuously adapted usage profiles and apply them to enhance testing methods, i.e., prioritization of tests for the testing of continuous integration of an IoT system. In addition, these usage profiles provide relevance weightings to analyse architecture and behaviour of the system. Based on the analysis, testing methods can predict specific system locations that are susceptible to error, and therefore suggest where expanded runtime monitoring is necessary. Furthermore, IoT aims to connect billions of "smart devices" over the network. Testing even a small IoT system connecting a few dozens of smart devices would require a network of test Virtual Machines (VMs) possibly spreading across the Fog and the Cloud. In this paper we propose a framework for testing of each IoT layer in a separate VM environment, and discuss potential difficulties with optimal VM allocation.

[1]  Jesse H. Poore,et al.  Automated Statistical Testing for Embedded Systems , 2011, Model-Based Testing for Embedded Systems.

[2]  Maria Spichkova,et al.  Managing Usability and Reliability Aspects in Cloud Computing , 2016, ENASE.

[3]  Maria Rita Palattella,et al.  Internet of Things in the 5G Era: Enablers, Architecture, and Business Models , 2016, IEEE Journal on Selected Areas in Communications.

[4]  Risto Vaarandi,et al.  SEC - a lightweight event correlation tool , 2002, IEEE Workshop on IP Operations and Management.

[5]  Lida Xu,et al.  The internet of things: a survey , 2014, Information Systems Frontiers.

[6]  Klaus Pohl,et al.  Towards pro-active adaptation with confidence: augmenting service monitoring with online testing , 2010, SEAMS '10.

[7]  T. V. Lakshman,et al.  Network aware resource allocation in distributed clouds , 2012, 2012 Proceedings IEEE INFOCOM.

[8]  Siobhán Clarke,et al.  Middleware for Internet of Things: A Survey , 2016, IEEE Internet of Things Journal.

[9]  Huai Liu,et al.  An Application of Adaptive Random Sequence in Test Case Prioritization , 2014, SEKE.

[10]  Mario Nemirovsky,et al.  Key ingredients in an IoT recipe: Fog Computing, Cloud computing, and more Fog Computing , 2014, 2014 IEEE 19th International Workshop on Computer Aided Modeling and Design of Communication Links and Networks (CAMAD).

[11]  Maria Spichkova,et al.  Towards Modelling and Implementation of Reliability and Usability Features for Research-Oriented Cloud Computing Platforms , 2016, ENASE.

[12]  J. Torsner,et al.  Internet of Things in the 5G Era: Enablers, Architecture, and Business Models , 2016, IEEE Journal on Selected Areas in Communications.

[13]  Maria Spichkova,et al.  Chiminey: Reliable Computing and Data Management Platform in the Cloud , 2015, 2015 IEEE/ACM 37th IEEE International Conference on Software Engineering.

[14]  Henrik Thane,et al.  Monitoring, Testing and Debugging of Distributed Real-Time Systems , 2000 .

[15]  Wei-Tek Tsai,et al.  Ontology-Based Test Modeling and Partition Testing of Web Services , 2008, 2008 IEEE International Conference on Web Services.

[16]  Maria Spichkova,et al.  Scalable and Fault-Tolerant Cloud Computations: Modelling and Implementation , 2015, 2015 IEEE 21st International Conference on Parallel and Distributed Systems (ICPADS).

[17]  Kesheng Wu,et al.  Efficiently Extracting Operational Profiles from Execution Logs Using Suffix Arrays , 2009, 2009 20th International Symposium on Software Reliability Engineering.

[18]  John D. Musa,et al.  Operational profiles in software-reliability engineering , 1993, IEEE Software.

[19]  Maria Spichkova,et al.  Chiminey: Connecting Scientists to HPC, Cloud and Big Data , 2017, Big Data Res..

[20]  Raja Lavanya,et al.  Fog Computing and Its Role in the Internet of Things , 2019, Advances in Computer and Electrical Engineering.

[21]  Xavier Franch,et al.  Usage-Based Online Testing for Proactive Adaptation of Service-Based Applications , 2011, 2011 IEEE 35th Annual Computer Software and Applications Conference.

[22]  Mahdi Ben Alaya,et al.  OM2M: Extensible ETSI-compliant M2M Service Platform with Self-configuration Capability , 2014, ANT/SEIT.

[23]  Eike Steffen Reetz,et al.  Service testing for the 'Internet of Things' , 2016 .

[24]  Arkady B. Zaslavsky,et al.  Context Aware Computing for The Internet of Things: A Survey , 2013, IEEE Communications Surveys & Tutorials.