A Distributed Test System Architecture for Open-source IoT Software

In this paper, we discuss challenges that are specific to testing of open IoT software systems. The analysis reveals gaps compared to wireless sensor networks as well as embedded software. We propose a testing framework which (a) supports continuous integration techniques, (b) allows for the integration of project contributors to volunteer hardware and software resources to the test system, and (c) can function as a permanent distributed plugtest for network interoperability testing. The focus of this paper lies in open-source IoT development but many aspects are also applicable to closed-source projects.

[1]  Maximilian Ott,et al.  OMF: a control and management framework for networking testbeds , 2010, OPSR.

[2]  Walid Dabbous,et al.  NEPI: An integration framework for Network Experimentation , 2011, SoftCOM 2011, 19th International Conference on Software, Telecommunications and Computer Networks.

[3]  Adam Dunkels,et al.  Contiki - a lightweight and flexible operating system for tiny networked sensors , 2004, 29th Annual IEEE International Conference on Local Computer Networks.

[4]  Matthias Kovatsch,et al.  Industry adoption of the Internet of Things: A constrained application protocol survey , 2012, Proceedings of 2012 IEEE 17th International Conference on Emerging Technologies & Factory Automation (ETFA 2012).

[5]  F. Dressler,et al.  A GNU Radio-based IEEE 802.15.4 Testbed , 2013 .

[6]  Nathalie Mitton,et al.  A Survey on (mobile) Wireless Sensor Network Experimentation Testbeds , 2014, 2014 IEEE International Conference on Distributed Computing in Sensor Systems.

[7]  Carsten Bormann,et al.  Terminology for Constrained-Node Networks , 2014, RFC.

[8]  David E. Culler,et al.  TinyOS: An Operating System for Sensor Networks , 2005, Ambient Intelligence.

[9]  Pedro José Marrón,et al.  COOJA/MSPSim: interoperability testing for wireless sensor networks , 2009, SimuTools.

[10]  Thomas C. Schmidt,et al.  RIOT OS: Towards an OS for the Internet of Things , 2013, 2013 IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS).

[11]  William Bereza,et al.  Mocking the Embedded World: Test-Driven Development, Continuous Integration, and Design Patterns , 2007 .

[12]  Lothar Thiele,et al.  Increasing the reliability of wireless sensor networks with a distributed testing framework , 2007, EmNets '07.

[13]  Kamin Whitehouse,et al.  Unit testing for wireless sensor networks , 2010, SESENA '10.