A Survey on Testbeds and Experimentation Environments for Wireless Sensor Networks

Research results in wireless sensor networks are primarily gained from simulations and theoretical considerations. Currently, the community begins to realize that the results need to be validated in testbeds. Testbeds can be also used to directly gather knowledge with sensor network experiments on real hardware and a real environmental context. This survey gives an overview of different approaches to build testbeds and experimentation environments regarding different research foci. We discuss emerging testbed requirements and present existing solutions of the community. The overview is complemented with a discussion of common design decisions concerning architectures and experimentation support in current testbeds. A look on future trends and developments in wireless sensor network testbeds concludes this paper. This survey is intended to help researchers to attain own results in real-world experiments with wireless sensor networks. The reader gains a comprehensive overview on existing testbeds and practical knowledge documented in the referenced literature. The survey is laying the foundation for design decisions while developing an own testbed using the examples of described approaches.

[1]  Frank Stajano,et al.  The Grenade Timer: Fortifying the Watchdog Timer Against Malicious Mobile Code , 2000 .

[2]  David E. Culler,et al.  TOSSIM: accurate and scalable simulation of entire TinyOS applications , 2003, SenSys '03.

[3]  Jan Beutel,et al.  Poster abstract: BTnodes -- a distributed platform for sensor nodes , 2003, SenSys '03.

[4]  Deborah Estrin,et al.  EmStar: An Environment for Developing Wireless Embedded Systems Software , 2003 .

[5]  Erik Welsh,et al.  GNOMES: a testbed for low power heterogeneous wireless sensor networks , 2003, Proceedings of the 2003 International Symposium on Circuits and Systems, 2003. ISCAS '03..

[6]  Matt Welsh,et al.  Simulating the power consumption of large-scale sensor network applications , 2004, SenSys '04.

[7]  D. Timmermann,et al.  SeNeTs - test and validation environment for applications in large-scale wireless sensor networks , 2004, 2nd IEEE International Conference on Industrial Informatics, 2004. INDIN '04. 2004.

[8]  Andreas Willig,et al.  A Scalable and Reconfigurable Wireless Sensor Network Testbed for Indoor Deployments , 2005 .

[9]  Chen Zhang,et al.  ExScal: elements of an extreme scale wireless sensor network , 2005, 11th IEEE International Conference on Embedded and Real-Time Computing Systems and Applications (RTCSA'05).

[10]  E. Jovanov,et al.  An environment for runtime power monitoring of wireless sensor network platforms , 2005, Proceedings of the Thirty-Seventh Southeastern Symposium on System Theory, 2005. SSST '05..

[11]  David E. Culler,et al.  Design of an application-cooperative management system for wireless sensor networks , 2005, Proceeedings of the Second European Workshop on Wireless Sensor Networks, 2005..

[12]  Vlado Handziski,et al.  A Wireless Sensor Network Testbed Supporting Controlled In-building Experiments * , 2005 .

[13]  Matt Welsh,et al.  MoteLab: a wireless sensor network testbed , 2005, IPSN '05.

[14]  Thomas Schmid,et al.  SensorScope: Experiences with a Wireless Building Monitoring Sensor Network , 2005 .

[15]  Mark A. Minor,et al.  Emulab's wireless sensor net testbed: true mobility, location precision, and remote access , 2005, SenSys '05.

[16]  Pradipta De,et al.  MiNT: a miniaturized network testbed for mobile wireless research , 2005, Proceedings IEEE 24th Annual Joint Conference of the IEEE Computer and Communications Societies..

[17]  Manpreet Singh,et al.  ORBIT testbed software architecture: supporting experiments as a service , 2005, First International Conference on Testbeds and Research Infrastructures for the DEvelopment of NeTworks and COMmunities.

[18]  Manpreet Singh,et al.  Overview of the ORBIT radio grid testbed for evaluation of next-generation wireless network protocols , 2005, IEEE Wireless Communications and Networking Conference, 2005.

[19]  Robert Tappan Morris,et al.  Architecture and evaluation of an unplanned 802.11b mesh network , 2005, MobiCom '05.

[20]  Chaki Ng,et al.  Mirage: a microeconomic resource allocation system for sensornet testbeds , 2005, The Second IEEE Workshop on Embedded Networked Sensors, 2005. EmNetS-II..

[21]  Alessandro Leonardi,et al.  S-WiNeTest: Remote Access To A Sensor Testbed , 2006 .

[22]  Emre Ertin,et al.  Kansei: a high-fidelity sensing testbed , 2006, IEEE Internet Computing.

[23]  Robert Ricci,et al.  Mobile Emulab: A Robotic Wireless and Sensor Network Testbed , 2006, Proceedings IEEE INFOCOM 2006. 25TH IEEE International Conference on Computer Communications.

[24]  Andrea Zanella,et al.  SignetLab: deployable sensor network testbed and management tool , 2006, SenSys '06.

[25]  Alexander Zimmermann,et al.  Architecture of the hybrid MCG-mesh testbed , 2006, WINTECH.

[26]  N.D. Georganas,et al.  Test-Bed for Sensor Network Management Protocols , 2006, 23rd Biennial Symposium on Communications, 2006.

[27]  Pradipta De,et al.  MiNT-m: an autonomous mobile wireless experimentation platform , 2006, MobiSys '06.

[28]  Emre Ertin,et al.  Kansei: a testbed for sensing at scale , 2006, 2006 5th International Conference on Information Processing in Sensor Networks.

[29]  S. Kim,et al.  Trio: enabling sustainable and scalable outdoor wireless sensor network deployments , 2006, 2006 5th International Conference on Information Processing in Sensor Networks.

[30]  Lothar Thiele,et al.  Deployment support network a toolkit for the development of WSNs , 2007 .

[31]  Alexander Zimmermann,et al.  How to Study Wireless Mesh Networks: A hybrid Testbed Approach , 2007, 21st International Conference on Advanced Information Networking and Applications (AINA '07).

[32]  Tassos Dimitriou,et al.  Sensenet: a wireless sensor network testbed , 2007, MSWiM '07.

[33]  Matt Welsh,et al.  CitySense: A Vision for an Urban-Scale Wireless Networking Testbed , 2007 .

[34]  Richard Han,et al.  SWARMS: A Sensornet Wide Area Remote Management System , 2007, 2007 3rd International Conference on Testbeds and Research Infrastructure for the Development of Networks and Communities.

[35]  David E. Culler,et al.  Micro Power Meter for Energy Monitoring of Wireless Sensor Networks at Scale , 2007, 2007 6th International Symposium on Information Processing in Sensor Networks.

[36]  Chad Stephen Metcalf.  TOSSIM LIVE : TOWARDS A TESTBED IN A THREAD , 2007 .

[37]  Andrea Zanella,et al.  The Design, Deployment, and Analysis of SignetLab: A Sensor Network Testbed and Interactive Management Tool , 2006, 2007 3rd International Conference on Testbeds and Research Infrastructure for the Development of Networks and Communities.

[38]  Divya Sakamuri.  NetEye: A wireless sensor network testbed , 2008 .

[39]  Thomas Staub,et al.  MARWIS: A Management Architecture for Heterogeneous Wireless Sensor Networks , 2008, WWIC.

[40]  Dirk Pesch,et al.  AvroraZ: extending Avrora with an IEEE 802.15.4 compliant radio chip model , 2008, PM2HW2N '08.

[41]  Felix Juraschek,et al.  Concept and design of the hybrid distributed embedded systems testbed , 2008 .

[42]  K. Langendoen,et al.  PowerBench: A Scalable Testbed Infrastructure for Benchmarking Power Consumption , 2008 .

[43]  Ian F. Akyildiz,et al.  Wireless Multimedia Sensor Networks: Applications and Testbeds , 2008, Proceedings of the IEEE.

[44]  Rudolf Hornig,et al.  An overview of the OMNeT++ simulation environment , 2008, Simutools 2008.

[45]  M. Vetterli,et al.  Wireless Sensor Networks for Environmental Monitoring: The SensorScope Experience , 2008, 2008 IEEE International Zurich Seminar on Communications.

[46]  Enrico Perla,et al.  PowerTOSSIM z: realistic energy modelling for wireless sensor network environments , 2008, PM2HW2N '08.

[47]  Konrad Iwanicki.  KonTest : A Wireless Sensor Network Testbed at Vrije Universiteit Amsterdam , 2008 .

[48]  Philip Levis,et al.  Usenix Association 8th Usenix Symposium on Operating Systems Design and Implementation 323 Quanto: Tracking Energy in Networked Embedded Systems , 2022 .

[49]  Joseph A. Paradiso,et al.  Energy Metering for Free: Augmenting Switching Regulators for Real-Time Monitoring , 2008, 2008 International Conference on Information Processing in Sensor Networks (ipsn 2008).

[50]  Yan Huang,et al.  Toward a Real and Remote Wireless Sensor Network Testbed , 2008, WASA.

[51]  Adam Wolisz,et al.  Measuring the Node Energy Consumption in USB Based WSN Testbeds , 2008, 2008 The 28th International Conference on Distributed Computing Systems Workshops.

[52]  Jang-Ping Sheu,et al.  WSNTB: A testbed for heterogeneous wireless sensor networks , 2008, 2008 First IEEE International Conference on Ubi-Media Computing.

[53]  Nagesh Polu,et al.  WINTeR: Architecture and Applications of a Wireless Industrial Sensor Network Testbed for Radio-Harsh Environments , 2008, 6th Annual Communication Networks and Services Research Conference (cnsr 2008).

[54]  Martina Zitterbart,et al.  Distributed energy measurements in wireless sensor networks , 2009, SenSys '09.

[55]  Sang Gi Hong,et al.  Wireless Sensor Network Testbed for Real-Time Sensor Monitoring , 2009, 2009 Third International Conference on Sensor Technologies and Applications.

[56]  J. He.  Design and Implementation of a Wireless Sensor Network Testbed , 2009 .

[57]  Olof Rensfelt,et al.  Sensei — a flexible testbed for heterogeneous wireless sensor networks , 2009, 2009 5th International Conference on Testbeds and Research Infrastructures for the Development of Networks & Communities and Workshops.

[58]  C. Renner,et al.  A Roadmap for Hardware and Software Support for Developing Energy-Efficient Sensor Networks , 2009 .

[59]  Jochen H. Schiller,et al.  A Testbed for Next Generation Wireless Network Research , 2009, PIK Prax. Informationsverarbeitung Kommun..

[60]  Olof Rensfelt,et al.  Sensei-UU : A Nomadic Sensor Network Testbed Supporting Mobile Nodes , 2009 .

[61]  Thomas Staub,et al.  A Secure Remote Authentication, Operation and Management Infrastructure for Distributed Wireless Sensor Network Testbeds , 2009 .

[62]  Ioannis Chatzigiannakis,et al.  WISEBED: An Open Large-Scale Wireless Sensor Network Testbed , 2009, SENSAPPEAL.

[63]  Naoki Wakamiya,et al.  X-Sensor: A Sensor Network Testbed Integrating Multiple Networks , 2009, 2009 International Conference on Complex, Intelligent and Software Intensive Systems.

[64]  Joachim Wilke,et al.  SANDbed: A WSAN Testbed for Network Management and Energy Monitoring , 2009 .

[65]  Andreas Achtzehn,et al.  MoteMaster: A Scalable Sensor Network Testbed for Rapid Protocol Performance Evaluation , 2009, 2009 6th IEEE Annual Communications Society Conference on Sensor, Mesh and Ad Hoc Communications and Networks Workshops.

[66]  Morten Tranberg Hansen,et al.  Energy Bucket: A Tool for Power Profiling and Debugging of Sensor Nodes , 2009, 2009 Third International Conference on Sensor Technologies and Applications.

[67]  Ingrid Moerman,et al.  Demo abstract: WiLab, a real-life wireless sensor testbed with environment emulation , 2009 .

[68]  David Simplot-Ryl,et al.  Large scale geolocalization and routing experimentation with the SensLAB testbed , 2010, The 7th IEEE International Conference on Mobile Ad-hoc and Sensor Systems (IEEE MASS 2010).

[69]  MOTEL : Towards Flexible Mobile Wireless Sensor Network Testbeds , 2010 .

[70]  Li Dong,et al.  EasiTest: A Multi-Radio Testbed for Heterogeneous Wireless Sensor Networks , 2012 .

[71]  Joachim Wilke,et al.  Distributed Energy Measurements in WSN Testbeds with a Sensor Node Management Device (SNMD) , 2011, ARCS Workshops.

[72]  Yang Xiao,et al.  Handbook on Sensor Networks , 2010 .

[73]  Tho Le-Ngoc,et al.  A Wireless Sensor Network Testbed , 2010, 2010 8th Annual Communication Networks and Services Research Conference.

[74]  Hongwei Zhang,et al.  From Kansei to KanseiGenie: Architecture of Federated, Programmable Wireless Sensor Fabrics , 2010, TRIDENTCOM.

[75]  Ioannis Chatzigiannakis,et al.  Wiselib: A Generic Algorithm Library for Heterogeneous Sensor Networks , 2010, EWSN.

[76]  Hongwei Zhang,et al.  Elements of sensornet testbed design , 2010 .

[77]  Olof Rensfelt,et al.  Sensei-uu: a relocatable sensor network testbed , 2010, WiNTECH '10.

[78]  Limin Sun,et al.  AHigh-Accuracy Nonintrusive Networking Testbed for Wireless Sensor Networks , 2010 .

[79]  Tracy Camp,et al.  TestbedProfiler: A validation tool for wireless sensor network testbed deployment , 2010, IEEE Local Computer Network Conference.

[80]  Markus Anwander,et al.  A Testbed Management Architecture for Wireless Sensor Network Testbeds (TARWIS) , 2010 .

[81]  Qiang Liu,et al.  A versatile heterogeneous sensor networks testbed , 2010, SenSys '10.

[82]  Muhammad Imran,et al.  A survey of simulators, emulators and testbeds for wireless sensor networks , 2010, 2010 International Symposium on Information Technology.

[83]  Martin Reisslein,et al.  Towards Efficient Wireless Video Sensor Networks: A Survey of Existing Node Architectures and Proposal for A Flexi-WVSNP Design , 2011, IEEE Communications Surveys & Tutorials.

[84]  O. P. Vyas,et al.  An Exploratory Study of Experimental Tools for Wireless Sensor Networks , 2011, Wirel. Sens. Netw..

[85]  Alexander Gluhak,et al.  A survey on facilities for experimental internet of things research , 2011, IEEE Communications Magazine.

[86]  Thomas Kunz,et al.  Wireless Multimedia Sensor Networks Testbeds and State-of-the-Art Hardware: A Survey , 2011, FGIT-FGCN.

[87]  Oliver P. Waldhorst,et al.  Energy-aware resource sharing with mobile devices , 2011, 2011 Eighth International Conference on Wireless On-Demand Network Systems and Services.

[88]  Anton Hergenröder,et al.  Facing challenges in evaluation of WSN energy efficiency with distributed energy measurements , 2011, 2011 7th International Wireless Communications and Mobile Computing Conference.

[89]  G.P. Hancke,et al.  A survey of Wireless Sensor Network testbeds , 2011, IEEE Africon '11.

[90]  Mun Choon Chan,et al.  Indriya: A Low-Cost, 3D Wireless Sensor Network Testbed , 2011, TRIDENTCOM.

[91]  Thomas Staub,et al.  TARWIS — A testbed management architecture for wireless sensor network testbeds , 2012, 2012 IEEE Network Operations and Management Symposium.

[92]  Christian Haas,et al.  Realistic Simulation of Energy Consumption in Wireless Sensor Networks , 2012, EWSN.

[93]  Anton Hergenröder,et al.  On energy measurement methods in wireless networks , 2012, 2012 IEEE International Conference on Communications (ICC).

[94]  Federico Ferrari,et al.  FlockLab: A testbed for distributed, synchronized tracing and profiling of wireless embedded systems , 2013, 2013 ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN).

[95]  A Framework for the Management of Large-Scale Wireless Network Testbeds , 2022 .