A survey of simulators, emulators and testbeds for wireless sensor networks

Simulators, emulators and testbeds are invaluable tools for performance evaluation of algorithms and protocols in wireless sensor networks (WSNs). It is extremely difficult to choose an appropriate tool for performance testing without the horizontal and vertical analysis of existing tools. This paper presents a survey of thirty five performance evaluation tools for WSNs. Unlike most other studies, tools were selected based on their popularity, support for WSNs, active maintenance and the help available. On the horizontal dimension, prominent competitors at each stage were selected. For vertical analysis, tools for simulation, emulation and testbeds were categorized accordingly. We believe that this survey will aid researchers, application and tool developers while selecting an appropriate tool for their implementation. We have highlighted an open research issue to have an integrated tool that supports modeling, simulation, emulation and testbed implementation for algorithm validation, performance evaluation and proof-of-concept implementation in WSNs.

[1]  Jens Palsberg,et al.  Avrora: scalable sensor network simulation with precise timing , 2005, IPSN 2005. Fourth International Symposium on Information Processing in Sensor Networks, 2005..

[2]  Erik Welsh,et al.  GNOMES: a testbed for low power heterogeneous wireless sensor networks , 2003, Proceedings of the 2003 International Symposium on Circuits and Systems, 2003. ISCAS '03..

[3]  Per Gunningberg,et al.  A testbed and methodology for experimental evaluation of wireless mobile ad hoc networks , 2005, First International Conference on Testbeds and Research Infrastructures for the DEvelopment of NeTworks and COMmunities.

[4]  David E. Culler,et al.  The nesC language: A holistic approach to networked embedded systems , 2003, PLDI.

[5]  David E. Culler,et al.  TOSSIM: accurate and scalable simulation of entire TinyOS applications , 2003, SenSys '03.

[6]  Alejandro S. Martínez-Sala,et al.  Simulation Tools for Wireless Sensor Networks , 2005 .

[7]  Thomas Kunz,et al.  Simulation vs . Emulation : Evaluating Mobile Ad Hoc Network Routing Protocols , 2022 .

[8]  Gul A. Agha,et al.  SENS: a sensor, environment and network simulator , 2004, 37th Annual Simulation Symposium, 2004. Proceedings..

[9]  Manoj Kumar Tiwari,et al.  A Survey of Simulation in Sensor Networks , 2008, 2008 International Conference on Computational Intelligence for Modelling Control & Automation.

[10]  John S. Baras,et al.  ATEMU: a fine-grained sensor network simulator , 2004, 2004 First Annual IEEE Communications Society Conference on Sensor and Ad Hoc Communications and Networks, 2004. IEEE SECON 2004..

[11]  Per Gunningberg,et al.  A Testbed and Methodology for Experimental Evaluation of Mobile Ad hoc Networks , 2005 .

[12]  Matt Welsh,et al.  Simulating the power consumption of large-scale sensor network applications , 2004, SenSys '04.

[13]  Martin Mauve,et al.  A survey on real-world implementations of mobile ad-hoc networks , 2007, Ad Hoc Networks.

[14]  Peter G. Kropf,et al.  Freemote Emulator: A Lightweight and Visual Java Emulator for WSN , 2008, WWIC.

[15]  Sándor P. Fekete,et al.  Shawn: A new approach to simulating wireless sensor networks , 2005, ArXiv.

[16]  Manpreet Singh,et al.  Overview of the ORBIT radio grid testbed for evaluation of next-generation wireless network protocols , 2005, IEEE Wireless Communications and Networking Conference, 2005.

[17]  M. C. Vuran,et al.  – Draft – ( DO NOT DISTRIBUTE ) Wireless Sensor Networks : A Survey Revisited , 2005 .

[18]  Robert Ricci,et al.  Mobile Emulab: A Robotic Wireless and Sensor Network Testbed , 2006, Proceedings IEEE INFOCOM 2006. 25TH IEEE International Conference on Computer Communications.

[19]  B. Moulin,et al.  A Survey on Sensor Webs Simulation Tools , 2008, 2008 Second International Conference on Sensor Technologies and Applications (sensorcomm 2008).

[20]  Ian F. Akyildiz,et al.  Wireless underground sensor networks: Research challenges , 2006, Ad Hoc Networks.

[21]  Ralf Steinmetz,et al.  JiST/MobNet: combined simulation, emulation, and real-world testbed for ad hoc networks , 2007, WinTECH '07.

[22]  Johannes Lessmann,et al.  Comparative Study of Wireless Network Simulators , 2008, Seventh International Conference on Networking (icn 2008).

[23]  Deborah Estrin,et al.  EmStar: A Software Environment for Developing and Deploying Wireless Sensor Networks , 2004, USENIX ATC, General Track.

[24]  Mikko Sallinen,et al.  Survey of Wireless Sensor Networks Simulation Tools for Demanding Applications , 2009, 2009 Fifth International Conference on Networking and Services.

[25]  R. V. Renesse,et al.  JiST : Embedding Simulation Time into a Virtual Machine , 2003 .

[26]  Mani B. Srivastava,et al.  SensorSim: a simulation framework for sensor networks , 2000, MSWIM '00.

[27]  Thomas W. Carley.  Sidh: A Wireless Sensor Network Simulator , 2005 .

[28]  Stefan Valentin,et al.  Simulating wireless and mobile networks in OMNeT++ the MiXiM vision , 2008, SimuTools.