On the accuracy of omnet++ in the wireless sensornetworks domain: simulation vs. testbed

In this paper we present a first effort in assessing the reliability of OMNeT++ and the MAC Simulator framework insimulating Wireless Sensor Networks. A collection of metricson the flooding algorithm running on a simple testbed made of few Tmote Sky is used as reference to evaluate the qualityof the simulation results. Our experiments show that simulation results tend to over-estimate the metrics collected inthe testbed. A correcting factor derived from experimental evidences must be considered in order to improve the simulation results. At the best of our knowledge, this is thefirst result about the accuracy of OMNet++ in the wireless sensor network domain.

[1]  André Schiper,et al.  On the accuracy of MANET simulators , 2002, POMC '02.

[2]  Deborah Estrin,et al.  Towards a debugging system for sensor networks , 2005, Int. J. Netw. Manag..

[3]  Matt Welsh,et al.  MoteLab: a wireless sensor network testbed , 2005, IPSN '05.

[4]  Koen Langendoen,et al.  Comparing Energy-Saving MAC Protocols for Wireless Sensor Networks , 2005, Mob. Networks Appl..

[5]  Manoj Kumar Tiwari,et al.  A Survey of Simulation in Sensor Networks , 2008, 2008 International Conference on Computational Intelligence for Modelling Control & Automation.

[6]  David E. Culler,et al.  Versatile low power media access for wireless sensor networks , 2004, SenSys '04.

[7]  Cem Ersoy,et al.  MAC protocols for wireless sensor networks: a survey , 2006, IEEE Communications Magazine.

[8]  S. Iyengar,et al.  Simulating Wireless Sensor Networks with OMNeT + + , 2005 .

[9]  Krishna M. Sivalingam,et al.  A survey of MAC protocols for sensor networks , 2004 .

[10]  V. Kulathumani,et al.  Kansei: a testbed for sensing at scale , 2006, 2006 5th International Conference on Information Processing in Sensor Networks.

[11]  S. Wang,et al.  Simulation of Wireless Sensor Networks Localization with OMNeT , 2005, 2005 2nd Asia Pacific Conference on Mobile Technology, Applications and Systems.

[12]  Koen Langendoen,et al.  Distributed localization in wireless sensor networks: a quantitative compariso , 2003, Comput. Networks.

[13]  David E. Culler,et al.  A unifying link abstraction for wireless sensor networks , 2005, SenSys '05.

[14]  Ian F. Akyildiz,et al.  Sensor Networks , 2002, Encyclopedia of GIS.

[15]  A. Varga,et al.  THE OMNET++ DISCRETE EVENT SIMULATION SYSTEM , 2003 .

[16]  Jason Liu,et al.  Experimental evaluation of wireless simulation assumptions , 2004, MSWiM '04.