Experimental evaluation of wireless simulation assumptions

All analytical and simulation research on ad~hoc wireless networks must necessarily model radio propagation using simplifying assumptions. We provide a comprehensive review of six assumptions that are still part of many ad hoc network simulation studies, despite increasing awareness of the need to represent more realistic features, including hills, obstacles, link asymmetries, and unpredictable fading. We use an extensive set of measurements from a large outdoor routing experiment to demonstrate the weakness of these assumptions, and show how these assumptions cause simulation results to differ significantly from experimental results. We close with a series of recommendations for researchers, whether they develop protocols, analytic models, or simulators for ad~hoc wireless networks.

[1]  Dennis Bodson,et al.  Land-mobile communications engineering , 1984 .

[2]  Vinny Cahill,et al.  Understanding link quality in 802.11 mobile ad hoc networks , 2004, IEEE Internet Computing.

[3]  Timothy D. Andersen,et al.  A simple and effective cross layer networking system for mobile ad hoc networks , 2002, The 13th IEEE International Symposium on Personal, Indoor and Mobile Radio Communications.

[4]  Gang Zhou,et al.  Impact of radio irregularity on wireless sensor networks , 2004, MobiSys '04.

[5]  Bob Gray.  Soldiers, Agents and Wireless Networks: A Report on a Military Application , 2000 .

[6]  Mario Gerla,et al.  Efficient Wireless Network Simulations with Detailed Propagation Models , 2001, Wirel. Networks.

[7]  Andrea Goldsmith,et al.  Wireless Communications , 2005, 2021 15th International Conference on Advanced Technologies, Systems and Services in Telecommunications (TELSIKS).

[8]  Christian F. Tschudin,et al.  A large-scale testbed for reproducible ad hoc protocol evaluations , 2002, 2002 IEEE Wireless Communications and Networking Conference Record. WCNC 2002 (Cat. No.02TH8609).

[9]  David A. Maltz,et al.  Quantitative lessons from a full-scale multi-hop wireless ad hoc network testbed , 2000, 2000 IEEE Wireless Communications and Networking Conference. Conference Record (Cat. No.00TH8540).

[10]  H. T. Kung,et al.  Dynamic Neighbor Discovery and Loop-Free, Multi-Hop Routing for Wireless, Mobile Networks , 1998 .

[11]  Jennifer Widom,et al.  Efficient and flexible location management techniques for wireless communication systems , 1996, MobiCom '96.

[12]  Robert Morris,et al.  Link-level measurements from an 802.11b mesh network , 2004, SIGCOMM 2004.

[13]  Eyal de Lara,et al.  Simplified simulation models for indoor MANET evaluation are not robust , 2004, 2004 First Annual IEEE Communications Society Conference on Sensor and Ad Hoc Communications and Networks, 2004. IEEE SECON 2004..

[14]  David M. Nicol,et al.  Simulation validation using direct execution of wireless ad-hoc routing protocols , 2004, 18th Workshop on Parallel and Distributed Simulation, 2004. PADS 2004..

[15]  Mineo Takai,et al.  Effects of wireless physical layer modeling in mobile ad hoc networks , 2001, MobiHoc '01.

[16]  Tracy Camp,et al.  MANET Simulation Studies : The Current State and New Simulation Tools , 2005 .

[17]  Mark D. Yarvis,et al.  Real-world experiences with an interactive ad hoc sensor network , 2002, Proceedings. International Conference on Parallel Processing Workshop.

[18]  Ramesh Govindan,et al.  Understanding packet delivery performance in dense wireless sensor networks , 2003, SenSys '03.

[19]  Charles E. Perkins,et al.  Ad-hoc on-demand distance vector routing , 1999, Proceedings WMCSA'99. Second IEEE Workshop on Mobile Computing Systems and Applications.

[20]  Calvin Newport,et al.  The mistaken axioms of wireless-network research , 2003 .

[21]  Parameswaran Ramanathan,et al.  Adaptive allocation of CDMA resources for network-level QoS assurances , 2000, MobiCom '00.

[22]  Roy D. Yates,et al.  Scalable parallel simulations of wireless networks with WiPPET: Modeling of radio propagation, mobility and protocols , 2000, Mob. Networks Appl..

[23]  Ainslie,et al.  CORRELATION MODEL FOR SHADOW FADING IN MOBILE RADIO SYSTEMS , 2004 .

[24]  Sung-Ju Lee,et al.  Unicast performance analysis of the ODMRP in a mobile ad hoc network testbed , 2000, Proceedings Ninth International Conference on Computer Communications and Networks (Cat.No.00EX440).

[25]  Deborah Estrin,et al.  Effects of Detail in Wireless Network Simulation , 2001 .

[26]  Peter Steenkiste,et al.  Repeatable and realistic wireless experimentation through physical emulation , 2004, Comput. Commun. Rev..

[27]  William C. Y. Lee,et al.  Mobile Communications Engineering , 1982 .

[28]  Krzysztof Pawlikowski,et al.  On credibility of simulation studies of telecommunication networks , 2002, IEEE Commun. Mag..

[29]  Jason Liu,et al.  Outdoor experimental comparison of four ad hoc routing algorithms , 2004, MSWiM '04.

[30]  David E. Culler,et al.  Taming the underlying challenges of reliable multihop routing in sensor networks , 2003, SenSys '03.

[31]  Deborah Estrin,et al.  Complex Behavior at Scale: An Experimental Study of Low-Power Wireless Sensor Networks , 2002 .

[32]  Kwan-Wu Chin,et al.  Implementation experience with MANET routing protocols , 2002, CCRV.

[33]  Mahesh K. Marina,et al.  Routing performance in the presence of unidirectional links in multihop wireless networks , 2002, MobiHoc '02.

[34]  Bartosz Mielczarek,et al.  Scenario-based performance analysis of routing protocols for mobile ad-hoc networks , 1999, MobiCom.

[35]  Christian F. Tschudin,et al.  Coping with communication gray zones in IEEE 802.11b based ad hoc networks , 2002, WOWMOM '02.

[36]  David Lundberg.  Ad hoc Protocol Evaluation and Experiences of Real World Ad Hoc Networking , 2002 .

[37]  Theodore S. Rappaport,et al.  Wireless communications - principles and practice , 1996 .

[38]  Piyush Gupta,et al.  A system and traffic dependent adaptive routing algorithm for ad hoc networks , 1997, Proceedings of the 36th IEEE Conference on Decision and Control.