An adaptive delay-based power control and routing scheme

In this paper, We propose a Q-learning-based routing scheme embedded with a power-control method to minimize the overall network delay performance. Various problems of applying reinforcement learning method in Mobile Ad hoc Networks (MANETs), such as optimization, the routing-loop problem and the convergence problem, are all addressed accordingly. A power-control scheme which makes use of the on-demand routing information to form an objective function are introduced in order to find an optimal power level that provides a suitable trade-off between transmission range and interference. The impact between power control and routing are also discussed in this paper. Simulations show that our method can achieve better performance under different load and mobility conditions.

[1]  Ghufran Ahmed,et al.  A dynamic transmission power control routing protocol to avoid network partitioning in wireless sensor networks , 2011, 2011 International Conference on Information and Communication Technologies.

[2]  Natarajan Meghanathan.  On-Demand Maximum Battery Life Routing with Power Sensitive Power Control in Ad Hoc Networks , 2006, International Conference on Networking, International Conference on Systems and International Conference on Mobile Communications and Learning Technologies (ICNICONSMCL'06).

[3]  P. R. Kumar,et al.  Power Control in Ad-Hoc Networks: Theory, Architecture, Algorithm and Implementation of the COMPOW Protocol , 2002 .

[4]  Celimuge Wu,et al.  A MANET protocol considering link stability and bandwidth efficiency , 2009, 2009 International Conference on Ultra Modern Telecommunications & Workshops.

[5]  Alamelu Nachiappan,et al.  Q-learning based adaptive QoS routing protocol for MANETs , 2011, 2011 International Conference on Recent Trends in Information Technology (ICRTIT).

[6]  A. Girotra,et al.  Performance Analysis of the IEEE 802 . 11 Distributed Coordination Function , 2005 .

[7]  Eitan Altman,et al.  New Insights From a Fixed-Point Analysis of Single Cell IEEE 802.11 WLANs , 2007, IEEE/ACM Transactions on Networking.

[8]  Leslie Pack Kaelbling,et al.  Mobilized ad-hoc networks: a reinforcement learning approach , 2004 .

[9]  Chen-Khong Tham,et al.  Reinforcement learning and CMAC-based adaptive routing for MANETs , 2004, Proceedings. 2004 12th IEEE International Conference on Networks (ICON 2004) (IEEE Cat. No.04EX955).

[10]  Zubair Khalid,et al.  GRAdient Cost Establishment (GRACE) for an Energy-Aware Routing in Wireless Sensor Networks , 2009, EURASIP J. Wirel. Commun. Netw..

[11]  Chai-Keong Toh.  Maximum battery life routing to support ubiquitous mobile computing in wireless ad hoc networks , 2001 .

[12]  Ivan Stojmenovic,et al.  Ad hoc Networking , 2004 .

[13]  Jan M. Rabaey,et al.  Distributed algorithms for transmission power control in wireless sensor networks , 2003, 2003 IEEE Wireless Communications and Networking, 2003. WCNC 2003..

[14]  Charles E. Perkins,et al.  Ad-hoc on-demand distance vector routing , 1999, Proceedings WMCSA'99. Second IEEE Workshop on Mobile Computing Systems and Applications.

[15]  Qinglin Zhao,et al.  A simple model for nonsaturated IEEE 802.11 DCF networks , 2008, IEEE Communications Letters.

[16]  Hiromi Okada,et al.  Power control routing for multi hop wireless ad-hoc network , 2001, GLOBECOM'01. IEEE Global Telecommunications Conference (Cat. No.01CH37270).

[17]  Theodore Antonakopoulos,et al.  CSMA/CA performance under high traffic conditions: throughput and delay analysis , 2002, Comput. Commun..

[18]  Hongqiang Zhai,et al.  Performance analysis of IEEE 802.11 MAC protocols in wireless LANs , 2004, Wirel. Commun. Mob. Comput..

[19]  Andrew W. Moore,et al.  Reinforcement Learning: A Survey , 1996, J. Artif. Intell. Res..