A reinforcement learning based routing protocol with QoS support for biomedical sensor networks

Biomedical sensor networks have been widely used in medical applications, where data packets usually contain vital sign information and the network used for communications should guarantee that these packets can be delivered to the medical center reliably and efficiently. In other words, a set of requirements for quality of services (QoS) must be satisfied. In this paper, RL-QRP, a reinforcement learning based routing protocol with QoS-support is proposed for biomedical sensor networks. In RL-QRP, optimal routing policies can be found through experiences and rewards without the need of maintaining precise network state information. Simulation results show that RL-QRP performs well in terms of a number of QoS metrics and energy efficiency in various medical scenarios. By investigating the impacts of network traffic load and sensor node mobility on the network performance, RL-QRP has been proved to fit well in dynamic environments.

[1]  Robert Simon,et al.  A bandwidth-reservation mechanism for on-demand ad hoc path finding , 2002, Proceedings 35th Annual Simulation Symposium. SS 2002.

[2]  Andrew W. Moore,et al.  Reinforcement Learning: A Survey , 1996, J. Artif. Intell. Res..

[3]  A. Varga,et al.  THE OMNET++ DISCRETE EVENT SIMULATION SYSTEM , 2003 .

[4]  A. Mellouk,et al.  Optimal QoS and adaptatiw routing in Wireless Sensor Networks , 2006, 2006 2nd International Conference on Information & Communication Technologies.

[5]  Andrew T. Campbell,et al.  INSIGNIA: An IP-Based Quality of Service Framework for Mobile ad Hoc Networks , 2000, J. Parallel Distributed Comput..

[6]  Ting Wang,et al.  Adaptive Routing for Sensor Networks using Reinforcement Learning , 2006, The Sixth IEEE International Conference on Computer and Information Technology (CIT'06).

[7]  A. Varga,et al.  Using the OMNeT++ discrete event simulation system in education , 1999 .

[8]  Xuedong Liang,et al.  A QoS-aware Routing Service Framework for Biomedical Sensor Networks , 2007, 2007 4th International Symposium on Wireless Communication Systems.

[9]  Vaduvur Bharghavan,et al.  CEDAR: a core-extraction distributed ad hoc routing algorithm , 1999, IEEE INFOCOM '99. Conference on Computer Communications. Proceedings. Eighteenth Annual Joint Conference of the IEEE Computer and Communications Societies. The Future is Now (Cat. No.99CH36320).

[10]  Pramod K. Varshney,et al.  QoS Support in Wireless Sensor Networks: A Survey , 2004, International Conference on Wireless Networks.

[11]  Athanassios Boulis,et al.  From Simulation to Real Deployments in WSN and Back , 2007, 2007 IEEE International Symposium on a World of Wireless, Mobile and Multimedia Networks.

[12]  JAMAL N. AL-KARAKI,et al.  Routing techniques in wireless sensor networks: a survey , 2004, IEEE Wireless Communications.