Quality of experience-based routing in multi-service wireless mesh networks

We develop an optimization framework for Quality of Experience (QoE)-based routing in multi-service Wireless Mesh Networks (WMNs). The framework takes into account the heterogeneous requirements of different services delivered over a WMN, such that the overall end-user QoE is maximized under given resource constraints. We propose a novel QoE-aware double reinforcement learning strategy for dynamically computing the most efficient routes to deliver the flows of each service type. Comprehensive NS-2-based simulations demonstrate the substantial performance gains that our approach enables over conventional routing techniques such as AODV, with significant improvement over video quality.

[1]  Susana Sargento,et al.  Distortion Optimized Multi-Service Scheduling for Next-Generation Wireless Mesh Networks , 2010, 2010 INFOCOM IEEE Conference on Computer Communications Workshops.

[2]  Luciano Bononi,et al.  Adaptive Sensing Scheduling and Spectrum Selection in Cognitive Wireless Mesh Networks , 2011, 2011 Proceedings of 20th International Conference on Computer Communications and Networks (ICCCN).

[3]  Peter Brooks,et al.  User measures of quality of experience: why being objective and quantitative is important , 2010, IEEE Network.

[4]  Mainak Chatterjee,et al.  Inferring video QoE in real time , 2011, IEEE Network.

[5]  Amy L. Murphy,et al.  Froms: A failure tolerant and mobility enabled multicast routing paradigm with reinforcement learning for WSNs , 2011, Ad Hoc Networks.

[6]  Jim Dowling,et al.  Using feedback in collaborative reinforcement learning to adaptively optimize MANET routing , 2005, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[7]  Ian F. Akyildiz,et al.  Wireless mesh networks: a survey , 2005, Comput. Networks.

[8]  Mario Gerla,et al.  TP-UrbanX - A new transport protocol for Cognitive Multi-Radio Mesh Networks , 2011, 2011 IEEE International Symposium on a World of Wireless, Mobile and Multimedia Networks.

[9]  Pin-Han Ho,et al.  ARBR: Adaptive reinforcement-based routing for DTN , 2010, 2010 IEEE 6th International Conference on Wireless and Mobile Computing, Networking and Communications.

[10]  Chris Watkins,et al.  Learning from delayed rewards , 1989 .

[11]  Marcelo G. Rubinstein,et al.  Routing Metrics and Protocols for Wireless Mesh Networks , 2008, IEEE Network.

[12]  R. Asokan.  A review of Quality of Service (QoS) routing protocols for mobile Ad hoc networks , 2010, 2010 International Conference on Wireless Communication and Sensor Computing (ICWCSC).

[13]  Frank H. P. Fitzek,et al.  Video Traces for Network Performance Evaluation , 2006 .

[14]  Charles E. Perkins,et al.  Ad hoc On-Demand Distance Vector (AODV) Routing , 2001, RFC.

[15]  Philippe Jacquet,et al.  Optimized Link State Routing Protocol (OLSR) , 2003, RFC.

[16]  Wolfgang Kellerer,et al.  Qoe-based rate adaptation scheme selection for resource-constrained wireless video transmission , 2010, ACM Multimedia.

[17]  Erol Gelenbe.  Energy-Aware Routing in the Cognitive Packet Network , 2011 .

[18]  Yang Yang,et al.  Reinforcement learning based spectrum-aware routing in multi-hop cognitive radio networks , 2009, 2009 4th International Conference on Cognitive Radio Oriented Wireless Networks and Communications.

[19]  Alex M. Andrew,et al.  ROBOT LEARNING, edited by Jonathan H. Connell and Sridhar Mahadevan, Kluwer, Boston, 1993/1997, xii+240 pp., ISBN 0-7923-9365-1 (Hardback, 218.00 Guilders, $120.00, £89.95). , 1999, Robotica (Cambridge. Print).

[20]  Amitangshu Pal,et al.  GSQAR: A Quality Aware Anycast Routing Protocol for Wireless Mesh Networks , 2010, 2010 IEEE Global Telecommunications Conference GLOBECOM 2010.