Adaptive Learning Based Scheduling in Multichannel Protocol for Energy-Efficient Data-Gathering Wireless Sensor Networks

Multichannel communication protocols have been developed to alleviate the effects of interference and consequently improve the network performance in wireless sensor networks requiring high bandwidth. In this paper, we propose a contention-free multichannel protocol to maximize network throughput while ensuring energy-efficient operation. Arguing that routing decisions influence to a large extent the network throughput, we formulate route selection and transmission scheduling as a joint problem and propose a Reinforcement Learning based scheduling algorithm to solve it in a distributed manner. The results of extensive simulation experiments show that the proposed solution not only provides a collision-free transmission schedule but also minimizes energy waste, which makes it appropriate for energy-constrained wireless sensor networks.

[1]  Tzi-cker Chiueh,et al.  Architecture and algorithms for an IEEE 802.11-based multi-channel wireless mesh network , 2005, Proceedings IEEE 24th Annual Joint Conference of the IEEE Computer and Communications Societies..

[2]  Raghupathy Sivakumar,et al.  Component based channel assignment in single radio, multi-channel ad hoc networks , 2006, MobiCom '06.

[3]  Mingyan Liu,et al.  Data-gathering wireless sensor networks: organization and capacity , 2003, Comput. Networks.

[4]  Chih-Yung Chang,et al.  An efficient cluster-based multi-channel management protocol for wireless Ad Hoc networks , 2007, Comput. Commun..

[5]  Antonis Kalis,et al.  HYMAC: Hybrid TDMA/FDMA Medium Access Control Protocol for Wireless Sensor Networks , 2007, 2007 IEEE 18th International Symposium on Personal, Indoor and Mobile Radio Communications.

[6]  Saurabh Ganeriwal,et al.  Timing-sync protocol for sensor networks , 2003, SenSys '03.

[7]  Ian F. Akyildiz,et al.  Wireless Multimedia Sensor Networks: Applications and Testbeds , 2008, Proceedings of the IEEE.

[8]  Nitin H. Vaidya,et al.  Multi-channel mac for ad hoc networks: handling multi-channel hidden terminals using a single transceiver , 2004, MobiHoc '04.

[9]  Min Sheng,et al.  Performance evaluation of modified IEEE 802.11 MAC for multi-channel multi-hop ad hoc network , 2003, 17th International Conference on Advanced Information Networking and Applications, 2003. AINA 2003..

[10]  Amy L. Murphy,et al.  Froms: A failure tolerant and mobility enabled multicast routing paradigm with reinforcement learning for WSNs , 2011, Ad Hoc Networks.

[11]  Özlem Durmaz Incel A survey on multi-channel communication in wireless sensor networks , 2011, Comput. Networks.

[12]  Tian He,et al.  Realistic and Efficient Multi-Channel Communications in Wireless Sensor Networks , 2008, IEEE INFOCOM 2008 - The 27th Conference on Computer Communications.

[13]  David Elkind,et al.  Learning: An Introduction , 1968 .

[14]  Ingrid Moerman,et al.  Network-wide synchronization in Wireless Sensor Networks , 2012, 2012 19th IEEE Symposium on Communications and Vehicular Technology in the Benelux (SCVT).

[15]  Jean C. Walrand,et al.  McMAC: A Parallel Rendezvous Multi-Channel MAC Protocol , 2007, 2007 IEEE Wireless Communications and Networking Conference.

[16]  Ann Nowé,et al.  Decentralised reinforcement learning for energy-efficient scheduling in wireless sensor networks , 2012, Int. J. Commun. Networks Distributed Syst..

[17]  Yik-Chung Wu,et al.  Clock Synchronization in Wireless Sensor Networks: An Overview , 2009, Sensors.

[18]  P. Bahl,et al.  SSCH: slotted seeded channel hopping for capacity improvement in IEEE 802.11 ad-hoc wireless networks , 2004, MobiCom '04.

[19]  Jiming Chen,et al.  Multi-Channel Assignment in Wireless Sensor Networks: A Game Theoretic Approach , 2010, 2010 Proceedings IEEE INFOCOM.

[20]  Paul J. M. Havinga,et al.  MC-LMAC: A multi-channel MAC protocol for wireless sensor networks , 2011, Ad Hoc Networks.

[21]  M. Posch,et al.  Win-stay, lose-shift strategies for repeated games-memory length, aspiration levels and noise. , 1999, Journal of theoretical biology.

[22]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.