Energy-Efficient Monitoring in Software Defined Wireless Sensor Networks Using Reinforcement Learning: A Prototype

Software defined wireless networks (SDWNs) present an innovative framework for virtualized network control and flexible architecture design of wireless sensor networks (WSNs). However, the decoupled control and data planes and the logically centralized control in SDWNs may cause high energy consumption and resource waste during system operation, hindering their application in WSNs. In this paper, we propose a software defined WSN (SDWSN) prototype to improve the energy efficiency and adaptability of WSNs for environmental monitoring applications, taking into account the constraints of WSNs in terms of energy, radio resources, and computational capabilities, and the value redundancy and distributed nature of data flows in periodic transmissions for monitoring applications. Particularly, we design a reinforcement learning based mechanism to perform value-redundancy filtering and load-balancing routing according to the values and distribution of data flows, respectively, in order to improve the energy efficiency and self-adaptability to environmental changes for WSNs. The optimal matching rules in flow table are designed to curb the control signaling overhead and balance the distribution of data flows for achieving in-network fusion in data plane with guaranteed quality of service (QoS). Experiment results show that the proposed SDWSN prototype can effectively improve the energy efficiency and self-adaptability of environmental monitoring WSNs with QoS.

[1]  Ivan Stojmenovic,et al.  Data Centers as Software Defined Networks: Traffic Redundancy Elimination with Wireless Cards at Routers , 2013, IEEE Journal on Selected Areas in Communications.

[2]  Hwee Pink Tan,et al.  Sensor OpenFlow: Enabling Software-Defined Wireless Sensor Networks , 2012, IEEE Communications Letters.

[3]  Brad Karp,et al.  GPSR: greedy perimeter stateless routing for wireless networks , 2000, MobiCom '00.

[4]  Sean P. Meyn The policy iteration algorithm for average reward Markov decision processes with general state space , 1997, IEEE Trans. Autom. Control..

[5]  Michele Zorzi,et al.  ALBA-R: Load-Balancing Geographic Routing Around Connectivity Holes in Wireless Sensor Networks , 2014, IEEE Transactions on Parallel and Distributed Systems.

[6]  Luis M. Contreras,et al.  Software-defined control of the virtualized mobile packet core , 2015, IEEE Communications Magazine.

[7]  Ling Guan,et al.  Distributed Algorithms for Network Lifetime Maximization in Wireless Visual Sensor Networks , 2009, IEEE Transactions on Circuits and Systems for Video Technology.

[8]  Mario Gerla,et al.  Towards software-defined VANET: Architecture and services , 2014, 2014 13th Annual Mediterranean Ad Hoc Networking Workshop (MED-HOC-NET).

[9]  Chunming Qiao,et al.  A novel Qos-aware MAC scheme using optimal retransmission for wireless networks , 2009, IEEE Transactions on Wireless Communications.

[10]  Jianzhou Wang,et al.  ARMA Model identification using Particle Swarm Optimization Algorithm , 2008, 2008 International Conference on Computer Science and Information Technology.

[11]  Lei Ying,et al.  On Combining Shortest-Path and Back-Pressure Routing Over Multihop Wireless Networks , 2011, IEEE/ACM Transactions on Networking.

[12]  Srikanth Kandula,et al.  Achieving high utilization with software-driven WAN , 2013, SIGCOMM.

[13]  Ana Galindo-Serrano,et al.  Distributed Q-Learning for Aggregated Interference Control in Cognitive Radio Networks , 2010, IEEE Transactions on Vehicular Technology.

[14]  I. Chlamtac,et al.  Performance analysis for IEEE 802.11e EDCF service differentiation , 2005, IEEE Transactions on Wireless Communications.

[15]  Changjia Chen,et al.  Design and Implementation of Switches in Network Simulator (ns2) , 2006, First International Conference on Innovative Computing, Information and Control - Volume I (ICICIC'06).

[16]  Reda Alhajj,et al.  Positive Impact of State Similarity on Reinforcement Learning Performance , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[17]  Ling Li,et al.  Adaptive and Secure Load-Balancing Routing Protocol for Service-Oriented Wireless Sensor Networks , 2014, IEEE Systems Journal.

[18]  Deborah Estrin,et al.  Information-theoretic approaches for sensor selection and placement in sensor networks for target localization and tracking , 2005, Journal of Communications and Networks.

[19]  Yang Xiao,et al.  Intrusion detection techniques in mobile ad hoc and wireless sensor networks , 2007, IEEE Wireless Communications.

[20]  Carl D. Meyer,et al.  Matrix Analysis and Applied Linear Algebra , 2000 .

[21]  Raouf Boutaba,et al.  A survey of naming and routing in information-centric networks , 2012, IEEE Communications Magazine.

[22]  Yueh-Feng Lee,et al.  A transaction-based approach to over-the-air programming in wireless sensor networks , 2007, 2007 International Symposium on Communications and Information Technologies.

[23]  Song Guo,et al.  Energy Minimization in Multi-Task Software-Defined Sensor Networks , 2015, IEEE Transactions on Computers.

[24]  Éfren Lopes Souza,et al.  Towards a flexible event-detection model for wireless sensor networks , 2010, The IEEE symposium on Computers and Communications.