Optimal Data Scheduling and Admission Control for Backscatter Sensor Networks

This paper studies the data scheduling and admission control problem for a backscatter sensor network (BSN). In the network, instead of initiating their own transmissions, the sensors can send their data to the gateway just by switching their antenna impedance and reflecting the received RF signals. As such, we can reduce remarkably the complexity, the power consumption, and the implementation cost of sensor nodes. Different sensors may have different functions, and data collected from each sensor may also have a different status, e.g., urgent or normal, and thus we need to take these factors into account. Therefore, in this paper, we first introduce a system model together with a mechanism in order to address the data collection and scheduling problem in the BSN. We then propose an optimization solution using the Markov decision process framework and a reinforcement learning algorithm based on the linear function approximation method, with the aim of finding the optimal data collection policy for the gateway. Through simulation results, we not only show the efficiency of the proposed solution compared with other baseline policies, but also present the analysis for data admission control policy under different classes of sensors as well as different types of data.

[1]  Shigeo Kawasaki,et al.  Backscatter wireless sensor network with WPT capabilities , 2015, 2015 IEEE MTT-S International Microwave Symposium.

[2]  Pan Hu,et al.  EkhoNet: High-Speed Ultra Low-Power Backscatter for Next Generation Sensors , 2015, GETMBL.

[3]  J. Lambert Numerical Methods for Ordinary Differential Equations , 1991 .

[4]  Angli Liu,et al.  Turbocharging ambient backscatter communication , 2014, SIGCOMM.

[5]  Pan Hu,et al.  Laissez-Faire: Fully Asymmetric Backscatter Communication , 2015, SIGCOMM.

[6]  Pierre Priouret,et al.  Adaptive Algorithms and Stochastic Approximations , 1990, Applications of Mathematics.

[7]  Hai Liu,et al.  Taxonomy and Challenges of the Integration of RFID and Wireless Sensor Networks , 2008, IEEE Network.

[8]  Umberto Spagnolini,et al.  Energy Management Policies for Passive RFID Sensors with RF-Energy Harvesting , 2010, 2010 IEEE International Conference on Communications.

[9]  Piotr Indyk,et al.  Efficient and reliable low-power backscatter networks , 2012, CCRV.

[10]  William C. Wilson,et al.  Emerging Needs for Pervasive Passive Wireless Sensor Networks on Aerospace Vehicles , 2014, EUSPN/ICTH.

[11]  Wei Wang,et al.  RSS Distribution-Based Passive Localization and Its Application in Sensor Networks , 2016, IEEE Transactions on Wireless Communications.

[12]  Nuno Borges Carvalho,et al.  Continuously Power Delivering for Passive Backscatter Wireless Sensor Networks , 2016, IEEE Transactions on Microwave Theory and Techniques.

[13]  Deepak Ganesan,et al.  BLINK: a high throughput link layer for backscatter communication , 2012, MobiSys '12.

[14]  Peter Dayan,et al.  Q-learning , 1992, Machine Learning.

[15]  Darren Leigh,et al.  Implementing Backscatter Radio for Wireless Sensor Networks , 2007, 2007 IEEE 18th International Symposium on Personal, Indoor and Mobile Radio Communications.

[16]  Mo Li,et al.  Come and Be Served: Parallel Decoding for COTS RFID Tags , 2015, MobiCom.

[17]  John N. Tsitsiklis,et al.  Feature-based methods for large scale dynamic programming , 2004, Machine Learning.

[18]  John N. Tsitsiklis,et al.  Analysis of temporal-difference learning with function approximation , 1996, NIPS 1996.

[19]  Klaus Finkenzeller,et al.  Rfid Handbook: Fundamentals and Applications in Contactless Smart Cards and Identification , 2003 .

[20]  Tommi S. Jaakkola,et al.  Convergence Results for Single-Step On-Policy Reinforcement-Learning Algorithms , 2000, Machine Learning.

[21]  Aggelos Bletsas,et al.  Coherent Detection and Channel Coding for Bistatic Scatter Radio Sensor Networking , 2015, IEEE Transactions on Communications.

[22]  Aggelos Bletsas,et al.  Anti-collision backscatter sensor networks , 2009, IEEE Transactions on Wireless Communications.

[23]  Özgür B. Akan,et al.  Wireless passive sensor networks , 2009, IEEE Communications Magazine.

[24]  Aggelos Bletsas,et al.  Increased Range Bistatic Scatter Radio , 2014, IEEE Transactions on Communications.

[25]  Özgür B. Akan,et al.  Communication coverage in wireless passive sensor networks , 2009, IEEE Communications Letters.

[26]  O. Pietquin,et al.  A Brief Survey of Parametric Value Function Approximation A Brief Survey of Parametric Value Function Approximation , 2010 .

[27]  Alborz Geramifard,et al.  A Tutorial on Linear Function Approximators for Dynamic Programming and Reinforcement Learning , 2013, Found. Trends Mach. Learn..

[28]  Wenxing Xu,et al.  Probabilistic data association for wireless passive body sensor networks , 2013, 2013 IEEE 15th International Conference on e-Health Networking, Applications and Services (Healthcom 2013).

[29]  Deepak Ganesan,et al.  Flit: a bulk transmission protocol for RFID-scale sensors , 2012, MobiSys '12.

[30]  Joshua R. Smith,et al.  BLISP: Enhancing backscatter radio with active radio for computational RFIDs , 2016, 2016 IEEE International Conference on RFID (RFID).

[31]  Will Dabney,et al.  ADAPTIVE STEP-SIZES FOR REINFORCEMENT LEARNING , 2014 .

[32]  Lei Zhang,et al.  Integration of RFID into Wireless Sensor Networks: Architectures, Opportunities and Challenging Problems , 2006, 2006 Fifth International Conference on Grid and Cooperative Computing Workshops.

[33]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[34]  Benjamin Van Roy,et al.  On the existence of fixed points for approximate value iteration and temporal-difference learning , 2000 .

[35]  Aggelos Bletsas,et al.  Noncoherent composite hypothesis testing receivers for extended range bistatic scatter radio WSNs , 2015, 2015 IEEE International Conference on Communications (ICC).

[36]  Özgür B. Akan,et al.  PADRE: Modulated Backscattering-Based PAssive Data REtrieval in Wireless Sensor Networks , 2009, 2009 IEEE Wireless Communications and Networking Conference.

[37]  Nuno Borges Carvalho,et al.  Increasing the range of wireless passive sensor nodes using multisines , 2011, 2011 IEEE International Conference on RFID-Technologies and Applications.

[38]  David Hinkley,et al.  Bootstrap Methods: Another Look at the Jackknife , 2008 .

[39]  Aggelos Bletsas,et al.  Wireless Environmental Sensor Networking With Analog Scatter Radio and Timer Principles , 2014, IEEE Sensors Journal.