Energy Efficiency in Reinforcement Learning for Wireless Sensor Networks

As sensor networks for health monitoring become more prevalent, so will the need to control their usage and consumption of energy. This paper presents a method which leverages the algorithm's performance and energy consumption. By utilising Reinforcement Learning (RL) techniques, we provide an adaptive framework, which continuously performs weak training in an energy-aware system. We motivate this using a realistic example of residential localisation based on Received Signal Strength (RSS). The method is cheap in terms of work-hours, calibration and energy usage. It achieves this by utilising other sensors available in the environment. These other sensors provide weak labels, which are then used to employ the State-Action-Reward-State-Action (SARSA) algorithm and train the model over time. Our approach is evaluated on a simulated localisation environment and validated on a widely available pervasive health dataset which facilitates realistic residential localisation using RSS. We show that our method is cheaper to implement and requires less effort, whilst at the same time providing a performance enhancement and energy savings over time.

[1]  Robert J. Piechocki,et al.  Designing Wearable Sensing Platforms for Healthcare in a Residential Environment , 2017, EAI Endorsed Trans. Pervasive Health Technol..

[2]  Biing-Hwang Juang,et al.  Fundamentals of speech recognition , 1993, Prentice Hall signal processing series.

[3]  Jae-Young Pyun,et al.  Practical Fingerprinting Localization for Indoor Positioning System by Using Beacons , 2017, J. Sensors.

[4]  Gerhard P. Hancke,et al.  ALWadHA Localization Algorithm: Yet More Energy Efficient , 2017, IEEE Access.

[5]  Niall Twomey,et al.  Person Identification and Discovery With Wrist Worn Accelerometer Data , 2018, ESANN.

[6]  Niall Twomey,et al.  On-Board Feature Extraction from Acceleration Data for Activity Recognition , 2018, EWSN.

[7]  Ian Craddock,et al.  Residential wearable RSSI and accelerometer measurements with detailed location annotations , 2018, Scientific data.

[8]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[9]  Niall Twomey,et al.  Efficient approximate representations for computationally expensive features , 2018, ESANN.

[10]  Holger Claussen,et al.  Wireless RSSI fingerprinting localization , 2017, Signal Process..

[11]  Raúl Santos-Rodríguez,et al.  Understanding the quality of calibrations for indoor localisation , 2018, 2018 IEEE 4th World Forum on Internet of Things (WF-IoT).

[12]  Raúl Santos-Rodríguez,et al.  Data fusion for robust indoor localisation in digital health , 2018, 2018 IEEE Wireless Communications and Networking Conference Workshops (WCNCW).

[13]  Thomas S. Huang,et al.  Toward robust learning of the Gaussian mixture state emission densities for hidden Markov models , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[14]  Xenofon Fafoutis,et al.  Experiences and Lessons Learned From Making IoT Sensing Platforms for Large-Scale Deployments , 2018, IEEE Access.

[15]  Niall Twomey,et al.  SPHERE: A sensor platform for healthcare in a residential environment , 2017 .

[16]  Niall Twomey,et al.  The SPHERE Challenge: Activity Recognition with Multimodal Sensor Data , 2016, ArXiv.

[17]  Fabio Tozeto Ramos,et al.  Egocentric Activity Recognition on a Budget , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[18]  Robert J. Piechocki,et al.  Off-body Channel Measurements at 2.4 GHz and 868 MHz in an Indoor Environment , 2014, BODYNETS.

[19]  W. Li,et al.  Sensor selection for improving accuracy of target localisation in wireless visual sensor networks , 2012, IET Wirel. Sens. Syst..

[20]  Rong Zheng,et al.  TuRF: Fast data collection for fingerprint-based indoor localization , 2017, 2017 International Conference on Indoor Positioning and Indoor Navigation (IPIN).

[21]  Kin K. Leung,et al.  A Survey of Indoor Localization Systems and Technologies , 2017, IEEE Communications Surveys & Tutorials.

[22]  Jie Liu,et al.  The Microsoft Indoor Localization Competition: Experiences and Lessons Learned , 2015, IEEE Signal Processing Magazine.