Data-driven Energy-efficient Adaptive Sampling Using Deep Reinforcement Learning

This paper presents a resource-efficient adaptive sampling methodology for classifying electrocardiogram (ECG) signals into different heart rhythms. We present our methodology in two folds: (i) the design of a novel real-time adaptive neural network architecture capable of classifying ECG signals with different sampling rates, and (ii) a runtime implementation of sampling rate control using deep reinforcement learning (DRL). By using essential morphological details contained in the heartbeat waveform, the DRL agent can control the sampling rate and effectively reduce energy consumption at runtime. To evaluate our adaptive classifier, we use the MIT-BIH database and the recommendation of the AAMI to train the classifiers. The classifier is designed to recognize three major types of arrhythmias which are supraventricular ectopic beats (SVEB), ventricular ectopic beats (VEB) and normal beats (N). The performance of the arrhythmia classification reaches an accuracy of 97.2% for SVEB, and 97.6% for VEB beats. Moreover, the designed system is 7.3 × more energy efficient compared to the baseline architecture, where the adaptive sampling rate is not utilized. The proposed methodology can provide reliable and accurate real time ECG signal analysis with performances comparable to state-of-the-art methods. Given its time-efficient, low-complexity, and low-memory-usage characteristics, the proposed methodology is also suitable for practical ECG applications, in our case for arrhythmia classification, using resource-constrained devices, especially wearable healthcare devices and implanted medical devices.

[1]  Ting-Wei Sun,et al.  Compressed-Domain ECG-based Biometric User Identification Using Task-Driven Dictionary Learning , 2022, ACM Trans. Comput. Heal..

[2]  Berken Utku Demirel,et al.  Neural Contextual Bandits Based Dynamic Sensor Selection for Low-Power Body-Area Networks , 2022, ISLPED.

[3]  N. Trayanova,et al.  Optimal ECG-lead selection increases generalizability of deep learning on ECG abnormality classification , 2021, Philosophical Transactions of the Royal Society A.

[4]  Jyotirmoy V. Deshmukh,et al.  Non-Markovian Reinforcement Learning using Fractional Dynamics , 2021, 2021 60th IEEE Conference on Decision and Control (CDC).

[5]  Po-Chen Chien,et al.  A Fast ECG Diagnosis by Using Non-Uniform Spectral Analysis and the Artificial Neural Network , 2021, ACM Trans. Comput. Heal..

[6]  Jianbiao Xiao,et al.  ULECGNet: An Ultra-Lightweight End-to-End ECG Classification Neural Network , 2021, IEEE Journal of Biomedical and Health Informatics.

[7]  Sudip Misra,et al.  FogFL: Fog-Assisted Federated Learning for Resource-Constrained IoT Devices , 2021, IEEE Internet of Things Journal.

[8]  M. A. Rahman,et al.  An Internet-of-Medical-Things-Enabled Edge Computing Framework for Tackling COVID-19 , 2021, IEEE Internet of Things Journal.

[9]  P. Ramadge,et al.  Safe Reinforcement Learning with Natural Language Constraints , 2020, NeurIPS.

[10]  Xiaofei He,et al.  Accelerate CNNs from Three Dimensions: A Comprehensive Pruning Framework , 2020, ICML.

[11]  Quanquan Gu,et al.  Neural Thompson Sampling , 2020, ICLR.

[12]  K. Salama,et al.  The Internet of Bodies: A Systematic Survey on Propagation Characterization and Channel Modeling , 2020, IEEE Internet of Things Journal.

[13]  Andrea Cavallaro,et al.  DANA , 2020, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[14]  Mugen Peng,et al.  Toward Edge Intelligence: Multiaccess Edge Computing for 5G and Internet of Things , 2020, IEEE Internet of Things Journal.

[15]  Zhengya Sun,et al.  Inter-Patient ECG Classification With Symbolic Representations and Multi-Perspective Convolutional Neural Networks , 2020, IEEE Journal of Biomedical and Health Informatics.

[16]  Man-Wai Mak,et al.  I-Vector-Based Patient Adaptation of Deep Neural Networks for Automatic Heartbeat Classification , 2020, IEEE Journal of Biomedical and Health Informatics.

[17]  David Atienza,et al.  An Event-Based System for Low-Power ECG QRS Complex Detection , 2020, 2020 Design, Automation & Test in Europe Conference & Exhibition (DATE).

[18]  A. Bronstein,et al.  Robust Quantization: One Model to Rule Them All , 2020, NeurIPS.

[19]  Piotr Augustyniak,et al.  Adaptive Sampling of the Electrocardiogram Based on Generalized Perceptual Features , 2020, Sensors.

[20]  Jiming Liu,et al.  Reinforcement Learning in Healthcare: A Survey , 2019, ACM Comput. Surv..

[21]  Nianyin Zeng,et al.  Morphological Arrhythmia Automated Diagnosis Method Using Gray-Level Co-Occurrence Matrix Enhanced Convolutional Neural Network , 2019, IEEE Access.

[22]  Andre Esteva,et al.  A guide to deep learning in healthcare , 2019, Nature Medicine.

[23]  Matin Hashemi,et al.  LSTM-Based ECG Classification for Continuous Monitoring on Personal Wearable Devices , 2018, IEEE Journal of Biomedical and Health Informatics.

[24]  Fei Wang,et al.  Deep learning for healthcare: review, opportunities and challenges , 2018, Briefings Bioinform..

[25]  R. Morrison,et al.  Projected Costs of Informal Caregiving for Cardiovascular Disease: 2015 to 2035 A Policy Statement From the American Heart Association , 2018, Circulation.

[26]  Yuankun Xue,et al.  Constructing Compact Causal Mathematical Models for Complex Dynamics , 2017, 2017 ACM/IEEE 8th International Conference on Cyber-Physical Systems (ICCPS).

[27]  Timo Aila,et al.  Pruning Convolutional Neural Networks for Resource Efficient Inference , 2016, ICLR.

[28]  Weisong Shi,et al.  Edge Computing: Vision and Challenges , 2016, IEEE Internet of Things Journal.

[29]  Moncef Gabbouj,et al.  Real-Time Patient-Specific ECG Classification by 1-D Convolutional Neural Networks , 2016, IEEE Transactions on Biomedical Engineering.

[30]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[31]  David Silver,et al.  Deep Reinforcement Learning with Double Q-Learning , 2015, AAAI.

[32]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[33]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[34]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[35]  Pierre Vandergheynst,et al.  Compressed Sensing for Real-Time Energy-Efficient ECG Compression on Wireless Body Sensor Nodes , 2011, IEEE Transactions on Biomedical Engineering.

[36]  J. Huisken,et al.  Low-power robust beat detection in ambulatory cardiac monitoring , 2009, 2009 IEEE Biomedical Circuits and Systems Conference.

[37]  Moncef Gabbouj,et al.  A Generic and Robust System for Automated Patient-Specific Classification of ECG Signals , 2009, IEEE Transactions on Biomedical Engineering.

[38]  Feng Jun,et al.  Block-Based Neural Networks for Personalized ECG Signal Classification , 2007, IEEE Transactions on Neural Networks.

[39]  Jeffrey M. Hausdorff,et al.  Fractal dynamics in physiology: Alterations with disease and aging , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[40]  G.B. Moody,et al.  The impact of the MIT-BIH Arrhythmia Database , 2001, IEEE Engineering in Medicine and Biology Magazine.

[41]  Gusto Angiographic Investigators The effects of tissue plasminogen activator, streptokinase, or both on coronary-artery patency, ventricular function, and survival after acute myocardial infarction. , 1993, The New England journal of medicine.

[42]  Willis J. Tompkins,et al.  A Real-Time QRS Detection Algorithm , 1985, IEEE Transactions on Biomedical Engineering.

[43]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[44]  Gitta Kutyniok Compressed Sensing , 2012 .