Context-aware reinforcement learning-based mobile cloud computing for telemonitoring

Mobile cloud computing (MCC) has been extensively studied to provide pervasive healthcare services in a more affordable manner. Through offloading computation-intensive tasks from mobile to cloud, a significant portion of energy can be saved to extend the mobile battery life, which is critical to maintaining continuous and uninterrupted healthcare services. However, given the ever-changing clinical severity, personal demands, and environmental conditions, it is essential to explore context-aware approach capable of dynamically determining the optimal task offloading strategies and algorithmic settings, with the goal of achieving a balanced trade-off among energy efficiency, diagnostic accuracy, and processing latency. To this aim, we propose a model-free reinforcement learning based task scheduling approach to adapt to the changing requirements.

[1]  Winfried Lamersdorf,et al.  Context-Aware Computation Offloading for Mobile Cloud Computing: Requirements Analysis, Survey and Design Guideline , 2015, FNC/MobiSPC.

[2]  Marina Zapater,et al.  Power transmission and workload balancing policies in eHealth mobile cloud computing scenarios , 2018, Future Gener. Comput. Syst..

[3]  Peter Dayan,et al.  Q-learning , 1992, Machine Learning.

[4]  Victor C. M. Leung,et al.  EMC: Emotion-aware mobile cloud computing in 5G , 2015, IEEE Network.

[5]  Hyeoun-Ae Park Pervasive Healthcare Computing: EMR/EHR, Wireless and Health Monitoring , 2011, Healthcare Informatics Research.

[6]  Anne B Martin,et al.  National Health Care Spending In 2016: Spending And Enrollment Growth Slow After Initial Coverage Expansions. , 2018, Health affairs.

[7]  G.B. Moody,et al.  The impact of the MIT-BIH Arrhythmia Database , 2001, IEEE Engineering in Medicine and Biology Magazine.

[8]  Zhanpeng Jin,et al.  Telemedicine in the Cloud Era: Prospects and Challenges , 2015, IEEE Pervasive Computing.

[9]  Athanasios V. Vasilakos,et al.  Mobile Cloud Computing: A Survey, State of Art and Future Directions , 2013, Mobile Networks and Applications.

[10]  Zhanpeng Jin,et al.  Enabling Smart Personalized Healthcare: A Hybrid Mobile-Cloud Approach for ECG Telemonitoring , 2014, IEEE Journal of Biomedical and Health Informatics.

[11]  Chris D. Nugent,et al.  Activity recognition and resource optimization in mobile cloud through MapReduce , 2013, 2013 IEEE 15th International Conference on e-Health Networking, Applications and Services (Healthcom 2013).

[12]  Gurudatt Kulkarni,et al.  Optimization in Mobile Cloud Computing for Cloud Based Health Application , 2014, 2014 Fourth International Conference on Communication Systems and Network Technologies.

[13]  Shervin Shirmohammadi,et al.  An intelligent cloud-based data processing broker for mobile e-health multimedia applications , 2017, Future Gener. Comput. Syst..

[14]  Victor C. M. Leung,et al.  EMC: Emotion-aware Mobile Cloud Computing , 2015 .

[15]  Willis J. Tompkins,et al.  A Real-Time QRS Detection Algorithm , 1985, IEEE Transactions on Biomedical Engineering.

[16]  Jun Cheng,et al.  A Wearable Smartphone-Based Platform for Real-Time Cardiovascular Disease Detection Via Electrocardiogram Processing , 2010, IEEE Transactions on Information Technology in Biomedicine.

[17]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[18]  Katinka Wolter,et al.  Mobile Healthcare Systems with Multi-cloud Offloading , 2013, 2013 IEEE 14th International Conference on Mobile Data Management.

[19]  Ing-Ray Chen,et al.  A Survey of Mobile Cloud Computing Applications: Perspectives and Challenges , 2015, Wirel. Pers. Commun..

[20]  Raj Kumari,et al.  An efficient data offloading to cloud mechanism for smart healthcare sensors , 2015, 2015 1st International Conference on Next Generation Computing Technologies (NGCT).

[21]  Timothy K. Shih,et al.  Application-oriented offloading in heterogeneous networks for mobile cloud computing , 2018, Enterp. Inf. Syst..

[22]  Chonho Lee,et al.  A survey of mobile cloud computing: architecture, applications, and approaches , 2013, Wirel. Commun. Mob. Comput..