DL-HAR: Deep Learning-Based Human Activity Recognition Framework for Edge Computing

Human activity recognition is commonly used in several Internet of Things applications to recognize different contexts and respond to them. Deep learning has gained momentum for identifying activities through sensors, smartphones or even surveillance cameras. However, it is often difficult to train deep learning models on constrained IoT devices. The focus of this paper is to propose an alternative model by constructing a Deep Learning-based Human Activity Recognition framework for edge computing, which we call DL-HAR. The goal of this framework is to exploit the capabilities of cloud computing to train a deep learning model and deploy it on lesspowerful edge devices for recognition. The idea is to conduct the training of the model in the Cloud and distribute it to the edge nodes. We demonstrate how the DL-HAR can perform human activity recognition at the edge while improving efficiency and accuracy. In order to evaluate the proposed framework, we conducted a comprehensive set of experiments to validate the applicability of DL-HAR. Experimental results on the benchmark dataset show a significant increase in performance compared with the stateof-the-art models.

[1]  Ivan Merelli,et al.  Exploiting Docker containers over Grid computing for a comprehensive study of chromatin conformation in different cell types , 2019, J. Parallel Distributed Comput..

[2]  Giancarlo Fortino,et al.  A Smartphone-Enabled Fall Detection Framework for Elderly People in Connected Home Healthcare , 2019, IEEE Network.

[3]  Tiago M. Fernández-Caramés,et al.  Towards Next Generation Teaching, Learning, and Context-Aware Applications for Higher Education: A Review on Blockchain, IoT, Fog and Edge Computing Enabled Smart Campuses and Universities , 2019, Applied Sciences.

[4]  Mansaf Alam,et al.  A Lightweight Deep Learning Model for Human Activity Recognition on Edge Devices , 2019, Procedia Computer Science.

[5]  Mohammad Mehedi Hassan,et al.  A Hybrid Deep Learning Model for Human Activity Recognition Using Multimodal Body Sensing Data , 2019, IEEE Access.

[6]  Giancarlo Fortino,et al.  A lightweight and cost effective edge intelligence architecture based on containerization technology , 2019, World Wide Web.

[7]  Sven Helmer,et al.  A semantic pattern for trusted orchestration in IoT edge clouds , 2019, Internet Technol. Lett..

[8]  Pierluigi Ritrovato,et al.  An edge-stream computing infrastructure for real-time analysis of wearable sensors data , 2019, Future Gener. Comput. Syst..

[9]  Lei Shu,et al.  EdgeCare: Leveraging Edge Computing for Collaborative Data Management in Mobile Healthcare Systems , 2019, IEEE Access.

[10]  Andre Esteva,et al.  A guide to deep learning in healthcare , 2019, Nature Medicine.

[11]  Gabriel Villarrubia,et al.  Architecture to Embed Software Agents in Resource Constrained Internet of Things Devices , 2018, Sensors.

[12]  M. Shamim Hossain,et al.  Transferring activity recognition models in FOG computing architecture , 2018, J. Parallel Distributed Comput..

[13]  Krishna Pratap Singh,et al.  Long Short-Term Memory Recurrent Neural Network Architectures for Melody Generation , 2018, SocProS.

[14]  Jalal Al-Muhtadi,et al.  A robust convolutional neural network for online smartphone-based human activity recognition , 2018, J. Intell. Fuzzy Syst..

[15]  Giancarlo Fortino,et al.  Cost Efficient Edge Intelligence Framework Using Docker Containers , 2018, 2018 IEEE 16th Intl Conf on Dependable, Autonomic and Secure Computing, 16th Intl Conf on Pervasive Intelligence and Computing, 4th Intl Conf on Big Data Intelligence and Computing and Cyber Science and Technology Congress(DASC/PiCom/DataCom/CyberSciTech).

[16]  Nane Kratzke,et al.  A Brief History of Cloud Application Architectures , 2018, Applied Sciences.

[17]  Leonardo Goliatt da Fonseca,et al.  Modeling Heating and Cooling Loads in Buildings Using Gaussian Processes , 2018, 2018 IEEE Congress on Evolutionary Computation (CEC).

[18]  Jae-Yoon Jung,et al.  LiReD: A Light-Weight Real-Time Fault Detection System for Edge Computing Using LSTM Recurrent Neural Networks , 2018, Sensors.

[19]  Edin Golubovic,et al.  An Open and Extensible Data Acquisition and Processing Platform for Rehabilitation Applications , 2018, Advanced Technologies, Systems, and Applications III.

[20]  Nathalie Mitton,et al.  LEGIoT: A Lightweight Edge Gateway for the Internet of Things , 2018, Future Gener. Comput. Syst..

[21]  Marios D. Dikaiakos,et al.  Low-Cost Adaptive Monitoring Techniques for the Internet of Things , 2018, IEEE Transactions on Services Computing.

[22]  Mianxiong Dong,et al.  Learning IoT in Edge: Deep Learning for the Internet of Things with Edge Computing , 2018, IEEE Network.

[23]  Walid Saad,et al.  Deep Learning for Reliable Mobile Edge Analytics in Intelligent Transportation Systems: An Overview , 2017, IEEE Vehicular Technology Magazine.

[24]  Mohsen Guizani,et al.  Deep Learning for IoT Big Data and Streaming Analytics: A Survey , 2017, IEEE Communications Surveys & Tutorials.

[25]  Awais Ahmad,et al.  Deep learning in big data Analytics: A comparative study , 2017, Comput. Electr. Eng..

[26]  Ioannis G. Askoxylakis,et al.  Lightweight & secure industrial IoT communications via the MQ telemetry transport protocol , 2017, 2017 IEEE Symposium on Computers and Communications (ISCC).

[27]  H. T. Kung,et al.  Distributed Deep Neural Networks Over the Cloud, the Edge and End Devices , 2017, 2017 IEEE 37th International Conference on Distributed Computing Systems (ICDCS).

[28]  Roberto Morabito,et al.  Virtualization on Internet of Things Edge Devices With Container Technologies: A Performance Evaluation , 2017, IEEE Access.

[29]  Nane Kratzke,et al.  Understanding cloud-native applications after 10 years of cloud computing - A systematic mapping study , 2017, J. Syst. Softw..

[30]  Yong-Ju Lee,et al.  Scalable architecture for an automated surveillance system using edge computing , 2017, The Journal of Supercomputing.

[31]  Guang-Zhong Yang,et al.  Deep learning for human activity recognition: A resource efficient implementation on low-power devices , 2016, 2016 IEEE 13th International Conference on Wearable and Implantable Body Sensor Networks (BSN).

[32]  Thomas Plötz,et al.  Deep, Convolutional, and Recurrent Models for Human Activity Recognition Using Wearables , 2016, IJCAI.

[33]  Yuehong Yin,et al.  The internet of things in healthcare: An overview , 2016, J. Ind. Inf. Integr..

[34]  Daniel Roggen,et al.  Deep Convolutional and LSTM Recurrent Neural Networks for Multimodal Wearable Activity Recognition , 2016, Sensors.

[35]  Claudia Eckert,et al.  Neural Network-Based User-Independent Physical Activity Recognition for Mobile Devices , 2015, IDEAL.

[36]  Claus Pahl,et al.  Containers and Clusters for Edge Cloud Architectures -- A Technology Review , 2015, 2015 3rd International Conference on Future Internet of Things and Cloud.

[37]  William Stafford Noble Support vector machine , 2013 .

[38]  Özlem Durmaz Incel,et al.  ARAS human activity datasets in multiple homes with multiple residents , 2013, 2013 7th International Conference on Pervasive Computing Technologies for Healthcare and Workshops.

[39]  Razvan Pascanu,et al.  On the difficulty of training recurrent neural networks , 2012, ICML.

[40]  Hugo Fuks,et al.  Wearable Computing: Accelerometers' Data Classification of Body Postures and Movements , 2012, SBIA.

[41]  Gary M. Weiss,et al.  Activity recognition using cell phone accelerometers , 2011, SKDD.

[42]  Gwenn Englebienne,et al.  Accurate activity recognition in a home setting , 2008, UbiComp.

[43]  Kent Larson,et al.  Activity Recognition in the Home Using Simple and Ubiquitous Sensors , 2004, Pervasive.

[44]  Shuai Zhang,et al.  Service Scheduling Based on Edge Computing for Power Distribution IoT , 2020, Computers, Materials & Continua.

[45]  Md. Zia Uddin A wearable sensor-based activity prediction system to facilitate edge computing in smart healthcare system , 2019, J. Parallel Distributed Comput..

[46]  Andrey Ignatov,et al.  Real-time human activity recognition from accelerometer data using Convolutional Neural Networks , 2018, Appl. Soft Comput..

[47]  Long Cheng,et al.  Recognition of human activities using machine learning methods with wearable sensors , 2017, 2017 IEEE 7th Annual Computing and Communication Workshop and Conference (CCWC).

[48]  Justin Bayer,et al.  Learning Sequence Representations , 2015 .

[49]  Diane J. Cook,et al.  Learning Setting-Generalized Activity Models for Smart Spaces , 2012, IEEE Intelligent Systems.

[50]  Charissa Ann Ronao,et al.  Expert Systems With Applications , 2022 .