An end-to-end deep learning model for human activity recognition from highly sparse body sensor data in Internet of Medical Things environment

Recognizing human activity from highly sparse body sensor data is becoming an important problem in Internet of Medical Things (IoMT) industry. As IoMT currently uses batteryless or passive wearable body sensors for activity recognition, the data signals of these sensors have a high sparsity, which means that the time intervals of sensors’ readings are irregular and the number of sensors’ readings in time unit is frequently limited. Therefore, learning activity recognition models from temporally sparse data is challenging. Traditional machine learning techniques cannot be applicable in this scenario due to their focus on a single sensing modality requiring regular sampling rate. In this work, we propose an effective end-to-end deep neural network (DNN) model to recognize human activities from temporally sparse data signals of passive wearable sensors that improve the accuracy rate of human activity recognition. A dropout technique is used in the developed model to deal with sparsity problem and avoiding overfitting problem. In addition, optimization of the proposed DNN model was performed by evaluating a different number of hidden layers. Various experiments were conducted on a public clinical room dataset of sparse data signals to compare the performance of the proposed DNN model with the conventional and other deep learning approaches. The experimental results demonstrate that the proposed DNN model outperforms the existing state-of-the-art methods in terms of lower inference delay and activity recognition accuracy.

[1]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[2]  Giancarlo Fortino,et al.  Facial Expression Recognition Utilizing Local Direction-Based Robust Features and Deep Belief Network , 2017, IEEE Access.

[3]  Jun Hu,et al.  Activity recognition based on inertial sensors for Ambient Assisted Living , 2016, 2016 19th International Conference on Information Fusion (FUSION).

[4]  Derek Abbott,et al.  A battery-less and wireless wearable sensor system for identifying bed and chair exits in a pilot trial in hospitalized older people , 2017, PloS one.

[5]  Mohammad Mehedi Hassan,et al.  A Hybrid Deep Learning Model for Human Activity Recognition Using Multimodal Body Sensing Data , 2019, IEEE Access.

[6]  Giancarlo Fortino,et al.  A Smartphone-Enabled Fall Detection Framework for Elderly People in Connected Home Healthcare , 2019, IEEE Network.

[7]  Saad Rehman,et al.  Internet of Medical Things (IOMT): Applications, Benefits and Future Challenges in Healthcare Domain , 2017, J. Commun..

[8]  Alejandra Valencia,et al.  A 3D Printed Toolbox for Opto-Mechanical Components , 2016, PloS one.

[9]  Damith Chinthana Ranasinghe,et al.  Recognising Activities in Real Time Using Body Worn Passive Sensors With Sparse Data Streams: To Interpolate or Not To Interpolate? , 2015, MobiQuitous.

[10]  Damith Chinthana Ranasinghe,et al.  SparseSense: Human Activity Recognition from Highly Sparse Sensor Data-streams Using Set-based Neural Networks , 2019, IJCAI.

[11]  Pascal Vincent,et al.  Representation Learning: A Review and New Perspectives , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Nicholas D. Lane,et al.  Are Accelerometers for Activity Recognition a Dead-end? , 2020, HotMobile.

[13]  Giancarlo Fortino,et al.  Human emotion recognition using deep belief network architecture , 2019, Inf. Fusion.

[14]  Thomas Plötz,et al.  Deep, Convolutional, and Recurrent Models for Human Activity Recognition Using Wearables , 2016, IJCAI.

[15]  Qinfeng Shi,et al.  Sensor enabled wearable RFID technology for mitigating the risk of falls near beds , 2013, 2013 IEEE International Conference on RFID (RFID).

[16]  Simon Fong,et al.  Mining Massive E-Health Data Streams for IoMT Enabled Healthcare Systems , 2020, Sensors.

[17]  Xiaohui Peng,et al.  Deep Learning for Sensor-based Activity Recognition: A Survey , 2017, Pattern Recognit. Lett..

[18]  Sam Lemey,et al.  Wearable Flexible Lightweight Modular RFID Tag With Integrated Energy Harvester , 2016, IEEE Transactions on Microwave Theory and Techniques.

[19]  Ahmad Almogren,et al.  A robust human activity recognition system using smartphone sensors and deep learning , 2018, Future Gener. Comput. Syst..

[20]  Kim-Kwang Raymond Choo,et al.  Imaging and fusing time series for wearable sensor-based human activity recognition , 2020, Inf. Fusion.

[21]  Thomas Plötz,et al.  Ensembles of Deep LSTM Learners for Activity Recognition using Wearables , 2017, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[22]  Ahmad Almogren,et al.  Human Activity Recognition from Body Sensor Data using Deep Learning , 2018, Journal of Medical Systems.

[23]  Mohammad Mehedi Hassan,et al.  Activity Recognition for Cognitive Assistance Using Body Sensors Data and Deep Convolutional Neural Network , 2019, IEEE Sensors Journal.

[24]  Yoshua. Bengio,et al.  Learning Deep Architectures for AI , 2007, Found. Trends Mach. Learn..

[25]  Bernt Schiele,et al.  A tutorial on human activity recognition using body-worn inertial sensors , 2014, CSUR.

[26]  Senem Velipasalar,et al.  A Survey on Activity Detection and Classification Using Wearable Sensors , 2017, IEEE Sensors Journal.

[27]  Daniel Roggen,et al.  Deep Convolutional and LSTM Recurrent Neural Networks for Multimodal Wearable Activity Recognition , 2016, Sensors.