Modified deep residual network architecture deployed on serverless framework of IoT platform based on human activity recognition application

Abstract In the last few years, human activity recognition (HAR) is a subject undergoing intense study in various contexts such as pattern recognition and human-device interaction. HAR applications come to an aid of Telecare system which is paving the way for doctors and nurses to measure the health status of their patients. Due to the ubiquitous influence of smartphones in an individual’s life, we take embedded smartphone sensors into account as our case study. The proposed method, Modified Deep Residual Network, outperforms the accuracy of Human activity recognition compared with state-of-the-art machine learning techniques which are using Raw signals as their input. we defined new pooling layer called smooth-pooling to leverage the model performance. The accuracy of proposed architecture is evaluated on three common dataset that comprises accelerometer and gyroscope raw data. The results demonstrated the proposed method outperforms accuracy of classification while requiring just raw data with lower parameters compared to other works. Furthermore, The proposed HAR method is deployed in our IoT cloud platform which enables users to create scenarios based on what they are doing at home. Using Function as a Service (FaaS) architecture in this platform solves the scalability issues by running each function in a separate container. The IoT platform prepares an infrastructure for developers who want to integrate their application into the platform and use its functionality along with other IoT platform options.

[1]  Sung-Bae Cho,et al.  Evaluation of Deep Convolutional Neural Network Architectures for Human Activity Recognition with Smartphone Sensors , 2015 .

[2]  Tapas Mondal,et al.  Wearable Sensors for Remote Health Monitoring , 2017, Sensors.

[3]  Yurii Nesterov,et al.  Smooth minimization of non-smooth functions , 2005, Math. Program..

[4]  Davide Anguita,et al.  A Public Domain Dataset for Human Activity Recognition using Smartphones , 2013, ESANN.

[5]  Daijin Kim,et al.  Hidden Markov Model Ensemble for Activity Recognition Using Tri-Axis Accelerometer , 2015, 2015 IEEE International Conference on Systems, Man, and Cybernetics.

[6]  Jenq-Neng Hwang,et al.  A Review on Video-Based Human Activity Recognition , 2013, Comput..

[7]  Takeshi Nishida,et al.  Deep recurrent neural network for mobile human activity recognition with high throughput , 2017, Artificial Life and Robotics.

[8]  Petia Radeva,et al.  Human Activity Recognition from Accelerometer Data Using a Wearable Device , 2011, IbPRIA.

[9]  Friedrich Foerster,et al.  Detection of posture and motion by accelerometry : a validation study in ambulatory monitoring , 1999 .

[10]  Bruno M. C. Silva,et al.  An IoT-based mobile gateway for intelligent personal assistants on mobile health environments , 2016, J. Netw. Comput. Appl..

[11]  Daniel Roggen,et al.  Deep Convolutional and LSTM Recurrent Neural Networks for Multimodal Wearable Activity Recognition , 2016, Sensors.

[12]  Daijin Kim,et al.  Robust human activity recognition from depth video using spatiotemporal multi-fused features , 2017, Pattern Recognit..

[13]  Giancarlo Fortino,et al.  Enabling IoT interoperability through opportunistic smartphone-based mobile gateways , 2017, J. Netw. Comput. Appl..

[14]  Donald Steinwachs,et al.  Hospital at Home: Feasibility and Outcomes of a Program To Provide Hospital-Level Care at Home for Acutely Ill Older Patients , 2005, Annals of Internal Medicine.

[15]  Weihua Sheng,et al.  Delivering home healthcare through a Cloud-based Smart Home Environment (CoSHE) , 2018, Future Gener. Comput. Syst..

[16]  Bo Yu,et al.  Convolutional Neural Networks for human activity recognition using mobile sensors , 2014, 6th International Conference on Mobile Computing, Applications and Services.

[17]  Claudia Eckert,et al.  Neural Network-Based User-Independent Physical Activity Recognition for Mobile Devices , 2015, IDEAL.

[18]  Zhaozheng Yin,et al.  Human Activity Recognition Using Wearable Sensors by Deep Convolutional Neural Networks , 2015, ACM Multimedia.

[19]  Davide Anguita,et al.  Human Activity Recognition on Smartphones Using a Multiclass Hardware-Friendly Support Vector Machine , 2012, IWAAL.

[20]  M. Skubic,et al.  Senior residents’ perceived need of and preferences for “smart home” sensor technologies , 2008, International Journal of Technology Assessment in Health Care.

[21]  Josef Spillner,et al.  FaaSter, Better, Cheaper: The Prospect of Serverless Scientific Computing and HPC , 2017, CARLA.

[22]  Sung-Bae Cho,et al.  Human activity recognition using smartphone sensors with two-stage continuous hidden Markov models , 2014, 2014 10th International Conference on Natural Computation (ICNC).

[23]  Chuan Zhang,et al.  A Reconfigurable Smart Sensor Interface for Industrial WSN in IoT Environment , 2014, IEEE Transactions on Industrial Informatics.

[24]  Brighten Godfrey,et al.  Low latency via redundancy , 2013, CoNEXT.

[25]  Steven J. Miller,et al.  Using sensor networks to detect urinary tract infections in older adults , 2011, 2011 IEEE 13th International Conference on e-Health Networking, Applications and Services.

[26]  Davide Anguita,et al.  Transition-Aware Human Activity Recognition Using Smartphones , 2016, Neurocomputing.

[27]  Miguel A. Labrador,et al.  Centinela: A human activity recognition system based on acceleration and vital sign data , 2012, Pervasive Mob. Comput..

[28]  In Lee,et al.  The Internet of Things (IoT): Applications, investments, and challenges for enterprises , 2015 .

[29]  Bin Jiang,et al.  Wearable Vision Assistance System Based on Binocular Sensors for Visually Impaired Users , 2019, IEEE Internet of Things Journal.

[30]  Michael G. Pecht,et al.  IoT-Based Prognostics and Systems Health Management for Industrial Applications , 2016, IEEE Access.

[31]  Andrey Ignatov,et al.  Real-time human activity recognition from accelerometer data using Convolutional Neural Networks , 2018, Appl. Soft Comput..

[32]  Shyamsundar Rajaram,et al.  Human Activity Recognition Using Multidimensional Indexing , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[33]  Marimuthu Palaniswami,et al.  Internet of Things (IoT): A vision, architectural elements, and future directions , 2012, Future Gener. Comput. Syst..

[34]  Kalaiarasi Sonai Muthu,et al.  Classification Algorithms in Human Activity Recognition using Smartphones , 2012 .

[35]  Perry Cheng,et al.  Cloud-Native, Event-Based Programming for Mobile Applications , 2016, 2016 IEEE/ACM International Conference on Mobile Software Engineering and Systems (MOBILESoft).

[36]  Nervo Verdezoto,et al.  Beyond self-monitoring: understanding non-functional aspects of home-based healthcare technology , 2013, UbiComp.

[37]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[38]  Serge J. Belongie,et al.  Residual Networks Behave Like Ensembles of Relatively Shallow Networks , 2016, NIPS.

[39]  Kumbesan Sandrasegaran,et al.  A location-based smart shopping system with IoT technology , 2018, 2018 IEEE 4th World Forum on Internet of Things (WF-IoT).

[40]  Sung-Bae Cho,et al.  Human activity recognition with smartphone sensors using deep learning neural networks , 2016, Expert Syst. Appl..

[41]  Xi Long,et al.  Single-accelerometer-based daily physical activity classification , 2009, 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[42]  Manmeet Mahinderjit Singh,et al.  Human Activity Recognition (HAR) for Wearable Sensors with Classification Techniques , 2017 .

[43]  Daniela Micucci,et al.  UniMiB SHAR: a new dataset for human activity recognition using acceleration data from smartphones , 2016, ArXiv.

[44]  A. M. Khan,et al.  Accelerometer signal-based human activity recognition using augmented autoregressive model coefficients and artificial neural nets , 2008, 2008 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[45]  Gary M. Weiss,et al.  Activity recognition using cell phone accelerometers , 2011, SKDD.

[46]  Shuangquan Wang,et al.  Human activity recognition with user-free accelerometers in the sensor networks , 2005, 2005 International Conference on Neural Networks and Brain.

[47]  Suwon Kim,et al.  User preference for an IoT healthcare application for lifestyle disease management , 2017 .

[48]  Sung-Bae Cho,et al.  Recognizing human activities from smartphone sensors using hierarchical continuous hidden Markov models , 2017, Int. J. Distributed Sens. Networks.

[49]  Juan-Luis Gorricho,et al.  Activity Recognition from Accelerometer Data on a Mobile Phone , 2009, IWANN.

[50]  Carl Boettiger,et al.  An introduction to Docker for reproducible research , 2014, OPSR.

[51]  Bo Ding,et al.  Unsupervised Feature Learning for Human Activity Recognition Using Smartphone Sensors , 2014, MIKE.

[52]  Ian D. Reid,et al.  A general method for human activity recognition in video , 2006, Comput. Vis. Image Underst..

[53]  Ahmad Almogren,et al.  A robust human activity recognition system using smartphone sensors and deep learning , 2018, Future Gener. Comput. Syst..

[54]  Miguel A. Labrador,et al.  A Survey on Human Activity Recognition using Wearable Sensors , 2013, IEEE Communications Surveys & Tutorials.