Efficiency investigation of artificial neural networks in human activity recognition

Nowadays, human activity recognition (HAR) is an important component of many ambient intelligent solutions where accelerometer and gyroscope signals give the information about the physical activity of an observed person. It has gained increasing attention by the availability of commercial wearable devices such as smartphones, smartwatches, etc. Previous studies have shown that HAR can be seen as a general machine learning problem with a particular data pre-processing stage. In the last decade, several researchers measured high recognition rates on public data sets with numerous “shallow” machine learning techniques. In some cases artificial neural networks (ANNs) produced better performance than other shallow techniques while in other cases it was less effective. After the appearance of deep learning, a significant part of HAR researches turned toward more complex solutions such as convolutional neural networks (CNNs) and they claimed that CNNs can substitute the feature extraction stage in shallow techniques and can outperform them. Therefore in the current state of the art, the efficiency of ANNs against CNNs and other machine learning techniques is unclear. The aim of this study is to investigate the performance of more ANN structures with different hyper-parameters and inputs on two public databases. The result will show that the two key factors in ANN design are the data-preprocessing and the hyper-parameter setup because the accuracy difference between a well and a badly parameterized ANN is huge. A well-tuned ANN with extracted features can outperform other machine learning methods in the HAR problem including CNN classifiers.

[1]  Thomas Plötz,et al.  Deep, Convolutional, and Recurrent Models for Human Activity Recognition Using Wearables , 2016, IJCAI.

[2]  B. Winblad,et al.  Pattern of participation in leisure activities among older people in relation to their health conditions and contextual factors: a survey in a Swedish urban area , 2009, Ageing and Society.

[3]  Zhaozheng Yin,et al.  Human Activity Recognition Using Wearable Sensors by Deep Convolutional Neural Networks , 2015, ACM Multimedia.

[4]  Long Tang,et al.  Instantaneous Real-Time Kinematic Decimeter-Level Positioning with BeiDou Triple-Frequency Signals over Medium Baselines , 2015, Sensors.

[5]  Jozsef Suto,et al.  Human activity recognition using neural networks , 2014, Proceedings of the 2014 15th International Carpathian Control Conference (ICCC).

[6]  Paul J. M. Havinga,et al.  A Survey of Online Activity Recognition Using Mobile Phones , 2015, Sensors.

[7]  Kechen Zhang,et al.  How to Modify a Neural Network Gradually Without Changing Its Input-Output Functionality , 2010, Neural Computation.

[8]  G. ÓLaighin,et al.  Direct measurement of human movement by accelerometry. , 2008, Medical engineering & physics.

[9]  Jozsef Suto,et al.  Comparison of wrapper and filter feature selection algorithms on human activity recognition , 2016, 2016 6th International Conference on Computers Communications and Control (ICCCC).

[10]  Yoshua Bengio,et al.  Understanding the difficulty of training deep feedforward neural networks , 2010, AISTATS.

[11]  Francesco Orciuoli,et al.  Making sense of cloud-sensor data streams via Fuzzy Cognitive Maps and Temporal Fuzzy Concept Analysis , 2017, Neurocomputing.

[12]  József Sütő,et al.  Real time human activity monitoring , 2015 .

[13]  María de Lourdes Martínez-Villaseñor,et al.  A Novel Wearable Sensor-Based Human Activity Recognition Approach Using Artificial Hydrocarbon Networks , 2016, Sensors.

[14]  Luca Maria Gambardella,et al.  Deep, Big, Simple Neural Nets for Handwritten Digit Recognition , 2010, Neural Computation.

[15]  Min Sheng,et al.  The Recognition of Human Daily Actions with Wearable Motion Sensor System , 2016, Trans. Edutainment.

[16]  Ioan Orha,et al.  Wearable sensors network for activity recognition using inertial sensors , 2015 .

[17]  Nicholas D. Lane,et al.  From smart to deep: Robust activity recognition on smartwatches using deep learning , 2016, 2016 IEEE International Conference on Pervasive Computing and Communication Workshops (PerCom Workshops).

[18]  Xiaoli Li,et al.  Deep Convolutional Neural Networks on Multichannel Time Series for Human Activity Recognition , 2015, IJCAI.

[19]  Arnaldo J. Abrantes,et al.  Classification of Physical Activities Using a Smartphone: Evaluation Study Using Multiple Users , 2014 .

[20]  Ismail Uysal,et al.  Inertia Based Recognition of Daily Activities with ANNs and Spectrotemporal Features , 2015, 2015 IEEE 14th International Conference on Machine Learning and Applications (ICMLA).

[21]  M. S. Hane Aung,et al.  A One-Vs-One Classifier Ensemble With Majority Voting for Activity Recognition , 2013, ESANN.

[22]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[23]  Patrick Boissy,et al.  Wavelet-based algorithm for auto-detection of daily living activities of older adults captured by multiple inertial measurement units (IMUs) , 2016, Physiological measurement.

[24]  Hongnian Yu,et al.  Elderly activities recognition and classification for applications in assisted living , 2013, Expert Syst. Appl..

[25]  BottaAlessio,et al.  Integration of Cloud computing and Internet of Things , 2016 .

[26]  Jin Wang,et al.  Recognizing Human Daily Activities From Accelerometer Signal , 2011 .

[27]  Jozsef Suto,et al.  Activity recognition in adaptive assistive systems using artificial neural networks , 2016 .

[28]  Daniel P. Siewiorek,et al.  Activity recognition and monitoring using multiple sensors on different body positions , 2006, International Workshop on Wearable and Implantable Body Sensor Networks (BSN'06).

[29]  Francesco Orciuoli,et al.  Distributed online Temporal Fuzzy Concept Analysis for stream processing in smart cities , 2017, J. Parallel Distributed Comput..

[30]  Jason Weston,et al.  Natural Language Processing (Almost) from Scratch , 2011, J. Mach. Learn. Res..

[31]  Antonio Pescapè,et al.  Integration of Cloud computing and Internet of Things: A survey , 2016, Future Gener. Comput. Syst..

[32]  Bo Yu,et al.  Convolutional Neural Networks for human activity recognition using mobile sensors , 2014, 6th International Conference on Mobile Computing, Applications and Services.

[33]  David Howard,et al.  A Comparison of Feature Extraction Methods for the Classification of Dynamic Activities From Accelerometer Data , 2009, IEEE Transactions on Biomedical Engineering.

[34]  Stefan Oniga,et al.  Optimal Recognition Method of Human Activities Using Artificial Neural Networks , 2015 .

[35]  Alejandro Baldominos Gómez,et al.  A Comparison Study of Classifier Algorithms for Cross-Person Physical Activity Recognition , 2016, Sensors.

[36]  Lei Gao,et al.  Evaluation of accelerometer based multi-sensor versus single-sensor activity recognition systems. , 2014, Medical engineering & physics.

[37]  Wilhelm Stork,et al.  Context-aware mobile health monitoring: Evaluation of different pattern recognition methods for classification of physical activity , 2008, 2008 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[38]  Didier Stricker,et al.  A competitive approach for human activity recognition on smartphones , 2013, ESANN.

[39]  Bin Liu,et al.  A two-layer and multi-strategy framework for human activity recognition using smartphone , 2016, 2016 IEEE International Conference on Communications (ICC).

[40]  Sung-Bae Cho,et al.  Human activity recognition with smartphone sensors using deep learning neural networks , 2016, Expert Syst. Appl..

[41]  Duc A. Tran,et al.  The 11th International Conference on Mobile Systems and Pervasive Computing (MobiSPC-2014) A Study on Human Activity Recognition Using Accelerometer Data from Smartphones , 2014 .

[42]  Petrica C. Pop,et al.  Feature Analysis to Human Activity Recognition , 2016, Int. J. Comput. Commun. Control.

[43]  Huan Liu,et al.  Feature Selection: An Ever Evolving Frontier in Data Mining , 2010, FSDM.

[44]  Yuqing Chen,et al.  A Deep Learning Approach to Human Activity Recognition Based on Single Accelerometer , 2015, 2015 IEEE International Conference on Systems, Man, and Cybernetics.

[45]  Allen Y. Yang,et al.  Distributed recognition of human actions using wearable motion sensor networks , 2009, J. Ambient Intell. Smart Environ..

[46]  Thomas Villmann,et al.  A sparse kernelized matrix learning vector quantization model for human activity recognition , 2013, ESANN.

[47]  Nigel H. Lovell,et al.  Implementation of a real-time human movement classifier using a triaxial accelerometer for ambulatory monitoring , 2006, IEEE Transactions on Information Technology in Biomedicine.

[48]  Davide Anguita,et al.  A Public Domain Dataset for Human Activity Recognition using Smartphones , 2013, ESANN.

[49]  Daniel Roggen,et al.  Deep Convolutional and LSTM Recurrent Neural Networks for Multimodal Wearable Activity Recognition , 2016, Sensors.

[50]  Min Sheng,et al.  Short-time activity recognition with wearable sensors using convolutional neural network , 2016, VRCAI.

[51]  Miguel A. Labrador,et al.  A Survey on Human Activity Recognition using Wearable Sensors , 2013, IEEE Communications Surveys & Tutorials.

[52]  Patrice Y. Simard,et al.  Best practices for convolutional neural networks applied to visual document analysis , 2003, Seventh International Conference on Document Analysis and Recognition, 2003. Proceedings..

[53]  Yoshua Bengio,et al.  Random Search for Hyper-Parameter Optimization , 2012, J. Mach. Learn. Res..

[54]  Tae-Seong Kim,et al.  A Triaxial Accelerometer-Based Physical-Activity Recognition via Augmented-Signal Features and a Hierarchical Recognizer , 2010, IEEE Transactions on Information Technology in Biomedicine.

[55]  Pedro Larrañaga,et al.  A review of feature selection techniques in bioinformatics , 2007, Bioinform..

[56]  Jeen-Shing Wang,et al.  Using acceleration measurements for activity recognition: An effective learning algorithm for constructing neural classifiers , 2008, Pattern Recognit. Lett..