Human Activities Recognition Using Accelerometer and Gyroscope

Plenty of supervised machine learning techniques that use accelerometer and gyroscope signals for automatic Human Activity Recognition (HAR) has been proposed in the last decade. According to recent studies, the combination of accelerometer and gyroscope signals, also called multimodal recognition, increases the accuracy in HAR with respect to the use of each signal alone. This paper presents the results of an analysis we performed in order to compare the effectiveness of machine learning techniques when used separately or jointly on accelerometer and gyroscope signals. We compare SVM and \(k-\)NN classifiers (combined with hand-crafted features) with a deep residual network using three publicly available datasets. The results show that the use of deep learning techniques in multimodal mode (i.e., using accelerometer and gyroscope signals jointly) outperforms other strategies of at least 10%.

[1]  Xiaohui Peng,et al.  Deep Learning for Sensor-based Activity Recognition: A Survey , 2017, Pattern Recognit. Lett..

[2]  Nicoletta Noceti,et al.  Positive technology for elderly well-being: A review , 2020, Pattern Recognit. Lett..

[3]  Daniela Micucci,et al.  Hand-crafted Features vs Residual Networks for Human Activities Recognition using Accelerometer , 2019, 2019 IEEE 23rd International Symposium on Consumer Technologies (ISCT).

[4]  Daniela Micucci,et al.  Falls as anomalies? An experimental evaluation using smartphone accelerometer data , 2015, J. Ambient Intell. Humaniz. Comput..

[5]  Davide Anguita,et al.  A Public Domain Dataset for Human Activity Recognition using Smartphones , 2013, ESANN.

[6]  Daniela Micucci,et al.  On the Homogenization of Heterogeneous Inertial-Based Databases for Human Activity Recognition , 2019, 2019 IEEE World Congress on Services (SERVICES).

[7]  Manolis Tsiknakis,et al.  The MobiAct Dataset: Recognition of Activities of Daily Living using Smartphones , 2016, ICT4AgeingWell.

[8]  Daniela Micucci,et al.  UniMiB SHAR: a new dataset for human activity recognition using acceleration data from smartphones , 2016, ArXiv.

[9]  Sung-Bae Cho,et al.  Human activity recognition with smartphone sensors using deep learning neural networks , 2016, Expert Syst. Appl..

[10]  Andrea Cavallaro,et al.  Protecting Sensory Data against Sensitive Inferences , 2018, P2DS@EuroSys.

[11]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  Athanasios V. Vasilakos,et al.  A Survey on Ambient Intelligence in Healthcare , 2013, Proceedings of the IEEE.

[13]  Paolo Napoletano,et al.  Benchmark Analysis of Representative Deep Neural Network Architectures , 2018, IEEE Access.

[14]  Daniela Micucci,et al.  A Framework for Long-Term Data Collection to Support Automatic Human Activity Recognition , 2019, Intelligent Environments.

[15]  Niall Twomey,et al.  A Comprehensive Study of Activity Recognition Using Accelerometers , 2018, Informatics.

[16]  Paolo Napoletano,et al.  Multimodal Car Driver Stress Recognition , 2019, PervasiveHealth.