A Robust Feature Extraction Model for Human Activity Characterization Using 3-Axis Accelerometer and Gyroscope Data

Human Activity Recognition (HAR) using embedded sensors in smartphones and smartwatch has gained popularity in extensive applications in health care monitoring of elderly people, security purpose, robotics, monitoring employees in the industry, and others. However, human behavior analysis using the accelerometer and gyroscope data are typically grounded on supervised classification techniques, where models are showing sub-optimal performance for qualitative and quantitative features. Considering this factor, this paper proposes an efficient and reduce dimension feature extraction model for human activity recognition. In this feature extraction technique, the Enveloped Power Spectrum (EPS) is used for extracting impulse components of the signal using frequency domain analysis which is more robust and noise insensitive. The Linear Discriminant Analysis (LDA) is used as dimensionality reduction procedure to extract the minimum number of discriminant features from envelop spectrum for human activity recognition (HAR). The extracted features are used for human activity recognition using Multi-class Support Vector Machine (MCSVM). The proposed model was evaluated by using two benchmark datasets, i.e., the UCI-HAR and DU-MD datasets. This model is compared with other state-of-the-art methods and the model is outperformed.

[1]  J. K. Mandal,et al.  Activity recognition system using inbuilt sensors of smart mobile phone and minimizing feature vectors , 2015, Microsystem Technologies.

[2]  Shahrokh Valaee,et al.  Locomotion Activity Recognition Using Stacked Denoising Autoencoders , 2018, IEEE Internet of Things Journal.

[3]  Fatma Kalaoglu,et al.  Human Action Recognition Using Deep Learning Methods on Limited Sensory Data , 2020, IEEE Sensors Journal.

[4]  Zhaohui Wang,et al.  An overview of human activity recognition based on smartphone , 2019, Sensor Review.

[5]  Antonio Fernández-Caballero,et al.  A survey of video datasets for human action and activity recognition , 2013, Comput. Vis. Image Underst..

[6]  Edward Sazonov,et al.  RF hand gesture sensor for monitoring of cigarette smoking , 2011, 2011 Fifth International Conference on Sensing Technology.

[7]  Lina Yao,et al.  A Semisupervised Recurrent Convolutional Attention Model for Human Activity Recognition , 2020, IEEE Transactions on Neural Networks and Learning Systems.

[8]  Tao Li,et al.  A Deep Learning Method for Complex Human Activity Recognition Using Virtual Wearable Sensors , 2020, SpatialDI.

[9]  Bo Chen,et al.  MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications , 2017, ArXiv.

[10]  Alper Basturk,et al.  Human action recognition with deep learning and structural optimization using a hybrid heuristic algorithm , 2020, Cluster Computing.

[11]  Md. Atiqur Rahman Ahad,et al.  DU-MD: An Open-Source Human Action Dataset for Ubiquitous Wearable Sensors , 2018, 2018 Joint 7th International Conference on Informatics, Electronics & Vision (ICIEV) and 2018 2nd International Conference on Imaging, Vision & Pattern Recognition (icIVPR).

[12]  Eduardo Souto,et al.  A Smartphone Lightweight Method for Human Activity Recognition Based on Information Theory , 2020, Sensors.

[13]  Hongyi Li,et al.  An Incremental Learning Method Based on Probabilistic Neural Networks and Adjustable Fuzzy Clustering for Human Activity Recognition by Using Wearable Sensors , 2012, IEEE Transactions on Information Technology in Biomedicine.

[14]  Netzahualcóyotl Hernández,et al.  Literature Review on Transfer Learning for Human Activity Recognition Using Mobile and Wearable Devices with Environmental Technology , 2020, SN Computer Science.

[15]  Jonathan Loo,et al.  Authentication of Smartphone Users Based on Activity Recognition and Mobile Sensing , 2017, Sensors.

[16]  Dianhui Chu,et al.  Empirical Study and Improvement on Deep Transfer Learning for Human Activity Recognition , 2018, Sensors.

[17]  Xiaodong Yang,et al.  Super Normal Vector for Human Activity Recognition with Depth Cameras , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Ying Wah Teh,et al.  Deep learning algorithms for human activity recognition using mobile and wearable sensor networks: State of the art and research challenges , 2018, Expert Syst. Appl..

[19]  Vivek Kanhangad,et al.  Human Activity Classification in Smartphones Using Accelerometer and Gyroscope Sensors , 2018, IEEE Sensors Journal.

[20]  Davide Anguita,et al.  A Public Domain Dataset for Human Activity Recognition using Smartphones , 2013, ESANN.

[21]  Md. Atiqur Rahman Ahad,et al.  Feature Extraction, Performance Analysis and System Design Using the DU Mobility Dataset , 2018, IEEE Access.

[22]  Yu-Liang Hsu,et al.  Application of nonparametric weighted feature extraction for an inertial-signal-based human activity recognition system , 2017, 2017 International Conference on Applied System Innovation (ICASI).

[23]  Ahmad Almogren,et al.  A robust human activity recognition system using smartphone sensors and deep learning , 2018, Future Gener. Comput. Syst..

[24]  H. Nematallah,et al.  Logistic Model Tree for Human Activity Recognition Using Smartphone-Based Inertial Sensors , 2019, 2019 IEEE SENSORS.

[25]  Anna M. Bianchi,et al.  User-Independent Recognition of Sports Activities From a Single Wrist-Worn Accelerometer: A Template-Matching-Based Approach , 2016, IEEE Transactions on Biomedical Engineering.

[26]  Sung-Bae Cho,et al.  Human activity recognition with smartphone sensors using deep learning neural networks , 2016, Expert Syst. Appl..

[27]  Chen Wei,et al.  Up and down buses activity recognition using smartphone accelerometer , 2016, 2016 IEEE Information Technology, Networking, Electronic and Automation Control Conference.

[28]  Wing W. Y. Ng,et al.  Neural Network Ensembles for Sensor-Based Human Activity Recognition Within Smart Environments , 2019, Sensors.

[29]  Changseok Bae,et al.  Unsupervised learning for human activity recognition using smartphone sensors , 2014, Expert Syst. Appl..

[30]  Kim-Kwang Raymond Choo,et al.  Imaging and fusing time series for wearable sensor-based human activity recognition , 2020, Inf. Fusion.

[31]  Yeng Chai Soh,et al.  Robust Human Activity Recognition Using Smartphone Sensors via CT-PCA and Online SVM , 2017, IEEE Transactions on Industrial Informatics.

[32]  Dimitrios Tzovaras,et al.  Feature learning for Human Activity Recognition using Convolutional Neural Networks , 2020, CCF Transactions on Pervasive Computing and Interaction.

[33]  Diogo R. Ferreira,et al.  Preprocessing techniques for context recognition from accelerometer data , 2010, Personal and Ubiquitous Computing.

[34]  Bo Yan,et al.  Deep Ensemble Learning for Human Activity Recognition Using Smartphone , 2018, 2018 IEEE 23rd International Conference on Digital Signal Processing (DSP).

[35]  Hanyu Wang,et al.  LSTM-CNN Architecture for Human Activity Recognition , 2020, IEEE Access.

[36]  Amir H. Behzadan,et al.  Smartphone-based construction workers' activity recognition and classification , 2016 .

[37]  Lei Zhang,et al.  The Layer-Wise Training Convolutional Neural Networks Using Local Loss for Sensor-Based Human Activity Recognition , 2020, IEEE Sensors Journal.

[38]  Diane J. Cook,et al.  Activity Learning: Discovering, Recognizing, and Predicting Human Behavior from Sensor Data , 2015 .

[39]  Khalil El-Khatib,et al.  A Comparative Analysis of the Impact of Features on Human Activity Recognition with Smartphone Sensors , 2017, WebMedia.

[40]  Md. Rashedul Islam,et al.  Enhanced Human Activity Recognition Based on Smartphone Sensor Data Using Hybrid Feature Selection Model , 2020, Sensors.

[41]  U. Rajendra Acharya,et al.  ECG beat classification using PCA, LDA, ICA and Discrete Wavelet Transform , 2013, Biomed. Signal Process. Control..

[42]  B Jagadeesh,et al.  An Approach of Understanding Human Activity Recognition and Detection for Video Surveillance using HOG Descriptor and SVM Classifier , 2017, 2017 International Conference on Current Trends in Computer, Electrical, Electronics and Communication (CTCEEC).

[43]  Jungpil Shin,et al.  Arm movement activity based user authentication in P2P systems , 2020, Peer Peer Netw. Appl..

[44]  Andrey Ignatov,et al.  Real-time human activity recognition from accelerometer data using Convolutional Neural Networks , 2018, Appl. Soft Comput..

[45]  Daniel M. Batista,et al.  MBOSS: A Symbolic Representation of Human Activity Recognition Using Mobile Sensors , 2018, Sensors.

[46]  Ling Shao,et al.  A survey on fall detection: Principles and approaches , 2013, Neurocomputing.

[47]  Shenghui Zhao,et al.  A Comparative Study on Human Activity Recognition Using Inertial Sensors in a Smartphone , 2016, IEEE Sensors Journal.

[48]  Dario Maio,et al.  A multimodal approach for human activity recognition based on skeleton and RGB data , 2020, Pattern Recognit. Lett..

[49]  Athanasios V. Vasilakos,et al.  GCHAR: An efficient Group-based Context - aware human activity recognition on smartphone , 2017, J. Parallel Distributed Comput..