Hierarchical evolutionary classification framework for human action recognition using sparse dictionary optimization

Abstract Human action recognition using wearable sensors play a remarkable role in the province of Human-centric Computing. This paper accords a novel sparse representation based hierarchical evolutionary framework for classifying human activities. The main objective of this research is to propose a model for human action recognition that produces superior recognition results. This framework employs data from two inertial sensors namely an accelerometer and a gyroscope. Features like time and frequency-domain features were utilized in this work. This framework operates at multiple levels in the hierarchy, wherein, the output of one level is given as input to the next level in the hierarchy. A novel algorithm for deducing the hierarchical structure based on the input data called Hierarchical Architecture Design (HAD) algorithm is presented. We have also presented a novel Sparse Dictionary Optimization (SDO) algorithm for generating dictionaries that aid in the efficacious sparse representation-based classification. Finally, action recognition is done using the proposed Sparse Representation based Hierarchical (SRH) classifier. The performance analysis of the proposed system was conducted using University of Southern California Human Activity Dataset (USC-HAD) and Human Activities and Postural Transitions (HAPT) Dataset. The proposed classification framework attained a very high F-score value of 98.01% and 93.51% for the USC-HAD and HAPT datasets respectively.

[1]  Guang-Zhong Yang,et al.  A Deep Learning Approach to on-Node Sensor Data Analytics for Mobile or Wearable Devices , 2017, IEEE Journal of Biomedical and Health Informatics.

[2]  Salvatore Tabbone,et al.  Sparse representation over learned dictionary for symbol recognition , 2016, Signal Process..

[3]  Hugo Gamboa,et al.  Human activity data discovery from triaxial accelerometer sensor: Non-supervised learning sensitivity to feature extraction parametrization , 2015, Inf. Process. Manag..

[4]  Allen Y. Yang,et al.  Robust Face Recognition via Sparse Representation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Andrey Ignatov,et al.  Real-time human activity recognition from accelerometer data using Convolutional Neural Networks , 2018, Appl. Soft Comput..

[6]  Sung-Bae Cho,et al.  Recognizing human activities from smartphone sensors using hierarchical continuous hidden Markov models , 2017, Int. J. Distributed Sens. Networks.

[7]  Shenghui Zhao,et al.  A Comparative Study on Human Activity Recognition Using Inertial Sensors in a Smartphone , 2016, IEEE Sensors Journal.

[8]  Miguel A. Labrador,et al.  A Survey on Human Activity Recognition using Wearable Sensors , 2013, IEEE Communications Surveys & Tutorials.

[9]  Chih-Cheng Hung,et al.  Multi-objective evolution of oblique decision trees for imbalanced data binary classification , 2019, Swarm Evol. Comput..

[10]  Diane J. Cook,et al.  Learning Setting-Generalized Activity Models for Smart Spaces , 2012, IEEE Intelligent Systems.

[11]  Zhaozheng Yin,et al.  Human Activity Recognition Using Wearable Sensors by Deep Convolutional Neural Networks , 2015, ACM Multimedia.

[12]  R. Amutha,et al.  Compressive sensing based simultaneous fusion and compression of multi-focus images using learned dictionary , 2018, Multimedia Tools and Applications.

[13]  Hongnian Yu,et al.  A survey on wearable sensor modality centred human activity recognition in health care , 2019, Expert Syst. Appl..

[14]  Abbes Amira,et al.  Multiple comparator classifier framework for accelerometer-based fall detection and diagnostic , 2016, Appl. Soft Comput..

[15]  Joel A. Tropp,et al.  Signal Recovery From Random Measurements Via Orthogonal Matching Pursuit , 2007, IEEE Transactions on Information Theory.

[16]  Mi Zhang,et al.  Manifold Learning and Recognition of Human Activity Using Body-Area Sensors , 2011, 2011 10th International Conference on Machine Learning and Applications and Workshops.

[17]  Mi Zhang,et al.  Human Daily Activity Recognition With Sparse Representation Using Wearable Sensors , 2013, IEEE Journal of Biomedical and Health Informatics.

[18]  Bin Fang,et al.  Human action recognition based on spatio-temporal three-dimensional scattering transform descriptor and an improved VLAD feature encoding algorithm , 2019, Neurocomputing.

[19]  Yonghuai Liu,et al.  Histogram of Fuzzy Local Spatio-Temporal Descriptors for Video Action Recognition , 2020, IEEE Transactions on Industrial Informatics.

[20]  Arindam Banerjee,et al.  Online (cid:96) 1 -Dictionary Learning with Application to Novel Document Detection , 2012 .

[21]  R. Amutha,et al.  A novel chaotic map based compressive classification scheme for human activity recognition using a tri-axial accelerometer , 2018, Multimedia Tools and Applications.

[22]  Diane J. Cook,et al.  Activity recognition on streaming sensor data , 2014, Pervasive Mob. Comput..

[23]  Mi Zhang,et al.  USC-HAD: a daily activity dataset for ubiquitous activity recognition using wearable sensors , 2012, UbiComp.

[24]  Alexandre Benoit,et al.  Timed-image based deep learning for action recognition in video sequences , 2020, Pattern Recognit..

[25]  Edoardo Amaldi,et al.  On the Approximability of Minimizing Nonzero Variables or Unsatisfied Relations in Linear Systems , 1998, Theor. Comput. Sci..

[26]  Vineet Bafna,et al.  Inferring gene ontologies from pairwise similarity data , 2014, Bioinform..

[27]  Sung-Bae Cho,et al.  Activity Recognition Using Hierarchical Hidden Markov Models on a Smartphone with 3D Accelerometer , 2011, HAIS.

[28]  Yuhuang Zheng,et al.  Human Activity Recognition Based on the Hierarchical Feature Selection and Classification Framework , 2015, J. Electr. Comput. Eng..

[29]  S. Radha,et al.  Remote Monitoring of Children With Chronic Illness Using Wearable Vest , 2019 .

[30]  David Howard,et al.  A Comparison of Feature Extraction Methods for the Classification of Dynamic Activities From Accelerometer Data , 2009, IEEE Transactions on Biomedical Engineering.

[31]  Jae-Young Pyun,et al.  Deep Recurrent Neural Networks for Human Activity Recognition , 2017, Sensors.

[32]  Bijaya K. Panigrahi,et al.  Face recognition using bacterial foraging strategy , 2011, Swarm Evol. Comput..

[33]  Sreejit Chakravarty,et al.  Microarray medical data classification using kernel ridge regression and modified cat swarm optimization based gene selection system , 2016, Swarm Evol. Comput..

[34]  Athanasios V. Vasilakos,et al.  GCHAR: An efficient Group-based Context - aware human activity recognition on smartphone , 2017, J. Parallel Distributed Comput..

[35]  Shadrokh Samavi,et al.  Multi-focus image fusion using dictionary-based sparse representation , 2015, Inf. Fusion.

[36]  Cagatay Catal,et al.  On the use of ensemble of classifiers for accelerometer-based activity recognition , 2015, Appl. Soft Comput..

[37]  Xuelong Li,et al.  Rank Preserving Discriminant Analysis for Human Behavior Recognition on Wireless Sensor Networks , 2014, IEEE Transactions on Industrial Informatics.

[38]  Jie Yang,et al.  User Verification Leveraging Gait Recognition for Smartphone Enabled Mobile Healthcare Systems , 2015, IEEE Transactions on Mobile Computing.

[39]  Zoran A. Salcic,et al.  Adaptive sliding window segmentation for physical activity recognition using a single tri-axial accelerometer , 2017, Pervasive Mob. Comput..

[40]  Kaoru Hirota,et al.  Softmax regression based deep sparse autoencoder network for facial emotion recognition in human-robot interaction , 2018, Inf. Sci..

[41]  Ahmed Ghoneim,et al.  A Triaxial Accelerometer-Based Human Activity Recognition via EEMD-Based Features and Game-Theory-Based Feature Selection , 2016, IEEE Sensors Journal.

[42]  Stéphane Mallat,et al.  Matching pursuits with time-frequency dictionaries , 1993, IEEE Trans. Signal Process..

[43]  M. N. Nyan,et al.  Classification of gait patterns in the time-frequency domain. , 2006, Journal of biomechanics.

[44]  Sung-Bae Cho,et al.  Human activity recognition with smartphone sensors using deep learning neural networks , 2016, Expert Syst. Appl..

[45]  Elizabeth F. Wanner,et al.  Optimisation of phonetic aware speech recognition through multi-objective evolutionary algorithms , 2020, Expert Syst. Appl..

[46]  Changdon Kee,et al.  Hybrid Model–Based Motion Recognition for Smartphone Users , 2014 .

[47]  Davide Anguita,et al.  A Public Domain Dataset for Human Activity Recognition using Smartphones , 2013, ESANN.

[48]  Antonello Rizzi,et al.  A cluster-based dissimilarity learning approach for localized fault classification in Smart Grids , 2018, Swarm Evol. Comput..

[49]  Lakshmish Ramaswamy,et al.  A Hierarchical Meta-Classifier for Human Activity Recognition , 2016, 2016 15th IEEE International Conference on Machine Learning and Applications (ICMLA).

[50]  Zhen Yang,et al.  Research on Construction Workers’ Activity Recognition Based on Smartphone , 2018, Sensors.

[51]  Qiang Yao,et al.  Robust online object tracking via the convex hull representation model , 2018, Neurocomputing.

[52]  Ye Zhang,et al.  A novel image compression–encryption hybrid algorithm based on the analysis sparse representation , 2017 .

[53]  Gabriella Balestra,et al.  Comparison of Different Sets of Features for Human Activity Recognition by Wearable Sensors , 2018, Sensors.

[54]  Qiang Zhang,et al.  An Online Dictionary Learning-Based Compressive Data Gathering Algorithm in Wireless Sensor Networks , 2016, Sensors.

[55]  Amir H. Behzadan,et al.  Smartphone-based construction workers' activity recognition and classification , 2016 .

[56]  Abbes Amira,et al.  Matching pursuit-based compressive sensing in a wearable biomedical accelerometer fall diagnosis device , 2017, Biomed. Signal Process. Control..

[57]  R. Amutha,et al.  Sparse representation based classification scheme for human activity recognition using smartphones , 2018, Multimedia Tools and Applications.

[58]  Anna M. Bianchi,et al.  User-Independent Recognition of Sports Activities From a Single Wrist-Worn Accelerometer: A Template-Matching-Based Approach , 2016, IEEE Transactions on Biomedical Engineering.

[59]  Xin Zhang,et al.  Learning multi-level features for sensor-based human action recognition , 2016, Pervasive Mob. Comput..

[60]  Yongkang Wong,et al.  Hierarchical multi-view aggregation network for sensor-based human activity recognition , 2019, PloS one.

[61]  R. Amutha,et al.  A novel framework for action recognition based on histogram of oriented gradients and sparsity-inducing shared dictionary , 2017, 2017 International Conference on Wireless Communications, Signal Processing and Networking (WiSPNET).

[62]  S. Baskar,et al.  Optimized unsupervised deep learning assisted reconstructed coder in the on-nodule wearable sensor for human activity recognition , 2020 .

[63]  Ling Bao,et al.  Activity Recognition from User-Annotated Acceleration Data , 2004, Pervasive.

[64]  Aditya Gupta,et al.  Transition-Aware Human Activity Recognition Using eXtreme Gradient Boosted Decision Trees , 2018 .

[65]  R. Tibshirani,et al.  REJOINDER TO "LEAST ANGLE REGRESSION" BY EFRON ET AL. , 2004, math/0406474.

[66]  Wei Huang,et al.  A data augmentation method for human action recognition using dense joint motion images , 2020 .

[67]  Davide Anguita,et al.  Transition-Aware Human Activity Recognition Using Smartphones , 2016, Neurocomputing.

[68]  Daniel Roggen,et al.  Deep Convolutional and LSTM Recurrent Neural Networks for Multimodal Wearable Activity Recognition , 2016, Sensors.

[69]  S. Kanmani,et al.  A hybrid algorithm using ant and bee colony optimization for feature selection and classification (AC-ABC Hybrid) , 2017, Swarm Evol. Comput..

[70]  Xing Chen,et al.  Human emotion recognition by optimally fusing facial expression and speech feature , 2020, Signal Process. Image Commun..

[71]  Saeed Sharifian,et al.  Modified deep residual network architecture deployed on serverless framework of IoT platform based on human activity recognition application , 2019, Future Gener. Comput. Syst..

[72]  Gary G. Yen,et al.  Particle swarm optimization of deep neural networks architectures for image classification , 2019, Swarm Evol. Comput..

[73]  Hugo Fuks,et al.  Wearable Computing: Accelerometers' Data Classification of Body Postures and Movements , 2012, SBIA.

[74]  Billur Barshan,et al.  Comparative study on classifying human activities with miniature inertial and magnetic sensors , 2010, Pattern Recognit..

[75]  Dario Pompili,et al.  Erratum to: Human motion recognition using a wireless sensor-based wearable system , 2011, Personal and Ubiquitous Computing.

[76]  Ahmad Almogren,et al.  A robust human activity recognition system using smartphone sensors and deep learning , 2018, Future Gener. Comput. Syst..

[77]  Shruthi Nagendra,et al.  Video-Based Face Recognition and Face-Tracking using Sparse Representation Based Categorization☆ , 2015 .

[78]  Richard J. Povinelli,et al.  A light weight smartphone based human activity recognition system with high accuracy , 2019, J. Netw. Comput. Appl..

[79]  D. Donoho,et al.  Atomic Decomposition by Basis Pursuit , 2001 .

[80]  Qingfu Zhang,et al.  An evolutionary multi-objective optimization framework of discretization-based feature selection for classification , 2021, Swarm Evol. Comput..

[81]  Florian Baumann,et al.  Multi-sensor Acceleration-Based Action Recognition , 2014, ICIAR.

[82]  Pawel Plawiak,et al.  Novel genetic ensembles of classifiers applied to myocardium dysfunction recognition based on ECG signals , 2017, Swarm Evol. Comput..

[83]  John Paul Varkey,et al.  Human motion recognition using a wireless sensor-based wearable system , 2012, Personal and Ubiquitous Computing.