Towards a Clustering Guided Hierarchical Framework for Sensor-Based Activity Recognition

Human activity recognition plays a prominent role in numerous applications like smart homes, elderly healthcare and ambient intelligence. The complexity of human behavior leads to the difficulty of developing an accurate activity recognizer, especially in situations where different activities have similar sensor readings. Accordingly, how to measure the relationships among activities and construct an activity recognizer for better distinguishing the confusing activities remains critical. To this end, we in this study propose a clustering guided hierarchical framework to discriminate on-going human activities. Specifically, we first introduce a clustering-based activity confusion index and exploit it to automatically and quantitatively measure the confusion between activities in a data-driven way instead of relying on the prior domain knowledge. Afterwards, we design a hierarchical activity recognition framework under the guidance of the confusion relationships to reduce the recognition errors between similar activities. Finally, the simulations on the benchmark datasets are evaluated and results show the superiority of the proposed model over its competitors. In addition, we experimentally evaluate the key components of the framework comprehensively, which indicates its flexibility and stability.

[1]  Henry A. Kautz,et al.  Fine-grained activity recognition by aggregating abstract object usage , 2005, Ninth IEEE International Symposium on Wearable Computers (ISWC'05).

[2]  Tae-Seong Kim,et al.  A Triaxial Accelerometer-Based Physical-Activity Recognition via Augmented-Signal Features and a Hierarchical Recognizer , 2010, IEEE Transactions on Information Technology in Biomedicine.

[3]  Jian Lu,et al.  A hierarchical approach to real-time activity recognition in body sensor networks , 2012, Pervasive Mob. Comput..

[4]  Chris D. Nugent,et al.  A Knowledge-Driven Approach to Activity Recognition in Smart Homes , 2012, IEEE Transactions on Knowledge and Data Engineering.

[5]  Davide Anguita,et al.  A Public Domain Dataset for Human Activity Recognition using Smartphones , 2013, ESANN.

[6]  Aitor Almeida,et al.  Extending knowledge-driven activity models through data-driven learning techniques , 2015, Expert Syst. Appl..

[7]  Luming Zhang,et al.  Action2Activity: Recognizing Complex Activities from Sensor Data , 2015, IJCAI.

[8]  Chris D. Nugent,et al.  Analyzing Activity Recognition Uncertainties in Smart Home Environments , 2015, ACM Trans. Intell. Syst. Technol..

[9]  Shenghui Zhao,et al.  A Comparative Study on Human Activity Recognition Using Inertial Sensors in a Smartphone , 2016, IEEE Sensors Journal.

[10]  Sung-Bae Cho,et al.  Human activity recognition with smartphone sensors using deep learning neural networks , 2016, Expert Syst. Appl..

[11]  Daniel Roggen,et al.  Deep Convolutional and LSTM Recurrent Neural Networks for Multimodal Wearable Activity Recognition , 2016, Sensors.

[12]  Shenghui Zhao,et al.  Latent feature learning for activity recognition using simple sensors in smart homes , 2017, Multimedia Tools and Applications.

[13]  Lu Xu,et al.  Human activity recognition based on random forests , 2017, 2017 13th International Conference on Natural Computation, Fuzzy Systems and Knowledge Discovery (ICNC-FSKD).

[14]  Guilin Chen,et al.  Towards Human Activity Recognition: A Hierarchical Feature Selection Framework , 2018, Sensors.

[15]  Sang Min Yoon,et al.  Divide and Conquer-Based 1D CNN Human Activity Recognition Using Test Data Sharpening † , 2018, Sensors.

[16]  Muhammad Awais,et al.  Smart Aging System: Uncovering the Hidden Wellness Parameter for Well-Being Monitoring and Anomaly Detection , 2019, Sensors.

[17]  Rossitza Setchi,et al.  A hybrid approach of knowledge-driven and data-driven reasoning for activity recognition in smart homes , 2019, J. Intell. Fuzzy Syst..

[18]  Aiguo Wang,et al.  Evaluation of Random Forest for Complex Human Activity Recognition Using Wearable Sensors , 2020, 2020 International Conference on Networking and Network Applications (NaNA).

[19]  Fei-Fei Li,et al.  Illuminating the dark spaces of healthcare with ambient intelligence , 2020, Nature.

[20]  Shenghui Zhao,et al.  BIA: Behavior Identification Algorithm Using Unsupervised Learning Based on Sensor Data for Home Elderly , 2020, IEEE Journal of Biomedical and Health Informatics.

[21]  M. Shamim Hossain,et al.  A knowledge-driven approach for activity recognition in smart homes based on activity profiling , 2020, Future Gener. Comput. Syst..

[22]  Dinesh Kumar Vishwakarma,et al.  A deeply coupled ConvNet for human activity recognition using dynamic and RGB images , 2020, Neural Computing and Applications.

[23]  Roozbeh Jafari,et al.  Personalizing Activity Recognition Models Through Quantifying Different Types of Uncertainty Using Wearable Sensors , 2020, IEEE Transactions on Biomedical Engineering.

[24]  Lina Yao,et al.  Adversarial Multi-view Networks for Activity Recognition , 2020, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[25]  Zanobya N. Khan,et al.  Attention induced multi-head convolutional neural network for human activity recognition , 2021, Appl. Soft Comput..

[26]  Aiguo Song,et al.  Deep Neural Networks for Sensor-Based Human Activity Recognition Using Selective Kernel Convolution , 2021, IEEE Transactions on Instrumentation and Measurement.

[27]  Xiren Miao,et al.  Low-Cost and Device-Free Human Activity Recognition Based on Hierarchical Learning Model , 2021, Sensors.

[28]  Shenghui Zhao,et al.  HierHAR: Sensor-Based Data-Driven Hierarchical Human Activity Recognition , 2021, IEEE Sensors Journal.

[29]  Eduardo Souto,et al.  NOHAR - NOvelty discrete data stream for Human Activity Recognition based on smartphones with inertial sensors , 2021, Expert Syst. Appl..

[30]  Yang Liu,et al.  Semantics-Aware Adaptive Knowledge Distillation for Sensor-to-Vision Action Recognition , 2020, IEEE Transactions on Image Processing.

[31]  Olfa Jemai,et al.  Towards a deep human activity recognition approach based on video to image transformation with skeleton data , 2021, Multimedia Tools and Applications.

[32]  Syed Fahad Tahir,et al.  Activity recognition and anomaly detection in smart homes , 2021, Neurocomputing.

[33]  Thinagaran Perumal,et al.  Human Activity Recognition With Smartphone and Wearable Sensors Using Deep Learning Techniques: A Review , 2021, IEEE Sensors Journal.

[34]  Sao Mai Nguyen,et al.  A Survey of Human Activity Recognition in Smart Homes Based on IoT Sensors Algorithms: Taxonomies, Challenges, and Opportunities with Deep Learning , 2021, Sensors.

[35]  Xiaoshan Yang,et al.  Knowledge-driven Egocentric Multimodal Activity Recognition , 2020, ACM Trans. Multim. Comput. Commun. Appl..

[36]  Chih-Yung Chang,et al.  Activities of Daily Living Recognition With Binary Environment Sensors Using Deep Learning: A Comparative Study , 2021, IEEE Sensors Journal.

[37]  Diane J. Cook,et al.  Indirectly Supervised Anomaly Detection of Clinically Meaningful Health Events from Smart Home Data , 2021, ACM Trans. Intell. Syst. Technol..

[38]  Huanlai Xing,et al.  A federated learning system with enhanced feature extraction for human activity recognition , 2021, Knowl. Based Syst..