Automatic Classification Error Detection and Correction for Robust Human Activity Recognition

One of the main objectives of Ambient Assisted Living (AAL) systems is to proactively provide intelligent services to improve the quality of people's lives in terms of autonomy, safety, and well-being. Designing AAL systems that can autonomously monitor human's activities and provide assistance services poses several challenges of which Human Activity Recognition (HAR) which is critically important to adapt the assistance services to the user. In this letter, a robust multi-label HAR framework is proposed. The proposed framework is composed of two main modules: (i) activity classification module and (ii) classification error detection and correction module. In the first module, machine-learning models are used to predict human activities. Since these models may produce predictions with errors, there is a requirement to detect and correct these errors. The classification error detection and correction module is based on two acyclic directed graphical models and operates in two phases: (i) classification error detection and (ii) classification error correction. The proposed framework is evaluated on the Opportunity dataset, a benchmark and a unique dataset for multi-label human daily living activity recognition. The obtained results demonstrate the ability of the proposed framework to improve the performances of HAR.

[1]  Gary M. Weiss,et al.  Activity recognition using cell phone accelerometers , 2011, SKDD.

[2]  Jason Weston,et al.  A kernel method for multi-labelled classification , 2001, NIPS.

[3]  Didier Stricker,et al.  Introducing a New Benchmarked Dataset for Activity Monitoring , 2012, 2012 16th International Symposium on Wearable Computers.

[4]  Jit Biswas,et al.  Uncertainty handling in semantic reasoning for accurate context understanding , 2015, Knowl. Based Syst..

[5]  Héctor Pomares,et al.  mHealthDroid: A Novel Framework for Agile Development of Mobile Health Applications , 2014, IWAAL.

[6]  Eliasz Kantoch,et al.  Human activity recognition for physical rehabilitation using wearable sensors fusion and artificial neural networks , 2017, 2017 Computing in Cardiology (CinC).

[7]  Ramón F. Brena,et al.  Multi-view stacking for activity recognition with sound and accelerometer data , 2018, Inf. Fusion.

[8]  Abdelghani Chibani,et al.  Hybrid Approach for Human Activity Recognition by Ubiquitous Robots , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[9]  Nasser Kehtarnavaz,et al.  UTD-MHAD: A multimodal dataset for human action recognition utilizing a depth camera and a wearable inertial sensor , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[10]  Ying Wah Teh,et al.  Deep learning algorithms for human activity recognition using mobile and wearable sensor networks: State of the art and research challenges , 2018, Expert Syst. Appl..

[11]  Eyke Hüllermeier,et al.  Multilabel classification via calibrated label ranking , 2008, Machine Learning.

[12]  Zhiwei Ji,et al.  A Review of Parameter Learning Methods in Bayesian Network , 2015, ICIC.

[13]  Mahmood Fathy,et al.  Multi-label Discriminative Weakly-Supervised Human Activity Recognition and Localization , 2014, ACCV.

[14]  Adil Mehmood Khan,et al.  Multi-label Class-imbalanced Action Recognition in Hockey Videos via 3D Convolutional Neural Networks , 2017, 2018 19th IEEE/ACIS International Conference on Software Engineering, Artificial Intelligence, Networking and Parallel/Distributed Computing (SNPD).

[15]  Hamid R. Zarandi,et al.  A Cluster-Based Method to Detect and Correct Anomalies in Sensor Data of Embedded Systems , 2016, 2016 24th Euromicro International Conference on Parallel, Distributed, and Network-Based Processing (PDP).

[16]  Yu Zhao,et al.  Deep Residual Bidir-LSTM for Human Activity Recognition Using Wearable Sensors , 2017, Mathematical Problems in Engineering.

[17]  Yuhong Guo,et al.  Proceedings of the Twenty-Second International Joint Conference on Artificial Intelligence Multi-Label Classification Using Conditional Dependency Networks , 2022 .

[18]  Hamid R. Zarandi,et al.  Two effective anomaly correction methods in embedded systems , 2015, 2015 CSI Symposium on Real-Time and Embedded Systems and Technologies (RTEST).

[19]  Hongnian Yu,et al.  A survey on wearable sensor modality centred human activity recognition in health care , 2019, Expert Syst. Appl..

[20]  Mi Zhang,et al.  USC-HAD: a daily activity dataset for ubiquitous activity recognition using wearable sensors , 2012, UbiComp.

[21]  Kimiaki Shirahama,et al.  Comparison of Feature Learning Methods for Human Activity Recognition Using Wearable Sensors , 2018, Sensors.

[22]  Lei Huang,et al.  How to record the amount of exercise automatically? A general real-time recognition and counting approach for repetitive activities , 2016, 2016 IEEE International Conference on Bioinformatics and Biomedicine (BIBM).

[23]  Faicel Chamroukhi,et al.  Physical Human Activity Recognition Using Wearable Sensors , 2015, Sensors.

[24]  Ricardo Chavarriaga,et al.  The Opportunity challenge: A benchmark database for on-body sensor-based activity recognition , 2013, Pattern Recognit. Lett..

[25]  Gregory F. Cooper,et al.  A Bayesian method for the induction of probabilistic networks from data , 1992, Machine Learning.

[26]  Zhi-Hua Zhou,et al.  ML-KNN: A lazy learning approach to multi-label learning , 2007, Pattern Recognit..

[27]  Anind K. Dey,et al.  Understanding and Using Context , 2001, Personal and Ubiquitous Computing.

[28]  Ricardo Chavarriaga,et al.  Benchmarking classification techniques using the Opportunity human activity dataset , 2011, 2011 IEEE International Conference on Systems, Man, and Cybernetics.

[29]  Min-Ling Zhang,et al.  A Review on Multi-Label Learning Algorithms , 2014, IEEE Transactions on Knowledge and Data Engineering.

[30]  Qingming Huang,et al.  Improving multi-label classification with missing labels by learning label-specific features , 2019, Inf. Sci..

[31]  Jiebo Luo,et al.  Learning multi-label scene classification , 2004, Pattern Recognit..

[32]  Gang Chen,et al.  Multi-label Learning by Exploiting Label Correlations with LDA , 2017, 2017 IEEE 29th International Conference on Tools with Artificial Intelligence (ICTAI).

[33]  Grigorios Tsoumakas,et al.  Random k -Labelsets: An Ensemble Method for Multilabel Classification , 2007, ECML.

[34]  Fulvio Mastrogiovanni,et al.  A public domain dataset for ADL recognition using wrist-placed accelerometers , 2014, The 23rd IEEE International Symposium on Robot and Human Interactive Communication.

[35]  Geoff Holmes,et al.  Classifier chains for multi-label classification , 2009, Machine Learning.