A*HAR: A New Benchmark towards Semi-supervised learning for Class-imbalanced Human Activity Recognition

Despite the vast literature on Human Activity Recognition (HAR) with wearable inertial sensor data, it is perhaps surprising that there are few studies investigating semisupervised learning for HAR, particularly in a challenging scenario with class imbalance problem. In this work, we present a new benchmark, called A*HAR, towards semisupervised learning for class-imbalanced HAR. We evaluate state-of-the-art semi-supervised learning method on A*HAR, by combining Mean Teacher and Convolutional Neural Network. Interestingly, we find that Mean Teacher boosts the overall performance when training the classifier with fewer labeled samples and large amount of unlabeled samples, but the classifier falls short in handling unbalanced activities. These findings lead to an interesting open problem, i.e., development of semi-supervised HAR algorithms that are class-imbalance aware without any prior knowledge on the class distribution for unlabeled samples. The dataset and benchmark evaluation are released at https: //github.com/I2RDL2/ASTAR-HAR for future research.

[1]  Siti Mariyam Shamsuddin,et al.  Classification with class imbalance problem: A review , 2015, SOCO 2015.

[2]  Miguel A. Labrador,et al.  Survey on Fall Detection and Fall Prevention Using Wearable and External Sensors , 2014, Sensors.

[3]  Timo Aila,et al.  Temporal Ensembling for Semi-Supervised Learning , 2016, ICLR.

[4]  Lina Yao,et al.  A Semisupervised Recurrent Convolutional Attention Model for Human Activity Recognition , 2020, IEEE Transactions on Neural Networks and Learning Systems.

[5]  Ming Zeng,et al.  Semi-supervised convolutional neural networks for human activity recognition , 2017, 2017 IEEE International Conference on Big Data (Big Data).

[6]  Ling Chen,et al.  Bi-View Semi-Supervised Learning Based Semantic Human Activity Recognition Using Accelerometers , 2018, IEEE Transactions on Mobile Computing.

[7]  Zhenghua Chen,et al.  A Novel Semisupervised Deep Learning Method for Human Activity Recognition , 2019, IEEE Transactions on Industrial Informatics.

[8]  Tapani Raiko,et al.  Semi-supervised Learning with Ladder Networks , 2015, NIPS.

[9]  Bernt Schiele,et al.  Daily Routine Recognition through Activity Spotting , 2009, LoCA.

[10]  Chris D. Nugent,et al.  Multimodal Sensor Data Fusion for Activity Recognition Using Filtered Classifier , 2018, UCAmI.

[11]  Davide Anguita,et al.  A Public Domain Dataset for Human Activity Recognition using Smartphones , 2013, ESANN.

[12]  Paul Lukowicz,et al.  Opportunistic human activity and context recognition , 2013, Computer.

[13]  Didier Stricker,et al.  Introducing a New Benchmarked Dataset for Activity Monitoring , 2012, 2012 16th International Symposium on Wearable Computers.

[14]  Doruk Coskun,et al.  On-line Context Aware Physical Activity Recognition from the Accelerometer and Audio Sensors of Smartphones , 2014, AmI.

[15]  Bernt Schiele,et al.  A tutorial on human activity recognition using body-worn inertial sensors , 2014, CSUR.

[16]  Xiaohui Peng,et al.  Deep Learning for Sensor-based Activity Recognition: A Survey , 2017, Pattern Recognit. Lett..

[17]  Harri Valpola,et al.  Weight-averaged consistency targets improve semi-supervised deep learning results , 2017, ArXiv.