Efficacy of Imbalanced Data Handling Methods on Deep Learning for Smart Homes Environments

Human activity recognition as an engineering tool as well as an active research field has become fundamental to many applications in various fields such as health care, smart home monitoring and surveillance. However, delivering sufficiently robust activity recognition systems from sensor data recorded in a smart home setting is a challenging task. Moreover, human activity datasets are typically highly imbalanced because generally certain activities occur more frequently than others. Consequently, it is challenging to train classifiers from imbalanced human activity datasets. Deep learning algorithms perform well on balanced datasets, yet their performance cannot be promised on imbalanced datasets. Therefore, we aim to address the problem of class imbalance in deep learning for smart home data. We assess it with Activities of Daily Living recognition using binary sensors dataset. This paper proposes a data level perspective combined with a temporal window technique to handle imbalanced human activities from smart homes in order to make the learning algorithms more sensitive to the minority class. The experimental results indicate that handling imbalanced human activities from the data-level outperforms algorithms level and improved the classification performance.

[1]  Chris D. Nugent,et al.  Real-time Recognition of Interleaved Activities Based on Ensemble Classifier of Long Short-Term Memory with Fuzzy Temporal Windows , 2018, UCAmI.

[2]  Zhen Liu,et al.  Studying cost-sensitive learning for multi-class imbalance in Internet traffic classification , 2012 .

[3]  Chen Huang,et al.  Learning Deep Representation for Imbalanced Classification , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[4]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[5]  Diane J. Cook,et al.  Using smart phones for context-aware prompting in smart environments , 2012, 2012 IEEE Consumer Communications and Networking Conference (CCNC).

[6]  Héctor Pomares,et al.  Window Size Impact in Human Activity Recognition , 2014, Sensors.

[7]  Matthieu Geist,et al.  Convolutional and Recurrent Neural Networks for Activity Recognition in Smart Environment , 2015, BIRS-IMLKE.

[8]  Ahmad Lotfi,et al.  A Consensus Novelty Detection Ensemble Approach for Anomaly Detection in Activities of Daily Living , 2019, Appl. Soft Comput..

[9]  Francisco Herrera,et al.  A Review on Ensembles for the Class Imbalance Problem: Bagging-, Boosting-, and Hybrid-Based Approaches , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[10]  Araceli Sanchis,et al.  Activity Recognition Using Hybrid Generative/Discriminative Models on Home Environments Using Binary Sensors , 2013, Sensors.

[11]  Young-Koo Lee,et al.  Analysis and effects of smart home dataset characteristics for daily life activity recognition , 2013, The Journal of Supercomputing.

[12]  Mohamed-Rafik Bouguelia,et al.  Efficient Activity Recognition in Smart Homes Using Delayed Fuzzy Temporal Windows on Binary Sensors , 2020, IEEE Journal of Biomedical and Health Informatics.

[13]  Jae-Young Pyun,et al.  Deep Recurrent Neural Networks for Human Activity Recognition , 2017, Sensors.

[14]  Jens Lundström,et al.  Stability Analysis of the t-SNE Algorithm for Human Activity Pattern Data , 2018, 2018 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[15]  Nitesh V. Chawla,et al.  SMOTE: Synthetic Minority Over-sampling Technique , 2002, J. Artif. Intell. Res..

[16]  Josef Hallberg,et al.  A new approach based on temporal sub-windows for online sensor-based activity recognition , 2018, J. Ambient Intell. Humaniz. Comput..

[17]  Mohammed Bennamoun,et al.  Cost-Sensitive Learning of Deep Feature Representations From Imbalanced Data , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[18]  Gernot A. Fink,et al.  Convolutional Neural Networks for Human Activity Recognition Using Body-Worn Sensors , 2018, Informatics.

[19]  Yang Wang,et al.  Cost-sensitive boosting for classification of imbalanced data , 2007, Pattern Recognit..

[20]  Xiaoli Li,et al.  Deep Convolutional Neural Networks on Multichannel Time Series for Human Activity Recognition , 2015, IJCAI.

[21]  Qing Zhang,et al.  Fall detection in smart home environments using UWB sensors and unsupervised change detection , 2018, Journal of Reliable Intelligent Environments.

[22]  Gwenn Englebienne,et al.  An activity monitoring system for elderly care using generative and discriminative models , 2010, Personal and Ubiquitous Computing.

[23]  Ying Wah Teh,et al.  Deep learning algorithms for human activity recognition using mobile and wearable sensor networks: State of the art and research challenges , 2018, Expert Syst. Appl..

[24]  Taghi M. Khoshgoftaar,et al.  Survey on deep learning with class imbalance , 2019, J. Big Data.

[25]  François Portet,et al.  Dealing with Imbalanced Data Sets for Human Activity Recognition Using Mobile Phone Sensors , 2018, Intelligent Environments.

[26]  R. Rodrigo,et al.  Faster human activity recognition with SVM , 2012, International Conference on Advances in ICT for Emerging Regions (ICTer2012).

[27]  Xiaohui Peng,et al.  Deep Learning for Sensor-based Activity Recognition: A Survey , 2017, Pattern Recognit. Lett..

[28]  Jeffrey Xu Yu,et al.  A Balanced Ensemble Approach to Weighting Classifiers for Text Classification , 2006, Sixth International Conference on Data Mining (ICDM'06).

[29]  Kimiaki Shirahama,et al.  Comparison of Feature Learning Methods for Human Activity Recognition Using Wearable Sensors , 2018, Sensors.

[30]  Bernt Schiele,et al.  ADL recognition based on the combination of RFID and accelerometer sensing , 2008, Pervasive 2008.

[31]  Miguel A. Labrador,et al.  A Survey on Human Activity Recognition using Wearable Sensors , 2013, IEEE Communications Surveys & Tutorials.

[32]  Peng Wang,et al.  An Adaptive Multi-Sensor Data Fusion Method Based on Deep Convolutional Neural Networks for Fault Diagnosis of Planetary Gearbox , 2017, Sensors.

[33]  Sung-Bong Yang,et al.  Deep neural networks for activity recognition with multi-sensor data in a smart home , 2018, 2018 IEEE 4th World Forum on Internet of Things (WF-IoT).

[34]  Nawel Yala,et al.  Feature extraction for human activity recognition on streaming data , 2015, 2015 International Symposium on Innovations in Intelligent SysTems and Applications (INISTA).

[35]  Nathalie Japkowicz,et al.  The class imbalance problem: A systematic study , 2002, Intell. Data Anal..

[36]  Kent Larson,et al.  Activity Recognition in the Home Using Simple and Ubiquitous Sensors , 2004, Pervasive.

[37]  Athanasios V. Vasilakos,et al.  GCHAR: An efficient Group-based Context - aware human activity recognition on smartphone , 2017, J. Parallel Distributed Comput..

[38]  Chris D. Nugent,et al.  Ensemble classifier of long short-term memory with fuzzy temporal windows on binary sensors for activity recognition , 2018, Expert Syst. Appl..

[39]  Jascha Sohl-Dickstein,et al.  Capacity and Trainability in Recurrent Neural Networks , 2016, ICLR.

[40]  Qiong Wu,et al.  AI empowered context-aware smart system for medication adherence , 2017 .

[41]  Zhi-Hua Zhou,et al.  ON MULTI‐CLASS COST‐SENSITIVE LEARNING , 2006, Comput. Intell..