A Novel Feature Incremental Learning Method for Sensor-Based Activity Recognition

Recognizing activities of daily living is an important research topic for health monitoring and elderly care. However, most existing activity recognition models only work with static and pre-defined sensor configurations. Enabling an existing activity recognition model to adapt to the emergence of new sensors in a dynamic environment is a significant challenge. In this paper, we propose a novel feature incremental learning method, namely the Feature Incremental Random Forest (FIRF), to improve the performance of an existing model with a small amount of data on newly appeared features. It consists of two important components – 1) a mutual information based diversity generation strategy (MIDGS) and 2) a feature incremental tree growing mechanism (FITGM). MIDGS enhances the internal diversity of random forests, while FITGM improves the accuracy of individual decision trees. To evaluate the performance of FIRF, we conduct extensive experiments on three well-known public datasets for activity recognition. Experimental results demonstrate that FIRF is significantly more accurate and efficient compared with other state-of-the-art methods. It has the potential to allow the dynamic exploitation of new sensors in changing environments.

[1]  Yiqiang Chen,et al.  Cross-People Mobile-Phone Based Activity Recognition , 2011, IJCAI.

[2]  Timo Sztyler,et al.  On-body localization of wearable devices: An investigation of position-aware activity recognition , 2016, 2016 IEEE International Conference on Pervasive Computing and Communications (PerCom).

[3]  Davide Anguita,et al.  Human Activity Recognition on Smartphones Using a Multiclass Hardware-Friendly Support Vector Machine , 2012, IWAAL.

[4]  Billur Barshan,et al.  Comparative study on classifying human activities with miniature inertial and magnetic sensors , 2010, Pattern Recognit..

[5]  G. H. Jacobs,et al.  Response to Comment on "Emergence of Novel Color Vision in Mice Engineered to Express a Human Cone Photopigment" , 2007, Science.

[6]  Yutaka Matsuo,et al.  Privacy Issues Regarding the Application of DNNs to Activity-Recognition using Wearables and Its Countermeasures by Use of Adversarial Training , 2017, IJCAI.

[7]  Steven C. H. Hoi,et al.  OTL: A Framework of Online Transfer Learning , 2010, ICML.

[8]  Paul Lukowicz,et al.  Label Propagation , 2017, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[9]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[10]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[11]  Chenping Hou,et al.  One-Pass Learning with Incremental and Decremental Features , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Zhi-Hua Zhou,et al.  Ensemble Methods: Foundations and Algorithms , 2012 .

[13]  Billur Barshan,et al.  Recognizing Daily and Sports Activities in Two Open Source Machine Learning Environments Using Body-Worn Sensor Units , 2014, Comput. J..

[14]  Diane J. Cook,et al.  Transfer learning for activity recognition: a survey , 2013, Knowledge and Information Systems.

[15]  Craig A. Knoblock,et al.  Learning with Previously Unseen Features , 2017, IJCAI.

[16]  Chunyan Miao,et al.  An Agent-Based Game Platform for Exercising People's Prospective Memory , 2015, 2015 IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology (WI-IAT).

[17]  Anders Krogh,et al.  Neural Network Ensembles, Cross Validation, and Active Learning , 1994, NIPS.

[18]  陈振宇,et al.  Feature Adaptive Online Sequential Extreme Learning Machine for lifelong indoor localization , 2014 .

[19]  Pierre Geurts,et al.  Extremely randomized trees , 2006, Machine Learning.

[20]  Chunyan Miao,et al.  A coarse-to-fine feature selection method for accurate detection of cerebral small vessel disease , 2016, 2016 International Joint Conference on Neural Networks (IJCNN).

[21]  Diane J. Cook,et al.  Collegial activity learning between heterogeneous sensors , 2017, Knowledge and Information Systems.

[22]  Misha Denil,et al.  Consistency of Online Random Forests , 2013, ICML.

[23]  Manfred K. Warmuth,et al.  The weighted majority algorithm , 1989, 30th Annual Symposium on Foundations of Computer Science.

[24]  Václav Hlavác,et al.  Multi-class support vector machine , 2002, Object recognition supported by user interaction for service robots.

[25]  Chunyan Miao,et al.  Inferring Cognitive Wellness from Motor Patterns , 2018, IEEE Transactions on Knowledge and Data Engineering.

[26]  Qiang Yang,et al.  Cross-domain activity recognition , 2009, UbiComp.

[27]  C. Randell,et al.  Context awareness by analysing accelerometer data , 2000, Digest of Papers. Fourth International Symposium on Wearable Computers.

[28]  A. Hofman,et al.  Cognition and gait show a distinct pattern of association in the general population , 2014, Alzheimer's & Dementia.

[29]  Matthieu Guillaumin,et al.  Incremental Learning of Random Forests for Large-Scale Image Classification , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  Timo Sztyler,et al.  Online personalization of cross-subjects based activity recognition models on wearable devices , 2017, 2017 IEEE International Conference on Pervasive Computing and Communications (PerCom).

[31]  Thomas Plötz,et al.  Deep, Convolutional, and Recurrent Models for Human Activity Recognition Using Wearables , 2016, IJCAI.

[32]  Adam Krzyżak,et al.  Methods of combining multiple classifiers and their applications to handwriting recognition , 1992, IEEE Trans. Syst. Man Cybern..

[33]  Xiaohui Peng,et al.  A novel random forests based class incremental learning method for activity recognition , 2018, Pattern Recognit..

[34]  Yee Whye Teh,et al.  Mondrian Forests: Efficient Online Random Forests , 2014, NIPS.

[35]  Chih-Jen Lin,et al.  A comparison of methods for multiclass support vector machines , 2002, IEEE Trans. Neural Networks.

[36]  Tobias Alexander Große-Puppendahl,et al.  Enhancing Accelerometer-Based Activity Recognition with Capacitive Proximity Sensing , 2012, AmI.

[37]  Didier Stricker,et al.  Introducing a New Benchmarked Dataset for Activity Monitoring , 2012, 2012 16th International Symposium on Wearable Computers.

[38]  Gail A. Carpenter,et al.  Self-supervised ARTMAP , 2010, Neural Networks.

[39]  Shen Furao,et al.  Perception Evolution Network Adapting to the Emergence of New Sensory Receptor , 2015, IJCAI.

[40]  Zhiquan Wang,et al.  Recognition of human activities using SVM multi-class classifier , 2010, Pattern Recognit. Lett..

[41]  J. Ross Quinlan,et al.  Induction of Decision Trees , 1986, Machine Learning.

[42]  Wilhelm Stork,et al.  Context-aware mobile health monitoring: Evaluation of different pattern recognition methods for classification of physical activity , 2008, 2008 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[43]  Paul Lukowicz,et al.  Automatic Adaptation of Mobile Activity Recognition Systems to New Sensors , 2011 .

[44]  Nuno Vasconcelos,et al.  Complex Activity Recognition Via Attribute Dynamics , 2017, International Journal of Computer Vision.

[45]  Kai Tang,et al.  Kernel fusion based extreme learning machine for cross-location activity recognition , 2017, Inf. Fusion.

[46]  Nasser Kehtarnavaz,et al.  Improving Human Action Recognition Using Fusion of Depth Camera and Inertial Sensors , 2015, IEEE Transactions on Human-Machine Systems.

[47]  Ling Chen,et al.  Wearable sensor based multimodal human activity recognition exploiting the diversity of classifier ensemble , 2016, UbiComp.

[48]  Diane J. Cook,et al.  Transfer Learning across Feature-Rich Heterogeneous Feature Spaces via Feature-Space Remapping (FSR) , 2015, ACM Trans. Intell. Syst. Technol..

[49]  Nawid Jamali,et al.  Majority Voting: Material Classification by Tactile Sensing Using Surface Texture , 2011, IEEE Transactions on Robotics.

[50]  Zhijing Liu,et al.  Human Action Recognition Based on Non-linear SVM Decision Tree , 2011 .

[51]  Lina Yao,et al.  Learning from less for better: semi-supervised activity recognition via shared structure discovery , 2016, UbiComp.

[52]  Shuangquan Wang,et al.  b-COELM: A fast, lightweight and accurate activity recognition model for mini-wearable devices , 2014, Pervasive Mob. Comput..

[53]  Hassab Elgawi Osman,et al.  Online random forests based on CorrFS and CorrBE , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[54]  Thomas Phan,et al.  Improving activity recognition via automatic decision tree pruning , 2014, UbiComp Adjunct.

[55]  Horst Bischof,et al.  On-line Random Forests , 2009, 2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops.

[56]  Leo Breiman,et al.  Classification and Regression Trees , 1984 .

[57]  Lisha Hu,et al.  OKRELM: online kernelized and regularized extreme learning machine for wearable-based activity recognition , 2018, Int. J. Mach. Learn. Cybern..

[58]  Gilles Louppe,et al.  Understanding Random Forests: From Theory to Practice , 2014, 1407.7502.

[59]  Shuangquan Wang,et al.  A Class Incremental Extreme Learning Machine for Activity Recognition , 2014, Cognitive Computation.

[60]  L. Cooper,et al.  When Networks Disagree: Ensemble Methods for Hybrid Neural Networks , 1992 .