A novel random forests based class incremental learning method for activity recognition

Abstract Automatic activity recognition is an active research topic which aims to identify human activities automatically. A significant challenge is to recognize new activities effectively. In this paper, we propose an effective class incremental learning method, named Class Incremental Random Forests (CIRF), to enable existing activity recognition models to identify new activities. We design a separating axis theorem based splitting strategy to insert internal nodes and adopt Gini index or information gain to split leaves of the decision tree in the random forests (RF). With these two strategies, both inserting new nodes and splitting leaves are allowed in the incremental learning phase. We evaluate our method on three UCI public activity datasets and compare with other state-of-the-art methods. Experimental results show that the proposed incremental learning method converges to the performance of batch learning methods (RF and extremely randomized trees). Compared with other state-of-the-art methods, it is able to recognize new class data continuously with a better performance.

[1]  Timo Sztyler,et al.  Online personalization of cross-subjects based activity recognition models on wearable devices , 2017, 2017 IEEE International Conference on Pervasive Computing and Communications (PerCom).

[2]  Hongming Zhou,et al.  Extreme Learning Machine for Regression and Multiclass Classification , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[3]  Adam Krzyżak,et al.  Methods of combining multiple classifiers and their applications to handwriting recognition , 1992, IEEE Trans. Syst. Man Cybern..

[4]  Paolo Missier,et al.  Bootstrapping Personalised Human Activity Recognition Models Using Online Active Learning , 2015, 2015 IEEE International Conference on Computer and Information Technology; Ubiquitous Computing and Communications; Dependable, Autonomic and Secure Computing; Pervasive Intelligence and Computing.

[5]  Nawid Jamali,et al.  Majority Voting: Material Classification by Tactile Sensing Using Surface Texture , 2011, IEEE Transactions on Robotics.

[6]  Chunyan Miao,et al.  A coarse-to-fine feature selection method for accurate detection of cerebral small vessel disease , 2016, 2016 International Joint Conference on Neural Networks (IJCNN).

[7]  Yiqiang Chen,et al.  Cross-People Mobile-Phone Based Activity Recognition , 2011, IJCAI.

[8]  Chih-Jen Lin,et al.  A comparison of methods for multiclass support vector machines , 2002, IEEE Trans. Neural Networks.

[9]  Nassir Navab,et al.  Recognizing multiple human activities and tracking full-body pose in unconstrained environments , 2012, Pattern Recognit..

[10]  Brian R. Gaines,et al.  Induction of ripple-down rules applied to modeling large databases , 1995, Journal of Intelligent Information Systems.

[11]  Zhijing Liu,et al.  Human Action Recognition Based on Non-linear SVM Decision Tree , 2011 .

[12]  Davide Anguita,et al.  Human Activity Recognition on Smartphones Using a Multiclass Hardware-Friendly Support Vector Machine , 2012, IWAAL.

[13]  Billur Barshan,et al.  Comparative study on classifying human activities with miniature inertial and magnetic sensors , 2010, Pattern Recognit..

[14]  Václav Hlavác,et al.  Multi-class support vector machine , 2002, Object recognition supported by user interaction for service robots.

[15]  Shuangquan Wang,et al.  b-COELM: A fast, lightweight and accurate activity recognition model for mini-wearable devices , 2014, Pervasive Mob. Comput..

[16]  Xindong Wu,et al.  Online learning with mobile sensor data for user recognition , 2014, SAC.

[17]  Stephanie J. C. Taylor,et al.  Exercise for depression in elderly residents of care homes: a cluster-randomised controlled trial , 2013, The Lancet.

[18]  Xu Sun,et al.  Large-Scale Personalized Human Activity Recognition Using Online Multitask Learning , 2013, IEEE Transactions on Knowledge and Data Engineering.

[19]  Zhi-Hua Zhou,et al.  Classification Under Streaming Emerging New Classes: A Solution Using Completely-Random Trees , 2016, IEEE Transactions on Knowledge and Data Engineering.

[20]  Misha Denil,et al.  Consistency of Online Random Forests , 2013, ICML.

[21]  Jessica K. Hodgins,et al.  Hierarchical Aligned Cluster Analysis for Temporal Clustering of Human Motion , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Chunyan Miao,et al.  Using motor patterns for stroke detection , 2015 .

[23]  James Arvo Transforming axis-aligned bounding boxes , 1990 .

[24]  Lisha Hu,et al.  Leveraging Two-Stage Weighted ELM for Multimodal Wearables Based Fall Detection , 2015 .

[25]  Alexander Keller,et al.  Instant ray tracing: the bounding interval hierarchy , 2006, EGSR '06.

[26]  Miguel A. Labrador,et al.  Centinela: A human activity recognition system based on acceleration and vital sign data , 2012, Pervasive Mob. Comput..

[27]  Billur Barshan,et al.  Human Activity Recognition Using Inertial/Magnetic Sensor Units , 2010, HBU.

[28]  Li-Chen Fu,et al.  Hybrid User-Assisted Incremental Model Adaptation for Activity Recognition in a Dynamic Smart-Home Environment , 2013, IEEE Transactions on Human-Machine Systems.

[29]  Guang-Bin Huang,et al.  Extreme learning machine: a new learning scheme of feedforward neural networks , 2004, 2004 IEEE International Joint Conference on Neural Networks (IEEE Cat. No.04CH37541).

[30]  Arcot Sowmya,et al.  Incremental learning for segmentation in medical images , 2006, 3rd IEEE International Symposium on Biomedical Imaging: Nano to Macro, 2006..

[31]  Pierre Geurts,et al.  Extremely randomized trees , 2006, Machine Learning.

[32]  R. Malor,et al.  Ripple down rules: possibilities and limitations , 2010 .

[33]  J. Ross Quinlan,et al.  Induction of Decision Trees , 1986, Machine Learning.

[34]  Yasushi Makihara,et al.  Similar gait action recognition using an inertial sensor , 2015, Pattern Recognit..

[35]  David Minnen,et al.  Recognizing Soldier Activities in the Field , 2007, BSN.

[36]  Wilhelm Stork,et al.  Context-aware mobile health monitoring: Evaluation of different pattern recognition methods for classification of physical activity , 2008, 2008 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[37]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[38]  Manfred K. Warmuth,et al.  The Weighted Majority Algorithm , 1994, Inf. Comput..

[39]  Yee Whye Teh,et al.  Mondrian Forests: Efficient Online Random Forests , 2014, NIPS.

[40]  Bala Srinivasan,et al.  Adaptive mobile activity recognition system with evolving data streams , 2015, Neurocomputing.

[41]  Miguel A. Labrador,et al.  A Survey on Human Activity Recognition using Wearable Sensors , 2013, IEEE Communications Surveys & Tutorials.

[42]  Billur Barshan,et al.  Recognizing Daily and Sports Activities in Two Open Source Machine Learning Environments Using Body-Worn Sensor Units , 2014, Comput. J..

[43]  João Gama,et al.  A survey on concept drift adaptation , 2014, ACM Comput. Surv..

[44]  Geoffrey E. Hinton,et al.  Zero-shot Learning with Semantic Output Codes , 2009, NIPS.

[45]  Zhang Jin-fu,et al.  The Effect of Physical Activity on Cognitive Function in Older Adults , 2011 .

[46]  Horst Bischof,et al.  On-line Random Forests , 2009, 2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops.

[47]  G. Toussaint Solving geometric problems with the rotating calipers , 1983 .

[48]  Hongyi Li,et al.  An Incremental Learning Method Based on Probabilistic Neural Networks and Adjustable Fuzzy Clustering for Human Activity Recognition by Using Wearable Sensors , 2012, IEEE Transactions on Information Technology in Biomedicine.

[49]  C. Randell,et al.  Context awareness by analysing accelerometer data , 2000, Digest of Papers. Fourth International Symposium on Wearable Computers.

[50]  Paul Lukowicz,et al.  Collecting complex activity datasets in highly rich networked sensor environments , 2010, 2010 Seventh International Conference on Networked Sensing Systems (INSS).

[51]  Li Ying Survey of Box-based Algorithms for Collision Detection , 2006 .

[52]  Pietro Perona,et al.  One-shot learning of object categories , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[53]  Shuangquan Wang,et al.  A Class Incremental Extreme Learning Machine for Activity Recognition , 2014, Cognitive Computation.

[54]  Montserrat Ros,et al.  Recognizing human motions through mixture modeling of inertial data , 2015, Pattern Recognit..

[55]  Paul Lukowicz,et al.  Gesture spotting with body-worn inertial sensors to detect user activities , 2008, Pattern Recognit..

[56]  Matthieu Guillaumin,et al.  Incremental Learning of Random Forests for Large-Scale Image Classification , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[57]  Meng Li,et al.  A Random Forest-based ensemble method for activity recognition , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).