Motion Primitive Forests for Human Activity Recognition Using Wearable Sensors

Human activity recognition is important in many applications such as fitness logging, pervasive healthcare, near-emergency warning, and social networking. Using body-worn sensors, these applications detect activities of the users to understand the context and provide them appropriate assistance. For accurate recognition, it is crucial to design appropriate feature representation of sensor data. In this paper, we propose a new type of motion features: motion primitive forests, which are randomized ensembles of decision trees that act on original local features by clustering them to form motion primitives (or words). The bags of these features, which accumulate histograms of the resulting motion primitives over each data frame, are then used to build activity models. We experimentally validated the effectiveness of the proposed method on accelerometer data on three benchmark datasets. On all three datasets, the proposed motion primitive forests provided substantially higher accuracy than existing state-of-the-art methods, and were much faster in both training and prediction, compared with k-means feature learning. In addition, the method showed stable results over different types of original local features, indicating the ability of random forests in selecting relevant local features.

[1]  Shie Mannor,et al.  Activity Recognition with Mobile Phones , 2011, ECML/PKDD.

[2]  Ling Bao,et al.  Activity Recognition from User-Annotated Acceleration Data , 2004, Pervasive.

[3]  Bernt Schiele,et al.  Scalable Recognition of Daily Activities with Wearable Sensors , 2007, LoCA.

[4]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[5]  Zhenyu He,et al.  Activity recognition from acceleration data based on discrete consine transform and SVM , 2009, 2009 IEEE International Conference on Systems, Man and Cybernetics.

[6]  Hassan Ghasemzadeh,et al.  Collaborative signal processing for action recognition in body sensor networks: a distributed classification algorithm using motion transcripts , 2010, IPSN '10.

[7]  Miguel A. Labrador,et al.  A Survey on Human Activity Recognition using Wearable Sensors , 2013, IEEE Communications Surveys & Tutorials.

[8]  Daniel Jackson,et al.  The french kitchen: task-based learning in an instrumented kitchen , 2012, UbiComp.

[9]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[10]  Bo Yu,et al.  Convolutional Neural Networks for human activity recognition using mobile sensors , 2014, 6th International Conference on Mobile Computing, Applications and Services.

[11]  Stephen Lindsay,et al.  The Ambient Kitchen: A Pervasive Sensing Environment for Situated Services , 2012 .

[12]  Bernt Schiele,et al.  A tutorial on human activity recognition using body-worn inertial sensors , 2014, CSUR.

[13]  Luca Benini,et al.  Activity Recognition from On-Body Sensors: Accuracy-Power Trade-Off by Dynamic Sensor Selection , 2008, EWSN.

[14]  Bernt Schiele,et al.  Discovery of activity patterns using topic models , 2008 .

[15]  Ricardo Chavarriaga,et al.  The Opportunity challenge: A benchmark database for on-body sensor-based activity recognition , 2013, Pattern Recognit. Lett..

[16]  Saso Dzeroski,et al.  Fast and efficient visual codebook construction for multi-label annotation using predictive clustering trees , 2014, Pattern Recognit. Lett..

[17]  Mi Zhang,et al.  A feature selection-based framework for human activity recognition using wearable multimodal sensors , 2011, BODYNETS.

[18]  Gary M. Weiss,et al.  Activity recognition using cell phone accelerometers , 2011, SKDD.

[19]  Frédéric Jurie,et al.  Fast Discriminative Visual Codebooks using Randomized Clustering Forests , 2006, NIPS.

[20]  Shie Mannor,et al.  Activity and Gait Recognition with Time-Delay Embeddings , 2010, AAAI.

[21]  Mi Zhang,et al.  Motion primitive-based human activity recognition using a bag-of-features approach , 2012, IHI '12.

[22]  Daniel Jackson,et al.  Rapid specification and automated generation of prompting systems to assist people with dementia , 2011, Pervasive Mob. Comput..

[23]  Roberto Cipolla,et al.  Semantic texton forests for image categorization and segmentation , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[24]  Paul Lukowicz,et al.  Collecting complex activity datasets in highly rich networked sensor environments , 2010, 2010 Seventh International Conference on Networked Sensing Systems (INSS).

[25]  Patrick Olivier,et al.  A Dynamic Time Warping Approach to Real-Time Activity Recognition for Food Preparation , 2010, AmI.

[26]  Patrick Olivier,et al.  Feature Learning for Activity Recognition in Ubiquitous Computing , 2011, IJCAI.

[27]  Weng-Keen Wong,et al.  Physical Activity Recognition from Accelerometer Data Using a Multi-Scale Ensemble Method , 2013, IAAI.