A detailed human activity transition recognition framework for grossly labeled data from smartphone accelerometer

Smartphone based human activity monitoring and recognition play an important role in several medical applications, such as eldercare, diabetic patient monitoring, post-trauma recovery after surgery. However, it is more important to recognize the activity sequences in terms of transitions. In this work, we have designed a detailed activity transition recognition framework that can identify a set of activity transitions and their sequence for a time window. This enables us to extract more meaningful insight about the subject’s physical and behavioral context. However, precise labeling of training data for detailed activity transitions at every time instance is required for this purpose. But, due to non uniformity of individual gait, the labeling tends to be error prone. Accordingly, our contribution in this work is to formulate the activity transition detection problem as a multiple instance learning problem to deal with imprecise labeling of data. The proposed human activity transition recognition framework forms an ensemble model based on different MIML-kNN distance metrics. The ensemble model helps to find both the activity sequence as well as multiple activity transition. The framework is implemented for a real dataset collected from 8 users. It is found to be working adequately (average precision 0.94).

[1]  Jieping Ye,et al.  Drosophila Gene Expression Pattern Annotation through Multi-Instance Multi-Label Learning , 2009, IEEE/ACM Transactions on Computational Biology and Bioinformatics.

[2]  Laith Mohammad Abualigah,et al.  Feature Selection and Enhanced Krill Herd Algorithm for Text Document Clustering , 2018, Studies in Computational Intelligence.

[3]  Tim Dallas,et al.  Feature Selection and Activity Recognition System Using a Single Triaxial Accelerometer , 2014, IEEE Transactions on Biomedical Engineering.

[4]  Ming Li,et al.  Dual-source discrimination power analysis for multi-instance contactless palmprint recognition , 2015, Multimedia Tools and Applications.

[5]  Duc A. Tran,et al.  The 11th International Conference on Mobile Systems and Pervasive Computing (MobiSPC-2014) A Study on Human Activity Recognition Using Accelerometer Data from Smartphones , 2014 .

[6]  Muhammad Khurram Khan,et al.  Two-Directional Two-Dimensional Random Projection and Its Variations for Face and Palmprint Recognition , 2011, ICCSA.

[7]  Sanghamitra Bandyopadhyay,et al.  A fuzzy citation-kNN algorithm for multiple instance learning , 2015, 2015 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE).

[8]  Andrew Beng Jin Teoh,et al.  Conjugate 2DPalmHash code for secure palm-print-vein verification , 2013, 2013 6th International Congress on Image and Signal Processing (CISP).

[9]  Reza Malekian,et al.  Physical Activity Recognition From Smartphone Accelerometer Data for User Context Awareness Sensing , 2017, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[10]  Naonori Ueda,et al.  Training human activity recognition for labels with inaccurate time stamps , 2014, UbiComp Adjunct.

[11]  Jayita Saha,et al.  Two phase ensemble classifier for smartphone based human activity recognition independent of hardware configuration and usage behaviour , 2018, Microsystem Technologies.

[12]  Ümit Y. Ogras,et al.  Online Human Activity Recognition using Low-Power Wearable Devices , 2018, 2018 IEEE/ACM International Conference on Computer-Aided Design (ICCAD).

[13]  Ling Chen,et al.  Hierarchical Complex Activity Representation and Recognition Using Topic Model and Classifier Level Fusion. , 2017, IEEE transactions on bio-medical engineering.

[14]  Daphna Weinshall,et al.  Classification with Nonmetric Distances: Image Retrieval and Class Representation , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Lu Leng,et al.  Two-dimensional cancelable biometric scheme , 2012, 2012 International Conference on Wavelet Analysis and Pattern Recognition.

[16]  Xiaojie Wu,et al.  Hierarchical Complex Activity Representation and Recognition Using Topic Model and Classifier Level Fusion , 2017, IEEE Transactions on Biomedical Engineering.

[17]  Diane J. Cook,et al.  Ambient and smartphone sensor assisted ADL recognition in multi-inhabitant smart environments , 2016, J. Ambient Intell. Humaniz. Comput..

[18]  Lei Wang,et al.  Analysis of filtering methods for 3D acceleration signals in body sensor network , 2011, International Symposium on Bioelectronics and Bioinformations 2011.

[19]  Laith Mohammad Abualigah,et al.  A new feature selection method to improve the document clustering using particle swarm optimization algorithm , 2017, J. Comput. Sci..

[20]  Jayita Saha,et al.  Novel features for intensive human activity recognition based on wearable and smartphone sensors , 2020 .

[21]  Jayita Saha,et al.  Detailed Activity Recognition with Smartphones , 2018, 2018 Fifth International Conference on Emerging Applications of Information Technology (EAIT).

[22]  Weng-Keen Wong,et al.  Efficient Multi-Instance Learning for Activity Recognition from Time Series Data Using an Auto-Regressive Hidden Markov Model , 2016, ICML.

[23]  S. Dinakaran,et al.  Role of Attribute Selection in Classification Algorithms , 2013 .

[24]  Jun Zhong,et al.  Towards unsupervised physical activity recognition using smartphone accelerometers , 2016, Multimedia Tools and Applications.

[25]  Jun Wang,et al.  Solving the Multiple-Instance Problem: A Lazy Learning Approach , 2000, ICML.

[26]  Jayita Saha,et al.  An Ensemble of Condition Based Classifiers for Device Independent Detailed Human Activity Recognition Using Smartphones † , 2018, Inf..

[27]  Muhammad Khurram Khan,et al.  Dynamic weighted discrimination power analysis: A novel approach for face and palmprint recognition in DCT domain , 2010 .

[28]  Min-Ling Zhang,et al.  A k-Nearest Neighbor Based Multi-Instance Multi-Label Learning Algorithm , 2010, 2010 22nd IEEE International Conference on Tools with Artificial Intelligence.

[29]  Laith Mohammad Abualigah,et al.  Unsupervised text feature selection technique based on hybrid particle swarm optimization algorithm with genetic operators for the text clustering , 2017, The Journal of Supercomputing.

[30]  Alessio Vecchio,et al.  Posture Recognition Using the Interdistances Between Wearable Devices , 2017, IEEE Sensors Letters.

[31]  Davide Anguita,et al.  Transition-Aware Human Activity Recognition Using Smartphones , 2016, Neurocomputing.

[32]  Lu Leng,et al.  PalmHash Code vs. PalmPhasor Code , 2013, Neurocomputing.

[33]  Laith Mohammad Abualigah,et al.  APPLYING GENETIC ALGORITHMS TO INFORMATION RETRIEVAL USING VECTOR SPACE MODEL , 2015 .