Feature matching and instance reweighting with transfer learning for human activity recognition using smartphone

Human activity recognition using smartphone has been attracting great interest. Since collecting large amount of labeled data is expensive and time-consuming for conventional machine learning techniques, transfer learning techniques have been proposed for activity recognition. However, existing transfer learning techniques typically rely on feature matching based on global domain shift and lack considering the intra-class knowledge transfer. In this paper, a novel transfer learning technique is proposed for cross-domain activity recognition, which can properly integrate feature matching and instance reweighting across the source and target domain in principled dimensionality reduction. The experiments using three real datasets demonstrate that the proposed scheme can achieve much higher precision (92%), recall (91%), and F1-score (92%), in comparison with the existing schemes.

[1]  Jianhua Ma,et al.  ActiRecognizer: Design and Implementation of a Real-Time Human Activity Recognition System , 2017, 2017 International Conference on Cyber-Enabled Distributed Computing and Knowledge Discovery (CyberC).

[2]  Lorenzo Bruzzone,et al.  Domain Adaptation Problems: A DASVM Classification Technique and a Circular Validation Strategy , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Liezel Cilliers,et al.  Mobile and wearable technologies in healthcare for the ageing population , 2018, Comput. Methods Programs Biomed..

[4]  Md. Rashedul Islam,et al.  Enhanced Human Activity Recognition Based on Smartphone Sensor Data Using Hybrid Feature Selection Model , 2020, Sensors.

[5]  Philip S. Yu,et al.  Transfer Feature Learning with Joint Distribution Adaptation , 2013, 2013 IEEE International Conference on Computer Vision.

[6]  Luc Van Gool,et al.  Transferring activities: Updating human behavior analysis , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).

[7]  Philip S. Yu,et al.  Transfer Joint Matching for Unsupervised Domain Adaptation , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[8]  Bernhard Schölkopf,et al.  A Kernel Two-Sample Test , 2012, J. Mach. Learn. Res..

[9]  Qiang Yang,et al.  Cross-domain activity recognition , 2009, UbiComp.

[10]  Mihir Jain,et al.  Fall classification based on sensor data from smartphone and smartwatch , 2019 .

[11]  Reza Malekian,et al.  Fall detection using machine learning algorithms , 2016, 2016 24th International Conference on Software, Telecommunications and Computer Networks (SoftCOM).

[12]  Ivor W. Tsang,et al.  Domain Adaptation via Transfer Component Analysis , 2009, IEEE Transactions on Neural Networks.

[13]  Fernando De la Torre,et al.  Selective Transfer Machine for Personalized Facial Action Unit Detection , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[14]  Zhaohui Wang,et al.  An overview of human activity recognition based on smartphone , 2019, Sensor Review.

[15]  Yoav Freund,et al.  A decision-theoretic generalization of on-line learning and an application to boosting , 1997, EuroCOLT.

[16]  Yiqiang Chen,et al.  Cross-People Mobile-Phone Based Activity Recognition , 2011, IJCAI.

[17]  Yiqiang Chen,et al.  Balanced Distribution Adaptation for Transfer Learning , 2017, 2017 IEEE International Conference on Data Mining (ICDM).

[18]  Hee Yong Youn,et al.  Detection of Falls with Smartphone Using Machine Learning Technique , 2019, 2019 8th International Congress on Advanced Applied Informatics (IIAI-AAI).

[19]  Paul Helling,et al.  Evaluate action primitives for human activity recognition using unsupervised learning approach , 2017, 2017 12th International Conference for Internet Technology and Secured Transactions (ICITST).

[20]  Nirmalya Roy,et al.  TransAct: Transfer learning enabled activity recognition , 2017, 2017 IEEE International Conference on Pervasive Computing and Communications Workshops (PerCom Workshops).

[21]  Kimiaki Shirahama,et al.  Comparison of Feature Learning Methods for Human Activity Recognition Using Wearable Sensors , 2018, Sensors.

[22]  Rong Yan,et al.  Cross-domain video concept detection using adaptive svms , 2007, ACM Multimedia.

[23]  Davide Anguita,et al.  A Public Domain Dataset for Human Activity Recognition using Smartphones , 2013, ESANN.

[24]  Ling Zhang,et al.  Research on Recognition of Nine Kinds of Fine Gestures Based on Adaptive AdaBoost Algorithm and Multi-Feature Combination , 2019, IEEE Access.

[25]  Masashi Sugiyama,et al.  Importance-weighted least-squares probabilistic classifier for covariate shift adaptation with application to human activity recognition , 2012, Neurocomputing.

[26]  João Gama,et al.  Human Activity Recognition Using Inertial Sensors in a Smartphone: An Overview , 2019, Sensors.

[27]  Isabel N. Figueiredo,et al.  Exploring smartphone sensors for fall detection , 2016, mUX: The Journal of Mobile User Experience.

[28]  Yu-Liang Hsu,et al.  Human Daily and Sport Activity Recognition Using a Wearable Inertial Sensor Network , 2018, IEEE Access.

[29]  Vito Janko,et al.  Real-time activity monitoring with a wristband and a smartphone , 2017, Information Fusion.

[30]  Qiang Yang,et al.  Proceedings of the Twenty-Second International Joint Conference on Artificial Intelligence Transfer Learning for Activity Recognition via Sensor Mapping , 2022 .

[31]  Özlem Durmaz Incel,et al.  ARService: A Smartphone based Crowd-Sourced Data Collection and Activity Recognition Framework , 2018, ANT/SEIT.

[32]  John Blitzer,et al.  Co-Training for Domain Adaptation , 2011, NIPS.

[33]  C. Medrano,et al.  Detecting Falls as Novelties in Acceleration Patterns Acquired with Smartphones , 2014, PloS one.

[34]  Burcin Becerik-Gerber,et al.  Real-time activity recognition for energy efficiency in buildings , 2018 .

[35]  Philip S. Yu,et al.  Stratified Transfer Learning for Cross-domain Activity Recognition , 2017, 2018 IEEE International Conference on Pervasive Computing and Communications (PerCom).

[36]  Laurence T. Yang,et al.  Response time optimization for cloudlets in Mobile Edge Computing , 2018, J. Parallel Distributed Comput..

[37]  Jonathan Rodriguez,et al.  SmartWall: Novel RFID-Enabled Ambient Human Activity Recognition Using Machine Learning for Unobtrusive Health Monitoring , 2019, IEEE Access.

[38]  Gary M. Weiss,et al.  Smartwatch-based activity recognition: A machine learning approach , 2016, 2016 IEEE-EMBS International Conference on Biomedical and Health Informatics (BHI).

[39]  Hans-Peter Kriegel,et al.  Integrating structured biological data by Kernel Maximum Mean Discrepancy , 2006, ISMB.

[40]  Manolis Tsiknakis,et al.  The MobiFall Dataset: Fall Detection and Classification with a Smartphone , 2014, Int. J. Monit. Surveillance Technol. Res..

[41]  Bernhard Schölkopf,et al.  Nonlinear Component Analysis as a Kernel Eigenvalue Problem , 1998, Neural Computation.

[42]  Ivor W. Tsang,et al.  Visual Event Recognition in Videos by Learning from Web Data , 2012, IEEE Trans. Pattern Anal. Mach. Intell..