Evaluating the Transferability of Personalised Exercise Recognition Models

Exercise Recognition (ExR) is relevant in many high impact domains, from healthcare to recreational activities to sports sciences. Like Human Activity Recognition (HAR), ExR faces many challenges when deployed in the real-world. For instance, typical lab performances of Machine Learning (ML) models, are hard to replicate, due to differences in personal nuances, traits and ambulatory rhythms. Thus effective transferability of a trained ExR model, depends on its ability to adapt and personalise to a new user or a user group. This calls for new experimental design strategies that are person-aware, and able to organise train and test data differently from standard ML practice. Specifically, we look at person-agnostic and person-aware methods of train-test data creation, and compare them to identify best practices on a comparative study of personalised ExR model transfer. Our findings show that ExR when compared to results with other HAR tasks, to be a far more challenging personalisation problem and also confirms the utility of metric learning algorithms for personalised model transfer.

[1]  Deborah Estrin,et al.  Improving activity classification for health applications on mobile devices using active and semi-supervised learning , 2010, 2010 4th International Conference on Pervasive Computing Technologies for Healthcare.

[2]  Andreas Dengel,et al.  Attributes’ Importance for Zero-Shot Pose-Classification Based on Wearable Sensors , 2018, Sensors.

[3]  Paul Lukowicz,et al.  Smart-mat: recognizing and counting gym exercises with low-cost resistive pressure sensing matrix , 2014, UbiComp.

[4]  Paolo Missier,et al.  Bootstrapping Personalised Human Activity Recognition Models Using Online Active Learning , 2015, 2015 IEEE International Conference on Computer and Information Technology; Ubiquitous Computing and Communications; Dependable, Autonomic and Secure Computing; Pervasive Intelligence and Computing.

[5]  Matthias Budde,et al.  ActiServ: Activity Recognition Service for mobile phones , 2010, International Symposium on Wearable Computers (ISWC) 2010.

[6]  Hugo Fuks,et al.  Qualitative activity recognition of weight lifting exercises , 2013, AH.

[7]  Nirmalie Wiratunga,et al.  A knowledge-light approach to personalised and open-ended human activity recognition , 2020, Knowl. Based Syst..

[8]  Xu Sun,et al.  Large-Scale Personalized Human Activity Recognition Using Online Multitask Learning , 2013, IEEE Transactions on Knowledge and Data Engineering.

[9]  Oriol Vinyals,et al.  Matching Networks for One Shot Learning , 2016, NIPS.

[10]  Paul Lukowicz,et al.  Never skip leg day: A novel wearable approach to monitoring gym leg exercises , 2016, 2016 IEEE International Conference on Pervasive Computing and Communications (PerCom).

[11]  Po Yang,et al.  A Hybrid Hierarchical Framework for Free Weight Exercise Recognition and Intensity Measurement with Accelerometer and ECG Data Fusion , 2018, 2018 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[12]  Linqing Gui,et al.  SEARE: A System for Exercise Activity Recognition and Quality Evaluation Based on Green Sensing , 2018, IEEE Transactions on Emerging Topics in Computing.

[13]  Kent Larson,et al.  Real-Time Recognition of Physical Activities and Their Intensities Using Wireless Accelerometers and a Heart Rate Monitor , 2007, 2007 11th IEEE International Symposium on Wearable Computers.

[14]  Patrick Henry,et al.  Shoulder physiotherapy exercise recognition: machine learning the inertial signals from a smartwatch , 2018, Physiological measurement.