Smartphone-Based Patients’ Activity Recognition by Using a Self-Learning Scheme for Medical Monitoring

Smartphone based activity recognition has recently received remarkable attention in various applications of mobile health such as safety monitoring, fitness tracking, and disease prediction. To achieve more accurate and simplified medical monitoring, this paper proposes a self-learning scheme for patients’ activity recognition, in which a patient only needs to carry an ordinary smartphone that contains common motion sensors. After the real-time data collection though this smartphone, we preprocess the data using coordinate system transformation to eliminate phone orientation influence. A set of robust and effective features are then extracted from the preprocessed data. Because a patient may inevitably perform various unpredictable activities that have no apriori knowledge in the training dataset, we propose a self-learning activity recognition scheme. The scheme determines whether there are apriori training samples and labeled categories in training pools that well match with unpredictable activity data. If not, it automatically assembles these unpredictable samples into different clusters and gives them new category labels. These clustered samples combined with the acquired new category labels are then merged into the training dataset to reinforce recognition ability of the self-learning model. In experiments, we evaluate our scheme using the data collected from two postoperative patient volunteers, including six labeled daily activities as the initial apriori categories in the training pool. Experimental results demonstrate that the proposed self-learning scheme for activity recognition works very well for most cases. When there exist several types of unseen activities without any apriori information, the accuracy reaches above 80 % after the self-learning process converges.

[1]  Tin Kam Ho,et al.  The Random Subspace Method for Constructing Decision Forests , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Surapa Thiemjarus,et al.  Accurate Activity Recognition Using a Mobile Phone Regardless of Device Orientation and Location , 2011, 2011 International Conference on Body Sensor Networks.

[3]  Jun Yang,et al.  Toward physical activity diary: motion recognition using simple acceleration features with mobile phones , 2009, IMCE '09.

[4]  Roger O. Smith,et al.  Feature Extraction Method for Real Time Human Activity Recognition on Cell Phones , 2011 .

[5]  Norbert Gyorbíró,et al.  An Activity Recognition System For Mobile Phones , 2009, Mob. Networks Appl..

[6]  Surapa Thiemjarus,et al.  A Device-Orientation Independent Method for Activity Recognition , 2010, 2010 International Conference on Body Sensor Networks.

[7]  Ling Bao,et al.  Activity Recognition from User-Annotated Acceleration Data , 2004, Pervasive.

[8]  Geoffrey E. Hinton,et al.  Visualizing Data using t-SNE , 2008 .

[9]  Ulf Blanke Sensing Location in the Pocket , 2008 .

[10]  M. Arozullah,et al.  Neural network based novelty filtering for signal detection enhancement , 1992, [1992] Proceedings of the 35th Midwest Symposium on Circuits and Systems.

[11]  Özlem Durmaz Incel,et al.  User, device and orientation independent human activity recognition on mobile phones: challenges and a proposal , 2013, UbiComp.

[12]  Alberto L. Morán,et al.  On the Effect of Previous Technological Experience on the Usability of a Virtual Rehabilitation Tool for the Physical Activation and Cognitive Stimulation of Elders , 2015, Journal of Medical Systems.

[13]  Xiangyang Xue,et al.  Null Foley-Sammon transform , 2006, Pattern Recognit..

[14]  Guoliang Xing,et al.  PBN: towards practical activity recognition using smartphone-based body sensor networks , 2011, SenSys.

[15]  Daniel P. Siewiorek,et al.  Activity recognition and monitoring using multiple sensors on different body positions , 2006, International Workshop on Wearable and Implantable Body Sensor Networks (BSN'06).

[16]  Ronald Poppe,et al.  A survey on vision-based human action recognition , 2010, Image Vis. Comput..

[17]  Rama Chellappa,et al.  Machine Recognition of Human Activities: A Survey , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[18]  Gary M. Weiss,et al.  Activity recognition using cell phone accelerometers , 2011, SKDD.

[19]  Lin Sun,et al.  Activity Recognition on an Accelerometer Embedded Mobile Phone with Varying Positions and Orientations , 2010, UIC.

[20]  Qiang Yang,et al.  Sensor-Based Abnormal Human-Activity Detection , 2008, IEEE Transactions on Knowledge and Data Engineering.

[21]  Hans-Peter Kriegel,et al.  A Density-Based Algorithm for Discovering Clusters in Large Spatial Databases with Noise , 1996, KDD.

[22]  Cem Ersoy,et al.  A Review and Taxonomy of Activity Recognition on Mobile Phones , 2013 .

[23]  Davide Anguita,et al.  A Public Domain Dataset for Human Activity Recognition using Smartphones , 2013, ESANN.

[24]  Martin L. Griss,et al.  NuActiv: recognizing unseen new activities using semantic attribute-based learning , 2013, MobiSys '13.

[25]  Bernhard Schölkopf,et al.  Estimating the Support of a High-Dimensional Distribution , 2001, Neural Computation.

[26]  John W. Sammon,et al.  An Optimal Set of Discriminant Vectors , 1975, IEEE Transactions on Computers.

[27]  Yu'e Lin,et al.  Kernel Null Foley-Sammon Transform , 2008, 2008 International Conference on Computer Science and Software Engineering.

[28]  Kaoru Hirota,et al.  A Rule-Based Approach to Activity Recognition , 2010, KICSS.

[29]  Alberto Muñoz,et al.  Self-organizing maps for outlier detection , 1998, Neurocomputing.

[30]  Ahmed Kattan,et al.  Better Physical Activity Classification using Smartphone Acceleration Sensor , 2014, Journal of Medical Systems.

[31]  Anthony Rowe,et al.  Location and Activity Recognition Using eWatch: A Wearable Sensor Platform , 2006, Ambient Intelligence in Everyday.

[32]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[33]  Li-Chen Fu,et al.  Active-learning assisted self-reconfigurable activity recognition in a dynamic environment , 2009, 2009 IEEE International Conference on Robotics and Automation.

[34]  Wenming Zheng,et al.  Foley-Sammon optimal discriminant vectors using kernel approach , 2005, IEEE Trans. Neural Networks.

[35]  Christopher M. Bishop,et al.  Novelty detection and neural network validation , 1994 .