Activity logging using lightweight classification techniques in mobile devices

Automated activity recognition enables a wide variety of applications related to child and elderly care, disease diagnosis and treatment, personal health or sports training, for which it is key to seamlessly determine and log the user’s motion. This work focuses on exploring the use of smartphones to perform activity recognition without interfering in the user’s lifestyle. Thus, we study how to build an activity recognition system to be continuously executed in a mobile device in background mode. The system relies on device’s sensing, processing and storing capabilities to estimate significant movements/postures (walking at different paces—slow, normal, rush, running, sitting, standing). In order to evaluate the combinations of sensors, features and algorithms, an activity dataset of 16 individuals has been gathered. The performance of a set of lightweight classifiers (Naïve Bayes, Decision Table and Decision Tree) working on different sensor data has been fully evaluated and optimized in terms of accuracy, computational cost and memory fingerprint. Results have pointed out that a priori information on the relative position of the mobile device with respect to the user’s body enhances the estimation accuracy. Results show that computational low-cost Decision Tables using the best set of features among mean and variance and considering all the sensors (acceleration, gravity, linear acceleration, magnetometer, gyroscope) may be enough to get an activity estimation accuracy of around 88 % (78 % is the accuracy of the Naïve Bayes algorithm with the same characteristics used as a baseline). To demonstrate its applicability, the activity recognition system has been used to enable a mobile application to promote active lifestyles.

[1]  Pat Langley,et al.  Estimating Continuous Distributions in Bayesian Classifiers , 1995, UAI.

[2]  Ilkka Korhonen,et al.  Detection of Daily Activities and Sports With Wearable Sensors in Controlled and Uncontrolled Conditions , 2008, IEEE Transactions on Information Technology in Biomedicine.

[3]  Oscar Mayora-Ibarra,et al.  Smart Phone Sensing to Examine Effects of Social Interactions and Non-sedentary Work Time on Mood Changes , 2011, CONTEXT.

[4]  Ana M. Bernardos,et al.  Design and validation of a light inference system to support embedded context reasoning , 2012, Personal and Ubiquitous Computing.

[5]  Emiliano Miluzzo,et al.  A survey of mobile phone sensing , 2010, IEEE Communications Magazine.

[6]  Jenny Benois-Pineau,et al.  Activities of daily living indexing by hierarchical HMM for dementia diagnostics , 2011, 2011 9th International Workshop on Content-Based Multimedia Indexing (CBMI).

[7]  Louise Barkhuus,et al.  Empowerment through seamfulness: smart phones in everyday life , 2011, Personal and Ubiquitous Computing.

[8]  Gaetano Borriello,et al.  BALANCE: towards a usable pervasive wellness application with accurate activity inference , 2009, HotMobile '09.

[9]  Paul Lukowicz,et al.  Activity and emotion recognition to support early diagnosis of psychiatric diseases , 2008, 2008 Second International Conference on Pervasive Computing Technologies for Healthcare.

[10]  Y.-K. Lee,et al.  Human Activity Recognition via an Accelerometer-Enabled-Smartphone Using Kernel Discriminant Analysis , 2010, 2010 5th International Conference on Future Information Technology.

[11]  Ling Bao,et al.  Activity Recognition from User-Annotated Acceleration Data , 2004, Pervasive.

[12]  Matthai Philipose,et al.  Towards Activity Databases: Using Sensors and Statistical Models to Summarize People's Lives , 2006, IEEE Data Eng. Bull..

[13]  Huiru Zheng,et al.  Activity Monitoring Using a Smart Phone's Accelerometer with Hierarchical Classification , 2010, 2010 Sixth International Conference on Intelligent Environments.

[14]  Joint Fao,et al.  Human energy requirements : report of a Joint FAO/WHO/UNU Expert Consultation : Rome, 17-24 October 2001 , 2004 .

[15]  B E Ainsworth,et al.  Compendium of physical activities: an update of activity codes and MET intensities. , 2000, Medicine and science in sports and exercise.

[16]  Lin Sun,et al.  Activity Recognition on an Accelerometer Embedded Mobile Phone with Varying Positions and Orientations , 2010, UIC.

[17]  David W. McDonald,et al.  Activity sensing in the wild: a field trial of ubifit garden , 2008, CHI.

[18]  Patrick Bours,et al.  Towards an automatic gait recognition system using activity recognition (wearable based) , 2011, 2011 Third International Workshop on Security and Communication Networks (IWSCN).

[19]  Sonia M. Arteaga,et al.  Combating obesity trends in teenagers through persuasive mobile technology , 2009, ASAC.

[20]  Chris D. Nugent,et al.  Mapping User Needs to Smartphone Services for Persons with Chronic Disease , 2009, ICOST.

[21]  Stefan Wrobel,et al.  Machine Learning: ECML-95: 8th European Conference on Machine Learning, Heraclion, Crete, Greece, April 25 - 27, 1995. Proceedings , 1995 .

[22]  Kristina Höök,et al.  Affective diary: designing for bodily expressiveness and self-reflection , 2006, CHI Extended Abstracts.

[23]  Robin Jeffries,et al.  CHI '06 Extended Abstracts on Human Factors in Computing Systems , 2006, CHI 2006.

[24]  Context-Aware Computing,et al.  Inferring Activities from Interactions with Objects , 2004 .

[25]  Romit Roy Choudhury,et al.  AAMPL: accelerometer augmented mobile phone localization , 2008, MELT '08.

[26]  Jun Yang,et al.  Toward physical activity diary: motion recognition using simple acceleration features with mobile phones , 2009, IMCE '09.

[27]  Mirco Musolesi,et al.  Sensing meets mobile social networks: the design, implementation and evaluation of the CenceMe application , 2008, SenSys '08.

[28]  Sangeeta Bhattacharya,et al.  Jog Falls: A Pervasive Healthcare Platform for Diabetes Management , 2010, Pervasive.

[29]  J. Ross Quinlan,et al.  C4.5: Programs for Machine Learning , 1992 .

[30]  Alex Pentland,et al.  InSense: Interest-Based Life Logging , 2006, IEEE MultiMedia.

[31]  William G. Griswold,et al.  Usability and Feasibility of PmEB: A Mobile Phone Application for Monitoring Real Time Caloric Balance , 2006, Mob. Networks Appl..

[32]  Paula Tarrío Alonso,et al.  Enhancing Activity Recognition by Fusing Inertial and Biometric Information , 2011, FUSION 2011.

[33]  Kiyoharu Aizawa,et al.  High level activity annotation of daily experiences by a combination of a wearable device and Wi-Fi based positioning system , 2008, 2008 IEEE International Conference on Multimedia and Expo.

[34]  Ian H. Witten,et al.  The WEKA data mining software: an update , 2009, SKDD.

[35]  Ron Kohavi,et al.  The Power of Decision Tables , 1995, ECML.

[36]  Chris D. Nugent,et al.  Proceedings of the 7th International Conference on Smart Homes and Health Telematics: Ambient Assistive Health and Wellness Management in the Heart of the City , 2009 .

[37]  Issa Zakeri,et al.  Prediction of activity energy expenditure using accelerometers in children. , 2004, Medicine and science in sports and exercise.

[38]  K N Maruthy,et al.  A simple method of measuring total daily energy expenditure and physical activity level from the heart rate in adult men , 2006, European Journal of Clinical Nutrition.

[39]  SeungHee Lee,et al.  System for Detecting Kindergartners’ Potential Emergency Situations , 2010 .

[40]  J. Witmer,et al.  Statistics for the Life Sciences , 1990 .

[41]  O. Mayora,et al.  Activity and emotion recognition to support early diagnosis of psychiatric diseases , 2008, Pervasive 2008.

[42]  Björn Eskofier,et al.  Biometric and mobile gait analysis for early diagnosis and therapy monitoring in Parkinson's disease , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[43]  Hojung Cha,et al.  LifeMap: A Smartphone-Based Context Provider for Location-Based Services , 2011, IEEE Pervasive Computing.