Activity recognition based on inertial sensors for Ambient Assisted Living

Ambient Assisted Living (AAL) aims to create innovative technical solutions and services to support independent living among older adults, improve their quality of life and reduce the costs associated with health and social care. AAL systems provide health monitoring through sensor based technologies to preserve health and functional ability and facilitate social support for the ageing population. Human activity recognition (HAR) is an enabler for the development of robust AAL solutions, especially in safety critical environments. Therefore, HAR models applied within this domain (e.g. for fall detection or for providing contextual information to caregivers) need to be accurate to assist in developing reliable support systems. In this paper, we evaluate three machine learning algorithms, namely Support Vector Machine (SVM), a hybrid of Hidden Markov Models (HMM) and SVM (SVM-HMM) and Artificial Neural Networks (ANNs) applied on a dataset collected between the elderly and their caregiver counterparts. Detected activities will later serve as inputs to a bidirectional activity awareness system for increasing social connectedness. Results show high classification performances for all three algorithms. Specifically, the SVM-HMM hybrid demonstrates the best classification performance. In addition to this, we make our dataset publicly available for use by the machine learning community.

[1]  Gita Reese Sukthankar,et al.  Motif Discovery and Feature Selection for CRF-based Activity Recognition , 2010, 2010 20th International Conference on Pattern Recognition.

[2]  Diane J. Cook,et al.  Human Activity Recognition and Pattern Discovery , 2010, IEEE Pervasive Computing.

[3]  Jun Hu,et al.  Social Hue: A subtle awareness system for connecting the elderly and their caregivers , 2015, 2015 IEEE International Conference on Pervasive Computing and Communication Workshops (PerCom Workshops).

[4]  Juha Röning,et al.  Discriminative Temporal Smoothing for Activity Recognition from Wearable Sensors , 2007, UCS.

[5]  Federica Paganelli,et al.  An Ontology-Based System for Context-Aware and Configurable Services to Support Home-Based Continuous Care , 2011, IEEE Transactions on Information Technology in Biomedicine.

[6]  Carlo S. Regazzoni,et al.  A particle filter based sequential trajectory classifier for behavior analysis in video surveillance , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[7]  Javier Bajo,et al.  Using Heterogeneous Wireless Sensor Networks in a Telemonitoring System for Healthcare , 2010, IEEE Transactions on Information Technology in Biomedicine.

[8]  E. Cornwell,et al.  Social Disconnectedness, Perceived Isolation, and Health among Older Adults∗ , 2009, Journal of health and social behavior.

[9]  Araceli Sanchis,et al.  Activity Recognition Using Hybrid Generative/Discriminative Models on Home Environments Using Binary Sensors , 2013, Sensors.

[10]  A K Bourke,et al.  Evaluation of a threshold-based tri-axial accelerometer fall detection algorithm. , 2007, Gait & posture.

[11]  Davide Anguita,et al.  Transition-Aware Human Activity Recognition Using Smartphones , 2016, Neurocomputing.

[12]  Jeen-Shing Wang,et al.  Using acceleration measurements for activity recognition: An effective learning algorithm for constructing neural classifiers , 2008, Pattern Recognit. Lett..

[13]  Gary M. Weiss,et al.  Activity recognition using cell phone accelerometers , 2011, SKDD.

[14]  Context-Aware Computing,et al.  Inferring Activities from Interactions with Objects , 2004 .

[15]  Joan Cabestany,et al.  SVM-based posture identification with a single waist-located triaxial accelerometer , 2013, Expert Syst. Appl..

[16]  Jun Hu,et al.  Perception of Human Activities - A Means to Support Connectedness Between the Elderly and Their Caregivers , 2015, ICT4AgeingWell.

[17]  Simon A. Dobson,et al.  Situation identification techniques in pervasive computing: A review , 2012, Pervasive Mob. Comput..

[18]  Sumi Helal,et al.  The Engineering Handbook of Smart Technology for Aging, Disability, and Independence , 2008 .

[19]  Maja Pantic,et al.  Combined Support Vector Machines and Hidden Markov Models for Modeling Facial Action Temporal Dynamics , 2007, ICCV-HCI.

[20]  Changseok Bae,et al.  Unsupervised learning for human activity recognition using smartphone sensors , 2014, Expert Syst. Appl..

[21]  Driss Choujaa,et al.  Activity Recognition from Mobile Phone Data : State of the Art , Prospects and Open Problems , 2014 .

[22]  Henry A. Kautz,et al.  Fine-grained activity recognition by aggregating abstract object usage , 2005, Ninth IEEE International Symposium on Wearable Computers (ISWC'05).

[23]  Martin Fodslette Meiller A Scaled Conjugate Gradient Algorithm for Fast Supervised Learning , 1993 .

[24]  J. Wardle,et al.  Social isolation, loneliness, and all-cause mortality in older men and women , 2013, Proceedings of the National Academy of Sciences.

[25]  Alex Pentland,et al.  Reality mining: sensing complex social systems , 2006, Personal and Ubiquitous Computing.

[26]  Stephen Few Information dashbord design - the effective visual communication of data , 2006 .

[27]  Gang Wei,et al.  Speech emotion recognition based on HMM and SVM , 2005, 2005 International Conference on Machine Learning and Cybernetics.

[28]  Mukhtiar Memon,et al.  Ambient Assisted Living Healthcare Frameworks, Platforms, Standards, and Quality Attributes , 2014, Sensors.

[29]  Chih-Jen Lin,et al.  A comparison of methods for multiclass support vector machines , 2002, IEEE Trans. Neural Networks.

[30]  Joseph Picone,et al.  Applications of support vector machines to speech recognition , 2004, IEEE Transactions on Signal Processing.

[31]  Davide Anguita,et al.  Human Activity Recognition on Smartphones Using a Multiclass Hardware-Friendly Support Vector Machine , 2012, IWAAL.

[32]  Elizabeth D. Mynatt,et al.  Digital Family Portrait Field Trial: Support for Aging in Place , 2005, CHI.

[33]  Philippe A. Palanque,et al.  Proceedings of the SIGCHI Conference on Human Factors in Computing Systems , 2014, International Conference on Human Factors in Computing Systems.

[34]  Kamiar Aminian,et al.  Ambulatory system for human motion analysis using a kinematic sensor: monitoring of daily physical activity in the elderly , 2003, IEEE Transactions on Biomedical Engineering.

[35]  Yvonne de Kort,et al.  Interpersonal connectedness: conceptualization and directions for a measurement instrument , 2008, CHI Extended Abstracts.

[36]  Nikolaos Papanikolopoulos,et al.  Multi-Camera Human Activity Monitoring , 2008, J. Intell. Robotic Syst..

[37]  Shyamal Patel,et al.  A review of wearable sensors and systems with application in rehabilitation , 2012, Journal of NeuroEngineering and Rehabilitation.

[38]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[39]  Shengli Wu,et al.  Clustering-Based Ensemble Learning for Activity Recognition in Smart Homes , 2014, Sensors.

[40]  Jorge Luis Reyes Ortiz Smartphone-Based Human Activity Recognition , 2015 .

[41]  P. Bartlett,et al.  Probabilities for SV Machines , 2000 .

[42]  Elizabeth D. Mynatt,et al.  Digital family portraits: supporting peace of mind for extended family members , 2001, CHI.

[43]  Davide Anguita,et al.  A Public Domain Dataset for Human Activity Recognition using Smartphones , 2013, ESANN.

[44]  T. Warren Liao,et al.  Clustering of time series data - a survey , 2005, Pattern Recognit..

[45]  Özlem Durmaz Incel,et al.  User, device and orientation independent human activity recognition on mobile phones: challenges and a proposal , 2013, UbiComp.

[46]  Simon Haykin,et al.  Neural Networks: A Comprehensive Foundation , 1998 .

[47]  Edward D. Lemaire,et al.  Feature Selection for Wearable Smartphone-Based Human Activity Recognition with Able bodied, Elderly, and Stroke Patients , 2015, PloS one.

[48]  Ryan M. Rifkin,et al.  In Defense of One-Vs-All Classification , 2004, J. Mach. Learn. Res..

[49]  Michael L. Littman,et al.  Activity Recognition from Accelerometer Data , 2005, AAAI.

[50]  Marcin Rudzki,et al.  Artificial neural networks in accelerometer-based human activity recognition , 2015, 2015 22nd International Conference Mixed Design of Integrated Circuits & Systems (MIXDES).

[51]  Svetha Venkatesh,et al.  Activity recognition and abnormality detection with the switching hidden semi-Markov model , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[52]  Hanghang Tong,et al.  Activity recognition with smartphone sensors , 2014 .