Towards Clustering of Mobile and Smartwatch Accelerometer Data for Physical Activity Recognition

Mobile and wearable devices now have a greater capability of sensing human activity ubiquitously and unobtrusively through advancements in miniaturization and sensing abilities. However, outstanding issues remain around the energy restrictions of these devices when processing large sets of data. This paper presents our approach that uses feature selection to refine the clustering of accelerometer data to detect physical activity. This also has a positive effect on the computational burden that is associated with processing large sets of data, as energy efficiency and resource use is decreased because less data is processed by the clustering algorithms. Raw accelerometer data, obtained from smartphones and smartwatches, have been preprocessed to extract both time and frequency domain features. Principle component analysis feature selection (PCAFS) and correlation feature selection (CFS) have been used to remove redundant features. The reduced feature sets have then been evaluated against three widely used clustering algorithms, including hierarchical clustering analysis (HCA), k-means, and density-based spatial clustering of applications with noise (DBSCAN). Using the reduced feature sets resulted in improved separability, reduced uncertainty, and improved efficiency compared with the baseline, which utilized all features. Overall, the CFS approach in conjunction with HCA produced higher Dunn Index results of 9.7001 for the phone and 5.1438 for the watch features, which is an improvement over the baseline. The results of this comparative study of feature selection and clustering, with the specific algorithms used, has not been performed previously and provides an optimistic and usable approach to recognize activities using either a smartphone or smartwatch.

[1]  Isabelle Guyon,et al.  An Introduction to Variable and Feature Selection , 2003, J. Mach. Learn. Res..

[2]  P. Drummond,et al.  A review of lifestyle factors that contribute to important pathways associated with major depression: diet, sleep and exercise. , 2013, Journal of affective disorders.

[3]  Miguel A. Labrador,et al.  A Survey on Human Activity Recognition using Wearable Sensors , 2013, IEEE Communications Surveys & Tutorials.

[4]  Tanzeem Choudhury,et al.  Towards Population Scale Activity Recognition: A Framework for Handling Data Diversity , 2012, AAAI.

[5]  Michael L. Littman,et al.  Activity Recognition from Accelerometer Data , 2005, AAAI.

[6]  Chelsea Dobbins,et al.  Detecting physical activity within lifelogs towards preventing obesity and aiding ambient assisted living , 2017, Neurocomputing.

[7]  Amit P. Sheth,et al.  Computing for human experience: Semantics-empowered sensors, services, and social computing on the ubiquitous Web , 2010, IEEE Internet Computing.

[8]  Mi Zhang,et al.  A feature selection-based framework for human activity recognition using wearable multimodal sensors , 2011, BODYNETS.

[9]  Philip S. Yu,et al.  Top 10 algorithms in data mining , 2007, Knowledge and Information Systems.

[10]  Bruce A. Draper,et al.  Feature selection from huge feature sets , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[11]  P. Rousseeuw Silhouettes: a graphical aid to the interpretation and validation of cluster analysis , 1987 .

[12]  Diogo R. Ferreira,et al.  Preprocessing techniques for context recognition from accelerometer data , 2010, Personal and Ubiquitous Computing.

[13]  Jun Zhong,et al.  Towards unsupervised physical activity recognition using smartphone accelerometers , 2016, Multimedia Tools and Applications.

[14]  Anil K. Jain Data clustering: 50 years beyond K-means , 2008, Pattern Recognit. Lett..

[15]  Gabriel Cristóbal,et al.  Identification of tuberculosis bacteria based on shape and color , 2004, Real Time Imaging.

[16]  Thomas Phan,et al.  Generating natural-language narratives from activity recognition with spurious classification pruning , 2012, PhoneSense '12.

[17]  Chelsea Dobbins,et al.  Scalable Daily Human Behavioral Pattern Mining from Multivariate Temporal Data , 2016, IEEE Transactions on Knowledge and Data Engineering.

[18]  Blaine A. Price,et al.  Wearables: has the age of smartwatches finally arrived? , 2015, Commun. ACM.

[19]  C. Walter Kryder's law. , 2005, Scientific American.

[20]  Trevor Hastie,et al.  An Introduction to Statistical Learning , 2013, Springer Texts in Statistics.

[21]  G. Saade,et al.  Predicting Term and Preterm Delivery With Transabdominal Uterine Electromyography , 2003, Obstetrics and gynecology.

[22]  Mikkel Baun Kjærgaard,et al.  Smart Devices are Different: Assessing and MitigatingMobile Sensing Heterogeneities for Activity Recognition , 2015, SenSys.

[23]  I-Min Lee,et al.  Using accelerometers to measure physical activity in large-scale epidemiological studies: issues and challenges , 2013, British Journal of Sports Medicine.

[24]  Steve Warren,et al.  Activity recognition in planetary navigation field tests using classification algorithms applied to accelerometer data , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[25]  Joachim M. Buhmann,et al.  Bagging for Path-Based Clustering , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[26]  Yueh-Min Huang,et al.  The Add-on Impact of Mobile Applications in Learning Strategies: A Review Study , 2010, J. Educ. Technol. Soc..

[27]  Tae-Seong Kim,et al.  A single tri-axial accelerometer-based real-time personal life log system capable of human activity recognition and exercise information generation , 2011, Personal and Ubiquitous Computing.

[28]  Noriyuki Hori,et al.  Kinematic quantitation of the patellar tendon reflex using a tri-axial accelerometer. , 2007, Journal of Biomechanics.

[29]  Basel Kikhia,et al.  Structuring and Presenting Lifelogs Based on Location Data , 2014, MindCare.

[30]  H. Abdi,et al.  Principal component analysis , 2010 .

[31]  Didier Stricker,et al.  Creating and benchmarking a new dataset for physical activity monitoring , 2012, PETRA '12.

[32]  R. Kurzweil,et al.  The Singularity Is Near: When Humans Transcend Biology , 2006 .

[33]  Sung-Bae Cho,et al.  Recognizing multi-modal sensor signals using evolutionary learning of dynamic Bayesian networks , 2012, Pattern Analysis and Applications.

[34]  Hugo Gamboa,et al.  Human activity data discovery from triaxial accelerometer sensor: Non-supervised learning sensitivity to feature extraction parametrization , 2015, Inf. Process. Manag..

[35]  Huan Liu,et al.  Feature Selection for High-Dimensional Data: A Fast Correlation-Based Filter Solution , 2003, ICML.

[36]  Lei Yu,et al.  Fast Correlation Based Filter (FCBF) with a different search strategy , 2008, 2008 23rd International Symposium on Computer and Information Sciences.

[37]  Anthony Rowe,et al.  MARS: A Muscle Activity Recognition System enabling self-configuring musculoskeletal sensor networks , 2013, 2013 ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN).

[38]  Alan F. Smeaton,et al.  Mining user activity as a context source for search and retrieval , 2011, 2011 International Conference on Semantic Technology and Information Retrieval.

[39]  Yuting Zhang,et al.  Continuous functional activity monitoring based on wearable tri-axial accelerometer and gyroscope , 2011, 2011 5th International Conference on Pervasive Computing Technologies for Healthcare (PervasiveHealth) and Workshops.

[40]  Angelo M. Sabatini,et al.  Machine Learning Methods for Classifying Human Physical Activity from On-Body Accelerometers , 2010, Sensors.

[41]  Ling Bao,et al.  Activity Recognition from User-Annotated Acceleration Data , 2004, Pervasive.

[42]  Subhas Chandra Mukhopadhyay,et al.  Wearable Sensors for Human Activity Monitoring: A Review , 2015, IEEE Sensors Journal.

[43]  Derya Birant,et al.  ST-DBSCAN: An algorithm for clustering spatial-temporal data , 2007, Data Knowl. Eng..

[44]  Tamer Nadeem,et al.  Wearable Sensing Framework for Human Activity Monitoring , 2015, WearSys '15.

[45]  Kun Li,et al.  Data sensing and analysis: Challenges for wearables , 2015, The 20th Asia and South Pacific Design Automation Conference.

[46]  A. Goris,et al.  Detection of type, duration, and intensity of physical activity using an accelerometer. , 2009, Medicine and science in sports and exercise.

[47]  André Dias,et al.  Measuring Physical Activity with Sensors: A Qualitative Study , 2009, MIE.

[48]  Ting Lie,et al.  Advances in Intelligent Systems and Computing , 2014 .

[49]  Hassan Ghasemzadeh,et al.  Toward seamless wearable sensing: Automatic on-body sensor localization for physical activity monitoring , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[50]  Hui Xiong,et al.  Understanding of Internal Clustering Validation Measures , 2010, 2010 IEEE International Conference on Data Mining.

[51]  Ruben Dias,et al.  A Flexible Wearable Sensor Network for Bio-Signals and Human Activity Monitoring , 2014, 2014 11th International Conference on Wearable and Implantable Body Sensor Networks Workshops.

[52]  Alex Pentland,et al.  Wearable feedback systems for rehabilitation , 2005, Journal of NeuroEngineering and Rehabilitation.

[53]  Claire Cardie,et al.  Proceedings of the Eighteenth International Conference on Machine Learning, 2001, p. 577–584. Constrained K-means Clustering with Background Knowledge , 2022 .

[54]  Xi Long,et al.  Single-accelerometer-based daily physical activity classification , 2009, 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[55]  David Kotz,et al.  NoCloud: Exploring Network Disconnection through On-Device Data Analysis , 2018, IEEE Pervasive Computing.

[56]  Giancarlo Fortino,et al.  Engineering Large-Scale Body Area Networks Applications , 2013, BODYNETS.

[57]  Jafet Morales,et al.  Physical activity recognition by smartphones, a survey , 2017 .

[58]  Rui Xu,et al.  Survey of clustering algorithms , 2005, IEEE Transactions on Neural Networks.

[59]  Paolo Bonato,et al.  Wearable Sensors and Systems , 2010, IEEE Engineering in Medicine and Biology Magazine.

[60]  Prateek Srivastava,et al.  Hierarchical Human Activity Recognition Using GMM , 2012 .

[61]  G M Lyons,et al.  A description of an accelerometer-based mobility monitoring technique. , 2005, Medical engineering & physics.

[62]  Ronen Feldman,et al.  The Data Mining and Knowledge Discovery Handbook , 2005 .

[63]  Sethuraman Panchanathan,et al.  Analysis of low resolution accelerometer data for continuous human activity recognition , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[64]  Peter H Veltink,et al.  Accelerometer and rate gyroscope measurement of kinematics: an inexpensive alternative to optical motion analysis systems. , 2002, Journal of biomechanics.

[65]  Constantine Kotropoulos,et al.  Feature Selection Based on Mutual Correlation , 2006, CIARP.