Activity Tracking Using Ear-Level Accelerometers

Introduction: By means of adding more sensor technology, modern hearing aids (HAs) strive to become better, more personalized, and self-adaptive devices that can handle environmental changes and cope with the day-to-day fitness of the users. The latest HA technology available in the market already combines sound analysis with motion activity classification based on accelerometers to adjust settings. While there is a lot of research in activity tracking using accelerometers in sports applications and consumer electronics, there is not yet much in hearing research. Objective: This study investigates the feasibility of activity tracking with ear-level accelerometers and how it compares to waist-mounted accelerometers, which is a more common measurement location. Method: The activity classification methods in this study are based on supervised learning. The experimental set up consisted of 21 subjects, equipped with two XSens MTw Awinda at ear-level and one at waist-level, performing nine different activities. Results: The highest accuracy on our experimental data as obtained with the combination of Bagging and Classification tree techniques. The total accuracy over all activities and users was 84% (ear-level), 90% (waist-level), and 91% (ear-level + waist-level). Most prominently, the classes, namely, standing, jogging, laying (on one side), laying (face-down), and walking all have an accuracy of above 90%. Furthermore, estimated ear-level step-detection accuracy was 95% in walking and 90% in jogging. Conclusion: It is demonstrated that several activities can be classified, using ear-level accelerometers, with an accuracy that is on par with waist-level. It is indicated that step-detection accuracy is comparable to a high-performance wrist device. These findings are encouraging for the development of activity applications in hearing healthcare.

[1]  John Weston,et al.  Strapdown Inertial Navigation Technology , 1997 .

[2]  Peter E. Hart,et al.  Nearest neighbor pattern classification , 1967, IEEE Trans. Inf. Theory.

[3]  Diane J. Cook,et al.  Simple and Complex Activity Recognition through Smart Phones , 2012, 2012 Eighth International Conference on Intelligent Environments.

[4]  Davide Anguita,et al.  A Public Domain Dataset for Human Activity Recognition using Smartphones , 2013, ESANN.

[5]  Juan-Luis Gorricho,et al.  Activity Recognition from Accelerometer Data on a Mobile Phone , 2009, IWANN.

[6]  Robert E. Schapire,et al.  The strength of weak learnability , 1990, Mach. Learn..

[7]  Gang Wang,et al.  Context recognition for adaptive hearing-aids , 2015, 2015 IEEE 13th International Conference on Industrial Informatics (INDIN).

[8]  Scott E Crouter,et al.  A novel method for using accelerometer data to predict energy expenditure. , 2006, Journal of applied physiology.

[9]  R. Fisher THE USE OF MULTIPLE MEASUREMENTS IN TAXONOMIC PROBLEMS , 1936 .

[10]  JAN CHRISTIAN BRØND,et al.  Generating ActiGraph Counts from Raw Acceleration Recorded by an Alternative Monitor , 2017, Medicine and science in sports and exercise.

[11]  Andrew Hua,et al.  Accelerometer-based predictive models of fall risk in older women: a pilot study , 2018, npj Digital Medicine.

[12]  Jan Larsen,et al.  Modeling User Intents as Context in Smartphone-connected Hearing Aids , 2018, UMAP.

[13]  Gary M. Weiss,et al.  Activity recognition using cell phone accelerometers , 2011, SKDD.

[14]  Radford M. Neal Pattern Recognition and Machine Learning , 2007, Technometrics.

[15]  Thomas Plötz,et al.  Deep, Convolutional, and Recurrent Models for Human Activity Recognition Using Wearables , 2016, IJCAI.

[16]  Johannes Peltola,et al.  Activity classification using realistic data from wearable sensors , 2006, IEEE Transactions on Information Technology in Biomedicine.

[17]  S.Y. Lee,et al.  Accelerometer's position free human activity recognition using a hierarchical recognition model , 2010, The 12th IEEE International Conference on e-Health Networking, Applications and Services.

[18]  Ilkka Korhonen,et al.  Detection of Daily Activities and Sports With Wearable Sensors in Controlled and Uncontrolled Conditions , 2008, IEEE Transactions on Information Technology in Biomedicine.

[19]  Paul J. M. Havinga,et al.  Fusion of Smartphone Motion Sensors for Physical Activity Recognition , 2014, Sensors.

[20]  Ahmad Abadleh,et al.  Step Detection Algorithm for Accurate Distance Estimation Using Dynamic Step Length , 2017, 2017 18th IEEE International Conference on Mobile Data Management (MDM).

[21]  D. Joanes,et al.  Comparing measures of sample skewness and kurtosis , 1998 .

[22]  Md. Kamrul Hasan,et al.  Activity recognition of a badminton game through accelerometer and gyroscope , 2016, 2016 19th International Conference on Computer and Information Technology (ICCIT).

[23]  Y.-K. Lee,et al.  Human Activity Recognition via an Accelerometer-Enabled-Smartphone Using Kernel Discriminant Analysis , 2010, 2010 5th International Conference on Future Information Technology.

[24]  Bernard F Fuemmeler,et al.  Accelerometer data reduction: a comparison of four reduction algorithms on select outcome variables. , 2005, Medicine and science in sports and exercise.

[25]  Pascal Vincent,et al.  Representation Learning: A Review and New Perspectives , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  Yuting Zhang,et al.  Continuous functional activity monitoring based on wearable tri-axial accelerometer and gyroscope , 2011, 2011 5th International Conference on Pervasive Computing Technologies for Healthcare (PervasiveHealth) and Workshops.

[27]  K. Shadan,et al.  Available online: , 2012 .

[28]  Buye Xu,et al.  Preliminary Examination of the Accuracy of a Fall Detection Device Embedded into Hearing Instruments. , 2019, Journal of the American Academy of Audiology.

[29]  Wei-Yin Loh,et al.  Classification and regression trees , 2011, WIREs Data Mining Knowl. Discov..

[30]  Guang-Zhong Yang,et al.  Sensor Positioning for Activity Recognition Using Wearable Accelerometers , 2011, IEEE Transactions on Biomedical Circuits and Systems.

[31]  Sung-Bae Cho,et al.  Human activity recognition with smartphone sensors using deep learning neural networks , 2016, Expert Syst. Appl..

[32]  Yoav Freund,et al.  A decision-theoretic generalization of on-line learning and an application to boosting , 1997, EuroCOLT.

[33]  Nishant Doshi,et al.  Human Activity Recognition: A Survey , 2019, Procedia Computer Science.

[34]  Matjaz Gams,et al.  Accelerometer Placement for Posture Recognition and Fall Detection , 2011, 2011 Seventh International Conference on Intelligent Environments.

[35]  Ying-Wen Bai,et al.  Using a three-axis accelerometer and GPS module in a smart phone to measure walking steps and distance , 2014, 2014 IEEE 27th Canadian Conference on Electrical and Computer Engineering (CCECE).

[36]  Jakob Eg Larsen,et al.  Hearables in hearing care: discovering usage patterns through IoT devices , 2018, HCI.