Hierarchical, Multi-Sensor Based Classification of Daily Life Activities: Comparison with State-of-the-Art Algorithms Using a Benchmark Dataset

Insufficient physical activity is the 4th leading risk factor for mortality. Methods for assessing the individual daily life activity (DLA) are of major interest in order to monitor the current health status and to provide feedback about the individual quality of life. The conventional assessment of DLAs with self-reports induces problems like reliability, validity, and sensitivity. The assessment of DLAs with small and light-weight wearable sensors (e.g. inertial measurement units) provides a reliable and objective method. State-of-the-art human physical activity classification systems differ in e.g. the number and kind of sensors, the performed activities, and the sampling rate. Hence, it is difficult to compare newly proposed classification algorithms to existing approaches in literature and no commonly used dataset exists. We generated a publicly available benchmark dataset for the classification of DLAs. Inertial data were recorded with four sensor nodes, each consisting of a triaxial accelerometer and a triaxial gyroscope, placed on wrist, hip, chest, and ankle. Further, we developed a novel, hierarchical, multi-sensor based classification system for the distinction of a large set of DLAs. Our hierarchical classification system reached an overall mean classification rate of 89.6% and was diligently compared to existing state-of-the-art algorithms using our benchmark dataset. For future research, the dataset can be used in the evaluation process of new classification algorithms and could speed up the process of getting the best performing and most appropriate DLA classification system.

[1]  Angelo M. Sabatini,et al.  Machine Learning Methods for Classifying Human Physical Activity from On-Body Accelerometers , 2010, Sensors.

[2]  Björn Eskofier,et al.  Classification of surfaces and inclinations during outdoor running using shoe-mounted inertial sensors , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[3]  Shigeo Abe DrEng Pattern Classification , 2001, Springer London.

[4]  David G. Stork,et al.  Pattern Classification , 1973 .

[5]  R S Paffenbarger,et al.  Physical activity and all cause mortality in women: a review of the evidence , 2002, British journal of sports medicine.

[6]  Stewart G Trost,et al.  Conducting accelerometer-based activity assessments in field-based research. , 2005, Medicine and science in sports and exercise.

[7]  Ulf Ekelund,et al.  Assessment of physical activity – a review of methodologies with reference to epidemiological research: a report of the exercise physiology section of the European Association of Cardiovascular Prevention and Rehabilitation , 2010, European journal of cardiovascular prevention and rehabilitation : official journal of the European Society of Cardiology, Working Groups on Epidemiology & Prevention and Cardiac Rehabilitation and Exercise Physiology.

[8]  Nigel H. Lovell,et al.  Implementation of a real-time human movement classifier using a triaxial accelerometer for ambulatory monitoring , 2006, IEEE Transactions on Information Technology in Biomedicine.

[9]  Ian H. Witten,et al.  Data mining: practical machine learning tools and techniques, 3rd Edition , 1999 .

[10]  M. N. Nyan,et al.  Classification of gait patterns in the time-frequency domain. , 2006, Journal of biomechanics.

[11]  Kelly R Evenson,et al.  Accelerometer use in physical activity: best practices and research recommendations. , 2005, Medicine and science in sports and exercise.

[12]  R. Shephard Limits to the measurement of habitual physical activity by questionnaires , 2003, British journal of sports medicine.

[13]  David Howard,et al.  A Comparison of Feature Extraction Methods for the Classification of Dynamic Activities From Accelerometer Data , 2009, IEEE Transactions on Biomedical Engineering.

[14]  B. Celler,et al.  Accelerometry Based Classification of Walking Patterns Using Time-frequency Analysis , 2007, 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[15]  C. Caspersen,et al.  Physical activity and the incidence of coronary heart disease. , 1987, Annual review of public health.

[16]  Emanuele Pollastri,et al.  Musical Instrument Timbres Classification with Spectral Features , 2001, 2001 IEEE Fourth Workshop on Multimedia Signal Processing (Cat. No.01TH8564).

[17]  Robert X. Gao,et al.  Multisensor Data Fusion for Physical Activity Assessment , 2012, IEEE Transactions on Biomedical Engineering.

[18]  Billur Barshan,et al.  Human Activity Recognition Using Inertial/Magnetic Sensor Units , 2010, HBU.

[19]  B. Ripley,et al.  Pattern Recognition , 1968, Nature.

[20]  Ilkka Korhonen,et al.  Detection of Daily Activities and Sports With Wearable Sensors in Controlled and Uncontrolled Conditions , 2008, IEEE Transactions on Information Technology in Biomedicine.

[21]  T Togawa,et al.  Classification of acceleration waveforms during walking by wavelet transform. , 1997, Methods of information in medicine.

[22]  Kamiar Aminian,et al.  3D gait assessment in young and elderly subjects using foot-worn inertial sensors. , 2010, Journal of biomechanics.

[23]  Fuhui Long,et al.  Feature selection based on mutual information criteria of max-dependency, max-relevance, and min-redundancy , 2003, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  T Togawa,et al.  Classification of waist-acceleration signals in a continuous walking record. , 2000, Medical engineering & physics.

[25]  R. Adams Revised Physical Activity Readiness Questionnaire. , 1999, Canadian family physician Medecin de famille canadien.

[26]  อนิรุธ สืบสิงห์,et al.  Data Mining Practical Machine Learning Tools and Techniques , 2014 .

[27]  David R Bassett,et al.  2011 Compendium of Physical Activities: a second update of codes and MET values. , 2011, Medicine and science in sports and exercise.

[28]  Physical Activity Guidelines Advisory Committee report, 2008. To the Secretary of Health and Human Services. Part A: executive summary. , 2009, Nutrition reviews.

[29]  K. Patrick,et al.  Physical Activity and Public Health: A Recommendation From the Centers for Disease Control and Prevention and the American College of Sports Medicine , 1995 .

[30]  K. Flegal,et al.  Prevalence of overweight and obesity in the United States, 1999-2004. , 2006, JAMA.

[31]  J F Sallis,et al.  Compendium of physical activities: classification of energy costs of human physical activities. , 1993, Medicine and science in sports and exercise.

[32]  M. Akay,et al.  Discrimination of walking patterns using wavelet-based fractal analysis , 2002, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[33]  Kenji Mase,et al.  Activity and Location Recognition Using Wearable Sensors , 2002, IEEE Pervasive Comput..

[34]  Michael L. Littman,et al.  Activity Recognition from Accelerometer Data , 2005, AAAI.

[35]  Ling Bao,et al.  Activity Recognition from User-Annotated Acceleration Data , 2004, Pervasive.

[36]  D. Warburton,et al.  Health benefits of physical activity: the evidence , 2006, Canadian Medical Association Journal.

[37]  Kamiar Aminian,et al.  Ambulatory system for human motion analysis using a kinematic sensor: monitoring of daily physical activity in the elderly , 2003, IEEE Transactions on Biomedical Engineering.

[38]  R R Wing,et al.  Physical activity in the treatment of the adulthood overweight and obesity: current evidence and research issues. , 1999, Medicine and science in sports and exercise.

[39]  B E Ainsworth,et al.  Compendium of physical activities: an update of activity codes and MET intensities. , 2000, Medicine and science in sports and exercise.

[40]  G A Colditz,et al.  A meta-analysis of physical activity in the prevention of coronary heart disease. , 1990, American journal of epidemiology.

[41]  S. Blair,et al.  Is physical activity or physical fitness more important in defining health benefits? , 2001, Medicine and science in sports and exercise.

[42]  Adrian Burns,et al.  SHIMMER™ – A Wireless Sensor Platform for Noninvasive Biomedical Research , 2010, IEEE Sensors Journal.

[43]  Johannes Peltola,et al.  Activity classification using realistic data from wearable sensors , 2006, IEEE Transactions on Information Technology in Biomedicine.

[44]  Pekka Siirtola,et al.  Activity recognition using a wrist-worn inertial measurement unit: A case study for industrial assembly lines , 2009, 2009 17th Mediterranean Conference on Control and Automation.

[45]  R S Paffenbarger,et al.  Associations of light, moderate, and vigorous intensity physical activity with longevity. The Harvard Alumni Health Study. , 2000, American journal of epidemiology.