Recognizing Daily and Sports Activities in Two Open Source Machine Learning Environments Using Body-Worn Sensor Units

This study provides a comparative assessment on the different techniques of classifying human activities performed while wearing inertial and magnetic sensor units on the chest, arms and legs. The gyroscope, accelerometer and the magnetometer in each unit are tri-axial. Naive Bayesian classifier, artificial neural networks (ANNs), dissimilarity-based classifier, three types of decision trees, Gaussian mixture models (GMMs) and support vector machines (SVMs) are considered.A feature set extracted from the raw sensor data using principal component analysis is used for classification. Three different cross-validation techniques are employed to validate the classifiers. A performance comparison of the classifiers is provided in terms of their correct differentiation rates, confusion matrices and computational cost. The highest correct differentiation rates are achieved with ANNs (99.2%), SVMs (99.2%) and a GMM (99.1%). GMMs may be preferable because of their lower computational requirements. Regarding the position of sensor units on the body, those worn on the legs are the most informative. Comparing the different sensor modalities indicates that if only a single sensor type is used, the highest classification rates are achieved with magnetometers, followed by accelerometers and gyroscopes. The study also provides a comparison between two commonly used open source machine learning environments (WEKA and PRTools) in terms of their functionality, manageability, classifier performance and execution times.

[1]  Kamiar Aminian,et al.  Measurement of stand-sit and sit-stand transitions using a miniature gyroscope and its application in fall risk evaluation in the elderly , 2002, IEEE Transactions on Biomedical Engineering.

[2]  Merryn J Mathie,et al.  Accelerometry: providing an integrated, practical method for long-term, ambulatory monitoring of human movement , 2004, Physiological measurement.

[3]  Kenneth Meijer,et al.  Activity identification using body-mounted sensors—a review of classification techniques , 2009, Physiological measurement.

[4]  David G. Stork,et al.  Pattern Classification (2nd ed.) , 1999 .

[5]  Paul Lukowicz,et al.  WearIT@work: Toward Real-World Industrial Wearable Computing , 2007, IEEE Pervasive Computing.

[6]  Matjaz Gams,et al.  Confidence: Ubiquitous Care System to Support Independent Living , 2012, ECAI.

[7]  Thomas B. Moeslund,et al.  A Survey of Computer Vision-Based Human Motion Capture , 2001, Comput. Vis. Image Underst..

[8]  Paul Lukowicz,et al.  Gesture spotting with body-worn inertial sensors to detect user activities , 2008, Pattern Recognit..

[9]  Sotiris B. Kotsiantis,et al.  Supervised Machine Learning: A Review of Classification Techniques , 2007, Informatica.

[10]  John,et al.  Strapdown Inertial Navigation Technology - 2nd Edition , 2005 .

[11]  A. Bourke,et al.  Fall detection - Principles and Methods , 2007, 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[12]  Tatsuo Nakajima,et al.  Feature Selection and Activity Recognition from Wearable Sensors , 2006, UCS.

[13]  John Darby,et al.  Tracking human pose with multiple activity models , 2010, Pattern Recognit..

[14]  Ruud W. Selles,et al.  Automated Detection of Instantaneous Gait Events Using Time Frequency Analysis and Manifold Embedding , 2013, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[15]  Billur Barshan,et al.  Leg Motion Classification with Artificial Neural Networks Using Wavelet-Based Features of Gyroscope Signals , 2011, Sensors.

[16]  Daniel Tik-Pui Fong,et al.  The Use of Wearable Inertial Motion Sensors in Human Lower Limb Biomechanics Studies: A Systematic Review , 2010, Sensors.

[17]  Jian Lu,et al.  Recognizing multi-user activities using wearable sensors in a smart home , 2011, Pervasive Mob. Comput..

[18]  Michael Beetz,et al.  A Self-Training Approach for Visual Tracking and Recognition of Complex Human Activity Patterns , 2012, International Journal of Computer Vision.

[19]  Matjaz Gams,et al.  Behavior Analysis Based on Coordinates of Body Tags , 2009, AmI.

[20]  Nikolaos G. Bourbakis,et al.  A Survey on Wearable Sensor-Based Systems for Health Monitoring and Prognosis , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[21]  Jihong Lee,et al.  Real-Time Motion Capture for a Human Body using Accelerometers , 2001, Robotica.

[22]  C. Becker,et al.  Systematic review of definitions and methods of measuring falls in randomised controlled fall prevention trials. , 2006, Age and ageing.

[23]  Andrew R. Webb,et al.  Statistical Pattern Recognition , 1999 .

[24]  Shyamal Patel,et al.  A review of wearable sensors and systems with application in rehabilitation , 2012, Journal of NeuroEngineering and Rehabilitation.

[25]  Maxim A. Batalin,et al.  Incremental Diagnosis Method for Intelligent Wearable Sensor Systems , 2007, IEEE Transactions on Information Technology in Biomedicine.

[26]  Kamiar Aminian,et al.  Mobility assessment in older people: new possibilities and challenges , 2007, European journal of ageing.

[27]  Billur Barshan,et al.  Inter- and intra-subject variations in activity recognition using inertial sensors and magnetometers , 2012 .

[28]  Ian H. Witten,et al.  The WEKA data mining software: an update , 2009, SKDD.

[29]  Zhaoying Zhou,et al.  A real-time articulated human motion tracking using tri-axis inertial/magnetic sensors package. , 2004, IEEE transactions on neural systems and rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[30]  Miguel A. Labrador,et al.  Centinela: A human activity recognition system based on acceleration and vital sign data , 2012, Pervasive Mob. Comput..

[31]  Billur Barshan,et al.  Human Activity Recognition Using Inertial/Magnetic Sensor Units , 2010, HBU.

[32]  Tae-Seong Kim,et al.  A Triaxial Accelerometer-Based Physical-Activity Recognition via Augmented-Signal Features and a Hierarchical Recognizer , 2010, IEEE Transactions on Information Technology in Biomedicine.

[33]  Rama Chellappa,et al.  Machine Recognition of Human Activities: A Survey , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[34]  Rong Zhu,et al.  A real-time articulated human motion tracking using tri-axis inertial/magnetic sensors package , 2004, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[35]  David W. Murray,et al.  On the Choice and Placement of Wearable Vision Sensors , 2009, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[36]  Huosheng Hu,et al.  Integration of Vision and Inertial Sensors for 3D Arm Motion Tracking in Home-based Rehabilitation , 2007, Int. J. Robotics Res..

[37]  Adrian Hilton,et al.  A survey of advances in vision-based human motion capture and analysis , 2006, Comput. Vis. Image Underst..

[38]  Maarit Kangas,et al.  Comparison of low-complexity fall detection algorithms for body attached accelerometers. , 2008, Gait & posture.

[39]  Billur Barshan,et al.  Classifying Human Leg Motions with Uniaxial Piezoelectric Gyroscopes , 2009, Sensors.

[40]  Dan Siewiorek,et al.  Generation smartphone , 2012, IEEE Spectrum.

[41]  Peter H. Veltink,et al.  Ambulatory Position and Orientation Tracking Fusing Magnetic and Inertial Sensing , 2007, IEEE Transactions on Biomedical Engineering.

[42]  Ling Bao,et al.  Activity Recognition from User-Annotated Acceleration Data , 2004, Pervasive.

[43]  Billur Barshan,et al.  Comparative study on classifying human activities with miniature inertial and magnetic sensors , 2010, Pattern Recognit..

[44]  A. Nguyen,et al.  Unsupervised Clustering of Free-Living Human Activities using Ambulatory Accelerometry , 2007, 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[45]  Anthony Rowe,et al.  Location and Activity Recognition Using eWatch: A Wearable Sensor Platform , 2006, Ambient Intelligence in Everyday.

[46]  Ian H. Witten,et al.  Data mining: practical machine learning tools and techniques, 3rd Edition , 1999 .

[47]  Jake K. Aggarwal,et al.  Human Motion Analysis: A Review , 1999, Comput. Vis. Image Underst..

[48]  Angelo Maria Sabatini,et al.  Inertial sensing in biomechanics: a survey of computational techniques bridging motion analysis and personal navigation , 2006 .

[49]  John Weston,et al.  Strapdown Inertial Navigation Technology , 1997 .

[50]  Aleksandar Milenkovic,et al.  Journal of Neuroengineering and Rehabilitation Open Access a Wireless Body Area Network of Intelligent Motion Sensors for Computer Assisted Physical Rehabilitation , 2005 .

[51]  Paul Lukowicz,et al.  Activity Recognition of Assembly Tasks Using Body-Worn Microphones and Accelerometers , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[52]  John Weston,et al.  Strapdown Inertial Navigation Technology, Second Edition , 2005 .

[53]  K. Aminian,et al.  Physical activity monitoring based on accelerometry: validation and comparison with video observation , 1999, Medical & Biological Engineering & Computing.

[54]  Billur Barshan,et al.  Human activity classification with miniature inertial and magnetic sensors , 2011, 2011 IEEE 19th Signal Processing and Communications Applications Conference (SIU).

[55]  Paul Lukowicz,et al.  OPPORTUNITY: Towards opportunistic activity and context recognition systems , 2009, 2009 IEEE International Symposium on a World of Wireless, Mobile and Multimedia Networks & Workshops.

[56]  Aras Yurtman RECOGNITION AND CLASSIFICATION OF HUMAN ACTIVITIES USING WEARABLE SENSORS , 2012 .

[57]  Nassir Navab,et al.  Recognizing multiple human activities and tracking full-body pose in unconstrained environments , 2012, Pattern Recognit..

[58]  Kamiar Aminian,et al.  Ambulatory system for human motion analysis using a kinematic sensor: monitoring of daily physical activity in the elderly , 2003, IEEE Transactions on Biomedical Engineering.

[59]  Mitja Lustrek,et al.  Fall Detection and Activity Recognition with Machine Learning , 2009, Informatica.

[60]  Hongyi Li,et al.  An Incremental Learning Method Based on Probabilistic Neural Networks and Adjustable Fuzzy Clustering for Human Activity Recognition by Using Wearable Sensors , 2012, IEEE Transactions on Information Technology in Biomedicine.

[61]  Wai Yin Wong,et al.  Clinical Applications of Sensors for Human Posture and Movement Analysis: A Review , 2007, Prosthetics and orthotics international.

[62]  B. G. Celler,et al.  Classification of basic daily movements using a triaxial accelerometer , 2004, Medical and Biological Engineering and Computing.

[63]  Cameron N. Riviere,et al.  Toward active tremor canceling in handheld microsurgical instruments , 2003, IEEE Trans. Robotics Autom..

[64]  Tieniu Tan,et al.  Recent developments in human motion analysis , 2003, Pattern Recognit..

[65]  Albrecht Schmidt,et al.  Multi-sensor Activity Context Detection for Wearable Computing , 2003, EUSAI.

[66]  Ilkka Korhonen,et al.  Detection of Daily Activities and Sports With Wearable Sensors in Controlled and Uncontrolled Conditions , 2008, IEEE Transactions on Information Technology in Biomedicine.

[67]  Hassan Ghasemzadeh,et al.  Collaborative signal processing for action recognition in body sensor networks: a distributed classification algorithm using motion transcripts , 2010, IPSN '10.

[68]  Philippe Pourcelot,et al.  Fourier analysis of trunk displacements: a method to identify the lame limb in trotting horses. , 2002, Journal of biomechanics.

[69]  Anthony Steed,et al.  Automatic Recognition of Non-Acted Affective Postures , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[70]  Franco Zambonelli,et al.  Detecting activities from body-worn accelerometers via instance-based algorithms , 2010, Pervasive Mob. Comput..

[71]  อนิรุธ สืบสิงห์,et al.  Data Mining Practical Machine Learning Tools and Techniques , 2014 .

[72]  Olivier Faugeras,et al.  Cooperation of the inertial and visual systems , 1990 .

[73]  Eliathamby Ambikairajah,et al.  Classification of a known sequence of motions and postures from accelerometry data using adapted Gaussian mixture models. , 2006, Physiological measurement.

[74]  Jeen-Shing Wang,et al.  Using acceleration measurements for activity recognition: An effective learning algorithm for constructing neural classifiers , 2008, Pattern Recognit. Lett..

[75]  Luca Benini,et al.  Activity Recognition from On-Body Sensors: Accuracy-Power Trade-Off by Dynamic Sensor Selection , 2008, EWSN.

[76]  Xiaoping Yun,et al.  Self-contained Position Tracking of Human Movement Using Small Inertial/Magnetic Sensor Modules , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[77]  Billur Barshan,et al.  Human activity classification with miniature inertial and magnetic sensor signals , 2011, 2011 19th European Signal Processing Conference.

[78]  Johannes Peltola,et al.  Activity classification using realistic data from wearable sensors , 2006, IEEE Transactions on Information Technology in Biomedicine.

[79]  Nadia Bianchi-Berthouze,et al.  Continuous Recognition of Player's Affective Body Expression as Dynamic Quality of Aesthetic Experience , 2012, IEEE Transactions on Computational Intelligence and AI in Games.

[80]  Jessica K. Hodgins,et al.  Accelerometer-based user interfaces for the control of a physically simulated character , 2008, SIGGRAPH 2008.