Activity Recognition Using Inertial Sensing for Healthcare, Wellbeing and Sports Applications: A Survey

This paper surveys the current research directions of activity recognition using inertial sensors, with potential application in healthcare, wellbeing and sports. The analysis of related work is organized according to the five main steps involved in the activity recognition process: preprocessing, segmentation, feature extraction, dimensionality reduction and classification. For each step, we present the main techniques utilized, their advantages and drawbacks, performance metrics and usage examples. We also discuss the research challenges, such as user behavior and technical limitations, as well as the remaining open research questions.

[1]  Keinosuke Fukunaga,et al.  Introduction to Statistical Pattern Recognition , 1972 .

[2]  Richard O. Duda,et al.  Pattern classification and scene analysis , 1974, A Wiley-Interscience publication.

[3]  C. Caspersen,et al.  Physical activity, exercise, and physical fitness: definitions and distinctions for health-related research. , 1985, Public health reports.

[4]  Keinosuke Fukunaga,et al.  Introduction to statistical pattern recognition (2nd ed.) , 1990 .

[5]  S. Davies,et al.  Use of limb movement sensors as indicators of the level of everyday physical activity in chronic congestive heart failure. , 1992, The American journal of cardiology.

[6]  Ron Kohavi,et al.  Supervised and Unsupervised Discretization of Continuous Features , 1995, ICML.

[7]  Hagit Shatkay,et al.  Approximate queries and representations for large data sequences , 1996, Proceedings of the Twelfth International Conference on Data Engineering.

[8]  M. Myrtek,et al.  Perception of emotions in everyday life: studies with patients and normals , 1996, Biological Psychology.

[9]  D J Walker,et al.  A continuous patient activity monitor: validation and relation to disability , 1997, Physiological measurement.

[10]  H. Busser,et al.  Ambulatory monitoring of children's activity. , 1997, Medical engineering & physics.

[11]  E.J.W. Van Someren,et al.  A new actigraph for long-term registration of the duration and intensity of tremor and movement , 1998, IEEE Transactions on Biomedical Engineering.

[12]  J. Evans,et al.  External cueing systems in the rehabilitation of executive impairments of action , 1998, Journal of the International Neuropsychological Society.

[13]  P. Heidenreich,et al.  Effect of a home monitoring system on hospitalization and resource use for patients with heart failure. , 1999, American heart journal.

[14]  Dariu Gavrila,et al.  The Visual Analysis of Human Movement: A Survey , 1999, Comput. Vis. Image Underst..

[15]  Kristof Van Laerhoven,et al.  What shall we teach our pants? , 2000, Digest of Papers. Fourth International Symposium on Wearable Computers.

[16]  M. Akay,et al.  Analysis of acceleration signals using wavelet transform. , 2000, Methods of information in medicine.

[17]  Christopher Edwards,et al.  The effects of filtered video on awareness and privacy , 2000, CSCW '00.

[18]  Alex Pentland,et al.  Looking at People: Sensing for Ubiquitous and Wearable Computing , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[19]  Tapio Seppänen,et al.  Recognizing human motion with multiple acceleration sensors , 2001, 2001 IEEE International Conference on Systems, Man and Cybernetics. e-Systems and e-Man for Cybernetics in Cyberspace (Cat.No.01CH37236).

[20]  Jennifer Healey,et al.  Toward Machine Emotional Intelligence: Analysis of Affective Physiological State , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  J. McMurray,et al.  Economics of chronic heart failure , 2001, European journal of heart failure.

[22]  Eamonn J. Keogh,et al.  An online algorithm for segmenting time series , 2001, Proceedings 2001 IEEE International Conference on Data Mining.

[23]  Svetha Venkatesh,et al.  Hierarchical recognition of intentional human gestures for sports video annotation , 2002, Object recognition supported by user interaction for service robots.

[24]  Nigel H. Lovell,et al.  Determining activity using a triaxial accelerometer , 2002, Proceedings of the Second Joint 24th Annual Conference and the Annual Fall Meeting of the Biomedical Engineering Society] [Engineering in Medicine and Biology.

[25]  Henry A. Kautz,et al.  An Overview of the Assisted Cognition Project , 2002 .

[26]  Emmanuel,et al.  Activity recognition in the home setting using simple and ubiquitous sensors , 2003 .

[27]  Hayashi Takafumi,et al.  CHI-ball, an interactive device assisting martial arts education for children , 2003, CHI Extended Abstracts.

[28]  Albrecht Schmidt,et al.  Multi-sensor Activity Context Detection for Wearable Computing , 2003, EUSAI.

[29]  Kamiar Aminian,et al.  Ambulatory system for human motion analysis using a kinematic sensor: monitoring of daily physical activity in the elderly , 2003, IEEE Transactions on Biomedical Engineering.

[30]  Andreas Krause,et al.  Unsupervised, dynamic identification of physiological and activity context in wearable computing , 2003, Seventh IEEE International Symposium on Wearable Computers, 2003. Proceedings..

[31]  B. Steele,et al.  Bodies in motion: monitoring daily activity and exercise with motion sensors in people with chronic pulmonary disease. , 2003, Journal of rehabilitation research and development.

[32]  Peter Gregor,et al.  Issues surrounding the user-centred development of a new interactive memory aid , 2003, Universal Access in the Information Society.

[33]  Ling Bao,et al.  Activity Recognition from User-Annotated Acceleration Data , 2004, Pervasive.

[34]  Jie Yang,et al.  Feature Selection for Multi-class Problems Using Support Vector Machines , 2004, PRICAI.

[35]  Olivier Chételat,et al.  Very Low Complexity Algorithm for Ambulatory Activity Classification , 2005 .

[36]  Paul Lukowicz,et al.  Where am I: Recognizing On-body Positions of Wearable Sensors , 2005, LoCA.

[37]  Bernt Schiele,et al.  Analyzing features for activity recognition , 2005, sOc-EUSAI '05.

[38]  Shuangquan Wang,et al.  Human activity recognition with user-free accelerometers in the sensor networks , 2005, 2005 International Conference on Neural Networks and Brain.

[39]  Wearable Kinesthetic System for Capturing and Classifying Upper Limb Gesture , 2005, WHC.

[40]  Paul Lukowicz,et al.  Gesture spotting using wrist worn microphone and 3-axis accelerometer , 2005, sOc-EUSAI '05.

[41]  Michael L. Littman,et al.  Activity Recognition from Accelerometer Data , 2005, AAAI.

[42]  Kai-Tai Song,et al.  Remote Activity Monitoring of the Elderly Using a Two-Axis Accelerometer , 2005 .

[43]  Alex Pentland,et al.  Wearable feedback systems for rehabilitation , 2005, Journal of NeuroEngineering and Rehabilitation.

[44]  Cyrus Shahabi,et al.  Feature subset selection and feature ranking for multivariate time series , 2005, IEEE Transactions on Knowledge and Data Engineering.

[45]  M. N. Nyan,et al.  Classification of gait patterns in the time-frequency domain. , 2006, Journal of biomechanics.

[46]  B. G. Celler,et al.  Classification of basic daily movements using a triaxial accelerometer , 2004, Medical and Biological Engineering and Computing.

[47]  Nigel H. Lovell,et al.  Implementation of a real-time human movement classifier using a triaxial accelerometer for ambulatory monitoring , 2006, IEEE Transactions on Information Technology in Biomedicine.

[48]  Paul Lukowicz,et al.  Using Wearable Sensors for Real-Time Recognition Tasks in Games of Martial Arts - An Initial Experiment , 2006, 2006 IEEE Symposium on Computational Intelligence and Games.

[49]  Paul Lukowicz,et al.  Activity Recognition of Assembly Tasks Using Body-Worn Microphones and Accelerometers , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[50]  E. Ambikairajah,et al.  An Adapted Gaussian Mixture Model Approach to Accelerometry-Based Movement Classification Using Time-Domain Features , 2006, 2006 International Conference of the IEEE Engineering in Medicine and Biology Society.

[51]  Gaetano Borriello,et al.  A Practical Approach to Recognizing Physical Activities , 2006, Pervasive.

[52]  Johannes Peltola,et al.  Activity classification using realistic data from wearable sensors , 2006, IEEE Transactions on Information Technology in Biomedicine.

[53]  M. Mathie,et al.  Detection of daily physical activities using a triaxial accelerometer , 2003, Medical and Biological Engineering and Computing.

[54]  Tatsuo Nakajima,et al.  Feature Selection and Activity Recognition from Wearable Sensors , 2006, UCS.

[55]  Daniel P. Siewiorek,et al.  Activity recognition and monitoring using multiple sensors on different body positions , 2006, International Workshop on Wearable and Implantable Body Sensor Networks (BSN'06).

[56]  S. Shankar Sastry,et al.  Physical Activity Monitoring for Assisted Living at Home , 2007, BSN.

[57]  Gerhard Tröster,et al.  On-body activity recognition in a dynamic sensor network , 2007, BODYNETS.

[58]  Venet Osmani,et al.  Self-organising object networks using context zones for distributed activity recognition , 2007, BODYNETS.

[59]  Raghunathan Rengaswamy,et al.  Fault diagnosis using dynamic trend analysis: A review and recent developments , 2007, Eng. Appl. Artif. Intell..

[60]  B. Celler,et al.  Accelerometry Based Classification of Walking Patterns Using Time-frequency Analysis , 2007, 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[61]  Garik Markarian,et al.  Self management of chronic disease using mobile devices and Bluetooth monitors , 2007, BODYNETS.

[62]  Chang-Gun Lee,et al.  PAS: A Wireless-Enabled, Sensor-Integrated Personal Assistance System for Independent and Assisted Living , 2007, 2007 Joint Workshop on High Confidence Medical Devices, Software, and Systems and Medical Device Plug-and-Play Interoperability (HCMDSS-MDPnP 2007).

[63]  L. Klingbeil,et al.  Detecting walking activity in cardiac rehabilitation by using accelerometer , 2007, 2007 3rd International Conference on Intelligent Sensors, Sensor Networks and Information.

[64]  E. Ambikairajah,et al.  Time-Frequency Based Features for Classification of Walking Patterns , 2007, 2007 15th International Conference on Digital Signal Processing.

[65]  Christian Peter,et al.  Using physical activity for user behavior analysis , 2008, PETRA '08.

[66]  Jeen-Shing Wang,et al.  Using acceleration measurements for activity recognition: An effective learning algorithm for constructing neural classifiers , 2008, Pattern Recognit. Lett..

[67]  Stephen B. Wicker,et al.  CareNet: an integrated wireless sensor networking environment for remote healthcare , 2008, BODYNETS.

[68]  Zhenyu He,et al.  Gesture recognition based on 3D accelerometer for cell phones interaction , 2008, APCCAS 2008 - 2008 IEEE Asia Pacific Conference on Circuits and Systems.

[69]  Paul Lukowicz,et al.  Gesture spotting with body-worn inertial sensors to detect user activities , 2008, Pattern Recognit..

[70]  Maxim A. Batalin,et al.  MEDIC: Medical embedded device for individualized care , 2008, Artif. Intell. Medicine.

[71]  Ilkka Korhonen,et al.  Detection of Daily Activities and Sports With Wearable Sensors in Controlled and Uncontrolled Conditions , 2008, IEEE Transactions on Information Technology in Biomedicine.

[72]  Shuwan Xue,et al.  Portable Preimpact Fall Detector With Inertial Sensors , 2008, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[73]  Luca Benini,et al.  Activity Recognition from On-Body Sensors: Accuracy-Power Trade-Off by Dynamic Sensor Selection , 2008, EWSN.

[74]  Hassan Ghasemzadeh,et al.  Sport training using body sensor networks: a statistical approach to measure wrist rotation for golf swing , 2009, BODYNETS.

[75]  Kenneth Meijer,et al.  Activity identification using body-mounted sensors—a review of classification techniques , 2009, Physiological measurement.

[76]  Xi Long,et al.  Single-accelerometer-based daily physical activity classification , 2009, 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[77]  Paul J. M. Havinga,et al.  Keep on Moving! Activity Monitoring and Stimulation Using Wireless Sensor Networks , 2009, EuroSSC.

[78]  Chris D. Nugent,et al.  Evidential fusion of sensor data for activity recognition in smart homes , 2009, Pervasive Mob. Comput..

[79]  Daqing Zhang,et al.  Gesture Recognition with a 3-D Accelerometer , 2009, UIC.

[80]  David Howard,et al.  A Comparison of Feature Extraction Methods for the Classification of Dynamic Activities From Accelerometer Data , 2009, IEEE Transactions on Biomedical Engineering.

[81]  Sethuraman Panchanathan,et al.  Recognition of hand movements using wearable accelerometers , 2009, J. Ambient Intell. Smart Environ..

[82]  D. Segal.  Diagnostic and Statistical Manual of Mental Disorders (DSM-IV-TR) , 2010 .

[83]  P. Nurmi,et al.  Online feature selection for contextual time series data ( Extended abstract ) , 2022 .