Activity identification using body-mounted sensors—a review of classification techniques

With the advent of miniaturized sensing technology, which can be body-worn, it is now possible to collect and store data on different aspects of human movement under the conditions of free living. This technology has the potential to be used in automated activity profiling systems which produce a continuous record of activity patterns over extended periods of time. Such activity profiling systems are dependent on classification algorithms which can effectively interpret body-worn sensor data and identify different activities. This article reviews the different techniques which have been used to classify normal activities and/or identify falls from body-worn sensor data. The review is structured according to the different analytical techniques and illustrates the variety of approaches which have previously been applied in this field. Although significant progress has been made in this important area, there is still significant scope for further work, particularly in the application of advanced classification techniques to problems involving many different activities.

[1]  Alan Godfrey,et al.  Motion Analysis in Delirium: A Novel Method of Clarifying Motoric Subtypes , 2007, Neurocase.

[2]  Kamiar Aminian,et al.  Measurement of stand-sit and sit-stand transitions using a miniature gyroscope and its application in fall risk evaluation in the elderly , 2002, IEEE Transactions on Biomedical Engineering.

[3]  H J Montoye,et al.  The assessment of physical activity by questionnaire. , 1986, American Journal of Epidemiology.

[4]  H.J. Stam,et al.  Automated estimation of initial and terminal contact timing using accelerometers; development and validation in transtibial amputees and controls , 2005, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[5]  J. Tuomilehto,et al.  Low physical activity as a predictor for total and cardiovascular disease mortality in middle-aged men and women in Finland. , 2004, European heart journal.

[6]  G M Lyons,et al.  Long-term mobility monitoring of older adults using accelerometers in a clinical environment , 2004, Clinical rehabilitation.

[7]  Ling Bao,et al.  Activity Recognition from User-Annotated Acceleration Data , 2004, Pervasive.

[8]  Kelly R Evenson,et al.  Accelerometer use in physical activity: best practices and research recommendations. , 2005, Medicine and science in sports and exercise.

[9]  Bernt Schiele,et al.  Unsupervised Discovery of Structure in Activity Data Using Multiple Eigenspaces , 2006, LoCA.

[10]  B. G. Celler,et al.  Classification of basic daily movements using a triaxial accelerometer , 2004, Medical and Biological Engineering and Computing.

[11]  K. Aminian,et al.  Temporal feature estimation during walking using miniature accelerometers: an analysis of gait improvement after hip arthroplasty , 1999, Medical & Biological Engineering & Computing.

[12]  Peter H. Veltink,et al.  Measuring orientation of human body segments using miniature gyroscopes and accelerometers , 2005, Medical and Biological Engineering and Computing.

[13]  K. Aminian,et al.  The prediction of speed and incline in outdoor running in humans using accelerometry. , 1999, Medicine and science in sports and exercise.

[14]  H. Busser,et al.  Ambulatory monitoring of physical activity in working situations, a validation study. , 1998, Journal of medical engineering & technology.

[15]  P H Veltink,et al.  Detection of static and dynamic activities using uniaxial accelerometers. , 1996, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[16]  J. Fahrenberg,et al.  Assessment of posture and motion by multichannel piezoresistive accelerometer recordings. , 1997, Psychophysiology.

[17]  Michael L. Littman,et al.  Activity Recognition from Accelerometer Data , 2005, AAAI.

[18]  J. Bussmann,et al.  Ambulatory accelerometry to quantify motor behaviour in patients after failed back surgery: a validation study , 1998, Pain.

[19]  Tatsuo Nakajima,et al.  Feature Selection and Activity Recognition from Wearable Sensors , 2006, UCS.

[20]  Bernt Schiele,et al.  Analyzing features for activity recognition , 2005, sOc-EUSAI '05.

[21]  J. Staudenmayer,et al.  Development of novel techniques to classify physical activity mode using accelerometers. , 2006, Medicine and science in sports and exercise.

[22]  Friedrich Foerster,et al.  Motion pattern and posture: Correctly assessed by calibrated accelerometers , 2000, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[23]  E. Gelsema,et al.  Recognition of daily life motor activity classes using an artificial neural network. , 1998, Archives of physical medicine and rehabilitation.

[24]  M N Nyan,et al.  Distinguishing fall activities from normal activities by angular rate characteristics and high-speed camera characterization. , 2006, Medical engineering & physics.

[25]  G. Wu,et al.  Distinguishing fall activities from normal activities by velocity characteristics. , 2000, Journal of biomechanics.

[26]  Hylton B Menz,et al.  Accelerometry: a technique for quantifying movement patterns during walking. , 2008, Gait & posture.

[27]  C J Snijders,et al.  Computerized analysis of daily life motor activity for ambulatory monitoring. , 1997, Technology and health care : official journal of the European Society for Engineering and Medicine.

[28]  Andreas Krause,et al.  Unsupervised, dynamic identification of physiological and activity context in wearable computing , 2003, Seventh IEEE International Symposium on Wearable Computers, 2003. Proceedings..

[29]  Kenji Mase,et al.  Activity and Location Recognition Using Wearable Sensors , 2002, IEEE Pervasive Comput..

[30]  P. Freedson,et al.  Validity of accelerometry for the assessment of moderate intensity physical activity in the field. , 2000, Medicine and science in sports and exercise.

[31]  Andrew R. Webb,et al.  Statistical Pattern Recognition , 1999 .

[32]  Geoffrey J. McLachlan,et al.  Finite Mixture Models , 2019, Annual Review of Statistics and Its Application.

[33]  Bernt Schiele,et al.  Towards Less Supervision in Activity Recognition from Wearable Sensors , 2006, 2006 10th IEEE International Symposium on Wearable Computers.

[34]  Johannes Peltola,et al.  Activity classification using realistic data from wearable sensors , 2006, IEEE Transactions on Information Technology in Biomedicine.

[35]  D.B. Popovic,et al.  Machine learning in control of functional electrical stimulation systems for locomotion , 1995, IEEE Transactions on Biomedical Engineering.

[36]  Kristof Van Laerhoven,et al.  What shall we teach our pants? , 2000, Digest of Papers. Fourth International Symposium on Wearable Computers.

[37]  Amara Lynn Graps,et al.  An introduction to wavelets , 1995 .

[38]  E. Taub,et al.  Objective measurement of functional upper-extremity movement using accelerometer recordings transformed with a threshold filter. , 2000, Stroke.

[39]  Gaetano Borriello,et al.  A Practical Approach to Recognizing Physical Activities , 2006, Pervasive.

[40]  M Makikawa,et al.  Development of an ambulatory physical activity memory device and its application for the categorization of actions in daily life. , 1995, Medinfo. MEDINFO.

[41]  Justin R. Boyle,et al.  Quantifying Functional Mobility Progress for Chronic Disease Management , 2006, 2006 International Conference of the IEEE Engineering in Medicine and Biology Society.

[42]  David Howard,et al.  A Comparison of Feature Extraction Methods for the Classification of Dynamic Activities From Accelerometer Data , 2009, IEEE Transactions on Biomedical Engineering.

[43]  A. Yancey,et al.  Physical inactivity and overweight among Los Angeles County adults. , 2004, American journal of preventive medicine.

[44]  Tong Zhang,et al.  Fall Detection by Wearable Sensor and One-Class SVM Algorithm , 2006 .

[45]  M. Akay,et al.  Discrimination of walking patterns using wavelet-based fractal analysis , 2002, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[46]  K Aminian,et al.  Can accelerometry accurately predict the energy cost of uphill/downhill walking? , 2001, Ergonomics.

[47]  R. J. Gurley,et al.  Persons found in their homes helpless or dead. , 1996, The New England journal of medicine.

[48]  L. Ohno-Machado,et al.  Neural network applications in physical medicine and rehabilitation. , 1999, American journal of physical medicine & rehabilitation.

[49]  B. Celler,et al.  Accelerometry Based Classification of Walking Patterns Using Time-frequency Analysis , 2007, 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[50]  H. Busser,et al.  Ambulatory monitoring of children's activity. , 1997, Medical engineering & physics.

[51]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[52]  M. Decramer,et al.  Quantifying physical activity in daily life with questionnaires and motion sensors in COPD , 2006, European Respiratory Journal.

[53]  A McIntosh,et al.  The design of a practical and reliable fall detector for community and institutional telecare , 2000, Journal of telemedicine and telecare.

[54]  K. Aminian,et al.  Physical activity monitoring based on accelerometry: validation and comparison with video observation , 1999, Medical & Biological Engineering & Computing.

[55]  D. Rosenbaum,et al.  Quantity versus quality of gait and quality of life in patients with osteoarthritis. , 2008, Gait & posture.

[56]  B. Ugur Toreyin,et al.  Falling Person Detection Using Multi-sensor Signal Processing , 2007 .

[57]  H.C. Kim,et al.  Development of novel algorithm and real-time monitoring ambulatory system using Bluetooth module for fall detection in the elderly , 2004, The 26th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[58]  J. Allum,et al.  Gait event detection using linear accelerometers or angular velocity transducers in able-bodied and spinal-cord injured individuals. , 2006, Gait & posture.

[59]  S. Mukhopadhyay,et al.  Resistive fibre-meshed transducers , 2003, Seventh IEEE International Symposium on Wearable Computers, 2003. Proceedings..

[60]  Angelo M. Sabatini,et al.  Quaternion-based extended Kalman filter for determining orientation by inertial and magnetic sensing , 2006, IEEE Transactions on Biomedical Engineering.

[61]  A. Enis Çetin,et al.  Falling Person Detection Using Multi-Sensor Signal Processing , 2007, 2007 IEEE 15th Signal Processing and Communications Applications.

[62]  J. B. J. Bussmann,et al.  Measuring daily behavior using ambulatory accelerometry: The Activity Monitor , 2001, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[63]  Karen Holtzblatt Designing for the Mobile Device: Experiences, Challenges, and Methods , 2005 .

[64]  T. Tamura,et al.  Classification of walking pattern using acceleration waveform in elderly people , 2000, Proceedings of the 22nd Annual International Conference of the IEEE Engineering in Medicine and Biology Society (Cat. No.00CH37143).

[65]  G. Lyons,et al.  The use of accelerometry to detect heel contact events for use as a sensor in FES assisted walking. , 2003, Medical engineering & physics.

[66]  O. Rioul,et al.  Wavelets and signal processing , 1991, IEEE Signal Processing Magazine.

[67]  Ilias Maglogiannis,et al.  Advanced patient or elder fall detection based on movement and sound data , 2008, Pervasive 2008.

[68]  C. Becker,et al.  Evaluation of a fall detector based on accelerometers: A pilot study , 2005, Medical and Biological Engineering and Computing.

[69]  Kamiar Aminian,et al.  Ambulatory Monitoring of Physical Activities in Patients With Parkinson's Disease , 2007, IEEE Transactions on Biomedical Engineering.

[70]  T. Findley,et al.  A useful method for measuring daily physical activity by a three-direction monitor. , 1997, Scandinavian journal of rehabilitation medicine.

[71]  C. Caspersen,et al.  Physical activity, exercise, and physical fitness: definitions and distinctions for health-related research. , 1985, Public health reports.

[72]  O. Wilder‐Smith,et al.  How dangerous are falls in old people at home? , 1981, British medical journal.

[73]  K Aminian,et al.  Ambulatory system for the quantitative and qualitative analysis of gait and posture in chronic pain patients treated with spinal cord stimulation. , 2004, Gait & posture.

[74]  Blake Hannaford,et al.  A Hybrid Discriminative/Generative Approach for Modeling Human Activities , 2005, IJCAI.

[75]  J Y Goulermas,et al.  Regression techniques for the prediction of lower limb kinematics. , 2005, Journal of biomechanical engineering.

[76]  Kristof Van Laerhoven,et al.  Spine versus porcupine: a study in distributed wearable activity recognition , 2004, Eighth International Symposium on Wearable Computers.

[77]  J. Ross Quinlan,et al.  Improved Use of Continuous Attributes in C4.5 , 1996, J. Artif. Intell. Res..

[78]  W. Ondo,et al.  Ambulatory monitoring of freezing of gait in Parkinson's disease , 2008, Journal of Neuroscience Methods.

[79]  K Aminian,et al.  Incline, speed, and distance assessment during unconstrained walking. , 1995, Medicine and science in sports and exercise.

[80]  Oliver J. Woodman,et al.  An introduction to inertial navigation , 2007 .

[81]  Schmidtke Hedda,et al.  Change of Orientation , 2003 .

[82]  A. Nguyen,et al.  Unsupervised Clustering of Free-Living Human Activities using Ambulatory Accelerometry , 2007, 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[83]  A. Hof,et al.  Assessment of spatio-temporal gait parameters from trunk accelerations during human walking. , 2003, Gait & posture.

[84]  Christopher J. Bishop,et al.  Pulsed Neural Networks , 1998 .

[85]  M. N. Nyan,et al.  Classification of gait patterns in the time-frequency domain. , 2006, Journal of biomechanics.

[86]  J. Bussmann,et al.  Quantification of physical activities by means of ambulatory accelerometry: a validation study. , 1998, Psychophysiology.

[87]  A. Bourke,et al.  A threshold-based fall-detection algorithm using a bi-axial gyroscope sensor. , 2008, Medical engineering & physics.

[88]  J. Kent‐Braun,et al.  Quantitation of lower physical activity in persons with multiple sclerosis. , 1997, Medicine and science in sports and exercise.

[89]  Nigel H. Lovell,et al.  Implementation of a real-time human movement classifier using a triaxial accelerometer for ambulatory monitoring , 2006, IEEE Transactions on Information Technology in Biomedicine.

[90]  Kamiar Aminian,et al.  Spatio-temporal parameters of gait measured by an ambulatory system using miniature gyroscopes. , 2002, Journal of biomechanics.

[91]  Kuan Zhang,et al.  Assessment of human locomotion by using an insole measurement system and artificial neural networks. , 2005, Journal of biomechanics.

[92]  S. Blair,et al.  Health promotion for educators: impact on health behaviors, satisfaction, and general well-being. , 1984, American journal of public health.

[93]  Liang Xu,et al.  Using Wearable Sensor and NMF Algorithm to Realize Ambulatory Fall Detection , 2006, ICNC.

[94]  Maxim A. Batalin,et al.  Incremental Diagnosis Method for Intelligent Wearable Sensor Systems , 2007, IEEE Transactions on Information Technology in Biomedicine.

[95]  Paul Lukowicz,et al.  Recognizing Workshop Activity Using Body Worn Microphones and Accelerometers , 2004, Pervasive.

[96]  HyungDal Park,et al.  A study on the activity classification using a triaxial accelerometer , 2003, Proceedings of the 25th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (IEEE Cat. No.03CH37439).

[97]  A K Bourke,et al.  Evaluation of a threshold-based tri-axial accelerometer fall detection algorithm. , 2007, Gait & posture.

[98]  T Togawa,et al.  Classification of waist-acceleration signals in a continuous walking record. , 2000, Medical engineering & physics.

[99]  T Chau,et al.  A review of analytical techniques for gait data. Part 1: Fuzzy, statistical and fractal methods. , 2001, Gait & posture.

[100]  J. Manson,et al.  Physical activity and incidence of non-insulin-dependent diabetes mellitus in women , 1991, The Lancet.

[101]  Tapio Seppänen,et al.  Recognizing human motion with multiple acceleration sensors , 2001, 2001 IEEE International Conference on Systems, Man and Cybernetics. e-Systems and e-Man for Cybernetics in Cyberspace (Cat.No.01CH37236).

[102]  G. ÓLaighin,et al.  Direct measurement of human movement by accelerometry. , 2008, Medical engineering & physics.

[103]  Tong Zhang,et al.  Fall Detection by Embedding an Accelerometer in Cellphone and Using KFD Algorithm , 2006 .

[104]  S. Griffin,et al.  Effectiveness of interventions to promote physical activity in children and adolescents: systematic review of controlled trials , 2009 .

[105]  B E Ainsworth,et al.  Validity and reliability of self-reported physical activity status: the Lipid Research Clinics questionnaire. , 1993, Medicine and science in sports and exercise.

[106]  Kamiar Aminian,et al.  Ambulatory system for human motion analysis using a kinematic sensor: monitoring of daily physical activity in the elderly , 2003, IEEE Transactions on Biomedical Engineering.

[107]  A. Bourke,et al.  The identification of vertical velocity profiles using an inertial sensor to investigate pre-impact detection of falls. , 2008, Medical Engineering and Physics.

[108]  Kamiar Aminian,et al.  Stair climbing detection during daily physical activity using a miniature gyroscope. , 2005, Gait & posture.

[109]  Nello Cristianini,et al.  An Introduction to Support Vector Machines and Other Kernel-based Learning Methods , 2000 .

[110]  T Togawa,et al.  Classification of acceleration waveforms during walking by wavelet transform. , 1997, Methods of information in medicine.

[111]  R. Dunnewold,et al.  Quantitative assessment of bradykinesia in patients with parkinson's disease , 1997, Journal of Neuroscience Methods.

[112]  Anthony Rowe,et al.  Location and Activity Recognition Using eWatch: A Wearable Sensor Platform , 2006, Ambient Intelligence in Everyday.

[113]  Heekuck Oh,et al.  Neural Networks for Pattern Recognition , 1993, Adv. Comput..

[114]  Paul Lukowicz,et al.  Activity Recognition of Assembly Tasks Using Body-Worn Microphones and Accelerometers , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[115]  Wiebren Zijlstra,et al.  Assessment of spatio-temporal parameters during unconstrained walking , 2004, European Journal of Applied Physiology.

[116]  Kristof Van Laerhoven,et al.  Long term activity monitoring with a wearable sensor node , 2006, International Workshop on Wearable and Implantable Body Sensor Networks (BSN'06).

[117]  M Makikawa,et al.  Ambulatory behavior map, physical activity and biosignal monitoring system. , 1997, Methods of information in medicine.

[118]  M. Mathie,et al.  Detection of daily physical activities using a triaxial accelerometer , 2003, Medical and Biological Engineering and Computing.

[119]  Friedrich Foerster,et al.  Detection of posture and motion by accelerometry : a validation study in ambulatory monitoring , 1999 .

[120]  Patrick Boissy,et al.  User-based motion sensing and fuzzy logic for automated fall detection in older adults. , 2007, Telemedicine journal and e-health : the official journal of the American Telemedicine Association.

[121]  T Chau,et al.  A review of analytical techniques for gait data. Part 2: neural network and wavelet methods. , 2001, Gait & posture.

[122]  R B Stein,et al.  Application of tilt sensors in functional electrical stimulation. , 1996, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[123]  Merryn J Mathie,et al.  Accelerometry: providing an integrated, practical method for long-term, ambulatory monitoring of human movement , 2004, Physiological measurement.

[124]  J. D. Janssen,et al.  A triaxial accelerometer and portable data processing unit for the assessment of daily physical activity , 1997, IEEE Transactions on Biomedical Engineering.

[125]  Donald F. Specht,et al.  Probabilistic neural networks , 1990, Neural Networks.

[126]  R. Bajcsy,et al.  Wearable Sensors for Reliable Fall Detection , 2005, 2005 IEEE Engineering in Medicine and Biology 27th Annual Conference.

[127]  David Garlan,et al.  Context is key , 2005, CACM.

[128]  Paul Lukowicz,et al.  Experimental Evaluation of Variations in Primary Features Used for Accelerometric Context Recognition , 2003, EUSAI.

[129]  Andreas Krause,et al.  Trading off prediction accuracy and power consumption for context-aware wearable computing , 2005, Ninth IEEE International Symposium on Wearable Computers (ISWC'05).

[130]  Lindsey Dugdill,et al.  Physical activity and health promotion: evidence-based approaches to practice , 2009 .

[131]  Heinz Jäckel,et al.  SPEEDY:a fall detector in a wrist watch , 2003, Seventh IEEE International Symposium on Wearable Computers, 2003. Proceedings..

[132]  Xiao-Jun Zeng,et al.  An Instance-Based Algorithm With Auxiliary Similarity Information for the Estimation of Gait Kinematics From Wearable Sensors , 2008, IEEE Transactions on Neural Networks.

[133]  Dennis M. Healy,et al.  Wavelet transform domain filters: a spatially selective noise filtration technique , 1994, IEEE Trans. Image Process..

[134]  Peter H. Veltink,et al.  Ambulatory measurement of ground reaction forces , 2005, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[135]  Eliathamby Ambikairajah,et al.  Classification of a known sequence of motions and postures from accelerometry data using adapted Gaussian mixture models. , 2006, Physiological measurement.

[136]  D. Bassett,et al.  The technology of accelerometry-based activity monitors: current and future. , 2005, Medicine and science in sports and exercise.

[137]  P. Veltink,et al.  Ambulatory measurement of ground reaction forces , 2005 .

[138]  P. Veltink,et al.  Validity and reliability of measurements obtained with an "activity monitor" in people with and without a transtibial amputation. , 1998, Physical therapy.

[139]  Albrecht Schmidt,et al.  Multi-sensor Activity Context Detection for Wearable Computing , 2003, EUSAI.

[140]  Ilkka Korhonen,et al.  Detection of Daily Activities and Sports With Wearable Sensors in Controlled and Uncontrolled Conditions , 2008, IEEE Transactions on Information Technology in Biomedicine.