Deep Learning for Classifying Physical Activities from Accelerometer Data

Physical inactivity increases the risk of many adverse health conditions, including the world’s major non-communicable diseases, such as coronary heart disease, type 2 diabetes, and breast and colon cancers, shortening life expectancy. There are minimal medical care and personal trainers’ methods to monitor a patient’s actual physical activity types. To improve activity monitoring, we propose an artificial-intelligence-based approach to classify physical movement activity patterns. In more detail, we employ two deep learning (DL) methods, namely a deep feed-forward neural network (DNN) and a deep recurrent neural network (RNN) for this purpose. We evaluate the two models on two physical movement datasets collected from several volunteers who carried tri-axial accelerometer sensors. The first dataset is from the UCI machine learning repository, which contains 14 different activities-of-daily-life (ADL) and is collected from 16 volunteers who carried a single wrist-worn tri-axial accelerometer. The second dataset includes ten other ADLs and is gathered from eight volunteers who placed the sensors on their hips. Our experiment results show that the RNN model provides accurate performance compared to the state-of-the-art methods in classifying the fundamental movement patterns with an overall accuracy of 84.89% and an overall F1-score of 82.56%. The results indicate that our method provides the medical doctors and trainers a promising way to track and understand a patient’s physical activities precisely for better treatment.

[1]  M. Tahar Kechadi,et al.  Human Activity Recognition with Convolutional Neural Networks , 2018, ECML/PKDD.

[2]  Kun Zhang,et al.  Lung sounds classification using convolutional neural networks , 2018, Artif. Intell. Medicine.

[3]  Rui Dai,et al.  Classifying medical relations in clinical text via convolutional neural networks , 2018, Artif. Intell. Medicine.

[4]  Eliathamby Ambikairajah,et al.  Classification of a known sequence of motions and postures from accelerometry data using adapted Gaussian mixture models. , 2006, Physiological measurement.

[5]  Evangelia I. Zacharaki,et al.  Recognizing Physical Activity of Older People from Wearable Sensors and Inconsistent Data , 2019, Sensors.

[6]  Dong Seog Han,et al.  iSPLInception: An Inception-ResNet Deep Learning Architecture for Human Activity Recognition , 2021, IEEE Access.

[7]  Gernot A. Fink,et al.  Convolutional Neural Networks for Human Activity Recognition Using Body-Worn Sensors , 2018, Informatics.

[8]  Benoit Gosselin,et al.  Real-Time Human Physical Activity Recognition with Low Latency Prediction Feedback Using Raw IMU Data , 2018, 2018 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[9]  Sozo Inoue,et al.  Human activity recognition using earable device , 2019, UbiComp/ISWC Adjunct.

[10]  Stewart G Trost,et al.  Prediction of activity type in preschool children using machine learning techniques. , 2015, Journal of science and medicine in sport.

[11]  Alicja R. Rudnicka,et al.  An open-source tool to identify active travel from hip-worn accelerometer, GPS and GIS data , 2018, International Journal of Behavioral Nutrition and Physical Activity.

[12]  Tullio Vernazza,et al.  Analysis of human behavior recognition algorithms based on acceleration data , 2013, 2013 IEEE International Conference on Robotics and Automation.

[13]  Alejandro Baldominos Gómez,et al.  A Comparison Study of Classifier Algorithms for Cross-Person Physical Activity Recognition , 2016, Sensors.

[14]  Attaphongse Taparugssanagorn,et al.  Human activity classification using long short-term memory network , 2018, Signal, Image and Video Processing.

[15]  Stewart Massie,et al.  Learning Deep and Shallow Features for Human Activity Recognition , 2017, KSEM.

[16]  Dong Seog Han,et al.  Feature Representation and Data Augmentation for Human Activity Classification Based on Wearable IMU Sensor Data Using a Deep LSTM Neural Network , 2018, Sensors.

[17]  D. Warburton,et al.  Health benefits of physical activity: the evidence , 2006, Canadian Medical Association Journal.

[18]  C. Caspersen,et al.  Physical activity, exercise, and physical fitness: definitions and distinctions for health-related research. , 1985, Public health reports.

[19]  Abhay Gupta,et al.  A Survey on Human Activity Recognition and Classification , 2020, 2020 International Conference on Communication and Signal Processing (ICCSP).

[20]  Weng-Keen Wong,et al.  Machine learning for activity recognition: hip versus wrist data , 2014, Physiological measurement.

[21]  Jozsef Suto,et al.  Efficiency investigation of artificial neural networks in human activity recognition , 2017, Journal of Ambient Intelligence and Humanized Computing.

[22]  Kenneth Meijer,et al.  Activity identification using body-mounted sensors—a review of classification techniques , 2009, Physiological measurement.

[23]  Angelo M. Sabatini,et al.  Machine Learning Methods for Classifying Human Physical Activity from On-Body Accelerometers , 2010, Sensors.

[24]  Ni Zhang,et al.  Skin cancer diagnosis based on optimized convolutional neural network , 2020, Artif. Intell. Medicine.

[25]  Fatma Kalaoglu,et al.  Human Action Recognition Using Deep Learning Methods on Limited Sensory Data , 2020, IEEE Sensors Journal.

[26]  Nobuhiko Nishio,et al.  Human Activity Sensing: Corpus and Applications , 2019, Human Activity Sensing.

[27]  Jie Ding,et al.  Smartphone Sensor-Based Human Activity Recognition Using Feature Fusion and Maximum Full a Posteriori , 2020, IEEE Transactions on Instrumentation and Measurement.

[28]  Oladimeji Farri,et al.  Comparative effectiveness of convolutional neural network (CNN) and recurrent neural network (RNN) architectures for radiology text report classification , 2019, Artif. Intell. Medicine.

[29]  Fillia Makedon,et al.  CogniLearn: A Deep Learning-based Interface for Cognitive Behavior Assessment , 2017, IUI.

[30]  Zina Ben Miled,et al.  Predicting dementia with routine care EMR data , 2020, Artif. Intell. Medicine.

[31]  ‘Physical activity, that’s a tricky subject.’ Experiences of health care professionals with physical activity in type 2 diabetes care , 2018, BMC Health Services Research.

[32]  Shaohua Wan,et al.  Deep Learning Models for Real-time Human Activity Recognition with Smartphones , 2019, Mobile Networks and Applications.

[33]  Dana Kulic,et al.  Exercise motion classification from large-scale wearable sensor data using convolutional neural networks , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[34]  Jae-Young Pyun,et al.  Deep Recurrent Neural Networks for Human Activity Recognition , 2017, Sensors.

[35]  Ahmad Almogren,et al.  Human Activity Recognition from Body Sensor Data using Deep Learning , 2018, Journal of Medical Systems.

[36]  Fernando Jiménez,et al.  Feature selection based multivariate time series forecasting: An application to antibiotic resistance outbreaks prediction , 2020, Artif. Intell. Medicine.

[37]  Thomas Plötz,et al.  Deep, Convolutional, and Recurrent Models for Human Activity Recognition Using Wearables , 2016, IJCAI.

[38]  John Darby,et al.  Human Activity Recognition for Physical Rehabilitation , 2013, 2013 IEEE International Conference on Systems, Man, and Cybernetics.

[39]  K. Roessler,et al.  Exercise on Prescription. Effect of attendance on participants' psychological factors in a Danish version of Exercise on Prescription: A Study Protocol , 2008, BMC health services research.

[40]  Farshad Firouzi,et al.  Human Activity Recognition: From Sensors to Applications , 2020, 2020 International Conference on Omni-layer Intelligent Systems (COINS).

[41]  Sheng-Luen Chung,et al.  A drug identification model developed using deep learning technologies: experience of a medical center in Taiwan , 2020, BMC Health Services Research.

[42]  Masud Ahmed,et al.  Challenges in Sensor-based Human Activity Recognition and a Comparative Analysis of Benchmark Datasets: A Review , 2019, 2019 Joint 8th International Conference on Informatics, Electronics & Vision (ICIEV) and 2019 3rd International Conference on Imaging, Vision & Pattern Recognition (icIVPR).

[43]  Muhammed Talo,et al.  Automated classification of histopathology images using transfer learning , 2019, Artif. Intell. Medicine.

[44]  Tina L Hurst,et al.  Physical activity classification using the GENEA wrist-worn accelerometer. , 2012, Medicine and science in sports and exercise.