Determining Physical Activity Characteristics From Wristband Data for Use in Automated Insulin Delivery Systems

Algorithms that can determine the type of physical activity (PA) and quantify the intensity can allow precision medicine approaches, such as automated insulin delivery systems that modulate insulin administration in response to PA. In this work, data from a multi-sensor wristband is used to design classifiers to distinguish among five different physical states (PS) (resting, activities of daily living, running, biking, and resistance training), and to develop models to estimate the energy expenditure (EE) of the PA for diabetes therapy. The data collected are filtered, features are extracted from the reconciled signals, and the extracted features are used by machine learning algorithms, including deep-learning techniques, to obtain accurate PS classification and EE estimation. The various machine learning techniques have different success rates ranging from 75.7% to 94.8% in classifying the five different PS. The deep neural network model with long short-term memory has 94.8% classification accuracy. We achieved 0.5 MET (Metabolic Equivalent of Task) root-mean-square error for EE estimation accuracy, relative to indirect calorimetry with randomly selected testing data (10% of collected data). We also demonstrate a 5% improvement in PS classification accuracy and a 0.34 MET decrease in the mean absolute error when using multi-sensor approach relative to using only accelerometer data.

[1]  D. Ding,et al.  COMPARATIVE VALIDITY OF ENERGY EXPENDITURE PREDICTION ALGORITHMS USING WEARABLE DEVICES FOR PEOPLE WITH SPINAL CORD INJURY , 2020, Spinal Cord.

[2]  Matthew N. Ahmadi,et al.  Physical Activity Classification in Youth Using Raw Accelerometer Data from the Hip , 2020 .

[3]  Bo Sheng,et al.  A comparison of different machine learning algorithms, types and placements of activity monitors for physical activity classification , 2020, Measurement.

[4]  Hoda Sedighi Classification of human activity recognition using smartphones , 2020, ArXiv.

[5]  Mauricio Pardo,et al.  Physical Workload Tracking Using Human Activity Recognition with Wearable Devices , 2019, Sensors.

[6]  Ali Cinar,et al.  Artifact Removal from Data Generated by Nonlinear Systems: Heart Rate Estimation from Blood Volume Pulse signal , 2020 .

[7]  Samuel R LaMunion,et al.  Use of Consumer Monitors for Estimating Energy Expenditure in Youth. , 2020, Applied physiology, nutrition, and metabolism = Physiologie appliquee, nutrition et metabolisme.

[8]  Jean-François Gagnon,et al.  A Multimodal Approach to Improve the Robustness of Physiological Stress Prediction During Physical Activity , 2019, 2019 IEEE International Conference on Systems, Man and Cybernetics (SMC).

[9]  Jinglan Zhang,et al.  Prediction of Relative Physical Activity Intensity Using Multimodal Sensing of Physiological Data , 2019, Sensors.

[10]  Maury A. Nussbaum,et al.  Classifying Diverse Physical Activities Using “Smart Garments” , 2019, Sensors.

[11]  M. Schafer,et al.  Validity of Activity Trackers in Estimating Energy Expenditure During High-Intensity Functional Training , 2019, Research quarterly for exercise and sport.

[12]  Iman Hajizadeh,et al.  Assessing the Effects of Stress Response on Glucose Variations , 2019, 2019 IEEE 16th International Conference on Wearable and Implantable Body Sensor Networks (BSN).

[13]  M. Löf,et al.  Accelerometer Data Processing and Energy Expenditure Estimation in Preschoolers , 2019, Medicine and science in sports and exercise.

[14]  Amjad Anvari-Moghaddam,et al.  Prediction of energy expenditure during activities of daily living by a wearable set of inertial sensors. , 2019, Medical engineering & physics.

[15]  Carlo Baldari,et al.  Validity, reliability and minimum detectable change of COSMED K5 portable gas exchange system in breath-by-breath mode , 2018, PloS one.

[16]  Po Yang,et al.  Examining sensor-based physical activity recognition and monitoring for healthcare using Internet of Things: A systematic review , 2018, Journal of Biomedical Informatics.

[17]  Maury A. Nussbaum,et al.  A “Smart” Undershirt for Tracking Upper Body Motions: Task Classification and Angle Estimation , 2018, IEEE Sensors Journal.

[18]  Maury A. Nussbaum,et al.  Preferred Placement and Usability of a Smart Textile System vs. Inertial Measurement Units for Activity Monitoring , 2018, Sensors.

[19]  Ali Cinar,et al.  Incorporating Unannounced Meals and Exercise in Adaptive Learning of Personalized Models for Multivariable Artificial Pancreas Systems , 2018, Journal of diabetes science and technology.

[20]  S. Ruchat,et al.  Validation of the Fitbit Zip and Fitbit Flex with pregnant women in free-living conditions , 2018, Journal of medical engineering & technology.

[21]  JENNIFER A. BUNN,et al.  Current State of Commercial Wearable Technology in Physical Activity Monitoring 2015–2017 , 2018, International journal of exercise science.

[22]  Alok Kumar Chowdhury,et al.  Sensor-based prediction of physical activity and its impacts using machine learning , 2018 .

[23]  Jinglan Zhang,et al.  Towards non-laboratory prediction of relative physical activity intensities from multimodal wearable sensor data , 2017, 2017 IEEE Life Sciences Conference (LSC).

[24]  Kimberly A. Ingraham,et al.  Using wearable physiological sensors to predict energy expenditure , 2017, 2017 International Conference on Rehabilitation Robotics (ICORR).

[25]  Ali Cinar,et al.  Social and competition stress detection with wristband physiological signals , 2017, 2017 IEEE 14th International Conference on Wearable and Implantable Body Sensor Networks (BSN).

[26]  Francesca Annan,et al.  Exercise management in type 1 diabetes: a consensus statement. , 2017, The lancet. Diabetes & endocrinology.

[27]  K. Price,et al.  Validation of the Fitbit One, Garmin Vivofit and Jawbone UP activity tracker in estimation of energy expenditure during treadmill walking and running , 2017, Journal of medical engineering & technology.

[28]  Hyun-Sung An,et al.  Concurrent Validity of Wearable Activity Trackers Under Free-Living Conditions , 2017, Journal of strength and conditioning research.

[29]  Ali Cinar,et al.  Use of Wearable Sensors and Biometric Variables in an Artificial Pancreas System , 2017, Sensors.

[30]  Ali Cinar,et al.  Real-time insulin bolusing for unannounced meals with artificial pancreas , 2017 .

[31]  Tapas Mondal,et al.  Wearable Sensors for Remote Health Monitoring , 2017, Sensors.

[32]  Jürgen Schmidhuber,et al.  LSTM: A Search Space Odyssey , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[33]  Gavin Brown,et al.  Ensemble Learning , 2010, Encyclopedia of Machine Learning and Data Mining.

[34]  Gregory M Dominick,et al.  Physical Activity Assessment Between Consumer- and Research-Grade Accelerometers: A Comparative Study in Free-Living Conditions , 2016, JMIR mHealth and uHealth.

[35]  Anton Gradisek,et al.  Mobile Application to Stimulate Physical Activity in Schoolchildren , 2016, 2016 12th International Conference on Intelligent Environments (IE).

[36]  Ahmet Turan Özdemir,et al.  An Analysis on Sensor Locations of the Human Body for Wearable Fall Detection Devices: Principles and Practice , 2016, Sensors.

[37]  Mitja Lustrek,et al.  Estimating Energy Expenditure With Multiple Models Using Different Wearable Sensors , 2016, IEEE Journal of Biomedical and Health Informatics.

[38]  James M. Pivarnik,et al.  Comparison of Activity Type Classification Accuracy from Accelerometers Worn on the Hip, Wrists, and Thigh in Young, Apparently Healthy Adults , 2016 .

[39]  Andy Adler,et al.  Validation of the Empatica E4 wristband , 2016, 2016 IEEE EMBS International Student Conference (ISC).

[40]  Michael Schumacher,et al.  Sensor Monitoring of Physical Activity to Improve Glucose Management in Diabetic Patients: A Review , 2016, Sensors.

[41]  Luigi Ferrucci,et al.  Assessing Daily Physical Activity in Older Adults: Unraveling the Complexity of Monitors, Measures, and Methods. , 2016, The journals of gerontology. Series A, Biological sciences and medical sciences.

[42]  Fernando Fernández Martínez,et al.  Feature extraction from smartphone inertial signals for human activity segmentation , 2016, Signal Process..

[43]  Diane J. Cook,et al.  One-Class Classification-Based Real-Time Activity Error Detection in Smart Homes , 2016, IEEE Journal of Selected Topics in Signal Processing.

[44]  Kamiar Aminian,et al.  Instrumented shoes for activity classification in the elderly. , 2016, Gait & posture.

[45]  M. Gams,et al.  Activity and stress monitoring using smartphone and wrist device , 2016 .

[46]  Matjaz Gams,et al.  Context-based ensemble method for human energy expenditure estimation , 2015, Appl. Soft Comput..

[47]  Victoria Xia,et al.  Active learning for electrodermal activity classification , 2015, 2015 IEEE Signal Processing in Medicine and Biology Symposium (SPMB).

[48]  Ritu Gupta,et al.  Classification of team sport activities using a single wearable tracking device. , 2015, Journal of biomechanics.

[49]  Nicholas Preiser,et al.  Incorporating an Exercise Detection, Grading, and Hormone Dosing Algorithm Into the Artificial Pancreas Using Accelerometry and Heart Rate , 2015, Journal of diabetes science and technology.

[50]  Ali Cinar,et al.  Exercise and the Development of the Artificial Pancreas , 2015, Journal of diabetes science and technology.

[51]  Ahmed Kattan,et al.  Physical Activities Monitoring Using Wearable Acceleration Sensors Attached to the Body , 2015, PloS one.

[52]  Keith Tolfrey,et al.  Energy expenditure during common sitting and standing tasks: examining the 1.5 MET definition of sedentary behaviour , 2015, BMC Public Health.

[53]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[54]  J. Schwartz,et al.  Abstract MP11: Fitbit: An Accurate and Reliable Device for Wireless Physical Activity Tracking , 2015 .

[55]  Subhas Chandra Mukhopadhyay,et al.  Wearable Sensors for Human Activity Monitoring: A Review , 2015, IEEE Sensors Journal.

[56]  Paul J. M. Havinga,et al.  A Survey of Online Activity Recognition Using Mobile Phones , 2015, Sensors.

[57]  Jeen-Shing Wang,et al.  An Energy Expenditure Estimation Algorithm for a Wearable System , 2015 .

[58]  Julien Penders,et al.  Estimating Energy Expenditure Using Body-Worn Accelerometers: A Comparison of Methods, Sensors Number and Positioning , 2015, IEEE Journal of Biomedical and Health Informatics.

[59]  Gert R. G. Lanckriet,et al.  A random forest classifier for the prediction of energy expenditure and type of physical activity from wrist and hip accelerometers , 2014, Physiological measurement.

[60]  Nick Ball,et al.  Accuracy of the SenseWear Armband Mini and the BodyMedia FIT in resistance training. , 2014, Journal of science and medicine in sport.

[61]  J. Reginster,et al.  Smart wearable body sensors for patient self-assessment and monitoring , 2014, Archives of Public Health.

[62]  D. BretonMarc,et al.  Adding heart rate signal to a control-to-range artificial pancreas system improves the protection against hypoglycemia during exercise in type 1 diabetes. , 2014 .

[63]  G. Alberti,et al.  Comparison of Image Analysis Methods in Skin Temperature Measurements during Physical Exercise , 2014 .

[64]  A Moncada-Torres,et al.  Activity classification based on inertial and barometric pressure sensors at different anatomical locations , 2014, Physiological measurement.

[65]  Ali Cinar,et al.  An Integrated Multivariable Artificial Pancreas Control System , 2014, Journal of diabetes science and technology.

[66]  Ali Cinar,et al.  Multivariable Adaptive Identification and Control for Artificial Pancreas Systems , 2014, IEEE Transactions on Biomedical Engineering.

[67]  Hermie Hermens,et al.  Optimal Sensor Placement for Measuring Physical Activity with a 3D Accelerometer , 2014, Sensors.

[68]  Marc D Breton,et al.  Adding heart rate signal to a control-to-range artificial pancreas system improves the protection against hypoglycemia during exercise in type 1 diabetes. , 2014, Diabetes technology & therapeutics.

[69]  B. Dobkin Wearable motion sensors to continuously measure real-world physical activities. , 2013, Current opinion in neurology.

[70]  Shaw Bronner,et al.  Comparison of steps and energy expenditure assessment in adults of Fitbit Tracker and Ultra to the Actical and indirect calorimetry , 2013, Journal of medical engineering & technology.

[71]  James A. Reggia,et al.  Robust human action recognition via long short-term memory , 2013, The 2013 International Joint Conference on Neural Networks (IJCNN).

[72]  Bo Dong,et al.  Comparing metabolic energy expenditure estimation using wearable multi-sensor network and single accelerometer , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[73]  Basel Kikhia,et al.  Optimal Placement of Accelerometers for the Detection of Everyday Activities , 2013, Sensors.

[74]  S. Colberg Exercise and Diabetes: A Clinician’s Guide to Prescribing Physical Activity , 2013 .

[75]  Ovidiu Grigore,et al.  A study about feature extraction for stress detection , 2013, 2013 8TH INTERNATIONAL SYMPOSIUM ON ADVANCED TOPICS IN ELECTRICAL ENGINEERING (ATEE).

[76]  Cem Ersoy,et al.  A Review and Taxonomy of Activity Recognition on Mobile Phones , 2013 .

[77]  Muhammad Usman Ilyas,et al.  Activity recognition using smartphone sensors , 2013, 2013 IEEE 10th Consumer Communications and Networking Conference (CCNC).

[78]  Dinesh Kant Kumar,et al.  Evaluation of feature extraction techniques in emotional state recognition , 2012, 2012 4th International Conference on Intelligent Human Computer Interaction (IHCI).

[79]  David R Bassett,et al.  Device-based monitoring in physical activity and public health research , 2012, Physiological measurement.

[80]  Wanmin Wu,et al.  Classification Accuracies of Physical Activities Using Smartphone Motion Sensors , 2012, Journal of medical Internet research.

[81]  M. Morey,et al.  Enhanced Fitness: A Randomized Controlled Trial of the Effects of Home‐Based Physical Activity Counseling on Glycemic Control in Older Adults with Prediabetes Mellitus , 2012, Journal of the American Geriatrics Society.

[82]  Weng-Keen Wong,et al.  Artificial neural networks to predict activity type and energy expenditure in youth. , 2012, Medicine and science in sports and exercise.

[83]  Jasper Snoek,et al.  Practical Bayesian Optimization of Machine Learning Algorithms , 2012, NIPS.

[84]  Robert X. Gao,et al.  Multisensor Data Fusion for Physical Activity Assessment , 2012, IEEE Transactions on Biomedical Engineering.

[85]  KR Westerterp,et al.  Advances in physical activity monitoring and lifestyle interventions in obesity: a review , 2012, International Journal of Obesity.

[86]  Shyamal Patel,et al.  A review of wearable sensors and systems with application in rehabilitation , 2012, Journal of NeuroEngineering and Rehabilitation.

[87]  John Nelson,et al.  Activity level classification algorithm using SHIMMER™ wearable sensors for individuals with rheumatoid arthritis , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[88]  L. Andersen,et al.  Physical activity and obesity in children , 2011, British Journal of Sports Medicine.

[89]  Angelo M. Sabatini,et al.  Machine Learning Methods for Classifying Human Physical Activity from On-Body Accelerometers , 2010, Sensors.

[90]  Carl E. Rasmussen,et al.  Gaussian processes for machine learning , 2005, Adaptive computation and machine learning.

[91]  Heng Tao Shen,et al.  Principal Component Analysis , 2009, Encyclopedia of Biometrics.

[92]  Haibo He,et al.  ADASYN: Adaptive synthetic sampling approach for imbalanced learning , 2008, 2008 IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence).

[93]  Nigel H. Lovell,et al.  Accelerometry based classification of gait patterns using empirical mode decomposition , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[94]  Wendong Xiao,et al.  Real-time Physical Activity classification and tracking using wearble sensors , 2007, 2007 6th International Conference on Information, Communications & Signal Processing.

[95]  Zyad Shaaban,et al.  Normalization as a Preprocessing Engine for Data Mining and the Approach of Preference Matrix , 2006, 2006 International Conference on Dependability of Computer Systems.

[96]  J. Viikari,et al.  Risk of obesity in relation to physical activity tracking from youth to adulthood. , 2006, Medicine and science in sports and exercise.

[97]  A. Barreto,et al.  Stress Detection in Computer Users Based on Digital Signal Processing of Noninvasive Physiological Variables , 2006, 2006 International Conference of the IEEE Engineering in Medicine and Biology Society.

[98]  Arun Ross,et al.  Score normalization in multimodal biometric systems , 2005, Pattern Recognit..

[99]  Heaton T. Jeff,et al.  Introduction to Neural Networks with Java , 2005 .

[100]  Margarita Treuth,et al.  Predicting energy expenditure from accelerometry counts in adolescent girls. , 2005, Medicine and science in sports and exercise.

[101]  Margaret L Fruin,et al.  Validity of a multi-sensor armband in estimating rest and exercise energy expenditure. , 2004, Medicine and science in sports and exercise.

[102]  HyungDal Park,et al.  A study on the activity classification using a triaxial accelerometer , 2003, Proceedings of the 25th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (IEEE Cat. No.03CH37439).

[103]  Anthony Widjaja,et al.  Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond , 2003, IEEE Transactions on Neural Networks.

[104]  John H. L. Hansen,et al.  Nonlinear feature based classification of speech under stress , 2001, IEEE Trans. Speech Audio Process..

[105]  Michael I. Jordan,et al.  On Discriminative vs. Generative Classifiers: A comparison of logistic regression and naive Bayes , 2001, NIPS.

[106]  H C Kemper,et al.  Tracking of activity and fitness and the relationship with cardiovascular disease risk factors. , 2000, Medicine and science in sports and exercise.

[107]  Nikunj C. Oza,et al.  Online Ensemble Learning , 2000, AAAI/IAAI.

[108]  T. Tamura,et al.  Classification of walking pattern using acceleration waveform in elderly people , 2000, Proceedings of the 22nd Annual International Conference of the IEEE Engineering in Medicine and Biology Society (Cat. No.00CH37143).

[109]  Wen-Jyi Hwang,et al.  Fast kNN classification algorithm based on partial distance search , 1998 .

[110]  Kevin N. Gurney,et al.  An introduction to neural networks , 2018 .

[111]  M. Sun,et al.  Improving energy expenditure estimation by using a triaxial accelerometer. , 1997, Journal of applied physiology.

[112]  C. Brodley,et al.  Decision tree classification of land cover from remotely sensed data , 1997 .

[113]  J. Brisswalter,et al.  Energy cost and stride duration variability at preferred transition gait speed between walking and running. , 1996, Canadian journal of applied physiology = Revue canadienne de physiologie appliquee.

[114]  Patrick van der Smagt,et al.  Introduction to neural networks , 1995, The Lancet.

[115]  M Yamasaki,et al.  Fall in skin temperature of exercising man. , 1992, British journal of sports medicine.

[116]  Donald F. Specht,et al.  A general regression neural network , 1991, IEEE Trans. Neural Networks.

[117]  J G Gamble,et al.  The energy expenditure index: a method to quantitate and compare walking energy expenditure for children and adolescents. , 1991, Journal of pediatric orthopedics.

[118]  R. F. Goldman,et al.  Predicting energy expenditure with loads while standing or walking very slowly. , 1977, Journal of applied physiology: respiratory, environmental and exercise physiology.

[119]  T P Andriacchi,et al.  Walking speed as a basis for normal and abnormal gait measurements. , 1977, Journal of biomechanics.

[120]  Franklin A. Graybill,et al.  Theory and Application of the Linear Model , 1976 .