Assessment of Fatigue Using Wearable Sensors: A Pilot Study

Background: Fatigue is a broad, multifactorial concept encompassing feelings of reduced physical and mental energy levels. Fatigue strongly impacts patient health-related quality of life across a huge range of conditions, yet, to date, tools available to understand fatigue are severely limited. Methods: After using a recurrent neural network-based algorithm to impute missing time series data form a multisensor wearable device, we compared supervised and unsupervised machine learning approaches to gain insights on the relationship between self-reported non-pathological fatigue and multimodal sensor data. Results: A total of 27 healthy subjects and 405 recording days were analyzed. Recorded data included continuous multimodal wearable sensor time series on physical activity, vital signs, and other physiological parameters, and daily questionnaires on fatigue. The best results were obtained when using the causal convolutional neural network model for unsupervised representation learning of multivariate sensor data, and random forest as a classifier trained on subject-reported physical fatigue labels (weighted precision of 0.70 ± 0.03 and recall of 0.73 ± 0.03). When using manually engineered features on sensor data to train our random forest (weighted precision of 0.70 ± 0.05 and recall of 0.72 ± 0.01), both physical activity (energy expenditure, activity counts, and steps) and vital signs (heart rate, heart rate variability, and respiratory rate) were important parameters to measure. Furthermore, vital signs contributed the most as top features for predicting mental fatigue compared to physical ones. These results support the idea that fatigue is a highly multimodal concept. Analysis of clusters from sensor data highlighted a digital phenotype indicating the presence of fatigue (95% of observations) characterized by a high intensity of physical activity. Mental fatigue followed similar trends but was less predictable. Potential future directions could focus on anomaly detection assuming longer individual monitoring periods. Conclusion: Taken together, these results are the first demonstration that multimodal digital data can be used to inform, quantify, and augment subjectively captured non-pathological fatigue measures.

[1]  R. Hays,et al.  The Minimally Important Difference for the Fatigue Visual Analog Scale in Patients with Rheumatoid Arthritis Followed in an Academic Clinical Practice , 2008, The Journal of Rheumatology.

[2]  Daniel M. Bolt,et al.  Measurement and control of bias in patient reported outcomes using multidimensional item response theory , 2016, BMC Medical Research Methodology.

[3]  L. Pallikkathayil,et al.  A Qualitative Investigation of Fatigue among Healthy Working Adults , 2003, Western journal of nursing research.

[4]  N. Rose,et al.  Fatigue, Sleep, and Autoimmune and Related Disorders , 2019, Front. Immunol..

[5]  Martin Jaggi,et al.  Unsupervised Scalable Representation Learning for Multivariate Time Series , 2019, NeurIPS.

[6]  G. Nagels,et al.  A rapid screening tool for fatigue impact in multiple sclerosis , 2006, BMC neurology.

[7]  Xiao Li,et al.  Digital Health: Tracking Physiomes and Activity Using Wearable Biosensors Reveals Useful Health-Related Information , 2017, PLoS biology.

[8]  Akane Sano,et al.  Prediction of Happy-Sad mood from daily behaviors and previous sleep history , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[9]  J. Finsterer,et al.  Fatigue in Healthy and Diseased Individuals , 2014, The American journal of hospice & palliative care.

[10]  Akane Sano,et al.  Stress Recognition Using Wearable Sensors and Mobile Phones , 2013, 2013 Humaine Association Conference on Affective Computing and Intelligent Interaction.

[11]  Burcin Becerik-Gerber,et al.  Monitoring fatigue in construction workers using physiological measurements , 2017 .

[12]  Kathryn A. Lee,et al.  Validity and reliability of a scale to assess fatigue , 1991, Psychiatry Research.

[13]  A. Chaudhuri,et al.  Fatigue in neurological disorders , 2004, The Lancet.

[14]  Vera Maljkovic,et al.  Developing Measures of Cognitive Impairment in the Real World from Consumer-Grade Multimodal Sensor Streams , 2019, KDD.

[15]  Joel E Dimsdale,et al.  The relationship between fatigue and cardiac functioning. , 2008, Archives of internal medicine.

[16]  James L Rudolph,et al.  Vital signs in older patients: age-related changes. , 2011, Journal of the American Medical Directors Association.

[17]  Rosalind W. Picard,et al.  Continuous Pain Intensity Estimation from Autonomic Signals with Recurrent Neural Networks , 2018, 2018 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[18]  Roger M Enoka,et al.  Fatigue and fatigability in neurologic illnesses , 2013, Neurology.

[19]  Ieuan Clay,et al.  Continuous Monitoring of Patient Mobility for 18 Months Using Inertial Sensors following Traumatic Knee Injury: A Case Study , 2018, Digital Biomarkers.

[20]  G. Millet,et al.  Monitoring Fatigue Status with HRV Measures in Elite Athletes: An Avenue Beyond RMSSD? , 2015, Front. Physiol..

[21]  T Reilly,et al.  Do subjective symptoms predict our perception of jet-lag? , 2000, Ergonomics.

[22]  Tim Oates,et al.  Time series classification from scratch with deep neural networks: A strong baseline , 2016, 2017 International Joint Conference on Neural Networks (IJCNN).

[23]  Hans-Peter Kriegel,et al.  LOF: identifying density-based local outliers , 2000, SIGMOD '00.

[24]  M. Mukaka,et al.  Statistics corner: A guide to appropriate use of correlation coefficient in medical research. , 2012, Malawi medical journal : the journal of Medical Association of Malawi.

[25]  Greg Atkinson,et al.  Jet lag: trends and coping strategies , 2007, The Lancet.

[26]  C. Shapiro,et al.  A systematic review of fatigue in patients with traumatic brain injury: The course, predictors and consequences , 2014, Neuroscience & Biobehavioral Reviews.

[27]  Jeffrey Dean,et al.  Distributed Representations of Words and Phrases and their Compositionality , 2013, NIPS.

[28]  Wannes Meert,et al.  Fatigue Prediction in Outdoor Runners Via Machine Learning and Sensor Fusion , 2018, KDD.

[29]  A. Stone,et al.  Paper and electronic diaries: Too early for conclusions on compliance rates and their effects--Comment on Green, Rafaeli, Bolger, Shrout, and Reis (2006). , 2006, Psychological methods.

[30]  Wei Cao,et al.  BRITS: Bidirectional Recurrent Imputation for Time Series , 2018, NeurIPS.

[31]  J. H. Ward Hierarchical Grouping to Optimize an Objective Function , 1963 .

[32]  R. M. Escorihuela,et al.  Reduced heart rate variability predicts fatigue severity in individuals with chronic fatigue syndrome/myalgic encephalomyelitis , 2020, Journal of Translational Medicine.

[33]  Elena Smets,et al.  Large-scale wearable data reveal digital phenotypes for daily-life stress detection , 2018, npj Digital Medicine.

[34]  Ieuan Clay,et al.  Impact of Digital Technologies on Novel Endpoint Capture in Clinical Trials , 2017, Clinical pharmacology and therapeutics.

[35]  Fernando De la Torre,et al.  Facing Imbalanced Data--Recommendations for the Use of Performance Metrics , 2013, 2013 Humaine Association Conference on Affective Computing and Intelligent Interaction.

[36]  Samuele M. Marcora,et al.  Mental fatigue impairs physical performance in humans. , 2009, Journal of applied physiology.

[37]  K. Mizuno,et al.  Mental fatigue caused by prolonged cognitive load associated with sympathetic hyperactivity , 2011, Behavioral and Brain Functions.

[38]  Akane Sano,et al.  Multimodal autoencoder: A deep learning approach to filling in missing sensor data and enabling better mood prediction , 2017, 2017 Seventh International Conference on Affective Computing and Intelligent Interaction (ACII).

[39]  S. Shiffman,et al.  Patient non-compliance with paper diaries , 2002, BMJ : British Medical Journal.

[40]  Zahra Sedighi Maman,et al.  A data-driven approach to modeling physical fatigue in the workplace using wearable sensors. , 2017, Applied ergonomics.

[41]  Fadel M. Megahed,et al.  A data analytic framework for physical fatigue management using wearable sensors , 2020, Expert Syst. Appl..

[42]  Mohamed Faisal Lutfi,et al.  The effect of gender on heart rate variability in asthmatic and normal healthy adults. , 2011, International journal of health sciences.

[43]  Sergi Bermúdez i Badia,et al.  PhysioLab - a multivariate physiological computing toolbox for ECG, EMG and EDA signals: a case of study of cardiorespiratory fitness assessment in the elderly population , 2017, Multimedia Tools and Applications.

[44]  H M Wegmann,et al.  Aircrew fatigue in long-haul operations. , 1997, Accident; analysis and prevention.

[45]  Thomas G. Dietterich Approximate Statistical Tests for Comparing Supervised Classification Learning Algorithms , 1998, Neural Computation.

[46]  N. Schork,et al.  The n-of-1 clinical trial: the ultimate strategy for individualizing medicine? , 2011, Personalized medicine.

[47]  G. V. van Heck,et al.  Psychometric qualities of a brief self-rated fatigue measure: The Fatigue Assessment Scale. , 2003, Journal of psychosomatic research.

[48]  Martin Jaggi,et al.  Prediction of Patient-Reported Physical Activity Scores from Wearable Accelerometer Data: A Feasibility Study , 2018, Converging Clinical and Engineering Research on Neurorehabilitation III.

[49]  Germain Forestier,et al.  Deep learning for time series classification: a review , 2018, Data Mining and Knowledge Discovery.

[50]  Roma Maguire,et al.  What is the value of the routine use of patient-reported outcome measures toward improvement of patient outcomes, processes of care, and health service outcomes in cancer care? A systematic review of controlled trials. , 2014, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[51]  Jorge I. Galván-Tejada,et al.  Multivariate Radiological-Based Models for the Prediction of Future Knee Pain: Data from the OAI , 2015, Comput. Math. Methods Medicine.

[52]  P. Jean-Pierre,et al.  Cancer-related fatigue: the scale of the problem. , 2007, The oncologist.

[53]  Yvonne Tran,et al.  The Relationship Between Spectral Changes in Heart Rate Variability and Fatigue , 2009 .

[54]  A. Valentine,et al.  Cognitive and mood disturbance as causes and symptoms of fatigue in cancer patients , 2001, Cancer.