Evaluation of Commercial Self-Monitoring Devices for Clinical Purposes: Results from the Future Patient Trial, Phase I

Commercial self-monitoring devices are becoming increasingly popular, and over the last decade, the use of self-monitoring technology has spread widely in both consumer and medical markets. The purpose of this study was to evaluate five commercially available self-monitoring devices for further testing in clinical applications. Four activity trackers and one sleep tracker were evaluated based on step count validity and heart rate validity. Methods: The study enrolled 22 healthy volunteers in a walking test. Volunteers walked a 100 m track at 2 km/h and 3.5 km/h. Steps were measured by four activity trackers and compared to gyroscope readings. Two trackers were also tested on nine subjects by comparing pulse readings to Holter monitoring. Results: The lowest average systematic error in the walking tests was −0.2%, recorded on the Garmin Vivofit 2 at 3.5 km/h; the highest error was the Fitbit Charge HR at 2 km/h with an error margin of 26.8%. Comparisons of pulse measurements from the Fitbit Charge HR revealed a margin error of −3.42% ± 7.99% compared to the electrocardiogram. The Beddit sleep tracker measured a systematic error of −3.27% ± 4.60%. Conclusion: The measured results revealed the current functionality and limitations of the five self-tracking devices, and point towards a need for future research in this area.

[1]  G. Welk,et al.  How valid are wearable physical activity trackers for measuring steps? , 2017, European journal of sport science.

[2]  Tae Youn Kim,et al.  Factors associated with telemonitoring use among patients with chronic heart failure , 2017, Journal of telemedicine and telecare.

[3]  Jakub Parák,et al.  W2E-–Wellness Warehouse Engine for Semantic Interoperability of Consumer Health Data , 2016, IEEE Journal of Biomedical and Health Informatics.

[4]  B. Dolezal,et al.  Validation of Biofeedback Wearables for Photoplethysmographic Heart Rate Tracking. , 2016, Journal of sports science & medicine.

[5]  Junkai Xu,et al.  Validity of FitBit, Jawbone UP, Nike+ and other wearable devices for level and stair walking. , 2016, Gait & posture.

[6]  Patty S Freedson,et al.  Utility of Consumer Physical Activity Trackers as an Intervention Tool in Cardiovascular Disease Prevention and Treatment. , 2016, Progress in cardiovascular diseases.

[7]  C. F. Pedersen,et al.  An Evaluation of Commercial Pedometers for Monitoring Slow Walking Speed Populations. , 2016, Telemedicine journal and e-health : the official journal of the American Telemedicine Association.

[8]  G. Pulignano,et al.  Mini-Focus Issue: Risk Prediction and Prognosis in Heart FailureIncremental Value of Gait Speed in Predicting Prognosis of Older Adults With Heart Failure: Insights From the IMAGE-HF Study , 2016 .

[9]  C. Thorup,et al.  Cardiac Patients’ Walking Activity Determined by a Step Counter in Cardiac Telerehabilitation: Data From the Intervention Arm of a Randomized Controlled Trial , 2016, Journal of medical Internet research.

[10]  Parmit K. Chilana,et al.  Acceptance of Commercially Available Wearable Activity Trackers Among Adults Aged Over 50 and With Chronic Illness: A Mixed-Methods Evaluation , 2016, JMIR mHealth and uHealth.

[11]  R. Furberg,et al.  Systematic review of the validity and reliability of consumer-wearable activity trackers , 2015, International Journal of Behavioral Nutrition and Physical Activity.

[12]  Harri Honko,et al.  Data correction for seven activity trackers based on regression models , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[13]  S. Inglis,et al.  Telemonitoring in heart failure: fact, fiction, and controversy , 2015 .

[14]  Thea J. M. Kooiman,et al.  Reliability and validity of ten consumer activity trackers , 2015, BMC Sports Science, Medicine and Rehabilitation.

[15]  Janice J Eng,et al.  Capturing step counts at slow walking speeds in older adults: comparison of ankle and waist placement of measuring device. , 2015, Journal of rehabilitation medicine.

[16]  Tim Olds,et al.  The validity of consumer-level, activity monitors in healthy adults worn in free-living conditions: a cross-sectional study , 2015, International Journal of Behavioral Nutrition and Physical Activity.

[17]  C. Mazzà,et al.  Step Detection and Activity Recognition Accuracy of Seven Physical Activity Monitors , 2015, PloS one.

[18]  Zhilin Zhang,et al.  Photoplethysmography-Based Heart Rate Monitoring in Physical Activities via Joint Sparse Spectrum Reconstruction , 2015, IEEE Transactions on Biomedical Engineering.

[19]  Mark A Tully,et al.  The validation of Fibit Zip™ physical activity monitor as a measure of free-living physical activity , 2014, BMC Research Notes.

[20]  Yusuke Kasahara,et al.  Association between mental health and physical activity in patients with chronic heart failure , 2014, Disability and rehabilitation.

[21]  Sally J. Singh,et al.  Physical activity monitoring: addressing the difficulties of accurately detecting slow walking speeds. , 2013, Heart & lung : the journal of critical care.

[22]  Yusuke Kasahara,et al.  Usefulness of step counts to predict mortality in Japanese patients with heart failure. , 2013, The American journal of cardiology.

[23]  William T. Abraham,et al.  Development and validation of an integrated diagnostic algorithm derived from parameters monitored in implantable devices for identifying patients at risk for heart failure hospitalization in an ambulatory setting , 2013, European heart journal.

[24]  Thierry Troosters,et al.  Validity of activity monitors in health and chronic disease: a systematic review , 2012, International Journal of Behavioral Nutrition and Physical Activity.

[25]  David R. Bassett,et al.  Pedometer-measured physical activity and health behaviors in U.S. adults. , 2010, Medicine and science in sports and exercise.

[26]  Anthony S Leicht,et al.  Pedometer accuracy during walking over different surfaces. , 2007, Medicine and science in sports and exercise.

[27]  Adolfo Muñoz,et al.  The Usefulness of Activity Trackers in Elderly with Reduced Mobility: A Case Study , 2013, MedInfo.

[28]  D. Bassett,et al.  Pedometer-Measured Physical Activity and Health Behaviors in United States Adults , 2010 .

[29]  Melissa Cast-Brede,et al.  Myths of Quality on the World Wide Web , 2008 .