Evaluation of Commercial Self-Monitoring Devices for Clinical Purposes: Results from the Future Patient Trial, Phase I

Commercial self-monitoring devices are becoming increasingly popular, and over the last decade, the use of self-monitoring technology has spread widely in both consumer and medical markets. The purpose of this study was to evaluate five commercially available self-monitoring devices for further testing in clinical applications. Four activity trackers and one sleep tracker were evaluated based on step count validity and heart rate validity. Methods: The study enrolled 22 healthy volunteers in a walking test. Volunteers walked a 100 m track at 2 km/h and 3.5 km/h. Steps were measured by four activity trackers and compared to gyroscope readings. Two trackers were also tested on nine subjects by comparing pulse readings to Holter monitoring. Results: The lowest average systematic error in the walking tests was −0.2%, recorded on the Garmin Vivofit 2 at 3.5 km/h; the highest error was the Fitbit Charge HR at 2 km/h with an error margin of 26.8%. Comparisons of pulse measurements from the Fitbit Charge HR revealed a margin error of −3.42% ± 7.99% compared to the electrocardiogram. The Beddit sleep tracker measured a systematic error of −3.27% ± 4.60%. Conclusion: The measured results revealed the current functionality and limitations of the five self-tracking devices, and point towards a need for future research in this area.

[1]  D. Bassett,et al.  Pedometer-Measured Physical Activity and Health Behaviors in United States Adults , 2010 .

[2]  C. Thorup,et al.  Cardiac Patients’ Walking Activity Determined by a Step Counter in Cardiac Telerehabilitation: Data From the Intervention Arm of a Randomized Controlled Trial , 2016, Journal of medical Internet research.

[3]  Jakub Parák,et al.  W2E-–Wellness Warehouse Engine for Semantic Interoperability of Consumer Health Data , 2016, IEEE Journal of Biomedical and Health Informatics.

[4]  Janice J Eng,et al.  Capturing step counts at slow walking speeds in older adults: comparison of ankle and waist placement of measuring device. , 2015, Journal of rehabilitation medicine.

[5]  Tim Olds,et al.  The validity of consumer-level, activity monitors in healthy adults worn in free-living conditions: a cross-sectional study , 2015, International Journal of Behavioral Nutrition and Physical Activity.

[6]  Thierry Troosters,et al.  Validity of activity monitors in health and chronic disease: a systematic review , 2012, International Journal of Behavioral Nutrition and Physical Activity.

[7]  G. Pulignano,et al.  Incremental Value of Gait Speed in Predicting Prognosis of Older Adults With Heart Failure: Insights From the IMAGE-HF Study. , 2016, JACC. Heart failure.

[8]  C. F. Pedersen,et al.  An Evaluation of Commercial Pedometers for Monitoring Slow Walking Speed Populations. , 2016, Telemedicine journal and e-health : the official journal of the American Telemedicine Association.

[9]  Yusuke Kasahara,et al.  Association between mental health and physical activity in patients with chronic heart failure , 2014, Disability and rehabilitation.

[10]  S. Inglis,et al.  Telemonitoring in heart failure: fact, fiction, and controversy , 2015 .

[11]  Mark A Tully,et al.  The validation of Fibit Zip™ physical activity monitor as a measure of free-living physical activity , 2014, BMC Research Notes.

[12]  Patty S Freedson,et al.  Utility of Consumer Physical Activity Trackers as an Intervention Tool in Cardiovascular Disease Prevention and Treatment. , 2016, Progress in cardiovascular diseases.

[13]  Junkai Xu,et al.  Validity of FitBit, Jawbone UP, Nike+ and other wearable devices for level and stair walking. , 2016, Gait & posture.

[14]  B. Dolezal,et al.  Validation of Biofeedback Wearables for Photoplethysmographic Heart Rate Tracking. , 2016, Journal of sports science & medicine.

[15]  R. Furberg,et al.  Systematic review of the validity and reliability of consumer-wearable activity trackers , 2015, International Journal of Behavioral Nutrition and Physical Activity.

[16]  Adolfo Muñoz,et al.  The Usefulness of Activity Trackers in Elderly with Reduced Mobility: A Case Study , 2013, MedInfo.

[17]  Anthony S Leicht,et al.  Pedometer accuracy during walking over different surfaces. , 2007, Medicine and science in sports and exercise.

[18]  Zhilin Zhang,et al.  Photoplethysmography-Based Heart Rate Monitoring in Physical Activities via Joint Sparse Spectrum Reconstruction , 2015, IEEE Transactions on Biomedical Engineering.

[19]  James O. Hill,et al.  Pedometer-measured physical activity and health behaviors in U.S. adults. , 2010, Medicine and science in sports and exercise.

[20]  Sally J. Singh,et al.  Physical activity monitoring: addressing the difficulties of accurately detecting slow walking speeds. , 2013, Heart & lung : the journal of critical care.

[21]  Harri Honko,et al.  Data correction for seven activity trackers based on regression models , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[22]  Tae Youn Kim,et al.  Factors associated with telemonitoring use among patients with chronic heart failure , 2017, Journal of telemedicine and telecare.

[23]  C. Mazzà,et al.  Step Detection and Activity Recognition Accuracy of Seven Physical Activity Monitors , 2015, PloS one.

[24]  Hyun-Sung An,et al.  How accurate are the wrist-based heart rate monitors during walking and running activities? Are they accurate enough? , 2016, BMJ Open Sport & Exercise Medicine.

[25]  Thea J. M. Kooiman,et al.  Reliability and validity of ten consumer activity trackers , 2015, BMC Sports Science, Medicine and Rehabilitation.

[26]  William T. Abraham,et al.  Development and validation of an integrated diagnostic algorithm derived from parameters monitored in implantable devices for identifying patients at risk for heart failure hospitalization in an ambulatory setting , 2013, European heart journal.

[27]  G. Welk,et al.  How valid are wearable physical activity trackers for measuring steps? , 2017, European journal of sport science.

[28]  Parmit K. Chilana,et al.  Acceptance of Commercially Available Wearable Activity Trackers Among Adults Aged Over 50 and With Chronic Illness: A Mixed-Methods Evaluation , 2016, JMIR mHealth and uHealth.

[29]  Yusuke Kasahara,et al.  Usefulness of step counts to predict mortality in Japanese patients with heart failure. , 2013, The American journal of cardiology.