Version Reporting and Assessment Approaches for New and Updated Activity and Heart Rate Monitors †

This paper addresses the significant need for improvements in device version reporting and practice across the academic and technical activity monitoring literature, and it recommends assessments for new and updated consumer sensing devices. Reproducibility and data veracity are central to good scholarship, and particularly significant in clinical and health applications. Across the literature there is an absence of device version reporting and a failure to recognize that device validity is not maintained when firmware and software updates can, and do, change device performance and parameter estimation. In this paper, we propose the use of tractable methods to assess devices at their current version and provide an example empirical approach. Experimental results for heart rate and step count acquisitions during walking and everyday living activities from Garmin Vivosmart 3 (v4.10) wristband monitors are presented and analyzed, and the reliability issues of optically-acquired heart rates, especially during periods of activity, are demonstrated and discussed. In conclusion, the paper recommends the empirical assessment of new and updated activity monitors and improvements in device version reporting across the academic and technical literature.

[1]  Maria Lindén,et al.  A Systematic Review of Wearable Patient Monitoring Systems – Current Challenges and Opportunities for Clinical Adoption , 2017, Journal of Medical Systems.

[2]  Miao-Ju Hsu,et al.  Accuracy of Wristband Activity Monitors during Ambulation and Activities. , 2016, Medicine and science in sports and exercise.

[3]  John Hansen,et al.  Evaluation of Commercial Self-Monitoring Devices for Clinical Purposes: Results from the Future Patient Trial, Phase I , 2017, Sensors.

[4]  David R Bassett,et al.  Calibration and validation of wearable monitors. , 2012, Medicine and science in sports and exercise.

[5]  Scott E. Crouter,et al.  Step Counting: A Review of Measurement Considerations and Health-Related Applications , 2016, Sports Medicine.

[6]  Zhilin Zhang,et al.  TROIKA: A General Framework for Heart Rate Monitoring Using Wrist-Type Photoplethysmographic Signals During Intensive Physical Exercise , 2014, IEEE Transactions on Biomedical Engineering.

[7]  Hyun-Sung An,et al.  How accurate are the wrist-based heart rate monitors during walking and running activities? Are they accurate enough? , 2016, BMJ Open Sport & Exercise Medicine.

[8]  J. Takács,et al.  Validation of the Fitbit One activity monitor device during treadmill walking. , 2014, Journal of science and medicine in sport.

[9]  Thea J. M. Kooiman,et al.  Reliability and validity of ten consumer activity trackers , 2015, BMC Sports Science, Medicine and Rehabilitation.

[10]  Malcolm H Granat,et al.  Activity-monitor accuracy in measuring step number and cadence in community-dwelling older adults. , 2008, Journal of aging and physical activity.

[11]  Chuen Seng Tan,et al.  Fitbit Charge HR Wireless Heart Rate Monitor: Validation Study Conducted Under Free-Living Conditions , 2017, JMIR mHealth and uHealth.

[12]  Jan Vitek,et al.  The real software crisis , 2015, Commun. ACM.

[13]  Zhilin Zhang Heart rate monitoring from wrist-type photoplethysmographic (PPG) signals during intensive physical exercise , 2014, 2014 IEEE Global Conference on Signal and Information Processing (GlobalSIP).

[14]  C. F. Pedersen,et al.  An Evaluation of Commercial Pedometers for Monitoring Slow Walking Speed Populations. , 2016, Telemedicine journal and e-health : the official journal of the American Telemedicine Association.

[15]  R. Furberg,et al.  Systematic review of the validity and reliability of consumer-wearable activity trackers , 2015, International Journal of Behavioral Nutrition and Physical Activity.

[16]  Thea J. M. Kooiman,et al.  Reliability and Validity of Ten Consumer Activity Trackers Depend on Walking Speed , 2017, Medicine and science in sports and exercise.

[17]  Patty Freedson,et al.  Assessment of physical activity using wearable monitors: recommendations for monitor calibration and use in the field. , 2012, Medicine and science in sports and exercise.

[18]  Iván García-Magariño,et al.  Green Communication for Tracking Heart Rate with Smartbands , 2018, Sensors.

[19]  Thierry Troosters,et al.  Validity of activity monitors in health and chronic disease: a systematic review , 2012, International Journal of Behavioral Nutrition and Physical Activity.

[20]  Zohn Rosen,et al.  Validation of photoplethysmography as a method to detect heart rate during rest and exercise , 2015, Journal of medical engineering & technology.

[21]  E. Fibuch,et al.  A clinical evaluation of the accuracy of the Nellcor N-100 and Ohmeda 3700 pulse oximeters , 2005, Journal of Clinical Monitoring.

[22]  Kyu Tae Park,et al.  Aging Index using Photoplethysmography for a Healthcare Device: Comparison with Brachial-Ankle Pulse Wave Velocity , 2015, Healthcare informatics research.

[23]  Michael Lang,et al.  Beyond Fitbit: A Critical Appraisal of Optical Heart Rate Monitoring Wearables and Apps, Their Current Limitations and Legal Implications , 2017 .

[24]  Jakub Parák,et al.  Evaluation of wearable consumer heart rate monitors based on photopletysmography , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[25]  Sarah Aldred,et al.  Addressing the Deployment Challenges of Health Monitoring Devices for a Dementia Study , 2015 .

[26]  Iván García-Magariño,et al.  System to Recommend the Best Place to Live Based on Wellness State of the User Employing the Heart Rate Variability , 2017, IEEE Access.

[27]  JENNIFER A. BUNN,et al.  Current State of Commercial Wearable Technology in Physical Activity Monitoring 2015–2017 , 2018, International journal of exercise science.

[28]  R. Romashko,et al.  A new look at the essence of the imaging photoplethysmography , 2015, Scientific Reports.

[29]  K. McGraw,et al.  Forming inferences about some intraclass correlation coefficients. , 1996 .

[30]  Patrick Wahl,et al.  Criterion-Validity of Commercially Available Physical Activity Tracker to Estimate Step Count, Covered Distance and Energy Expenditure during Sports Conditions , 2017, Front. Physiol..