Comparing the Usability and Acceptability of Wearable Sensors Among Older Irish Adults in a Real-World Context: Observational Study

Background Wearable devices are valuable assessment tools for patient outcomes in contexts such as clinical trials. To be successfully deployed, however, participants must be willing to wear them. Another concern is that usability studies are rarely published, often fail to test devices beyond 24 hours, and need to be repeated frequently to ensure that contemporary devices are assessed. Objective This study aimed to compare multiple wearable sensors in a real-world context to establish their usability within an older adult (>50 years) population. Methods Eight older adults wore seven devices for a minimum of 1 week each: Actigraph GT9x, Actibelt, Actiwatch, Biovotion, Hexoskin, Mc10 Biostamp_RC, and Wavelet. Usability was established through mixed methods using semistructured interviews and three questionnaires, namely, the Intrinsic Motivation Inventory (IMI), the System Usability Scale (SUS), and an acceptability questionnaire. Quantitative data were reported descriptively and qualitative data were analyzed using deductive content analysis. Data were then integrated using triangulation. Results Results demonstrated that no device was considered optimal as all scored below average in the SUS (median, IQR; min-max=57.5, 12.5; 47.5-63.8). Hexoskin was the lowest scored device based on the IMI (3.6; 3.4-4.5), while Biovotion, Actibelt, and Mc10 Biostamp_RC achieved the highest median results on the acceptability questionnaire (3.6 on a 6-point Likert scale). Qualitatively, participants were willing to accept less comfort, less device discretion, and high charging burdens if the devices were perceived as useful, namely through the provision of feedback for the user. Participants agreed that the purpose of use is a key enabler for long-term compliance. These views were particularly noted by those not currently wearing an activity-tracking device. Participants believed that wrist-worn sensors were the most versatile and easy to use, and therefore, the most suitable for long-term use. In particular, Actiwatch and Wavelet stood out for their comfort. The convergence of quantitative and qualitative data was demonstrated in the study. Conclusions Based on the results, the following context-specific recommendations can be made: (1) researchers should consider their device selection in relation to both individual and environmental factors, and not simply the primary outcome of the research study; (2) if researchers do not wish their participants to have access to feedback from the devices, then a simple, wrist-worn device that acts as a watch is preferable; (3) if feedback is allowed, then it should be made available to help participants remain engaged; this is likely to apply only to people without cognitive impairments; (4) battery life of 1 week should be considered as a necessary feature to enhance data capture; (5) researchers should consider providing additional information about the purpose of devices to participants to support their continued use.

[1]  Sube Banerjee,et al.  Acceptability and feasibility of wearing activity monitors in community‐dwelling older adults with dementia , 2019, International journal of geriatric psychiatry.

[2]  Buzhou Tang,et al.  Usability Study of Mainstream Wearable Fitness Devices: Feature Analysis and System Usability Scale Evaluation , 2018, JMIR mHealth and uHealth.

[3]  Wei Wang,et al.  Perceived user preferences and usability evaluation of mainstream wearable devices for health monitoring , 2018, PeerJ.

[4]  Michael A. Rupp,et al.  The role of individual differences on perceptions of wearable fitness device trust, usability, and motivational impact. , 2018, Applied ergonomics.

[5]  T. Oliveira,et al.  Wearable technology: What explains continuance intention in smartwatches? , 2018, Journal of Retailing and Consumer Services.

[6]  A. Steinert,et al.  Activity-tracking devices for older adults: comparison and preferences , 2018, Universal Access in the Information Society.

[7]  R. Segurado,et al.  Feasibility of Training Physical Therapists to Deliver the Theory-Based Self-Management of Osteoarthritis and Low Back Pain Through Activity and Skills (SOLAS) Intervention Within a Trial , 2018, Physical therapy.

[8]  Brian Caulfield,et al.  A Wearable Sensor-Based Exercise Biofeedback System: Mixed Methods Evaluation of Formulift , 2018, JMIR mHealth and uHealth.

[9]  Yan Zhang,et al.  Technical attributes, health attribute, consumer attributes and their roles in adoption intention of healthcare wearable technology , 2017, Int. J. Medical Informatics.

[10]  Joon Lee,et al.  User Acceptance of Wrist-Worn Activity Trackers Among Community-Dwelling Older Adults: Mixed Method Study , 2017, JMIR mHealth and uHealth.

[11]  R. Lowry,et al.  Older adults’ satisfaction of wearing consumer-level activity monitors , 2017, Journal of rehabilitation and assistive technologies engineering.

[12]  D. Hurley,et al.  Using mixed methods to assess fidelity of delivery and its influencing factors in a complex self-management intervention for people with osteoarthritis and low back pain , 2017, BMJ Open.

[13]  Desleigh M de Jonge,et al.  Tracking down a solution: exploring the acceptability and value of wearable GPS devices for older persons, individuals with a disability and their support persons , 2017, Disability and rehabilitation. Assistive technology.

[14]  Matthew S. Eastin,et al.  Wearable fitness technology: A structural investigation into acceptance and perceived fitness outcomes , 2016, Comput. Hum. Behav..

[15]  Blaine Reeder,et al.  Health at hand: A systematic review of smart watch uses for health and wellness , 2016, J. Biomed. Informatics.

[16]  Kanitthika Kaewkannate,et al.  A comparison of wearable fitness devices , 2016, BMC Public Health.

[17]  Byeong-Seok Shin,et al.  Sustainable Wearables: Wearable Technology for Enhancing the Quality of Human Life , 2016 .

[18]  Alexander J. Rothman,et al.  Older Adults’ Experiences Using a Commercially Available Monitor to Self-Track Their Physical Activity , 2016, JMIR mHealth and uHealth.

[19]  Stephan Selinger,et al.  A Comparison of Multiple Wearable Devices Regarding their User Experience During Running , 2016 .

[20]  Matthew P Buman,et al.  Twenty-four Hours of Sleep, Sedentary Behavior, and Physical Activity with Nine Wearable Devices. , 2016, Medicine and science in sports and exercise.

[21]  Parmit K. Chilana,et al.  Acceptance of Commercially Available Wearable Activity Trackers Among Adults Aged Over 50 and With Chronic Illness: A Mixed-Methods Evaluation , 2016, JMIR mHealth and uHealth.

[22]  Gloria M. Miele,et al.  Using e-technologies in clinical trials. , 2015, Contemporary clinical trials.

[23]  Yiwen Gao,et al.  An empirical study of wearable technology acceptance in healthcare , 2015, Ind. Manag. Data Syst..

[24]  Nabil Ahmed Sultan,et al.  Reflective thoughts on the potential and challenges of wearable technology for healthcare provision and medical education , 2015, Int. J. Inf. Manag..

[25]  Joel T. Nadler,et al.  Stuck in the Middle: The Use and Interpretation of Mid-Points in Items on Questionnaires , 2015, The Journal of general psychology.

[26]  D. Asch,et al.  Wearable devices as facilitators, not drivers, of health behavior change. , 2015, JAMA.

[27]  Luciano Gamberini,et al.  Measuring User Acceptance of Wearable Symbiotic Devices: Validation Study Across Application Scenarios , 2014, Symbiotic.

[28]  J. Kenardy,et al.  Can Physical Therapists Deliver a Pain Coping Skills Program? An Examination of Training Processes and Outcomes , 2014, Physical Therapy.

[29]  N. Ntoumanis,et al.  The Effect of an Intervention to Improve Newly Qualified Teachers' Interpersonal Style, Students Motivation and Psychological Need Satisfaction in Sport-Based Physical Education. , 2010 .

[30]  A. O’Cathain,et al.  Three techniques for integrating data in mixed methods studies , 2010, BMJ : British Medical Journal.

[31]  Byron G. Spencer,et al.  Chronic Health Conditions: Changing Prevalence in an Aging Population and Some Implications for the Delivery of Health Care Services* , 2009, Canadian Journal on Aging / La Revue canadienne du vieillissement.

[32]  Philip T. Kortum,et al.  Determining what individual SUS scores mean: adding an adjective rating scale , 2009 .

[33]  Helvi Kyngäs,et al.  The qualitative content analysis process. , 2008, Journal of advanced nursing.

[34]  David Driscoll,et al.  Merging Qualitative and Quantitative Data in Mixed Methods Research: How To and Why Not , 2007 .

[35]  J. Creswell,et al.  Using Mixed-Methods Sequential Explanatory Design: From Theory to Practice , 2006 .

[36]  J. Creswell,et al.  Mixed Methods Research Designs in Counseling Psychology. , 2005 .

[37]  Francine Gemperle,et al.  Effects of functionality on perceived comfort of wearables , 2003, Seventh IEEE International Symposium on Wearable Computers, 2003. Proceedings..

[38]  M. Petró‐Turza,et al.  The International Organization for Standardization. , 2003 .

[39]  Moni Naor,et al.  Symbiotic Interaction , 2014, Lecture Notes in Computer Science.

[40]  Armagan Karahanoglu,et al.  PERCEIVED QUALITIES OF SMART WEARABLES Determinants of User Acceptance , 2012 .

[41]  Belinda Borrelli,et al.  The assessment, monitoring, and enhancement of treatment fidelity in public health clinical trials. , 2011, Journal of public health dentistry.

[42]  V. Braun,et al.  Please Scroll down for Article Qualitative Research in Psychology Using Thematic Analysis in Psychology , 2022 .