A Visualization Tool to Analyse Usage of Web-Based Interventions: The Example of Positive Online Weight Reduction (POWeR)

Background Attrition is a significant problem in Web-based interventions. Consequently, this research aims to identify the relation between Web usage and benefit from such interventions. A visualization tool has been developed that enables researchers to more easily examine large datasets on intervention usage that can be difficult to make sense of using traditional descriptive or statistical techniques alone. Objective This paper demonstrates how the visualization tool was used to explore patterns in participants’ use of a Web-based weight management intervention, termed "positive online weight reduction (POWeR)." We also demonstrate how the visualization tool can be used to perform subsequent statistical analyses of the association between usage patterns, participant characteristics, and intervention outcome. Methods The visualization tool was used to analyze data from 132 participants who had accessed at least one session of the POWeR intervention. Results There was a drop in usage of optional sessions after participants had accessed the initial, core POWeR sessions, but many users nevertheless continued to complete goal and weight reviews. The POWeR tools relating to the food diary and steps diary were reused most often. Differences in participant characteristics and usage of other intervention components were identified between participants who did and did not choose to access optional POWeR sessions (in addition to the initial core sessions) or reuse the food and steps diaries. Reuse of the steps diary and the getting support tools was associated with greater weight loss. Conclusions The visualization tool provided a quick and efficient method for exploring patterns of Web usage, which enabled further analyses of whether different usage patterns were associated with participant characteristics or differences in intervention outcome. Further usage of visualization techniques is recommended to (1) make sense of large datasets more quickly and efficiently; (2) determine the likely active ingredients in Web-based interventions, and thereby enhance the benefit they may provide; and (3) guide in designing (or redesigning) of future interventions to promote greater use and engagement by enabling users to easily access valued intervention content/tools. Trial Registration International Standard Randomized Controlled Trial Number (ISRCTN): 31685626; http://www.isrctn.com/ISRCTN31685626 (Archived by WebCite at http://www.webcitation.org/6YXYIw9vc).

[1]  Geri Gay,et al.  Determinants of Pregnant Women’s Online Self-Regulatory Activities for Appropriate Gestational Weight Gain , 2015, Health communication.

[2]  J. Schwartz,et al.  Interactive computer-based interventions for weight loss or weight maintenance in overweight or obese people. , 2012, The Cochrane database of systematic reviews.

[3]  Mark B Dignan,et al.  The effect of a motivational intervention on weight loss is moderated by level of baseline controlled motivation , 2010, The international journal of behavioral nutrition and physical activity.

[4]  L. Yardley,et al.  Integrating user perspectives into the development of a web‐based weight management intervention , 2012, Clinical obesity.

[5]  L. Yardley,et al.  The Person-Based Approach to Intervention Development: Application to Digital Health-Related Behavior Change Interventions , 2015, Journal of medical Internet research.

[6]  S. Kelders,et al.  Persuasive System Design Does Matter: A Systematic Review of Adherence to Web-Based Interventions , 2012, Journal of medical Internet research.

[7]  Jean Harvey-Berino,et al.  Internet-based weight control: the relationship between web features and weight loss. , 2008, Telemedicine journal and e-health : the official journal of the American Telemedicine Association.

[8]  J. Seeley,et al.  Methodological Issues in Research on Web-Based Behavioral Interventions , 2009, Annals of behavioral medicine : a publication of the Society of Behavioral Medicine.

[9]  Boris P. Kovatchev,et al.  A Behavior Change Model for Internet Interventions , 2009, Annals of behavioral medicine : a publication of the Society of Behavioral Medicine.

[10]  Charlie Hargood,et al.  Understanding Usage of a Hybrid Website and Smartphone App for Weight Management: A Mixed-Methods Study , 2014, Journal of medical Internet research.

[11]  M. Neve,et al.  Effectiveness of web‐based interventions in achieving weight loss and weight loss maintenance in overweight and obese adults: a systematic review with meta‐analysis , 2010, Obesity reviews : an official journal of the International Association for the Study of Obesity.

[12]  Shlomo Berkovsky,et al.  Features Predicting Weight Loss in Overweight or Obese Participants in a Web-Based Intervention: Randomized Trial , 2012, Journal of medical Internet research.

[13]  Clare E Collins,et al.  Dropout, Nonusage Attrition, and Pretreatment Predictors of Nonusage Attrition in a Commercial Web-Based Weight Loss Program , 2010, Journal of medical Internet research.

[14]  G. Eysenbach The Law of Attrition , 2005, Journal of medical Internet research.

[15]  Lucy Yardley,et al.  The role of nurse support within an Internet-delivered weight management intervention: A qualitative study , 2015, Psychology, health & medicine.

[16]  Lucy Yardley,et al.  Using mixed methods to develop and evaluate an online weight management intervention. , 2015, British journal of health psychology.

[17]  Cecily Morrison,et al.  Analyzing Engagement in a Web-Based Intervention Platform Through Visualizing Log-Data , 2014, Journal of medical Internet research.

[18]  Keith J Slifer,et al.  Multicomponent Cognitive-Behavioural Intervention to Improve Sleep in Adolescents: A Multiple Baseline Design , 2013, Behavioural and Cognitive Psychotherapy.

[19]  Lucy Yardley,et al.  Randomised controlled feasibility trial of a web-based weight management intervention with nurse support for obese patients in primary care , 2014, International Journal of Behavioral Nutrition and Physical Activity.

[20]  Saskia M Kelders,et al.  Understanding the Usage of Content in a Mental Health Intervention for Depression: An Analysis of Log Data , 2014, Journal of medical Internet research.

[21]  Scott B Going,et al.  Maintenance of Weight Loss in Overweight Middle‐aged Women Through the Internet , 2008, Obesity.

[22]  Alan Bauck,et al.  Associations of Internet Website Use With Weight Change in a Long-term Weight Loss Maintenance Program , 2010, Journal of medical Internet research.