Systematic review and evaluation of web-accessible tools for management of diabetes and related cardiovascular risk factors by patients and healthcare providers

Objective To identify and evaluate the effectiveness, clinical usefulness, sustainability, and usability of web-compatible diabetes-related tools. Data sources Medline, EMBASE, CINAHL, Cochrane Central Register of Controlled Trials, world wide web. Study selection Studies were included if they described an electronic audiovisual tool used as a means to educate patients, care givers, or clinicians about diabetes management and assessed a psychological, behavioral, or clinical outcome. Data extraction Study abstraction and evaluation for clinical usefulness, sustainability, and usability were performed by two independent reviewers. Results Of 12616 citations and 1541 full-text articles reviewed, 57 studies met inclusion criteria. Forty studies used experimental designs (25 randomized controlled trials, one controlled clinical trial, 14 before–after studies), and 17 used observational designs. Methodological quality and ratings for clinical usefulness and sustainability were variable, and there was a high prevalence of usability errors. Tools showed moderate but inconsistent effects on a variety of psychological and clinical outcomes including HbA1c and weight. Meta-regression of adequately reported studies (12 studies, 2731 participants) demonstrated that, although the interventions studied resulted in positive outcomes, this was not moderated by clinical usefulness nor usability. Limitation This review is limited by the number of accessible tools, exclusion of tools for mobile devices, study quality, and the use of non-validated scales. Conclusion Few tools were identified that met our criteria for effectiveness, usefulness, sustainability, and usability. Priority areas include identifying strategies to minimize website attrition and enabling patients and clinicians to make informed decisions about website choice by encouraging reporting of website quality indicators.

[1]  Peter Mendel,et al.  Interventions in Organizational and Community Context: A Framework for Building Evidence on Dissemination and Implementation in Health Services Research , 2007, Administration and Policy in Mental Health and Mental Health Services Research.

[2]  Lisa A Sutherland,et al.  Unraveling the web: an evaluation of the content quality, usability, and readability of nutrition web sites. , 2005, Journal of nutrition education and behavior.

[3]  John E. Perez,et al.  Toward evidence-based Internet interventions: A Spanish/English Web site for international smoking cessation trials. , 2006, Nicotine & tobacco research : official journal of the Society for Research on Nicotine and Tobacco.

[4]  Machiko Tomita,et al.  Development of Alive! (A Lifestyle Intervention Via Email), and Its Effect on Health-related Quality of Life, Presenteeism, and Other Behavioral Outcomes: Randomized Controlled Trial , 2008, Journal of medical Internet research.

[5]  Tobacco use among adolescents enrolled in Wisconsin Medicaid program. , 2005, WMJ : official publication of the State Medical Society of Wisconsin.

[6]  Sharon Straus,et al.  Managing evidence-based knowledge: the need for reliable, relevant and readable resources , 2009, Canadian Medical Association Journal.

[7]  Jean-François Etter,et al.  Comparing Computer-Tailored, Internet-Based Smoking Cessation Counseling Reports with Generic, Untailored Reports: A Randomized Trial , 2009, Journal of health communication.

[8]  Barbara Davies,et al.  Sustaining knowledge use , 2013 .

[9]  Ergonomic requirements for office work with visual display terminals ( VDTs ) — Part 11 : Guidance on usability , 1998 .

[10]  E. Rogers,et al.  Diffusion of innovations , 1964, Encyclopedia of Sport Management.

[11]  Michael L Berbaum,et al.  Implementation and evaluation of a low-literacy diabetes education computer multimedia application. , 2005, Diabetes care.

[12]  Nathan K. Cobb,et al.  Effectiveness of an Internet-Based Worksite Smoking Cessation Intervention at 12 Months , 2007, Journal of occupational and environmental medicine.

[13]  Ron Borland,et al.  Patterns of Use of an Automated Interactive Personalized Coaching Program for Smoking Cessation , 2008, Journal of medical Internet research.

[14]  Alessandro Liberati,et al.  A Review of Online Evidence-based Practice Point-of-Care Information Summary Providers , 2010, Journal of medical Internet research.

[15]  Kimo Ah Yun,et al.  An evaluation of the Freedom From Smoking Online cessation program among Wisconsin residents. , 2005, WMJ : official publication of the State Medical Society of Wisconsin.

[16]  R. Whittaker,et al.  Smoking status recording in GP electronic records: the unrealised potential. , 2006, Informatics in primary care.

[17]  O. Pedersen,et al.  Effect of a multifactorial intervention on mortality in type 2 diabetes. , 2008, The New England journal of medicine.

[18]  M. Engelgau,et al.  Improvements in Diabetes Processes of Care and Intermediate Outcomes: United States, 19882002 , 2006, Annals of Internal Medicine.

[19]  Kathleen M Griffiths,et al.  Web-based Cognitive Behavior Therapy: Analysis of Site Usage and Changes in Depression and Anxiety Scores , 2002, Journal of medical Internet research.

[20]  Elizabeth Drake,et al.  Development and Preliminary Testing of a Patient Decision Aid to Assist Pharmaceutical Care in the Prevention of Cardiovascular Disease , 2004, Pharmacotherapy.

[21]  Steven H. Woolf,et al.  A Practice-Sponsored Web Site to Help Patients Pursue Healthy Behaviors: An ACORN Study , 2006, The Annals of Family Medicine.

[22]  Robert B. Gramacy,et al.  amei: An R Package for the Adaptive Management of Epidemiological Interventions , 2010 .

[23]  Rod Jackson,et al.  Integrated electronic decision support increases cardiovascular disease risk assessment four fold in routine primary care practice , 2008, European journal of cardiovascular prevention and rehabilitation : official journal of the European Society of Cardiology, Working Groups on Epidemiology & Prevention and Cardiac Rehabilitation and Exercise Physiology.

[24]  Joshua J Seidman,et al.  Design and Testing of a Tool for Evaluating the Quality of Diabetes Consumer-Information Web Sites , 2003, Journal of medical Internet research.

[25]  Cameron D. Norman,et al.  Using the internet to assist smoking prevention and cessation in schools: a randomized, controlled trial. , 2008, Health psychology : official journal of the Division of Health Psychology, American Psychological Association.

[26]  D. Tate,et al.  Perinatal mortality and congenital anomalies in babies of women with type 1 or type 2 diabetes in England, Wales, and Northern Ireland: population based study , 2006, BMJ : British Medical Journal.

[27]  R. Speck,et al.  Assessment and Outcomes of HealthPartners 10,000 Steps® Program in an Academic Work Site , 2010, Health promotion practice.

[28]  K. Chapman-Novakofski,et al.  The creation and impact evaluation of "Your guide to diet and diabetes," an interactive web-based diabetes tutorial. , 2009, Diabetes technology & therapeutics.

[29]  A. Mcalister,et al.  Comparing Internet Assistance for Smoking Cessation: 13-Month Follow-Up of a Six-Arm Randomized Controlled Trial , 2008, Journal of medical Internet research.

[30]  W. Kroeze,et al.  Which Intervention Characteristics are Related to More Exposure to Internet-Delivered Healthy Lifestyle Promotion Interventions? A Systematic Review , 2011, Journal of medical Internet research.

[31]  H Garth McKay,et al.  Harnessing the potential of the Internet to promote chronic illness self-management: diabetes as an example of how well we are doing , 2005, Chronic illness.

[32]  D. Nash,et al.  Evaluating Online Continuing Medical Education Seminars: Evidence for Improving Clinical Practices , 2008, American journal of medical quality : the official journal of the American College of Medical Quality.

[33]  Robert Hurling,et al.  Internet-based exercise intervention systems: Are more interactive designs better? , 2006 .

[34]  Wolfgang Viechtbauer,et al.  Conducting Meta-Analyses in R with the metafor Package , 2010 .

[35]  Nathan K. Cobb,et al.  Initial evaluation of a real-world Internet smoking cessation system. , 2005, Nicotine & tobacco research : official journal of the Society for Research on Nicotine and Tobacco.

[36]  Michael Mackert,et al.  Designing e-health interventions for low-health-literate culturally diverse parents: addressing the obesity epidemic. , 2009, Telemedicine journal and e-health : the official journal of the American Telemedicine Association.

[37]  Amanda L. Graham,et al.  A Review of Web-Assisted Tobacco Interventions (WATIs) , 2008, Journal of medical Internet research.

[38]  Robert Hurling,et al.  Rates and Determinants of Uptake and Use of an Internet Physical Activity and Weight Management Program in Office and Manufacturing Work Sites in England: Cohort Study , 2008, Journal of medical Internet research.

[39]  R. Jackson,et al.  Audit of health data captured routinely in primary healthcare for the clinical decision support system PREDICT (PREDICT CVD-4) , 2008 .

[40]  A. Geiger,et al.  American Cancer Society's QuitLink: randomized trial of Internet assistance. , 2007, Nicotine & tobacco research : official journal of the Society for Research on Nicotine and Tobacco.

[41]  M. Goran,et al.  Interactive multimedia for promoting physical activity (IMPACT) in children. , 2005, Obesity research.

[42]  G. Eysenbach.  The Law of Attrition , 2005, Journal of medical Internet research.

[43]  Peter Gregor,et al.  Are guidelines enough? An introduction to designing Web sites accessible to older people , 2005, IBM Syst. J..

[44]  E. Vermeire,et al.  Interventions for improving adherence to treatment recommendations in people with type 2 diabetes mellitus. , 2005, The Cochrane database of systematic reviews.

[45]  Luciano Boquete,et al.  User-friendly cognitive training for the elderly: a technical report. , 2011, Telemedicine journal and e-health : the official journal of the American Telemedicine Association.

[46]  D. Elashoff,et al.  Nurses trying to quit smoking using the Internet. , 2009, Nursing outlook.

[47]  S. Shortell,et al.  Improving the quality of health care in the United Kingdom and the United States: a framework for change. , 2001, The Milbank quarterly.

[48]  W. Assendelft,et al.  Interventions to improve the management of diabetes mellitus in primary care, outpatient and community settings. , 2000, The Cochrane database of systematic reviews.

[49]  D. Jeste,et al.  Multimedia educational aids for improving consumer knowledge about illness management and treatment decisions: a review of randomized controlled trials. , 2008, Journal of psychiatric research.

[50]  Ruth Petersen,et al.  Effectiveness of Employee Internet-Based Weight Management Program , 2008, Journal of occupational and environmental medicine.

[51]  Joanna E Cohen,et al.  Comprehensive evaluation of an online tobacco control continuing education course in Canada , 2008, The Journal of continuing education in the health professions.

[52]  R. Marshall,et al.  Agreement between ethnicity recorded in two New Zealand health databases: effects of discordance on cardiovascular outcome measures (PREDICT CVD3) , 2007, Australian and New Zealand journal of public health.

[53]  Helen Christensen,et al.  The Law of Attrition Revisited , 2006, Journal of medical Internet research.

[54]  Clifford Block,et al.  Improving diet and physical activity with ALIVE: a worksite randomized trial. , 2009, American journal of preventive medicine.

[55]  Jill Gerhardt‐Powals,et al.  Cognitive engineering principles for enhancing human-computer performance , 1996, Int. J. Hum. Comput. Interact..

[56]  Hock-Hai Teo,et al.  An empirical study of the effects of interactivity on web user attitude , 2003, Int. J. Hum. Comput. Stud..

[57]  K. Carpenter,et al.  Brief Interventions for Tobacco Users: Using the Internet to Train Healthcare Providers. , 2008, The international electronic journal of health education.

[58]  Betty A Levine,et al.  Web-based care management in patients with poorly controlled diabetes. , 2005, Diabetes care.

[59]  G. Eysenbach.  The Law of Attrition Revisited – Author’s Reply , 2006, Journal of Medical Internet Research.

[60]  Mack T Ruffin,et al.  Effect of Preventive Messages Tailored to Family History on Health Behaviors: The Family Healthware Impact Trial , 2011, The Annals of Family Medicine.

[61]  Jessie E Saul,et al.  Utilization of Smoking Cessation Informational, Interactive, and Online Community Resources as Predictors of Abstinence: Cohort Study , 2008, Journal of medical Internet research.

[62]  Jacob Cohen.  A Coefficient of Agreement for Nominal Scales , 1960 .

[63]  Patrick J O'Connor,et al.  Maintaining physical activity among older adults: six-month outcomes of the Keep Active Minnesota randomized controlled trial. , 2008, Preventive medicine.

[64]  L. Hedges,et al.  The Handbook of Research Synthesis and Meta-Analysis , 2009 .

[65]  Bruce Neal,et al.  A Systematic Review of the Impact of Adherence on the Effectiveness of e-Therapies , 2011, Journal of medical Internet research.

[66]  J. Boucher,et al.  Experience Analysis of a Practice-Based, Online Pedometer Program , 2006 .

[67]  M. Hickson,et al.  Factors enabling success in weight management programmes: systematic review and phenomenological approach. , 2011 .

[68]  Joseph Finkelstein,et al.  Impact of consumer health informatics applications. , 2009, Evidence report/technology assessment.

[69]  P. Thakurdesai,et al.  Evaluation of the quality and contents of diabetes mellitus patient education on Internet. , 2004, Patient education and counseling.

[70]  B. Levine,et al.  Impact of MyCareTeam for poorly controlled diabetes mellitus. , 2004, Diabetes technology & therapeutics.

[71]  Gavriel Salvendy,et al.  The contribution of apparent and inherent usability to a user's satisfaction in a searching and browsing task on the Web , 2002, Ergonomics.

[72]  R. Marshall,et al.  The accuracy of ethnicity data in primary care and its impact on cardiovascular risk assessment and management--PREDICT CVD-8. , 2008, The New Zealand medical journal.

[73]  Kevin Delucchi,et al.  International Spanish/English Internet smoking cessation trial yields 20% abstinence rates at 1 year. , 2009, Nicotine & tobacco research : official journal of the Society for Research on Nicotine and Tobacco.

[74]  Dean Schillinger,et al.  Diabetes Websites Accredited by the Health On the Net Foundation Code of Conduct: Readable or Not? , 2003, MIE.

[75]  Toree Malasanos,et al.  Knowledge improvement with web-based diabetes education program: brainfood. , 2006, Diabetes technology & therapeutics.

[76]  Linda L. Edwards,et al.  Reach and effectiveness of DVD and in-person diabetes self-management education , 2009, Chronic illness.

[77]  Suzanne Austin Boren,et al.  Computer-Aided Diabetes Education: A Synthesis of Randomized Controlled Trials , 2006, AMIA.

[78]  R. Whittaker,et al.  Will a web-based cardiovascular disease (CVD) risk assessment programme increase the assessment of CVD risk factors for Maori? , 2006, The New Zealand medical journal.

[79]  Beth Bock,et al.  Smoking cessation treatment on the Internet: content, quality, and usability. , 2004, Nicotine & tobacco research : official journal of the Society for Research on Nicotine and Tobacco.

[80]  H. Christensen,et al.  Delivering interventions for depression by using the internet: randomised controlled trial , 2004, BMJ : British Medical Journal.

[81]  R. Morrell.  Older Adults, Health Information, and the World Wide Web , 2001 .

[82]  Kathleen M Griffiths,et al.  A Comparison of Changes in Anxiety and Depression Symptoms of Spontaneous Users and Trial Participants of a Cognitive Behavior Therapy Website , 2004, Journal of medical Internet research.

[83]  Myrna L Armstrong,et al.  Pilot Using World Wide Web to Prevent Diabetes in Adolescents , 2006, Clinical nursing research.

[84]  J. S. Sodhi,et al.  Using Internet and Mobile Phone Technology to Deliver an Automated Physical Activity Program: Randomized Controlled Trial , 2007, Journal of medical Internet research.

[85]  Lucas J Carr,et al.  Internet-delivered behavior change program increases physical activity and improves cardiometabolic disease risk factors in sedentary adults: results of a randomized controlled trial. , 2008, Preventive medicine.

[86]  David B Abrams,et al.  A randomized trial of Internet and telephone treatment for smoking cessation. , 2011, Archives of internal medicine.

[87]  S. Straus,et al.  Knowledge translation in health care : moving from evidence to practice , 2009 .

[88]  B. Everitt,et al.  Large sample standard errors of kappa and weighted kappa. , 1969 .

[89]  Brian Raffety,et al.  Teaching Brief Interventions for Smoking Cessation via an Interactive Computer-based Tutorial , 2003, Journal of health psychology.

[90]  Elizabeth Murray,et al.  Interactive Health Communication Applications for people with chronic disease. , 2005, The Cochrane database of systematic reviews.

[91]  A. Jacobson,et al.  What attracts patients with diabetes to an internet support group? A 21‐month longitudinal website study , 2001, Diabetic medicine : a journal of the British Diabetic Association.

[92]  S. Kelder,et al.  Impact of A Smoking Prevention Interactive Experience (ASPIRE), an interactive, multimedia smoking prevention and cessation curriculum for culturally diverse high-school students. , 2008, Nicotine & tobacco research : official journal of the Society for Research on Nicotine and Tobacco.