The Effectiveness of Web-Based vs. Non-Web-Based Interventions: A Meta-Analysis of Behavioral Change Outcomes

Background A primary focus of self-care interventions for chronic illness is the encouragement of an individual's behavior change necessitating knowledge sharing, education, and understanding of the condition. The use of the Internet to deliver Web-based interventions to patients is increasing rapidly. In a 7-year period (1996 to 2003), there was a 12-fold increase in MEDLINE citations for “Web-based therapies.” The use and effectiveness of Web-based interventions to encourage an individual's change in behavior compared to non-Web-based interventions have not been substantially reviewed. Objective This meta-analysis was undertaken to provide further information on patient/client knowledge and behavioral change outcomes after Web-based interventions as compared to outcomes seen after implementation of non-Web-based interventions. Methods The MEDLINE, CINAHL, Cochrane Library, EMBASE, ERIC, and PSYCHInfo databases were searched for relevant citations between the years 1996 and 2003. Identified articles were retrieved, reviewed, and assessed according to established criteria for quality and inclusion/exclusion in the study. Twenty-two articles were deemed appropriate for the study and selected for analysis. Effect sizes were calculated to ascertain a standardized difference between the intervention (Web-based) and control (non-Web-based) groups by applying the appropriate meta-analytic technique. Homogeneity analysis, forest plot review, and sensitivity analyses were performed to ascertain the comparability of the studies. Results Aggregation of participant data revealed a total of 11,754 participants (5,841 women and 5,729 men). The average age of participants was 41.5 years. In those studies reporting attrition rates, the average drop out rate was 21% for both the intervention and control groups. For the five Web-based studies that reported usage statistics, time spent/session/person ranged from 4.5 to 45 minutes. Session logons/person/week ranged from 2.6 logons/person over 32 weeks to 1008 logons/person over 36 weeks. The intervention designs included one-time Web-participant health outcome studies compared to non-Web participant health outcomes, self-paced interventions, and longitudinal, repeated measure intervention studies. Longitudinal studies ranged from 3 weeks to 78 weeks in duration. The effect sizes for the studied outcomes ranged from -.01 to .75. Broad variability in the focus of the studied outcomes precluded the calculation of an overall effect size for the compared outcome variables in the Web-based compared to the non-Web-based interventions. Homogeneity statistic estimation also revealed widely differing study parameters (Qw16 = 49.993, P ≤ .001). There was no significant difference between study length and effect size. Sixteen of the 17 studied effect outcomes revealed improved knowledge and/or improved behavioral outcomes for participants using the Web-based interventions. Five studies provided group information to compare the validity of Web-based vs. non-Web-based instruments using one-time cross-sectional studies. These studies revealed effect sizes ranging from -.25 to +.29. Homogeneity statistic estimation again revealed widely differing study parameters (Qw4 = 18.238, P ≤ .001). Conclusions The effect size comparisons in the use of Web-based interventions compared to non-Web-based interventions showed an improvement in outcomes for individuals using Web-based interventions to achieve the specified knowledge and/or behavior change for the studied outcome variables. These outcomes included increased exercise time, increased knowledge of nutritional status, increased knowledge of asthma treatment, increased participation in healthcare, slower health decline, improved body shape perception, and 18-month weight loss maintenance.

[1]  R. Brian Haynes,et al.  Compliance in Health Care , 1979 .

[2]  C Safran,et al.  Computer-based interview for screening blood donors for risk of HIV transmission. , 1990, JAMA.

[3]  Ware J.E.Jr.,et al.  THE MOS 36- ITEM SHORT FORM HEALTH SURVEY (SF- 36) CONCEPTUAL FRAMEWORK AND ITEM SELECTION , 1992 .

[4]  Gwenn W. Gröndal,et al.  Meta-analytic procedures for social research , 1993 .

[5]  C E Kahn,et al.  Health status assessment via the World Wide Web. , 1996, Proceedings : a conference of the American Medical Informatics Association. AMIA Fall Symposium.

[6]  Joyce A. Mitchell,et al.  The clinical value of computerized information services. A review of 98 randomized clinical trials. , 1996, Archives of family medicine.

[7]  R F DeBusk,et al.  Development and evaluation of a computer-based system for dietary management of hyperlipidemia. , 1997, Journal of the American Dietetic Association.

[8]  R. Soetikno,et al.  Quality-of-life research on the Internet: feasibility and potential biases in patients with ulcerative colitis. , 1997, Journal of the American Medical Informatics Association : JAMIA.

[9]  P. Brennan,et al.  Computer network home care demonstration: a randomized trial in persons living with AIDS , 1998, Comput. Biol. Medicine.

[10]  A. Wald,et al.  An interactive, computer-based program to educate patients about genital herpes. , 1999, Sexually Transmitted Diseases.

[11]  D. Gustafson,et al.  Impact of a patient-centered, computer-based health information/support system. , 1999, American journal of preventive medicine.

[12]  Y Satomura,et al.  Computer-assisted instructions for patients with bronchial asthma. , 1999, Patient education and counseling.

[13]  B Gerbert,et al.  When asked, patients tell: disclosure of sensitive health-risk behaviors. , 1999, Medical care.

[14]  M. Dodd,et al.  The PRO-SELF Program: a self-care intervention program for patients receiving cancer treatment. , 2000, Seminars in oncology nursing.

[15]  G. Andersson,et al.  A controlled trial of self-help treatment of recurrent headache conducted via the Internet. , 2000, Journal of consulting and clinical psychology.

[16]  M. Atherton.  Outcome Measures of Efficacy Associated with a Web-Enabled Asthma Self-Management Programme , 2000 .

[17]  C. B. Taylor,et al.  Reducing risk factors for eating disorders: comparison of an Internet- and a classroom-delivered psychoeducational program. , 2000, Journal of consulting and clinical psychology.

[18]  L. Schneider,et al.  An evaluation of an innovative multimedia educational software program for asthma management: report of a randomized, controlled trial. , 2000, Pediatrics.

[19]  C. B. Taylor,et al.  Effectiveness of an Internet-based program for reducing risk factors for eating disorders. , 2000, Journal of consulting and clinical psychology.

[20]  Yoji Inoue.  XIII International AIDS Conference , 2000 .

[21]  U. Josefsson,et al.  Patients creating self-help on the internet -lessons for future design of internet based healthcare resources , 2004, 37th Annual Hawaii International Conference on System Sciences, 2004. Proceedings of the.

[22]  R A Winett,et al.  A computerized social cognitive intervention for nutrition behavior: Direct and mediated effects on fat, fiber, fruits, and vegetables, self-efficacy, and outcome expectations among food shoppers , 2001, Annals of behavioral medicine : a publication of the Society of Behavioral Medicine.

[23]  R. Winett,et al.  Using Internet technology to deliver a behavioral weight loss program. , 2001, JAMA.

[24]  J. Brug,et al.  Web-based tailored nutrition education: results of a randomized controlled trial. , 2001, Health education research.

[25]  P. Brennan,et al.  HeartCare: an Internet-based information and support system for patient home recovery after coronary artery bypass graft (CABG) surgery. , 2001, Journal of advanced nursing.

[26]  Ng Yuen Yee Jenny,et al.  Evaluating the Effectiveness of an Interactive Multimedia Computer-Based Patient Education Program in Cardiac Rehabilitation , 2001 .

[27]  Enrique J. Gómez,et al.  A web-based self-monitoring system for people living with HIV/AIDS , 2002, Comput. Methods Programs Biomed..

[28]  Gerhard Andersson,et al.  Randomized Controlled Trial of Internet-Based Cognitive Behavior Therapy for Distress Associated With Tinnitus , 2002, Psychosomatic medicine.

[29]  Kathleen M Griffiths,et al.  Web-based Cognitive Behavior Therapy: Analysis of Site Usage and Changes in Depression and Anxiety Scores , 2002, Journal of medical Internet research.

[30]  Ulrich A Müller,et al.  Evaluation of a computer based interactive diabetes education program designed to train the estimation of the energy or carbohydrate contents of foods. , 2002, Patient education and counseling.

[31]  D. Bangsberg,et al.  A computer-based assessment detects regimen misunderstandings and nonadherence for patients on HIV antiretroviral therapy , 2002, AIDS care.

[32]  J. Hobart,et al.  Quality of Life Measurement After Stroke: Uses and Abuses of the SF-36 , 2002, Stroke.

[33]  R. Glasgow,et al.  Do Internet-Based Support Interventions Change Perceptions of Social Support?: An Experimental Trial of Approaches for Supporting Diabetes Self-Management , 2002, American journal of community psychology.

[34]  F. Lynch,et al.  Overcoming Depression on the Internet (ODIN): A Randomized Controlled Trial of an Internet Depression Skills Intervention Program , 2002, Journal of medical Internet research.

[35]  J. Harvey-Berino,et al.  Does using the Internet facilitate the maintenance of weight loss? , 2002, International Journal of Obesity.

[36]  J. Harvey-Berino,et al.  The Feasibility of Using Internet Support for the Maintenance of Weight Loss , 2002, Behavior modification.

[37]  Concepción Perpiñá,et al.  Internet-Based Telehealth System for the Treatment of Agoraphobia , 2003, Cyberpsychology Behav. Soc. Netw..

[38]  H. Nagata,et al.  Development of Web-based intervention system for periodontal health: a pilot study in the workplace , 2003, Medical informatics and the Internet in medicine.

[39]  Santosh Krishna,et al.  Internet-enabled interactive multimedia asthma education program: a randomized trial. , 2003, Pediatrics.

[40]  Alison L Marshall,et al.  Print versus website physical activity programs: a randomized trial. , 2003, American journal of preventive medicine.

[41]  Jean-François Etter,et al.  Impact of messages on concomitant use of nicotine replacement therapy and cigarettes: a randomized trial on the Internet. , 2003, Addiction.

[42]  P. Emmelkamp,et al.  Interapy: a controlled randomized trial of the standardized treatment of posttraumatic stress through the internet. , 2003, Journal of consulting and clinical psychology.

[43]  D. Southard,et al.  Clinical trial of an Internet-based case management system for secondary prevention of heart disease. , 2003, Journal of cardiopulmonary rehabilitation.

[44]  H Garth McKay,et al.  The D-Net diabetes self-management program: long-term implementation, outcomes, and generalization results. , 2003, Preventive medicine.

[45]  David M Nathan,et al.  A controlled trial of web-based diabetes disease management: the MGH diabetes primary care improvement project. , 2003, Diabetes care.

[46]  Lee M Ritterband,et al.  An Internet intervention as adjunctive therapy for pediatric encopresis. , 2003, Journal of consulting and clinical psychology.