A Review of Online Evidence-based Practice Point-of-Care Information Summary Providers

Background Busy clinicians need easy access to evidence-based information to inform their clinical practice. Publishers and organizations have designed specific tools to meet doctors’ needs at the point of care. Objective The aim of this study was to describe online point-of-care summaries and evaluate their breadth, content development, and editorial policy against their claims of being “evidence-based.” Methods We searched Medline, Google, librarian association websites, and information conference proceedings from January to December 2008. We included English Web-based point-of-care summaries designed to deliver predigested, rapidly accessible, comprehensive, periodically updated, evidence-based information to clinicians. Two investigators independently extracted data on the general characteristics and content presentation of summaries. We assessed and ranked point-of-care products according to: (1) coverage (volume) of medical conditions, (2) editorial quality, and (3) evidence-based methodology. We explored how these factors were associated. Results We retrieved 30 eligible summaries. Of these products, 18 met our inclusion criteria and were qualitatively described, and 16 provided sufficient data for quantitative evaluation. The median volume of medical conditions covered was 80.6% (interquartile range, 68.9% - 84.2%) and varied for the different products. Similarly, differences emerged for editorial policy (median 8.0, interquartile range 5.8 - 10.3) and evidence-based methodology scores (median 10.0, interquartile range 1.0 - 12.8) on a 15-point scale. None of these dimensions turned out to be significantly associated with the other dimensions (editorial quality and volume, Spearman rank correlation r = -0.001, P = .99; evidence-based methodology and volume, r = -0.19, P = .48; editorial and evidence-based methodology, r = 0.43, P =.09). Conclusions Publishers are moving to develop point-of-care summary products. Some of these have better profiles than others, and there is room for improved reporting of the strengths and weaknesses of these products.

[1]  G R Bergus,et al.  Using the World Wide Web to answer clinical questions: how efficient are different methods of information retrieval? , 1999, The Journal of family practice.

[2]  David Trafimow,et al.  Some Tests of the Distinction between Cognitive and Affective Beliefs , 1998 .

[3]  Michael J. Hauan,et al.  How much effort is needed to keep up with the literature relevant for primary care? , 2004, Journal of the Medical Library Association : JMLA.

[4]  T. Jefferson,et al.  Editorial peer review for improving the quality of reports of biomedical studies. , 2007, The Cochrane database of systematic reviews.

[5]  W A Fisher,et al.  Changing AIDS-risk behavior. , 1992, Psychological bulletin.

[6]  D. Moher,et al.  Use of the CONSORT statement and quality of reports of randomized trials: a comparative before-and-after evaluation. , 2001, JAMA.

[7]  B. Ewigman,et al.  Answering family physicians' clinical questions using electronic medical databases. , 2001, The Journal of family practice.

[8]  M. Ebell,et al.  Obstacles to answering doctors' questions about patient care with evidence: qualitative study , 2002, BMJ : British Medical Journal.

[9]  Gary McCord,et al.  Answering Questions at the Point of Care: Do Residents Practice EBM or Manage Information Sources? , 2007, Academic medicine : journal of the Association of American Medical Colleges.

[10]  David Moher,et al.  Epidemiology and Reporting Characteristics of Systematic Reviews , 2007, PLoS medicine.

[11]  D. Slawson,et al.  What clinical information do doctors need? , 1997 .

[12]  G. Hastings,et al.  Putting social marketing into practice , 2006, BMJ : British Medical Journal.

[13]  A. Hume,et al.  Update in Handheld Electronic Resources for Evidence-Based Practice in the Community Setting , 2005, The Annals of pharmacotherapy.

[14]  M. Rothschild,et al.  Carrots, Sticks, and Promises: A Conceptual Framework for the Management of Public Health and Social Issue Behaviors , 2000 .

[15]  R. Winett,et al.  Using Internet technology to deliver a behavioral weight loss program. , 2001, JAMA.

[16]  Jacob Cohen.  Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[17]  G. Zimet,et al.  Understanding Consumer Responses to Product Risk Information , 2006 .

[18]  B. Haynes.  Of studies, syntheses, synopses, summaries, and systems: the "5S" evolution of information services for evidence-based healthcare decisions. , 2006, Evidence-based nursing.

[19]  Bas Verplanken,et al.  Accessibility of affective versus cognitive components of attitudes. , 1998 .

[20]  Jacob Cohen,et al.  Applied multiple regression/correlation analysis for the behavioral sciences , 1979 .

[21]  Robert Hurling,et al.  Internet-based exercise intervention systems: Are more interactive designs better? , 2006 .

[22]  S. Krimsky,et al.  Financial interest and its disclosure in scientific publications. , 1998, JAMA.

[23]  I. Olkin,et al.  Improving the quality of reports of meta‐analyses of randomised controlled trials: the QUOROM statement , 2000, Revista espanola de salud publica.

[24]  Reinier Akkermans,et al.  Web-Based Targeted Nutrition Counselling and Social Support for Patients at Increased Cardiovascular Risk in General Practice: Randomized Controlled Trial , 2004, Journal of medical Internet research.

[25]  J. Brug,et al.  Characteristics of visitors and revisitors to an Internet-delivered computer-tailored lifestyle intervention implemented for use by the general public. , 2010, Health education research.

[26]  Douglas G Altman,et al.  Empirical evidence of bias in treatment effect estimates in controlled trials with different interventions and outcomes: meta-epidemiological study , 2008, BMJ : British Medical Journal.

[27]  Oleksandr Shepotylo.  Three-Point-For-Win in Soccer: Are There Incentives for Match Fixing? , 2005 .

[28]  M. Benninger,et al.  Assessment of Quality of Life among Patients with Sinonasal Disease as Determined by an Internet Survey based on the Rhinosinusitis Disability Index , 2007, Ear, nose, & throat journal.

[29]  D. Wantland,et al.  The Effectiveness of Web-Based vs. Non-Web-Based Interventions: A Meta-Analysis of Behavioral Change Outcomes , 2004, Journal of medical Internet research.

[30]  R B Haynes,et al.  Of studies, summaries, synopses, and systems: the “4S” evolution of services for finding current best evidence , 2005, ACP journal club.

[31]  Valentina Comba.  European Association for Health Information and Libraries (EAHIL) Workshop 2001: Cyberspace Odyssey , 2001 .

[32]  R A Bankowitz,et al.  Physicians' use of computer software in answering clinical questions. , 1993, Bulletin of the Medical Library Association.

[33]  S. Fenton,et al.  A comparison of primary care information content in UpToDate and the National Guideline Clearinghouse. , 2007, Journal of the Medical Library Association : JMLA.

[34]  Jean Harvey-Berino,et al.  Internet-based weight control: the relationship between web features and weight loss. , 2008, Telemedicine journal and e-health : the official journal of the American Telemedicine Association.

[35]  G. Kok,et al.  The Theory of Planned Behavior: A Review of its Applications to Health-Related Behaviors , 1996, American journal of health promotion : AJHP.

[36]  D. Tate,et al.  Perinatal mortality and congenital anomalies in babies of women with type 1 or type 2 diabetes in England, Wales, and Northern Ireland: population based study , 2006, BMJ : British Medical Journal.

[37]  John R. Clark.  The Social Science Research Network , 2002 .

[38]  C. Champagne,et al.  Weight loss during the intensive intervention phase of the weight-loss maintenance trial. , 2008, American journal of preventive medicine.

[39]  Richard Smith,et al.  Medical Journals Are an Extension of the Marketing Arm of Pharmaceutical Companies , 2005, PLoS medicine.

[40]  B. Ainsworth,et al.  International physical activity questionnaire: 12-country reliability and validity. , 2003, Medicine and science in sports and exercise.

[41]  B. Haynes.  Of studies, syntheses, synopses, summaries, and systems: the “5S” evolution of information services for evidence-based healthcare decisions , 2007, Evidence-based medicine.

[42]  Michael Proschan,et al.  Design considerations and rationale of a multi-center trial to sustain weight loss: the weight loss maintenance trial , 2008, Clinical trials.

[43]  Judith Wylie-Rosett,et al.  Achieving weight and activity goals among diabetes prevention program lifestyle participants. , 2004, Obesity research.

[44]  Mark H Ebell,et al.  Information mastery: integrating continuing medical education with the information needs of clinicians. , 2003, The Journal of continuing education in the health professions.

[45]  R B Haynes,et al.  Bridges between health care research evidence and clinical practice. , 1995, Journal of the American Medical Informatics Association : JAMIA.

[46]  D. Tate,et al.  Effects of Internet behavioral counseling on weight loss in adults at risk for type 2 diabetes: a randomized trial. , 2003, JAMA.

[47]  Trudy Dwyer,et al.  Examination of program exposure across intervention delivery modes: face-to-face versus internet , 2007, The international journal of behavioral nutrition and physical activity.

[48]  Elisheva F. Gross,et al.  Adolescent Internet use: What we expect, what teens report , 2004 .

[49]  I. Olkin,et al.  Improving the quality of reports of meta-analyses of randomised controlled trials: the QUOROM statement , 1999, The Lancet.

[50]  Alison L Marshall,et al.  Website physical activity interventions: preferences of potential users. , 2005, Health education research.

[51]  Scott B Going,et al.  Maintenance of Weight Loss in Overweight Middle‐aged Women Through the Internet , 2008, Obesity.

[52]  Jean Harvey-Berino,et al.  Minimal in-person support as an adjunct to internet obesity treatment , 2007, Annals of behavioral medicine : a publication of the Society of Behavioral Medicine.

[53]  D. Albarracín,et al.  Nature, decay, and spiraling of the effects of fear-inducing arguments and HIV counseling and testing: a meta-analysis of the short- and long-term outcomes of HIV-prevention interventions. , 2007, Health psychology : official journal of the Division of Health Psychology, American Psychological Association.

[54]  Mark H Ebell,et al.  Point-of-care information that changes practice: it's closer than we think. , 2003, Family medicine.

[55]  J. Harvey-Berino,et al.  Weight Loss on the Web: A Pilot Study Comparing a Structured Behavioral Intervention to a Commercial Program , 2007, Obesity.

[56]  안태경.  Social Science Research Network , 2005 .

[57]  David J Torgerson,et al.  Adequacy and reporting of allocation concealment: review of recent trials published in four general medical journals , 2005, BMJ : British Medical Journal.

[58]  G. Guyatt,et al.  Systems for grading the quality of evidence and the strength of recommendations I: Critical appraisal of existing approaches The GRADE Working Group , 2004, BMC health services research.

[59]  Iveta Simera,et al.  EQUATOR: reporting guidelines for health research , 2008, Open medicine : a peer-reviewed, independent, open-access journal.

[60]  W.T.M. Ooijendijk,et al.  Consensus over de Nederlandse norm voor gezond bewegen , 2000 .

[61]  Jean Harvey-Berino,et al.  Effect of internet support on the long-term maintenance of weight loss. , 2004, Obesity research.

[62]  Arjen Hoogendam,et al.  Answers to Questions Posed During Daily Patient Care Are More Likely to Be Answered by UpToDate Than PubMed , 2008, Journal of medical Internet research.

[63]  Alexander J. Rothman,et al.  The effects of message framing and ethnic targeting on mammography use among low-income women. , 2001, Health psychology : official journal of the Division of Health Psychology, American Psychological Association.

[64]  Joan Ash,et al.  An evaluation of five bedside information products using a user-centered, task-oriented approach. , 2006, Journal of the Medical Library Association : JMLA.

[65]  Miriam Wanner,et al.  Comparison of Trial Participants and Open Access Users of a Web-Based Physical Activity Intervention Regarding Adherence, Attrition, and Repeated Participation , 2010, Journal of medical Internet research.

[66]  T. Wadden,et al.  Behavioral treatment of obesity. , 2003, Endocrinology and metabolism clinics of North America.

[67]  R Smith,et al.  Information in practice , 1996, BMJ.

[68]  K. Flegal,et al.  Prevalence of overweight and obesity in the United States, 1999-2004. , 2006, JAMA.

[69]  C. Champagne,et al.  Design and Implementation of an Interactive Website to Support Long-Term Maintenance of Weight Loss , 2008, Journal of medical Internet research.

[70]  D. Moher,et al.  Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. , 2010, International journal of surgery.

[71]  Alan Bauck,et al.  Development and implementation cost analysis of telephone- and Internet-based interventions for the maintenance of weight loss , 2009, International Journal of Technology Assessment in Health Care.

[72]  N. Milas,et al.  Long-Term Weight Loss and Changes in Blood Pressure: Results of the Trials of Hypertension Prevention, Phase II , 2001, Annals of Internal Medicine.