A comparison of the accuracy of clinical decisions based on full-text articles and on journal abstracts alone: a study among residents in a tertiary care hospital

Background Many clinicians depend solely on journal abstracts to guide clinical decisions. Objectives This study aims to determine if there are differences in the accuracy of responses to simulated cases between resident physicians provided with an abstract only and those with full-text articles. It also attempts to describe their information-seeking behaviour. Methods Seventy-seven resident physicians from four specialty departments of a tertiary care hospital completed a paper-based questionnaire with clinical simulation cases, then randomly assigned to two intervention groups—access to abstracts-only and access to both abstracts and full-text. While having access to medical literature, they completed an online version of the same questionnaire. Findings The average improvement across departments was not significantly different between the abstracts-only group and the full-text group (p=0.44), but when accounting for an interaction between intervention and department, the effect was significant (p=0.049) with improvement greater with full-text in the surgery department. Overall, the accuracy of responses was greater after the provision of either abstracts-only or full-text (p<0.0001). Although some residents indicated that ‘accumulated knowledge’ was sufficient to respond to the patient management questions, in most instances (83% of cases) they still sought medical literature. Conclusions Our findings support studies that doctors will use evidence when convenient and current evidence improved clinical decisions. The accuracy of decisions improved after the provision of evidence. Clinical decisions guided by full-text articles were more accurate than those guided by abstracts alone, but the results seem to be driven by a significant difference in one department.

[1]  E. Huth,et al.  Structured abstracts for papers reporting clinical trials. , 1987, Annals of internal medicine.

[2]  Patrice Morel,et al.  Quality of abstracts in 3 clinical dermatology journals. , 2003, Archives of dermatology.

[3]  D. Sackett,et al.  Finding and applying evidence during clinical rounds: the "evidence cart". , 1998, JAMA.

[4]  D. Sackett,et al.  Evidence based medicine: what it is and what it isn't , 1996, BMJ.

[5]  D. Macauley Critical appraisal of medical literature: an aid to rational decision making. , 1995, Family practice.

[6]  R Core Team,et al.  R: A language and environment for statistical computing. , 2014 .

[7]  Johanna I. Westbrook,et al.  Do online information retrieval systems help experienced clinicians answer clinical questions? , 2005, Journal of the American Medical Informatics Association : JAMIA.

[8]  Paul Fontelo,et al.  MedlinePlus en Español and Spanish-speakers. , 2007, AMIA ... Annual Symposium proceedings. AMIA Symposium.

[9]  Josh Peterson,et al.  A Web‐based Compendium of Clinical Questions and Medical Evidence to Educate Internal Medicine Residents , 2003, Academic medicine : journal of the Association of American Medical Colleges.

[10]  Jessie McGowan,et al.  Just-in-Time Information Improved Decision-Making in Primary Care: A Randomized Controlled Trial , 2008, PloS one.

[11]  MPH Somnath Saha MD,et al.  Journal reading habits of internists , 2007, Journal of General Internal Medicine.

[12]  P. Diggle Analysis of Longitudinal Data , 1995 .

[13]  R M Pitkin,et al.  Accuracy of data in abstracts of published research articles. , 1999, JAMA.

[14]  Matthew E. Falagas,et al.  Addressing the Limitations of Structured Abstracts , 2004, Annals of Internal Medicine.

[15]  A. Berger FUNDAMENTALS OF BIOSTATISTICS , 1969 .

[16]  F. Godlee,et al.  Innovations in publishing BMJ research , 2008, BMJ : British Medical Journal.

[17]  R M Pitkin,et al.  Can the accuracy of abstracts be improved by providing specific instructions? A randomized controlled trial. , 1998, JAMA.

[18]  G. Yamey,et al.  The Impact of Open Access upon Public Health , 2006, PLoS Medicine.

[19]  James Hartley,et al.  Current findings from research on structured abstracts. , 2004, Journal of the Medical Library Association : JMLA.

[20]  V. Barbour,et al.  The impact of open access upon public health. , 2006, Bulletin of the World Health Organization.

[21]  E. Fisher,et al.  Abstracts in high profile journals often fail to report harm , 2008, BMC medical research methodology.

[22]  R. Pitkin The importance of the abstract. , 1987, Obstetrics and gynecology.

[23]  M. Falagas,et al.  Addressing the Limitations of Structured Abstracts , 2004, Annals of Internal Medicine.

[24]  Janet L. Peacock,et al.  How well do structured abstracts reflect the articles they summarize , 2009 .

[25]  F. Gutzwiller,et al.  A proposal for more informative abstracts of clinical articles. Ad Hoc Working Group for Critical Appraisal of the Medical Literature. , 1987, Annals of internal medicine.

[26]  C J Walker,et al.  Online access to MEDLINE in clinical settings: impact of user fees. , 1991, Bulletin of the Medical Library Association.

[27]  Shigeaki Yamazaki,et al.  Adoption of structured abstracts by general medical journals and format for a structured abstract. , 2005, Journal of the Medical Library Association : JMLA.

[28]  The Lancet Read MEDLINE abstracts with a pinch of salt , 2006, The Lancet.

[29]  T R Einarson,et al.  Quality of nonstructured and structured abstracts of original research articles in the British Medical Journal, the Canadian Medical Association Journal and the Journal of the American Medical Association. , 1994, CMAJ : Canadian Medical Association journal = journal de l'Association medicale canadienne.

[30]  H. Hricak,et al.  Evidence-based medicine. , 1997, Singapore medical journal.

[31]  D. Moher,et al.  CONSORT for Reporting Randomized Controlled Trials in Journal and Conference Abstracts: Explanation and Elaboration , 2008, PLoS medicine.

[32]  M H Ebell,et al.  Family physicians' use of medical abstracts to guide decision making: style or substance? , 2001, The Journal of the American Board of Family Practice.

[33]  M. Winker,et al.  The need for concrete improvement in abstract quality. , 1999, JAMA.

[34]  G. Gorry,et al.  Towards the simulation of clinical cognition. Taking a present illness by computer. , 1976, The American journal of medicine.

[35]  Robert Fletcher,et al.  Systematic Review: The Relationship between Clinical Experience and Quality of Health Care , 2005, Annals of Internal Medicine.

[36]  M. Gardner,et al.  More informative abstracts revisited. , 1990, The Cleft palate-craniofacial journal : official publication of the American Cleft Palate-Craniofacial Association.

[37]  K. A. McKibbon,et al.  Online access to MEDLINE in clinical settings. A study of use and usefulness. , 1990, Annals of internal medicine.

[38]  P. Fontelo Consensus abstracts for evidence-based medicine , 2011, Evidence Based Medicine.

[39]  D. Cook,et al.  The quality of reporting of trial abstracts is suboptimal: survey of major general medical journals. , 2009, Journal of clinical epidemiology.

[40]  T R Einarson,et al.  Quality of abstracts of original research articles in CMAJ in 1989. , 1991, CMAJ : Canadian Medical Association journal = journal de l'Association medicale canadienne.