Comparing data accuracy between structured abstracts and full-text journal articles: implications in their use for informing clinical decisions

Background The abstract is the most frequently read section of a research article. The use of ‘Consensus Abstracts’, a clinician-oriented web application formatted for mobile devices to search MEDLINE/PubMed, for informing clinical decisions was proposed recently; however, inaccuracies between abstracts and the full-text article have been shown. Efforts have been made to improve quality. Methods We compared data in 60 recent-structured abstracts and full-text articles from six highly read medical journals. Results Data inaccuracies were identified and then classified as either clinically significant or not significant. Data inaccuracies were observed in 53.33% of articles ranging from 3.33% to 45% based on the IMRAD format sections. The Results section showed the highest discrepancies (45%) although these were deemed to be mostly not significant clinically except in one. The two most common discrepancies were mismatched numbers or percentages (11.67%) and numerical data or calculations found in structured abstracts but not mentioned in the full text (40%). There was no significant relationship between journals and the presence of discrepancies (Fisher’s exact p value =0.3405). Although we found a high percentage of inaccuracy between structured abstracts and full-text articles, these were not significant clinically. Conclusions The inaccuracies do not seem to affect the conclusion and interpretation overall. Structured abstracts appear to be informative and may be useful to practitioners as a resource for guiding clinical decisions.

[1]  B. Kavanagh Glucose in the ICU--evidence, guidelines, and outcomes. , 2012, The New England journal of medicine.

[2]  Ermenegyldo Munhoz Junior Requisitos uniformes para manuscritos submetidos a periódicos biomédicos: escrevendo e editando para publicações biomédicas , 2006 .

[3]  D. Sackett,et al.  Finding and applying evidence during clinical rounds: the "evidence cart". , 1998, JAMA.

[4]  E. Huth,et al.  Structured abstracts for papers reporting clinical trials. , 1987, Annals of internal medicine.

[5]  W. Hersh,et al.  Factors associated with successful answering of clinical questions using an information retrieval system. , 2002, Bulletin of the Medical Library Association.

[6]  D. Sackett,et al.  Evidence based medicine: what it is and what it isn't , 1996, BMJ.

[7]  黄亚明(整理),et al.  ICMJE , 2012 .

[8]  M. Gardner,et al.  More informative abstracts revisited. , 1990, The Cleft palate-craniofacial journal : official publication of the American Cleft Palate-Craniofacial Association.

[9]  K. A. McKibbon,et al.  What do evidence-based secondary journals tell us about the publication of clinically important articles in primary healthcare journals? , 2004, BMC medicine.

[10]  Patrice Morel,et al.  Quality of abstracts in 3 clinical dermatology journals. , 2003, Archives of dermatology.

[11]  Luciana B Sollaci,et al.  The introduction, methods, results, and discussion (IMRAD) structure: a fifty-year survey. , 2004, Journal of the Medical Library Association : JMLA.

[12]  R M Pitkin,et al.  Can the accuracy of abstracts be improved by providing specific instructions? A randomized controlled trial. , 1998, JAMA.

[13]  G. Yamey,et al.  The Impact of Open Access upon Public Health , 2006, PLoS Medicine.

[14]  黄亚明 PubMed Central , 2009 .

[15]  Sandeep Sharma,et al.  Structured abstracts: do they improve the quality of information in abstracts? , 2006, American journal of orthodontics and dentofacial orthopedics : official publication of the American Association of Orthodontists, its constituent societies, and the American Board of Orthodontics.

[16]  Pieter de Vries Robbé,et al.  Analysis of queries sent to PubMed at the point of care: Observation of search behaviour in a medical teaching hospital , 2008, BMC Medical Informatics Decis. Mak..

[17]  D. Moher,et al.  CONSORT for Reporting Randomized Controlled Trials in Journal and Conference Abstracts: Explanation and Elaboration , 2008, PLoS medicine.

[18]  James G Mork,et al.  A retrospective cohort study of structured abstracts in MEDLINE, 1992-2006. , 2011, Journal of the Medical Library Association : JMLA.

[19]  K. A. McKibbon,et al.  Online access to MEDLINE in clinical settings. A study of use and usefulness. , 1990, Annals of internal medicine.

[20]  J. R. Landis,et al.  The measurement of observer agreement for categorical data. , 1977, Biometrics.

[21]  Hemant Kulkarni Structured Abstracts: Still More , 1996, Annals of Internal Medicine.

[22]  [Uniform requirements for manuscripts submitted to biomedical journals: writing and editing for biomedical publication]. , 2004 .

[23]  Douglas G Altman,et al.  Reporting and interpretation of randomized controlled trials with statistically nonsignificant results for primary outcomes. , 2010, JAMA.

[24]  Miguel A. Andrade-Navarro,et al.  Information extraction from full text scientific articles: Where are the keywords? , 2003, BMC Bioinformatics.

[25]  R M Pitkin,et al.  Accuracy of data in abstracts of published research articles. , 1999, JAMA.

[26]  MPH Somnath Saha MD,et al.  Journal reading habits of internists , 2007, Journal of General Internal Medicine.

[27]  F. Gutzwiller,et al.  A proposal for more informative abstracts of clinical articles. Ad Hoc Working Group for Critical Appraisal of the Medical Literature. , 1987, Annals of internal medicine.

[28]  Johanna I. Westbrook,et al.  Do online information retrieval systems help experienced clinicians answer clinical questions? , 2005, Journal of the American Medical Informatics Association : JAMIA.

[29]  Josh Peterson,et al.  A Web‐based Compendium of Clinical Questions and Medical Evidence to Educate Internal Medicine Residents , 2003, Academic medicine : journal of the Association of American Medical Colleges.

[30]  Timothy B. Patrick,et al.  Comparing Frequency of Content-Bearing Words in Abstracts and Texts in Articles from Four Medical Journals: An Exploratory Study , 2001, MedInfo.

[31]  Shigeaki Yamazaki,et al.  Adoption of structured abstracts by general medical journals and format for a structured abstract. , 2005, Journal of the Medical Library Association : JMLA.

[32]  P. Fontelo Consensus abstracts for evidence-based medicine , 2011, Evidence Based Medicine.

[33]  Christine Davidian,et al.  Quality of structured abstracts of original research articles in the British Medical Journal, the Canadian Medical Association Journal and the Journal of the American Medical Association: a 10-year follow-up study , 2005, Current medical research and opinion.

[34]  Peter Dalgaard,et al.  R Development Core Team (2010): R: A language and environment for statistical computing , 2010 .

[35]  T. Einarson,et al.  Quality Assessment of Pharmacoeconomic Abstracts of Original Research Articles in Selected Journals , 1997, The Annals of pharmacotherapy.

[36]  M H Ebell,et al.  Family physicians' use of medical abstracts to guide decision making: style or substance? , 2001, The Journal of the American Board of Family Practice.

[37]  M. Winker,et al.  The need for concrete improvement in abstract quality. , 1999, JAMA.

[38]  Arthur S Slutsky,et al.  An official multi-society statement: the role of clinical research results in the practice of critical care medicine. , 2012, American Journal of Respiratory and Critical Care Medicine.

[39]  D. Cook,et al.  The quality of reporting of trial abstracts is suboptimal: survey of major general medical journals. , 2009, Journal of clinical epidemiology.

[40]  Isabelle Boutron,et al.  Misrepresentation of Randomized Controlled Trials in Press Releases and News Coverage: A Cohort Study , 2012, PLoS medicine.

[41]  Paul Fontelo,et al.  A comparison of the accuracy of clinical decisions based on full-text articles and on journal abstracts alone: a study among residents in a tertiary care hospital , 2012, Evidence-Based Medicine.

[42]  Lauren B. Doyle,et al.  Semantic Road Maps for Literature Searchers , 1961, JACM.

[43]  Jessie McGowan,et al.  Just-in-Time Information Improved Decision-Making in Primary Care: A Randomized Controlled Trial , 2008, PloS one.

[44]  H. Rubin,et al.  More Informative Abstracts of Articles Describing Clinical Practice Guidelines , 1993, Annals of Internal Medicine.

[45]  The Lancet Read MEDLINE abstracts with a pinch of salt , 2006, The Lancet.

[46]  T R Einarson,et al.  Quality of nonstructured and structured abstracts of original research articles in the British Medical Journal, the Canadian Medical Association Journal and the Journal of the American Medical Association. , 1994, CMAJ : Canadian Medical Association journal = journal de l'Association medicale canadienne.

[47]  David L. Sackett,et al.  Evidence based medicine: What it is and what it isn't (reprinted from BMJ, vol 312, pg 71-72, 1996) , 2007 .

[48]  Paul Fontelo,et al.  MedlinePlus en Español and Spanish-speakers. , 2007, AMIA ... Annual Symposium proceedings. AMIA Symposium.