Systematic analysis underlying the quality of the scientific evidence and conflicts of interest in interventional medicine subspecialty guidelines.

OBJECTIVE To determine the validity of guidelines published by interventional medical societies. METHODS We reviewed the interventional medicine subspecialty society websites of the American Association for Bronchology and Interventional Pulmonology (AABIP), American Society of Diagnostic and Interventional Nephrology (ASDIN), American Society for Gastrointestinal Endoscopy (ASGE), and Society for Cardiovascular Angiography and Interventions (SCAI) as of November 15, 2012, for published interventional guidelines. The study was performed between November 15, 2012, and January 1, 2013. The AABIP did not publish guidelines, so American Thoracic Society and American College of Chest Physicians guidelines were reviewed. All the guidelines were reviewed for graded levels of evidence, methods used to grade the evidence, and disclosures of conflicts of interest (COIs). RESULTS Of 153 interventional guidelines evaluated, 4 were duplicates. Forty-six percent of guidelines (69 of 149) graded the quality of evidence using 7 different methods. The ASGE graded 71% of guidelines (46 of 65) compared with 29% (23 of 78) by the SCAI and 0 by the ASDIN (n=4) and the pulmonary societies (n=2). Of the 3425 recommendations reviewed, 11% (n=364) were supported by level A, 42% (n=1432) by level B, and 48% (n=1629) by level C. The mean age of the guidelines was 5.2 years. Additionally, 62% of the guidelines (92 of 149) failed to comment on COIs; when disclosed, 91% of guidelines (52 of 57) reported COIs. In total, 1827 COIs were reported by 45% of the authors (317 of 697), averaging 5.8 COIs per author. CONCLUSION Most of the interventional guidelines failed to grade the evidence. When present, most guidelines used lower-quality evidence. Furthermore, most guidelines failed to disclose COIs. When commented on, numerous COIs were present. Future guidelines should clearly state the quality of evidence, use a standard grading system, be transparent regarding potential biases, and provide frequent updates.

[1]  R. Califf,et al.  Scientific evidence underlying the ACC/AHA clinical practice guidelines. , 2009, JAMA.

[2]  Rodney A. White,et al.  ACC/AHA 2005 Practice Guidelines for the management of patients with peripheral arterial disease (lower extremity, renal, mesenteric, and abdominal aortic): a collaborative report from the American Association for Vascular Surgery/Society for Vascular Surgery, Society for Cardiovascular Angiography , 2006, Circulation.

[3]  P. Mackowiak,et al.  Failure of clinical practice guidelines to meet institute of medicine standards: Two more decades of little, if any, progress. , 2012, Archives of internal medicine.

[4]  Alastair Baker,et al.  Crossing the Quality Chasm: A New Health System for the 21st Century , 2001, BMJ : British Medical Journal.

[5]  J. Grimshaw,et al.  Potential benefits, limitations, and harms of clinical guidelines , 1999, BMJ.

[6]  Michelle E. Kho,et al.  AGREE II: advancing guideline development, reporting and evaluation in health care , 2010, Canadian Medical Association Journal.

[7]  M. Field,et al.  Guidelines for Clinical Practice: From Development to Use , 1992 .

[8]  M. Armstrong,et al.  Assessment of the Quality of Evidence Underlying International Guidelines in Liver Disease , 2012, The American Journal of Gastroenterology.

[9]  John V. White,et al.  2011 ACCF/AHA Focused Update of the Guideline for the Management of Patients With Peripheral Artery Disease (Updating the 2005 Guideline) , 2011, Vascular medicine.

[10]  Marilyn J. Field,et al.  Conflict of Interest in Medical Research, Education, and Practice , 2009 .

[11]  M. Field,et al.  Committee on Conflict of Interest in Medical Research, Education, and Practice , 2009 .

[12]  Salomeh Keyhani,et al.  Prevalence of financial conflicts of interest among panel members producing clinical practice guidelines in Canada and United States: cross sectional study , 2011, BMJ : British Medical Journal.

[13]  M. Somerfield,et al.  Perspectives on the value of American Society of Clinical Oncology clinical guidelines as reported by oncologists and health maintenance organizations. , 2003, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[14]  P. Shekelle,et al.  Validity of the Agency for Healthcare Research and Quality clinical practice guidelines: how quickly do guidelines become outdated? , 2001, JAMA.

[15]  E. Kuipers,et al.  Conflicts of Interest Ethics: Silencing Expertise in the Development of International Clinical Practice Guidelines , 2012, Annals of Internal Medicine.

[16]  N. Hyman,et al.  A consensus document on bowel preparation before colonoscopy: prepared by a task force from the American Society of Colon and Rectal Surgeons (ASCRS), the American Society for Gastrointestinal Endoscopy (ASGE), and the Society of American Gastrointestinal and Endoscopic Surgeons (SAGES) , 2006, Surgical Endoscopy And Other Interventional Techniques.

[17]  D. Lee,et al.  Analysis of overall level of evidence behind Infectious Diseases Society of America practice guidelines. , 2011, Archives of internal medicine.

[18]  N. Hyman,et al.  A consensus document on bowel preparation before colonoscopy: prepared by a Task Force from the American Society of Colon and Rectal Surgeons (ASCRS), the American Society for Gastrointestinal Endoscopy (ASGE), and the Society of American Gastrointestinal and Endoscopic Surgeons (SAGES) , 2006, Surgical Endoscopy And Other Interventional Techniques.

[19]  Eric G Campbell,et al.  Conflicts of interest in cardiovascular clinical practice guidelines. , 2011, Archives of internal medicine.

[20]  Michelle A. Anderson,et al.  Management of antithrombotic agents for endoscopic procedures. , 2009, Gastrointestinal endoscopy.

[21]  A. Detsky,et al.  Relationships between authors of clinical practice guidelines and the pharmaceutical industry. , 2002, JAMA.

[22]  Sunita Sah,et al.  The unintended consequences of conflict of interest disclosure. , 2012, JAMA.

[23]  John V. White,et al.  2011 ACCF/AHA Focused Update of the Guideline for the Management of patients with peripheral artery disease (Updating the 2005 Guideline): a report of the American College of Cardiology Foundation/American Heart Association Task Force on practice guidelines. , 2011, Circulation.