Level of scientific evidence underlying recommendations arising from the National Comprehensive Cancer Network clinical practice guidelines.

PURPOSE The level of scientific evidence on which the National Comprehensive Cancer Network (NCCN) guidelines are based has not been systematically investigated. We describe the distribution of categories of evidence and consensus (EC) among the 10 most common cancers with regard to recommendations for staging, initial and salvage therapy, and surveillance. METHODS NCCN uses a system of guideline development distinct from other major professional organizations. The NCCN definitions for EC are as follows: category I, high level of evidence with uniform consensus; category IIA, lower level of evidence with uniform consensus; category IIB, lower level of evidence without a uniform consensus but with no major disagreement; and category III, any level of evidence but with major disagreement. RESULTS Of the 1,023 recommendations found in the 10 guidelines, the proportions of category I, IIA, IIB, and III EC were 6%, 83%, 10%, and 1%, respectively. Recommendations with category I EC were found in kidney (20%), breast (19%), lung (6%), pancreatic (6%), non-Hodgkin's lymphoma (6%), melanoma (6%), prostate (4%), and colorectal (1%) guidelines. Urinary bladder and uterine guidelines did not have any category I recommendations. Eight percent of all therapeutic recommendations were category I. Guidelines with the highest proportions of category I therapeutic recommendations were for breast (30%) and kidney (28%) cancers. No category I recommendations were found on screening or surveillance. CONCLUSION Recommendations issued in the NCCN guidelines are largely developed from lower levels of evidence but with uniform expert opinion. This underscores the urgent need and available opportunities to expand evidence base in oncology.

[1]  Corneel Coens,et al.  Early versus delayed treatment of relapsed ovarian cancer (MRC OV05/EORTC 55955): a randomised trial , 2010, The Lancet.

[2]  D. Coit,et al.  Site and timing of first relapse in stage III melanoma patients: implications for follow-up guidelines. , 2010, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[3]  W. Mcgivney,et al.  NCCN Guidelines and Their Impact on Coverage Policy , 2010 .

[4]  G. Guyatt,et al.  The Vexing Problem of Guidelines and Conflict of Interest: A Potential Solution , 2010, Annals of Internal Medicine.

[5]  R. Go,et al.  Utility of routine cardiac ejection fraction (EF) measurement prior to anthracycline-based chemotherapy (ABC) in patients with diffuse large b-cell lymphoma (DLBCL). , 2010 .

[6]  Brian P. Kavanagh,et al.  The GRADE System for Rating Clinical Guidelines , 2009, PLoS medicine.

[7]  Thomas J. Smith,et al.  Efficacy does not necessarily translate to cost effectiveness: a case study in the challenges associated with 21st-century cancer drug pricing. , 2009, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[8]  Louis B Jacques,et al.  Compendia and Anticancer Therapy Under Medicare , 2009, Annals of Internal Medicine.

[9]  R. Califf,et al.  Scientific evidence underlying the ACC/AHA clinical practice guidelines. , 2009, JAMA.

[10]  C. Furberg,et al.  Why guideline-making requires reform. , 2009, JAMA.

[11]  J. Niland,et al.  Selecting High Priority Quality Measures For Breast Cancer Quality Improvement , 2008, Medical care.

[12]  Katherine L Kahn,et al.  American Society of Clinical Oncology/National Comprehensive Cancer Network Quality Measures. , 2008, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[13]  T. Hieken,et al.  Adverse Outcomes Associated with Noncompliance with Melanoma Treatment Guidelines , 2008, Annals of Surgical Oncology.

[14]  Allan S Detsky,et al.  Everyone's a little bit biased (even physicians). , 2008, JAMA.

[15]  R. Go,et al.  Financial conflicts of interest (FCOIs) among the National Comprehensive Cancer Network (NCCN) clinical practice guideline panel members , 2008 .

[16]  G. Guyatt,et al.  Going from evidence to recommendations , 2008, BMJ : British Medical Journal.

[17]  Gordon H Guyatt,et al.  GrADe : what is “ quality of evidence ” and why is it important to clinicians ? rATING quALITY of evIDeNCe AND STreNGTH of reCommeNDATIoNS , 2022 .

[18]  D. Cortese,et al.  Pay-for-performance or pay for value? , 2007, Mayo Clinic proceedings.

[19]  J. Landercasper,et al.  A breast center review of compliance with National Comprehensive Cancer Network Breast Cancer guidelines. , 2006, American journal of surgery.

[20]  Mohammad Jahanzeb,et al.  A process for measuring the quality of cancer care: the Quality Oncology Practice Initiative. , 2005, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[21]  A. Wu,et al.  Clinical practice guidelines and quality of care for older patients with multiple comorbid diseases: implications for pay for performance. , 2005, JAMA.

[22]  B. Djulbegovic,et al.  Oncology treatment recommendations can be supported only by 1-2% of high-quality published evidence. , 2005, Cancer treatment reviews.

[23]  G. Guyatt,et al.  Grading quality of evidence and strength of recommendations , 2004, BMJ : British Medical Journal.

[24]  Don A. Moore,et al.  The Dirt on Coming Clean: Perverse Effects of Disclosing Conflicts of Interest , 2003, The Journal of Legal Studies.

[25]  G. Browman,et al.  Development and aftercare of clinical guidelines: the balance between rigor and pragmatism. , 2001, JAMA.

[26]  B. Hillner,et al.  Ensuring quality cancer care by the use of clinical practice guidelines and critical pathways. , 2001, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[27]  S. Woolf,et al.  Evidence-based medicine and practice guidelines: an overview. , 2000, Cancer control : journal of the Moffitt Cancer Center.

[28]  A. Kazanjian,et al.  Do Clinical Practice Guidelines Reflect Research Evidence? , 2000, Journal of health services research & policy.

[29]  B. Djulbegovic,et al.  The quality of medical evidence in hematology-oncology. , 1999, The American journal of medicine.

[30]  W. McGivney The CMS 2006 Quality in Oncology Demonstration Project and NCCN Guidelines. , 2006, The Journal of the National Comprehensive Cancer Network.