Observational study designs for comparative effectiveness research: an alternative approach to close evidence gaps in head-and-neck cancer.

Comparative effectiveness research (CER) has emerged as an approach to improve quality of care and patient outcomes while reducing healthcare costs by providing evidence to guide healthcare decisions. Randomized controlled trials (RCTs) have represented the ideal study design to support treatment decisions in head-and-neck (H&N) cancers. In RCTs, formal chance (randomization) determines treatment allocation, which prevents selection bias from distorting the measure of treatment effects. Despite this advantage, only a minority of patients qualify for inclusion in H&N RCTs, which limits the validity of their results to the broader H&N cancer patient population seen in clinical practice. Randomized controlled trials often do not address other knowledge gaps in the management of H&N cancer, including treatment comparisons for rare types of H&N cancers, monitoring of rare or late toxicity events (eg, osteoradionecrosis), or in some instances an RCT is simply not feasible. Observational studies, or studies in which treatment allocation occurs independently of investigators' choice or randomization, may address several of these gaps in knowledge, thereby complementing the role of RCTs. This critical review discusses how observational CER studies complement RCTs in generating the evidence to inform healthcare decisions and improve the quality of care and outcomes of H&N cancer patients. Review topics include a balanced discussion about the strengths and limitations of both RCT and observational CER study designs; a brief description of design and analytic techniques to handle selection bias in observational studies; examples of observational studies that inform current clinical practices and management of H&N cancers; and suggestions for relevant CER questions that could be addressed by an observational study design.

[1]  S. Tunis,et al.  Does comparative-effectiveness research threaten personalized medicine? , 2009, The New England journal of medicine.

[2]  P. Warde,et al.  Cost-effectiveness of intensity-modulated radiotherapy in oropharyngeal cancer. , 2012, Clinical oncology (Royal College of Radiologists (Great Britain)).

[3]  J. Sham,et al.  Xerostomia and quality of life after intensity-modulated radiotherapy vs. conventional radiotherapy for early-stage nasopharyngeal carcinoma: initial report on a randomized controlled clinical trial. , 2006, International journal of radiation oncology, biology, physics.

[4]  M. Maguire,et al.  Identifying and eliminating the roadblocks to comparative-effectiveness research. , 2010, The New England journal of medicine.

[5]  C. Pashos,et al.  Economic burden of head and neck cancer , 2004, The European Journal of Health Economics, formerly: HEPAC.

[6]  D. Fried,et al.  Costs of Care in a Matched Pair Comparison of Intensity-modulated Radiation Therapy (IMRT) Versus Conventional Radiation Therapy (CRT) for the Treatment of Head and Neck Cancer , 2014, American journal of clinical oncology.

[7]  M. Weinstein,et al.  Recommendations of the Panel on Cost-effectiveness in Health and Medicine. , 1996, JAMA.

[8]  G. Lewith,et al.  Circular instead of hierarchical: methodological principles for the evaluation of complex interventions , 2006 .

[9]  S. Porceddu,et al.  Does fluorodeoxyglucose PET add to the management of the neck following curative radiotherapy in head and neck cancer compared with computed tomography? , 2013, Expert review of anticancer therapy.

[10]  E. Vogtmann,et al.  The cost burden of oral, oral pharyngeal, and salivary gland cancers in three groups: commercial insurance, medicare, and medicaid , 2012, Head & neck oncology.

[11]  Nicholas F. Marko,et al.  The role of observational investigations in comparative effectiveness research. , 2010, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[12]  G. de Lissovoy,et al.  Can managed care organizations partner with manufacturers for comparative effectiveness research? , 2008, The American journal of managed care.

[13]  K. Ang,et al.  Human papillomavirus and survival of patients with oropharyngeal cancer. , 2010, The New England journal of medicine.

[14]  D. Ronis,et al.  The effect of neck dissection on quality of life after chemoradiation , 2008, Otolaryngology--head and neck surgery : official journal of American Academy of Otolaryngology-Head and Neck Surgery.

[15]  A. Garden,et al.  Evaluating the impact of patient, tumor, and treatment characteristics on the development of jaw complications in patients treated for oral cancers: A SEER–Medicare analysis , 2013, Head & neck.

[16]  T. Lancaster,et al.  Instrumental variables and inverse probability weighting for causal inference from longitudinal observational studies , 2004, Statistical methods in medical research.

[17]  J. Concato,et al.  Randomized, controlled trials, observational studies, and the hierarchy of research designs. , 2000, The New England journal of medicine.

[18]  Deborah Schrag,et al.  Overview of the SEER-Medicare Data: Content, Research Applications, and Generalizability to the United States Elderly Population , 2002, Medical care.

[19]  Kenneth J. Smith,et al.  A cost‐effectiveness analysis of positron emission tomography‐computed tomography surveillance versus up‐front neck dissection for management of the neck for N2 disease after chemoradiotherapy , 2012, The Laryngoscope.

[20]  L. Collette,et al.  Larynx preservation in pyriform sinus cancer: preliminary results of a European Organization for Research and Treatment of Cancer phase III trial. EORTC Head and Neck Cancer Cooperative Group. , 1996, Journal of the National Cancer Institute.

[21]  Christopher U. Jones,et al.  Radiotherapy plus cetuximab for squamous-cell carcinoma of the head and neck. , 2006, The New England journal of medicine.

[22]  R. D'Agostino Adjustment Methods: Propensity Score Methods for Bias Reduction in the Comparison of a Treatment to a Non‐Randomized Control Group , 2005 .

[23]  S. Leung,et al.  Prospective randomized study of intensity-modulated radiotherapy on salivary gland function in early-stage nasopharyngeal carcinoma patients. , 2007, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[24]  Jan P Vandenbroucke,et al.  When are observational studies as credible as randomised trials? , 2004, The Lancet.

[25]  V. Mehta,et al.  Effect of radiotherapy interruptions on survival in medicare enrollees with local and regional head-and-neck cancer. , 2010, International journal of radiation oncology, biology, physics.

[26]  M. Shrime,et al.  Radiotherapy in parotid acinic cell carcinoma: does it have an impact on survival? , 2012, Archives of otolaryngology--head & neck surgery.

[27]  C. Perez,et al.  Intensity-modulated radiation therapy reduces late salivary toxicity without compromising tumor control in patients with oropharyngeal carcinoma: a comparison with conventional techniques. , 2001, Radiotherapy and oncology : journal of the European Society for Therapeutic Radiology and Oncology.

[28]  Srinivasan Vijayakumar,et al.  Marginal misses after postoperative intensity-modulated radiotherapy for head and neck cancer. , 2011, International journal of radiation oncology, biology, physics.

[29]  Clarence Balden Randall,et al.  Report to the President and the Congress , 1954 .

[30]  Sasa Mutic,et al.  Developing a national radiation oncology registry: From acorns to oaks. , 2012, Practical radiation oncology.

[31]  T. Koepsell,et al.  Epidemiologic Methods: Studying the Occurrence of Illness , 2003 .

[32]  A. Raben,et al.  Freedom from local and regional failure of contralateral neck with ipsilateral neck radiotherapy for node-positive tonsil cancer: results of a prospective management approach. , 2009, International journal of radiation oncology, biology, physics.

[33]  W. Hong,et al.  Induction chemotherapy plus radiation compared with surgery plus radiation in patients with advanced laryngeal cancer. , 1991, The New England journal of medicine.

[34]  Emma Hall,et al.  Parotid-sparing intensity modulated versus conventional radiotherapy in head and neck cancer (PARSPORT): a phase 3 multicentre randomised controlled trial , 2011, The Lancet. Oncology.

[35]  Avraham Eisbruch,et al.  Grading xerostomia by physicians or by patients after intensity-modulated radiotherapy of head-and-neck cancer. , 2006, International journal of radiation oncology, biology, physics.

[36]  D. Winchester,et al.  National cancer data base. A clinical assessment of patients with cancer , 1992, Cancer.

[37]  R. Weber,et al.  Laryngeal Cancer in the United States: Changes in Demographics, Patterns of Care, and Survival , 2006, The Laryngoscope.

[38]  G. Lyman,et al.  Comparative effectiveness research in oncology: an overview. , 2012, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[39]  J. Albert,et al.  Quality indicators in radiation oncology. , 2013, International journal of radiation oncology, biology, physics.

[40]  Ruth Etzioni,et al.  Chemotherapy use, outcomes, and costs for older persons with advanced non-small-cell lung cancer: evidence from surveillance, epidemiology and end results-Medicare. , 2004, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[41]  S. Pocock,et al.  The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement: guidelines for reporting observational studies , 2007, The Lancet.

[42]  Matthias Egger,et al.  The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) Statement: Guidelines for Reporting Observational Studies , 2007, PLoS medicine.

[43]  Amy Y. Chen,et al.  Longitudinal oncology registry of head and neck carcinoma (LORHAN) , 2011, Cancer.

[44]  R. Schilsky,et al.  Randomized controlled trials and comparative effectiveness research. , 2012, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[45]  R. Weber,et al.  Concurrent chemotherapy and radiotherapy for organ preservation in advanced laryngeal cancer. , 2003, The New England journal of medicine.

[46]  R. Tishler,et al.  Cost-effectiveness of CT and PET-CT for determining the need for adjuvant neck dissection in locally advanced head and neck cancer. , 2010, Annals of oncology : official journal of the European Society for Medical Oncology.

[47]  J. Turner,et al.  Incidence and survival in patients with sinonasal cancer: A historical analysis of population‐based data , 2012, Head & neck.

[48]  J. Heckman,et al.  Use of instrumental variables in the presence of heterogeneity and self-selection: an application to treatments of breast cancer patients. , 2007, Health economics.

[49]  Wei Xu,et al.  Deintensification candidate subgroups in human papillomavirus-related oropharyngeal cancer according to minimal risk of distant metastasis. , 2013, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[50]  Alvin I Mushlin,et al.  Health care reform and the need for comparative-effectiveness research. , 2010, The New England journal of medicine.

[51]  Beth A Virnig,et al.  Utility of the SEER-Medicare Data to Identify Chemotherapy Use , 2002, Medical care.

[52]  K. Frick,et al.  National trends in oropharyngeal cancer surgery and the effect of surgeon and hospital volume on short‐term outcomes and cost of care , 2012, The Laryngoscope.

[53]  Fei Liu,et al.  The benefits and pitfalls of ipsilateral radiotherapy in carcinoma of the tonsillar region. , 2001, International journal of radiation oncology, biology, physics.

[54]  G. Lanke,et al.  Mo1143 Is Lymph Node Ratio (LNR) a Prognostic Marker in Patients With Colon Cancer? A Study in National Cancer Institute's Surveillance Epidemiology, and End Results (SEER) Database , 2013 .

[55]  Amy Y. Chen,et al.  Improved survival is associated with treatment at high‐volume teaching facilities for patients with advanced stage laryngeal cancer , 2010, Cancer.

[56]  Esther Kim,et al.  Human papillomavirus and rising oropharyngeal cancer incidence in the United States. , 2011, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[57]  J. Debus,et al.  Phase II study of induction chemotherapy with TPF followed by radioimmunotherapy with Cetuximab and intensity-modulated radiotherapy (IMRT) in combination with a carbon ion boost for locally advanced tumours of the oro-, hypopharynx and larynx - TPF-C-HIT , 2011, BMC Cancer.

[58]  N. Lee,et al.  Recurrence in region of spared parotid gland after definitive intensity-modulated radiotherapy for head and neck cancer. , 2008, International journal of radiation oncology, biology, physics.

[59]  Angela Mariotto,et al.  Economic Burden of Cancer in the United States: Estimates, Projections, and Future Research , 2011, Cancer Epidemiology, Biomarkers & Prevention.

[60]  J. Pignon,et al.  Meta-analysis of chemotherapy in head and neck cancer (MACH-NC): a comprehensive analysis by tumour site. , 2011, Radiotherapy and oncology : journal of the European Society for Therapeutic Radiology and Oncology.

[61]  J. Albert,et al.  Quality assessment in oncology. , 2012, International journal of radiation oncology, biology, physics.

[62]  S. Kannan,et al.  Three-dimensional conformal radiotherapy (3D-CRT) versus intensity modulated radiation therapy (IMRT) in squamous cell carcinoma of the head and neck: a randomized controlled trial. , 2012, Radiotherapy and oncology : journal of the European Society for Therapeutic Radiology and Oncology.

[63]  D. Hershman,et al.  Comparative effectiveness research in oncology methodology: observational data. , 2012, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[64]  L. Dawson,et al.  Xerostomia and its predictors following parotid-sparing irradiation of head-and-neck cancer. , 2001, International journal of radiation oncology, biology, physics.