Funnel plots for population‐based cancer survival: principles, methods and applications

Funnel plots are graphical tools designed to detect excessive variation in performance indicators by simple visual inspection of the data. Their main use in the biomedical domain so far has been to detect publication bias in meta-analyses, but they have also been recommended as the most appropriate way to display performance indicators for a vast range of health-related outcomes. Here, we extend the use of funnel plots to population-based cancer survival and several related measures. We present three applications to familiarise the reader with their interpretation. We propose funnel plots for various cancer survival measures, as well as age-standardised survival, trends in survival and excess hazard ratios. We describe the components of a funnel plot and the formulae for the construction of the control limits for each of these survival measures. We include three transformations to construct the control limits for the survival function: complementary log-log, logit and logarithmic transformations. We present applications of funnel plots to explore the following: (i) small-area and temporal variation in cancer survival; (ii) racial and geographical variation in cancer survival; and (iii) geographical variation in the excess hazard of death. Funnel plots provide a simple and informative graphical tool to display geographical variation and trend in a range of cancer survival measures. We recommend their use as a routine instrument for cancer survival comparisons, to inform health policy makers in planning and assessing cancer policies. We advocate the use of the complementary log-log or logit transformation to construct the control limits for the survival function.

[1]  J R Anderson,et al.  Approximate confidence intervals for probabilities of survival and quantiles in life-table analysis. , 1982, Biometrics.

[2]  Bernard Rachet,et al.  Cancer survival in five continents: a worldwide population-based study (CONCORD). , 2008, The Lancet. Oncology.

[3]  Paul C. Lambert,et al.  Further Development of Flexible Parametric Models for Survival Analysis , 2009 .

[4]  Peter McCulloch,et al.  Jan using hospital mortality data performance of surgical units : validation study Mortality control charts for comparing , 2003 .

[5]  Yuri Ito,et al.  Regional differences in population‐based cancer survival between six prefectures in Japan: Application of relative survival models with funnel plots , 2009, Cancer science.

[6]  D. Spiegelhalter,et al.  Funnel plots for institutional comparison , 2002, Quality & safety in health care.

[7]  Janez Stare,et al.  Relative survival analysis in R , 2006, Comput. Methods Programs Biomed..

[8]  D J Spiegelhalter,et al.  Handling over-dispersion of performance indicators , 2005, Quality and Safety in Health Care.

[9]  M. Coleman,et al.  Geographical variation in cancer survival in England, 1991–2006: an analysis by Cancer Network , 2011, Journal of Epidemiology & Community Health.

[10]  W. A. Shewhart,et al.  The Application of Statistics as an Aid in Maintaining Quality of a Manufactured Product , 1925 .

[11]  David J Spiegelhalter,et al.  Funnel plots for comparing institutional performance , 2005, Statistics in medicine.

[12]  T. Hakulinen,et al.  Cancer survival corrected for heterogeneity in patient withdrawal. , 1982, Biometrics.

[13]  Paul W Dickman,et al.  Regression models for relative survival , 2004, Statistics in medicine.

[14]  J. Estève,et al.  Relative survival and the estimation of net survival: elements for further discussion. , 1990, Statistics in medicine.

[15]  G. Smith,et al.  Bias in meta-analysis detected by a simple, graphical test , 1997, BMJ.

[16]  M. Coleman,et al.  Cancer survival in England and Wales at the end of the 20th century , 2008, British Journal of Cancer.

[17]  Ara W. Darzi,et al.  Funnel Plots and Their Emerging Application in Surgery , 2009, Annals of surgery.

[18]  J. Kalbfleisch,et al.  The Statistical Analysis of Failure Time Data: Kalbfleisch/The Statistical , 2002 .

[19]  David Forman,et al.  Population-based cancer survival trends in England and Wales up to 2007: an assessment of the NHS cancer plan for England. , 2009, The Lancet. Oncology.

[20]  Mike Quinn,et al.  Standard cancer patient population for age standardising survival ratios. , 2004, European journal of cancer.

[21]  F. Ederer,et al.  The relative survival rate: a statistical methodology. , 1961, National Cancer Institute monograph.

[22]  J. Sterne,et al.  Funnel plots for detecting bias in meta-analysis: guidelines on choice of axis. , 2001, Journal of clinical epidemiology.

[23]  Janez Stare,et al.  On Estimation in Relative Survival , 2012, Biometrics.