Practical Problems With Clinical Guidelines for Breast Cancer Prevention Based on Remaining Lifetime Risk

Background: Clinical guidelines for breast cancer chemoprevention and MRI screening involve estimates of remaining lifetime risk (RLR); in the United States, women with an RLR of 20% or higher meet “high-risk” criteria for MRI screening. Methods: We prospectively followed 1764 women without breast cancer to compare the RLRs and 10-year risks assigned by the risk models International Breast Cancer Intervention Study (IBIS) and Breast and Ovarian Analysis of Disease Incidence and Carrier Estimation Algorithm (BOADICEA) and to compare both sets of model-assigned 10-year risks to subsequent incidence of breast cancer in the cohort. We used chi-square statistics to assess calibration and the area under the receiver operating characteristic curve (AUC) to assess discrimination. All statistical tests are two-sided. Results: The models classified different proportions of women as high-risk (IBIS = 59.3% vs BOADICEA = 20.1%) using the RLR threshold of 20%. The difference was smaller (IBIS = 52.9% vs BOADICEA = 43.2%) using a 10-year risk threshold of 3.34%. IBIS risks (mean = 4.9%) were better calibrated to observed breast cancer incidence (5.2%, 95% confidence interval (CI) = 4.2% to 6.4%) than were those of BOADICEA (mean = 3.7%) overall and within quartiles of model risk (P = .20 by IBIS and P = .07 by BOADICEA). Both models gave similar discrimination, with AUCs of 0.67 (95% CI = 0.61 to 0.73) using IBIS and 0.68 (95% CI = 0.62 to 0.74) using BOADICEA. Model sensitivities at thresholds for a 20% false-positive rate were also similar, with 41.8% using IBIS and 38.0% using BOADICEA. Conclusion: RLR-based guidelines for high-risk women are limited by discordance between commonly used risk models. Guidelines based on short-term risks would be more useful, as models are generally developed and validated under a short fixed time horizon (≤10 years).

[1]  A. Whittemore,et al.  Two-stage sampling designs for external validation of personal risk models , 2016, Statistical methods in medical research.

[2]  Mary Beth Terry,et al.  Assessing the goodness of fit of personal risk models , 2014, Statistics in medicine.

[3]  E. Friedman,et al.  Breast cancer risk prediction accuracy in Jewish Israeli high-risk women using the BOADICEA and IBIS risk models. , 2013, Genetics research.

[4]  G. Giles,et al.  Prospective validation of the breast cancer risk prediction model BOADICEA and a batch-mode version BOADICEACentre , 2013, British Journal of Cancer.

[5]  A. Whittemore,et al.  Breast cancer risk assessment across the risk continuum: genetic and nongenetic risk factors contributing to differential model performance , 2012, Breast Cancer Research.

[6]  Ammarin Thakkinstian,et al.  Risk prediction models of breast cancer: a systematic review of model performances , 2012, Breast Cancer Research and Treatment.

[7]  Richard D. Riley,et al.  A systematic review of breast cancer incidence risk prediction models with meta-analysis of their performance , 2012, Breast Cancer Research and Treatment.

[8]  H. Johansson,et al.  Evaluation of the BOADICEA risk assessment model in women with a family history of breast cancer , 2011, Familial Cancer.

[9]  Mitchell H Gail,et al.  Projecting individualized absolute invasive breast cancer risk in Asian and Pacific Islander American women. , 2011, Journal of the National Cancer Institute.

[10]  M. Pencina,et al.  On the C‐statistics for evaluating overall adequacy of risk prediction procedures with censored survival data , 2011, Statistics in medicine.

[11]  Seema A Khan,et al.  NCCN clinical practice guidelines in oncology: breast cancer screening and diagnosis. , 2009, Journal of the National Comprehensive Cancer Network : JNCCN.

[12]  Alice S Whittemore,et al.  Evaluating health risk models , 2009, Statistics in medicine.

[13]  H A Risch,et al.  The BOADICEA model of genetic susceptibility to breast and ovarian cancers: updates and extensions , 2008, British Journal of Cancer.

[14]  Melissa Bondy,et al.  Projecting individualized absolute invasive breast cancer risk in African American women. , 2007, Journal of the National Cancer Institute.

[15]  Mark A. Helvie,et al.  Breast Cancer Screening and Diagnosis Clinical Practice Guidelines in Oncology. , 2006, Journal of the National Comprehensive Cancer Network : JNCCN.

[16]  Margaret Sullivan Pepe,et al.  Standardizing Diagnostic Markers to Evaluate and Compare Their Performance , 2005, Epidemiology.

[17]  D. Easton,et al.  The BOADICEA model of genetic susceptibility to breast and ovarian cancer , 2004, British Journal of Cancer.

[18]  Norman Boyd,et al.  The Breast Cancer Family Registry: an infrastructure for cooperative multinational, interdisciplinary and translational studies of the genetic epidemiology of breast cancer , 2004, Breast Cancer Research.

[19]  Stephen W Duffy,et al.  A breast cancer prediction model incorporating familial and personal risk factors , 2004, Hereditary Cancer in Clinical Practice.

[20]  C. Broeckhoven,et al.  Evaluation of breast cancer risk assessment packages in the family history evaluation and screening programme , 2003, Journal of medical genetics.

[21]  N E Day,et al.  A comprehensive model for familial breast cancer incorporating BRCA1, BRCA2 and other genes , 2002, British Journal of Cancer.

[22]  S L Zeger,et al.  Multivariate Continuation Ratio Models: Connections and Caveats , 2000, Biometrics.

[23]  F. Harrell,et al.  Prognostic/Clinical Prediction Models: Multivariable Prognostic Models: Issues in Developing Models, Evaluating Assumptions and Adequacy, and Measuring and Reducing Errors , 2005 .

[24]  N Risch,et al.  Autosomal dominant inheritance of early‐onset breast cancer. Implications for risk prediction , 1994, Cancer.

[25]  M. Gail,et al.  Projecting individualized probabilities of developing breast cancer for white females who are being examined annually. , 1989, Journal of the National Cancer Institute.

[26]  D. Berry,et al.  Determining carrier probabilities for breast cancer-susceptibility genes BRCA1 and BRCA2. , 1998, American journal of human genetics.