Comparative validation of breast cancer risk prediction models and projections for future risk stratification

Background Well-validated risk models are critical for risk stratified breast cancer prevention. We used the Individualized Coherent Absolute Risk Estimation (iCARE) tool for comparative model validation of five-year risk of invasive breast cancer in a prospective cohort, and to make projections for population risk stratification. Methods Performance of two recently developed models, iCARE-BPC3 and iCARE-Lit, were compared with two established models (BCRAT, IBIS) based on classical risk factors in a UK-based cohort of 64,874 women (863 cases) aged 35-74 years. Risk projections in US White non-Hispanic women aged 50-70 years were made to assess potential improvements in risk stratification by adding mammographic breast density (MD) and polygenic risk score (PRS). Results The best calibrated models were iCARE-Lit (expected to observed number of cases (E/O)=0.98 (95% confidence interval [CI]=0.87 to 1.11)) for women younger than 50 years; and iCARE-BPC3 (E/O=1.00 (0.93 to 1.09)) for women 50 years or older. Risk projections using iCARE-BPC3 indicated classical risk factors can identify ~500,000 women at moderate to high risk (>3% five-year risk). Additional information on MD and a PRS based on 172 variants is expected to increase this to ~3.6 million, and among them, ~155,000 invasive breast cancer cases are expected within five years. Conclusions iCARE models based on classical risk factors perform similarly or better than BCRAT or IBIS. Addition of MD and PRS can lead to substantial improvements in risk stratification. Independent prospective validation of integrated models is needed prior to clinical evaluation risk stratified breast cancer screening and prevention.

[1]  Nilanjan Chatterjee,et al.  iCARE: An R package to build, validate and apply absolute risk models , 2020, PloS one.

[2]  J. Hopper,et al.  Performance of BCRAT in high-risk patients with breast cancer - Authors' reply. , 2019, The Lancet. Oncology.

[3]  Mitchell H Gail Performance of BCRAT in high-risk patients with breast cancer. , 2019, The Lancet. Oncology.

[4]  A. Whittemore,et al.  Reproductive Factors and Mammographic Density: Associations Among 24,840 Women and Comparison of Studies Using Digitized Film-Screen Mammography and Full-Field Digital Mammography. , 2019, American journal of epidemiology.

[5]  P. Fasching,et al.  Joint association of mammographic density adjusted for age and body mass index and polygenic risk score with breast cancer risk , 2019, Breast Cancer Research.

[6]  Gord Glendon,et al.  10-year performance of four models of breast cancer risk: a validation study. , 2019, The Lancet. Oncology.

[7]  M. García-Closas,et al.  Assessment of breast cancer risk: which tools to use? , 2019, The Lancet. Oncology.

[8]  Kristen S Purrington,et al.  Polygenic Risk Scores for Prediction of Breast Cancer and Breast Cancer Subtypes , 2018, American Journal of Human Genetics.

[9]  N. Chatterjee,et al.  Generalized meta-analysis for multiple regression models across studies with disparate covariate information. , 2017, Biometrika.

[10]  C. Nickson,et al.  Prospective validation of the NCI Breast Cancer Risk Assessment Tool (Gail Model) on 40,000 Australian women , 2018, Breast Cancer Research.

[11]  E. Topol,et al.  The personal and clinical utility of polygenic risk scores , 2018, Nature Reviews Genetics.

[12]  Nilanjan Chatterjee,et al.  Estimation of complex effect-size distributions using summary-level statistics from genome-wide association studies across 32 complex traits , 2018, Nature Genetics.

[13]  Cyril Ferdynus,et al.  Decision curve analysis: a technical note. , 2018, Annals of translational medicine.

[14]  P. Pharoah,et al.  Cost-effectiveness and Benefit-to-Harm Ratio of Risk-Stratified Screening for Breast Cancer , 2018, JAMA oncology.

[15]  Jack Cuzick,et al.  Long-term Accuracy of Breast Cancer Risk Assessment Combining Classic Risk Factors and Breast Density , 2018, JAMA oncology.

[16]  S. Astley,et al.  Use of Single-Nucleotide Polymorphisms and Mammographic Density Plus Classic Risk Factors for Breast Cancer Risk Prediction , 2018, JAMA oncology.

[17]  S. Cross,et al.  Joint associations of a polygenic risk score and environmental risk factors for breast cancer in the Breast Cancer Association Consortium. , 2018, International journal of epidemiology.

[18]  Nilanjan Chatterjee,et al.  iCARE: R package to build, validate and apply absolute risk models , 2016, bioRxiv.

[19]  P. Pharoah,et al.  Cost-effectiveness and Benefit-to-Harm Ratio of Risk-Stratified Screening for Breast Cancer: A Life-Table Model , 2018 .

[20]  Gary D Bader,et al.  Association analysis identifies 65 new breast cancer risk loci , 2017, Nature.

[21]  Michael Jones,et al.  Identification of ten variants associated with risk of estrogen-receptor-negative breast cancer , 2017, Nature Genetics.

[22]  Danielle Braun,et al.  Breast cancer risk models: a comprehensive overview of existing models, validation, and clinical applications , 2017, Breast Cancer Research and Treatment.

[23]  Nilanjan Chatterjee,et al.  Comparison of approaches for incorporating new information into existing risk prediction models , 2017, Statistics in medicine.

[24]  Martin Eklund,et al.  Breast Cancer Screening in the Precision Medicine Era: Risk-Based Screening in a Population-Based Trial , 2017, Journal of the National Cancer Institute.

[25]  Jack Cuzick,et al.  Impact of a Panel of 88 Single Nucleotide Polymorphisms on the Risk of Breast Cancer in High-Risk Women: Results From Two Randomized Tamoxifen Prevention Trials , 2016, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[26]  Practice Bulletin No. 179 Summary: Breast Cancer Risk Assessment and Screening in Average-Risk Women. , 2017, Obstetrics and gynecology.

[27]  Practice Bulletin Number 179: Breast Cancer Risk Assessment and Screening in Average-Risk Women. , 2017, Obstetrics and gynecology.

[28]  Oguzhan Alagoz,et al.  Tailoring Breast Cancer Screening Intervals by Breast Density and Risk for Women Aged 50 Years or Older: Collaborative Modeling of Screening Outcomes. , 2016, Annals of internal medicine.

[29]  J. Cuzick,et al.  The impact of a panel of 18 SNPs on breast cancer risk in women attending a UK familial screening clinic: a case–control study , 2016, Journal of Medical Genetics.

[30]  W. Willett,et al.  Breast Cancer Risk From Modifiable and Nonmodifiable Risk Factors Among White Women in the United States. , 2016, JAMA oncology.

[31]  S. Cummings,et al.  Breast cancer risk prediction using a clinical risk model and polygenic risk score , 2016, Breast Cancer Research and Treatment.

[32]  Jianxin Shi,et al.  Developing and evaluating polygenic risk prediction models for stratified disease prevention , 2016, Nature Reviews Genetics.

[33]  Oguzhan Alagoz,et al.  Collaborative Modeling of the Benefits and Harms Associated With Different U.S. Breast Cancer Screening Strategies , 2016, Annals of Internal Medicine.

[34]  R. Carroll,et al.  Constrained Maximum Likelihood Estimation for Model Calibration Using Summary-Level Information From External Big Data Sources , 2016, Journal of the American Statistical Association.

[35]  G. Giles,et al.  Breast Cancer Risk Prediction Using Clinical Models and 77 Independent Risk-Associated SNPs for Women Aged Under 50 Years: Australian Breast Cancer Family Registry , 2015, Cancer Epidemiology, Biomarkers & Prevention.

[36]  Susan M. Astley,et al.  Mammographic density adds accuracy to both the Tyrer-Cuzick and Gail breast cancer risk models in a prospective UK screening cohort , 2015, Breast Cancer Research.

[37]  C. Kooperberg,et al.  SNPs and breast cancer risk prediction for African American and Hispanic women , 2015, Breast Cancer Research and Treatment.

[38]  C. Vachon,et al.  Breast Density and Benign Breast Disease: Risk Assessment to Identify Women at High Risk of Breast Cancer. , 2015, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[39]  Karla Kerlikowske,et al.  The contributions of breast density and common genetic variation to breast cancer risk. , 2015, Journal of the National Cancer Institute.

[40]  Jane E. Carpenter,et al.  Prediction of Breast Cancer Risk Based on Profiling With Common Genetic Variants , 2015, JNCI Journal of the National Cancer Institute.

[41]  M. García-Closas,et al.  Combined associations of genetic and environmental risk factors: implications for prevention of breast cancer. , 2014, Journal of the National Cancer Institute.

[42]  Stephen W Duffy,et al.  Mammographic breast density refines Tyrer-Cuzick estimates of breast cancer risk in high-risk women: findings from the placebo arm of the International Breast Cancer Intervention Study I , 2014, Breast Cancer Research.

[43]  Seema A. Khan,et al.  A Randomized Phase II Presurgical Trial of Transdermal 4-Hydroxytamoxifen Gel versus Oral Tamoxifen in Women with Ductal Carcinoma In Situ of the Breast , 2014, Clinical Cancer Research.

[44]  Farid Jamshidian,et al.  Assessing breast cancer risk models in Marin County, a population with high rates of delayed childbirth. , 2014, Clinical breast cancer.

[45]  G. Collins,et al.  External validation of multivariable prediction models: a systematic review of methodological conduct and reporting , 2014, BMC Medical Research Methodology.

[46]  M. Rué,et al.  An assessment of existing models for individualized breast cancer risk estimation in a screening program in Spain , 2013, BMC Cancer.

[47]  V. Moyer Using Medications to Decrease the Risk for Breast Cancer in Women: Recommendations From the U.S. Preventive Services Task Force , 2013, Annals of Internal Medicine.

[48]  Nilanjan Chatterjee,et al.  Projecting the performance of risk prediction based on polygenic analyses of genome-wide association studies , 2013, Nature Genetics.

[49]  N. Ascunce,et al.  Recalibration of the Gail model for predicting invasive breast cancer risk in Spanish women: a population-based cohort study , 2013, Breast Cancer Research and Treatment.

[50]  Konstantin Strauch,et al.  Breast cancer risk assessment across the risk continuum: genetic and nongenetic risk factors contributing to differential model performance , 2012, Breast Cancer Research.

[51]  Heather Eliassen,et al.  Menarche, menopause, and breast cancer risk: individual participant meta-analysis, including 118 964 women with breast cancer from 117 epidemiological studies , 2012, The Lancet. Oncology.

[52]  V. Beral,et al.  Comparison of the effects of genetic and environmental risk factors on in situ and invasive ductal breast cancer , 2012, International journal of cancer.

[53]  Rongwei Fu,et al.  Risk Factors for Breast Cancer for Women Aged 40 to 49 Years , 2012, Annals of Internal Medicine.

[54]  D. Brizel,et al.  National Comprehensive Cancer Network (NCCN) Clinical Practice Guidelines in Oncology , 2012 .

[55]  Ammarin Thakkinstian,et al.  Risk prediction models of breast cancer: a systematic review of model performances , 2012, Breast Cancer Research and Treatment.

[56]  Richard D. Riley,et al.  A systematic review of breast cancer incidence risk prediction models with meta-analysis of their performance , 2012, Breast Cancer Research and Treatment.

[57]  A. LaCroix,et al.  Evaluating breast cancer risk projections for Hispanic women , 2012, Breast Cancer Research and Treatment.

[58]  A. Ashworth,et al.  The Breakthrough Generations Study: design of a long-term UK cohort study to investigate breast cancer aetiology , 2011, British Journal of Cancer.

[59]  M H Gail,et al.  Two Criteria for Evaluating Risk Prediction Models , 2011, Biometrics.

[60]  Valentin Rousson,et al.  Decision curve analysis revisited: overall net benefit, relationships to ROC curve analysis, and application to case-control studies , 2011, BMC Medical Informatics Decis. Mak..

[61]  M. Gail,et al.  Benefit/risk assessment for breast cancer chemoprevention with raloxifene or tamoxifen for women age 50 years or older. , 2011, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[62]  Jonathan E. Dickerson,et al.  Supplementary webappendix , 2018 .

[63]  V. Beral,et al.  Breast Cancer Risk in Relation to the Interval Between Menopause and Starting Hormone Therapy , 2011, Journal of the National Cancer Institute.

[64]  David A. Hinds,et al.  Assessment of Clinical Validity of a Breast Cancer Risk Model Combining Genetic and Clinical Information , 2010, Journal of the National Cancer Institute.

[65]  W. Willett,et al.  Oral Contraceptive Use and Breast Cancer: A Prospective Study of Young Women , 2010, Cancer Epidemiology, Biomarkers & Prevention.

[66]  P. Hartge,et al.  Effect of changing breast cancer incidence rates on the calibration of the Gail model. , 2010, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[67]  N. Obuchowski,et al.  Assessing the Performance of Prediction Models: A Framework for Traditional and Novel Measures , 2010, Epidemiology.

[68]  M. Gail Value of adding single-nucleotide polymorphism genotypes to a breast cancer risk model. , 2009, Journal of the National Cancer Institute.

[69]  D. Parkin Is the recent fall in incidence of post-menopausal breast cancer in UK related to changes in use of hormone replacement therapy? , 2009, European journal of cancer.

[70]  Karla Kerlikowske,et al.  Using Clinical Factors and Mammographic Breast Density to Estimate Breast Cancer Risk: Development and Validation of a New Predictive Model , 2008, Annals of Internal Medicine.

[71]  S. Suissa,et al.  Hormone replacement therapy use and variations in the risk of breast cancer , 2007, BJOG : an international journal of obstetrics and gynaecology.

[72]  G. Anderson,et al.  Predicting risk of breast cancer in postmenopausal women by hormone receptor status. , 2007, Journal of the National Cancer Institute.

[73]  Stefano Calza,et al.  Gail model for prediction of absolute risk of invasive breast cancer: independent evaluation in the Florence-European Prospective Investigation Into Cancer and Nutrition cohort. , 2006, Journal of the National Cancer Institute.

[74]  Jinbo Chen,et al.  Projecting absolute invasive breast cancer risk in white women with a model that includes mammographic density. , 2006, Journal of the National Cancer Institute.

[75]  V. McCormack,et al.  Breast Density and Parenchymal Patterns as Markers of Breast Cancer Risk: A Meta-analysis , 2006, Cancer Epidemiology Biomarkers & Prevention.

[76]  S. Cummings,et al.  Mammographic Breast Density and the Gail Model for Breast Cancer Risk Prediction in a Screening Population , 2005, Breast Cancer Research and Treatment.

[77]  V Shane Pankratz,et al.  Benign breast disease and the risk of breast cancer. , 2005, The New England journal of medicine.

[78]  Stephen W Duffy,et al.  A breast cancer prediction model incorporating familial and personal risk factors , 2004, Hereditary Cancer in Clinical Practice.

[79]  A Howell,et al.  Evaluation of breast cancer risk assessment packages in the family history evaluation and screening programme , 2003, Journal of medical genetics.

[80]  R. Carlson NCCN breast cancer clinical practice guidelines in oncology: an update. , 2003, Journal of the National Comprehensive Cancer Network : JNCCN.

[81]  M. C. Leske,et al.  Alcohol, tobacco and breast cancer – collaborative reanalysis of individual data from 53 epidemiological studies, including 58 515 women with breast cancer and 95 067 women without the disease , 2002, British Journal of Cancer.

[82]  Douglas F. Easton,et al.  Polygenic susceptibility to breast cancer and implications for prevention , 2002, Nature Genetics.

[83]  R. Goldbohm,et al.  Familial breast cancer: collaborative reanalysis of individual data from 52 epidemiological studies including 58 209 women with breast cancer and 101 986 women without the disease , 2001, The Lancet.

[84]  D Spiegelman,et al.  Validation of the Gail et al. model of breast cancer risk prediction and implications for chemoprevention. , 2001, Journal of the National Cancer Institute.

[85]  P C Prorok,et al.  Design of the Prostate, Lung, Colorectal and Ovarian (PLCO) Cancer Screening Trial. , 2000, Controlled clinical trials.

[86]  B. Ponder,et al.  Familial predisposition to breast cancer in a British population: implications for prevention. , 2000, European journal of cancer.

[87]  J Benichou,et al.  Validation studies for models projecting the risk of invasive and total breast cancer incidence. , 1999, Journal of the National Cancer Institute.

[88]  JoAnn E. Manson,et al.  Design of the Women's Health Initiative clinical trial and observational study. The Women's Health Initiative Study Group. , 1998, Controlled clinical trials.

[89]  D Spiegelman,et al.  Validation of the Gail et al. model for predicting individual breast cancer risk. , 1994, Journal of the National Cancer Institute.

[90]  M. Gail,et al.  Projecting individualized probabilities of developing breast cancer for white females who are being examined annually. , 1989, Journal of the National Cancer Institute.

[91]  E. DeLong,et al.  Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach. , 1988, Biometrics.

[92]  S Kamen,et al.  The task force. , 1976, Journal of hospital dental practice.