Stratification of cystic renal masses into benign and potentially malignant: applying machine learning to the bosniak classification

Purpose To create a CT texture-based machine learning algorithm that distinguishes benign from potentially malignant cystic renal masses as defined by the Bosniak Classification version 2019. Methods In this IRB-approved, HIPAA-compliant study, 4,454 adult patients underwent renal mass protocol CT or CT urography from January 2011 to June 2018. Of these, 257 cystic renal masses were included in the final study cohort. Each mass was independently classified using Bosniak version 2019 by three radiologists, resulting in 185 benign (Bosniak I or II) and 72 potentially malignant (Bosniak IIF, III or IV) masses. Six texture features: mean, standard deviation, mean of positive pixels, entropy, skewness, kurtosis were extracted using commercial software TexRAD (Feedback PLC, Cambridge, UK). Random forest (RF), logistic regression (LR), and support vector machine (SVM) machine learning algorithms were implemented to classify cystic renal masses into the two groups and tested with tenfold cross validations. Results Higher mean, standard deviation, mean of positive pixels, entropy, skewness were statistically associated with the potentially malignant group ( P  ≤ 0.0015 each). Sensitivity, specificity, positive predictive value, negative predictive value, and area under curve of RF model was 0.67, 0.91, 0.75, 0.88, 0.88; of LR model was 0.63, 0.93, 0.78, 0.86, 0.90, and of SVM model was 0.56, 0.91, 0.71, 0.84, 0.89, respectively. Conclusion Three CT texture-based machine learning algorithms demonstrated high discriminatory capability in distinguishing benign from potentially malignant cystic renal masses as defined by the Bosniak Classification version 2019. If validated, CT texture-based machine learning algorithms may help reduce interreader variability when applying the Bosniak classification.

[1]  W. Shabana,et al.  Diagnosis of Sarcomatoid Renal Cell Carcinoma With CT: Evaluation by Qualitative Imaging Features and Texture Analysis. , 2015, AJR. American journal of roentgenology.

[2]  Jennifer S. Lin,et al.  Defining, Estimating, and Communicating Overdiagnosis in Cancer Screening , 2018, Annals of Internal Medicine.

[3]  Charles E. McCulloch,et al.  CHRONIC KIDNEY DISEASE AND THE RISKS OF DEATH, CARDIOVASCULAR EVENTS, AND HOSPITALIZATION , 2004 .

[4]  G. Israel,et al.  How I do it: evaluating renal masses. , 2005, Radiology.

[5]  N. Dubrawsky Cancer statistics , 1989, CA: a cancer journal for clinicians.

[6]  W. Youden,et al.  Index for rating diagnostic tests , 1950, Cancer.

[7]  Ronald M. Summers,et al.  Texture analysis in radiology: Does the emperor have no clothes? , 2017, Abdominal Radiology.

[8]  Perry J Pickhardt,et al.  CT Texture Analysis: Definitions, Applications, Biologic Correlates, and Challenges. , 2017, Radiographics : a review publication of the Radiological Society of North America, Inc.

[9]  G. Israel,et al.  An update of the Bosniak renal cyst classification system. , 2005, Urology.

[10]  R. Sylvester,et al.  A prospective randomized EORTC intergroup phase 3 study comparing the complications of elective nephron-sparing surgery and radical nephrectomy for low-stage renal cell carcinoma. , 2007, European urology.

[11]  Vishwa Parekh,et al.  Radiomics: a new application from established techniques , 2016, Expert review of precision medicine and drug development.

[12]  Jennifer S. Lin,et al.  Defining, Estimating, and Communicating Overdiagnosis in Cancer Screening. , 2018, Annals of internal medicine.

[13]  P. Humphrey,et al.  CT of cystic renal masses: analysis of diagnostic performance and interobserver variation. , 1997, AJR. American journal of roentgenology.

[14]  M. Haider,et al.  CT texture analysis: a potential tool for prediction of survival in patients with metastatic clear cell carcinoma treated with sunitinib , 2017, Cancer Imaging.

[15]  J. Murchison,et al.  The prevalence of simple renal and hepatic cysts detected by spiral computed tomography. , 2003, Clinical radiology.

[16]  P. Pickhardt,et al.  Texture analysis of small renal cell carcinomas at MDCT for predicting relevant histologic and protein biomarkers , 2019, Abdominal Radiology.

[17]  Trevor Hastie,et al.  An Introduction to Statistical Learning , 2013, Springer Texts in Statistics.

[18]  S. Silverman,et al.  Renal masses in the adult patient: the role of percutaneous biopsy. , 2006, Radiology.

[19]  Daniela M. Witten,et al.  An Introduction to Statistical Learning: with Applications in R , 2013 .

[20]  J. Patard,et al.  Age-adjusted incidence, mortality, and survival rates of stage-specific renal cell carcinoma in North America: a trend analysis. , 2011, European urology.

[21]  X. Xu,et al.  Deep Transfer Learning and Radiomics Feature Prediction of Survival of Patients with High-Grade Gliomas , 2019, American Journal of Neuroradiology.

[22]  O. Kilickesmez,et al.  Clear Cell Renal Cell Carcinoma: Machine Learning-Based Quantitative Computed Tomography Texture Analysis for Prediction of Fuhrman Nuclear Grade , 2018, European Radiology.

[23]  Namkug Kim,et al.  Bayesian classifier for predicting malignant renal cysts on MDCT: early clinical experience. , 2009, AJR. American journal of roentgenology.

[24]  Andrew D. Smith,et al.  Bosniak category IIF and III cystic renal lesions: outcomes and associations. , 2012, Radiology.

[25]  J. Karstoft,et al.  Bosniak classification system: inter-observer and intra-observer agreement among experienced uroradiologists , 2015, Acta radiologica.

[26]  Y. Hata,et al.  The incidence of simple renal cyst by computed tomography. , 1983, Clinical radiology.

[27]  Xavier Robin,et al.  pROC: an open-source package for R and S+ to analyze and compare ROC curves , 2011, BMC Bioinformatics.

[28]  Huadan Xue,et al.  Can quantitative CT texture analysis be used to differentiate subtypes of renal cell carcinoma? , 2019, Clinical radiology.

[29]  Shuai Leng,et al.  Subjective and objective heterogeneity scores for differentiating small renal masses using contrast-enhanced CT , 2017, Abdominal Radiology.

[30]  M. Griswold,et al.  Outcomes and complications related to the management of Bosniak cystic renal lesions. , 2015, AJR. American journal of roentgenology.

[31]  Nicola Schieda,et al.  Can Quantitative CT Texture Analysis be Used to Differentiate Fat-poor Renal Angiomyolipoma from Renal Cell Carcinoma on Unenhanced CT Images? , 2015, Radiology.

[32]  S. Silverman,et al.  Utility of CT Texture Analysis in Differentiating Low-Attenuation Renal Cell Carcinoma From Cysts: A Bi-Institutional Retrospective Study. , 2019, AJR. American journal of roentgenology.

[33]  A. Fisher,et al.  Interobserver variability in determining enhancement of renal masses on helical CT. , 1999, AJR. American journal of roentgenology.

[34]  R. Sylvester,et al.  A prospective, randomised EORTC intergroup phase 3 study comparing the oncologic outcome of elective nephron-sparing surgery and radical nephrectomy for low-stage renal cell carcinoma. , 2011, European urology.

[35]  G. Tomlinson,et al.  Enhancing component on CT to predict malignancy in cystic renal masses and interobserver agreement of different CT features. , 2006, AJR. American journal of roentgenology.

[36]  Gülden Bayrak,et al.  Simple Renal Cyst Prevalence in Internal Medicine Department and Concomitant Diseases , 2006, Renal failure.

[37]  B. Erickson,et al.  Machine Learning for Medical Imaging. , 2017, Radiographics : a review publication of the Radiological Society of North America, Inc.

[38]  P. Verhagen,et al.  Bosniak Classification for Complex Renal Cysts Reevaluated: A Systematic Review , 2017, The Journal of urology.

[39]  D. Hwang,et al.  Texture Analysis of Imaging: What Radiologists Need to Know. , 2019, AJR. American journal of roentgenology.

[40]  N. Hindman Cystic renal masses , 2016, Abdominal Radiology.

[41]  Jeong Kon Kim,et al.  Malignant renal cysts: Diagnostic performance and strong predictors at MDCT , 2010, Acta radiologica.

[42]  E. DeLong,et al.  Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach. , 1988, Biometrics.

[43]  Hania Al-Hallaq,et al.  Variation in algorithm implementation across radiomics software , 2018, Journal of medical imaging.

[44]  N. Terada,et al.  Risk factors for renal cysts , 2004, BJU international.

[45]  I. Pedrosa,et al.  Imaging Advances in the Management of Kidney Cancer. , 2018, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[46]  G. Nabi,et al.  Progression, interobserver agreement, and malignancy rate in complex renal cysts ( ≥ Bosniak category IIF). , 2014, Urologic oncology.

[47]  T. Mussi,et al.  Malignancy Rate, Histologic Grade, and Progression of Bosniak Category III and IV Complex Renal Cystic Lesions. , 2017, AJR. American journal of roentgenology.

[48]  Ivan Pedrosa,et al.  Bosniak Classification of Cystic Renal Masses, Version 2019: An Update Proposal and Needs Assessment. , 2019, Radiology.

[49]  P. Weibl,et al.  Interpersonal variability and present diagnostic dilemmas in Bosniak classification system , 2011, Scandinavian journal of urology and nephrology.

[50]  F. Montorsi,et al.  A non-cancer-related survival benefit is associated with partial nephrectomy. , 2012, European urology.

[51]  E. Hecht,et al.  Follow-up for Bosniak category 2F cystic renal lesions. , 2014, Radiology.

[52]  Yunqian Ma,et al.  Imbalanced Learning: Foundations, Algorithms, and Applications , 2013 .

[53]  John L. Gore,et al.  Long-term survival following partial vs radical nephrectomy among older patients with early-stage kidney cancer. , 2012, JAMA.

[54]  A. Jemal,et al.  Cancer statistics, 2019 , 2019, CA: a cancer journal for clinicians.

[55]  Brian Reid,et al.  Overdiagnosis and overtreatment in cancer: an opportunity for improvement. , 2013, JAMA.

[56]  P. Pickhardt,et al.  CT Textural Analysis of Large Primary Renal Cell Carcinomas: Pretreatment Tumor Heterogeneity Correlates With Histologic Findings and Clinical Outcomes. , 2016, AJR. American journal of roentgenology.