Accurate Kidney Segmentation in CT Scans Using Deep Transfer Learning

A competitive model for kidney segmentation in CT scans is trained using the publicly-available KiTS19 dataset. The model performed well against the KiTS19 test dataset, achieving a Sorensen–Dice coefficient of 0.9620 when generating kidney segmentation masks from CT scans. The algorithm employed is U-Net, a common tool used to segment biomedical images of various modalities, including MRI and CT scans. The model is trained using nnU-Net, an open-source framework for training U-Net. To help bring Deep Learning to kidney stone diagnosis and treatment, this promising model is then applied to a dataset developed by the research team, comprised of CT scans from patients who underwent treatment for kidney stones between 2011 and 2014. Despite overall success, the model appears sensitive to changes in features between the two datasets, with some segmentation masks working very well and others unable to correctly separate the kidney from the surrounding anatomy. Improving this model further will enable advanced research in deep learning tools to aid urologists’ decision making for best procedure outcomes.

[1]  Marta Fiocco,et al.  Comparison of 3-Dimensional and Augmented Reality Kidney Models With Conventional Imaging Data in the Preoperative Assessment of Children With Wilms Tumors , 2019, JAMA network open.

[2]  Jun Zhang,et al.  Augmented-reality-driven medical simulation platform for percutaneous nephrolithotomy with cybersecurity awareness , 2019, Int. J. Distributed Sens. Networks.

[3]  I. Kohlstadt,et al.  Treatment and prevention of kidney stones: an update. , 2011, American family physician.

[4]  Jiang Bian,et al.  Development of a personalized diagnostic model for kidney stone disease tailored to acute care by integrating large clinical, demographics and laboratory data: the diagnostic acute care algorithm - kidney stones (DACA-KS) , 2018, BMC Medical Informatics and Decision Making.

[5]  John D Denstedt,et al.  Imaging in diagnosis, treatment, and follow-up of stone patients. , 2009, Advances in chronic kidney disease.

[6]  Joachim Weickert,et al.  Benchmarking Wilms’ tumor in multisequence MRI data: why does current clinical practice fail? Which popular segmentation algorithms perform well? , 2019, Journal of medical imaging.

[7]  Klaus H. Maier-Hein,et al.  nnU-Net: Breaking the Spell on Successful Medical Image Segmentation , 2019, ArXiv.

[8]  Seyed Abolghasem Mirroshandel,et al.  A novel method for predicting kidney stone type using ensemble learning , 2017, Artif. Intell. Medicine.

[9]  Nicholas Namias,et al.  Comparing Machine Learning Algorithms for Predicting Acute Kidney Injury , 2019, The American surgeon.

[10]  Suman V. Ravuri,et al.  A Clinically Applicable Approach to Continuous Prediction of Future Acute Kidney Injury , 2019, Nature.

[11]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[12]  B. Petros,et al.  Kidney Stone Disease: An Update on Current Concepts , 2018, Advances in urology.

[13]  Won Ho Kim,et al.  Derivation and Validation of Machine Learning Approaches to Predict Acute Kidney Injury after Cardiac Surgery , 2018, Journal of clinical medicine.

[14]  J. Lingeman,et al.  Management of lower pole nephrolithiasis: a critical analysis. , 1994, Journal of Urology.

[15]  Jean J M C H de la Rosette,et al.  A nephrolithometric nomogram to predict treatment success of percutaneous nephrolithotomy. , 2013, The Journal of urology.

[16]  Junmo Kim,et al.  Deep feature classification of angiomyolipoma without visible fat and renal cell carcinoma in abdominal contrast‐enhanced CT images with texture image patches and hand‐crafted feature concatenation , 2018, Medical physics.

[17]  Kemal Sarica,et al.  EAU Guidelines on Diagnosis and Conservative Management of Urolithiasis. , 2016, European urology.

[18]  Shuai Leng,et al.  Imaging evaluation and treatment of nephrolithiasis: an update. , 2010, Minnesota medicine.

[19]  Bradley J. Erickson,et al.  Performance of an Artificial Multi-observer Deep Neural Network for Fully Automated Segmentation of Polycystic Kidneys , 2017, Journal of Digital Imaging.

[20]  O. Moe,et al.  Kidney stones: pathophysiology and medical management , 2006, The Lancet.

[21]  S. Furth,et al.  Computer-aided diagnosis of congenital abnormalities of the kidney and urinary tract in children based on ultrasound imaging data by integrating texture image features and deep transfer learning image features. , 2019, Journal of pediatric urology.

[22]  Manoj Monga,et al.  Prospective, randomized trial comparing shock wave lithotripsy and ureteroscopy for lower pole caliceal calculi 1 cm or less. , 2005, The Journal of urology.

[23]  Hatem Alkadhi,et al.  Three‐Dimensional Texture Analysis with Machine Learning Provides Incremental Predictive Information for Successful Shock Wave Lithotripsy in Patients with Kidney Stones , 2018, The Journal of urology.

[24]  Jianhua Yao,et al.  Computer-aided detection of renal calculi from noncontrast CT images using TV-flow and MSER features. , 2014, Medical physics.

[25]  N. Maalouf,et al.  Clinical review. Kidney stones 2012: pathogenesis, diagnosis, and management. , 2012, The Journal of clinical endocrinology and metabolism.

[26]  Haribalan Kumar,et al.  Automated pancreas segmentation from computed tomography and magnetic resonance images: A systematic review , 2019, Comput. Methods Programs Biomed..

[27]  J E Wickham,et al.  Computerised tomography localisation of intrarenal calculi prior to nephrolithotomy. , 1980, British journal of urology.

[28]  Nassir Navab,et al.  Automatic Segmentation of Kidneys using Deep Learning for Total Kidney Volume Quantification in Autosomal Dominant Polycystic Kidney Disease , 2017, Scientific Reports.

[29]  Mathew D. Sorensen,et al.  An overview of kidney stone imaging techniques , 2016, Nature Reviews Urology.

[30]  Mordechai Duvdevani,et al.  Present indications and techniques of percutaneous nephrolithotomy: What the future holds? , 2018, Asian journal of urology.

[31]  Haluk Sen,et al.  A neural network - based algorithm for predicting stone -free status after ESWL therapy , 2017, International braz j urol : official journal of the Brazilian Society of Urology.

[32]  Kwang Gi Kim,et al.  Differentiation of Urinary Stone and Vascular Calcifications on Non-contrast CT Images: An Initial Experience using Computer Aided Diagnosis , 2010, Journal of Digital Imaging.

[33]  C. Hansen,et al.  Virtual and Augmented Reality Systems for Renal Interventions: A Systematic Review , 2017, IEEE Reviews in Biomedical Engineering.

[34]  Uday Patel,et al.  Computed tomography for percutaneous renal access. , 2009, Journal of endourology.

[35]  Samuel Kadoury,et al.  Liver segmentation: indications, techniques and future directions , 2017, Insights into Imaging.

[36]  Lena Maier-Hein,et al.  Mobile augmented reality for computer-assisted percutaneous nephrolithotomy , 2013, International Journal of Computer Assisted Radiology and Surgery.

[37]  Ghassan Hamarneh,et al.  Uncertainty-Encoded Augmented Reality for Robot-Assisted Partial Nephrectomy: A Phantom Study , 2013, AE-CAI.

[38]  G. Corrado,et al.  End-to-end lung cancer screening with three-dimensional deep learning on low-dose chest computed tomography , 2019, Nature Medicine.

[39]  Jae Sung Lee,et al.  Measurement of Glomerular Filtration Rate using Quantitative SPECT/CT and Deep-learning-based Kidney Segmentation , 2019, Scientific Reports.

[40]  Amy Loutfi,et al.  Computer aided detection of ureteral stones in thin slice computed tomography volumes using Convolutional Neural Networks , 2018, Comput. Biol. Medicine.

[41]  Zhe Li,et al.  Evaluate the Malignancy of Pulmonary Nodules Using the 3-D Deep Leaky Noisy-OR Network , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[42]  R C Smith,et al.  Diagnosis of acute flank pain: value of unenhanced helical CT. , 1996, AJR. American journal of roentgenology.

[43]  Mahesh R Desai,et al.  Percutaneous nephrolithotomy (PCNL) a critical review. , 2016, International journal of surgery.

[44]  Ayman El-Baz,et al.  3D Kidney Segmentation from Abdominal Images Using Spatial-Appearance Models , 2017, Comput. Math. Methods Medicine.

[45]  Hongsheng Yin,et al.  Deep Semantic Segmentation of Kidney and Space-Occupying Lesion Area Based on SCNN and ResNet Models Combined with SIFT-Flow Algorithm , 2018, Journal of Medical Systems.

[46]  Ayman El-Baz,et al.  3D kidney segmentation from abdominal diffusion MRI using an appearance-guided deformable boundary , 2018, PloS one.

[47]  Thomas Brox,et al.  3D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotation , 2016, MICCAI.