Automatic Evaluation of Histological Prognostic Factors Using Two Consecutive Convolutional Neural Networks on Kidney Samples

Visual Abstract Background and objectives The prognosis of patients undergoing kidney tumor resection or kidney donation is linked to many histologic criteria. These criteria notably include glomerular density, glomerular volume, vascular luminal stenosis, and severity of interstitial fibrosis/tubular atrophy. Automated measurements through a deep-learning approach could save time and provide more precise data. This work aimed to develop a free tool to automatically obtain kidney histologic prognostic features. Design, setting, participants, & measurements In total, 241 samples of healthy kidney tissue were split into three independent cohorts. The “Training” cohort (n=65) was used to train two convolutional neural networks: one to detect the cortex and a second to segment the kidney structures. The “Test” cohort (n=50) assessed their performance by comparing manually outlined regions of interest to predicted ones. The “Application” cohort (n=126) compared prognostic histologic data obtained manually or through the algorithm on the basis of the combination of the two convolutional neural networks. Results In the Test cohort, the networks isolated the cortex and segmented the elements of interest with good performances (>90% of the cortex, healthy tubules, glomeruli, and even globally sclerotic glomeruli were detected). In the Application cohort, the expected and predicted prognostic data were significantly correlated. The correlation coefficients r were 0.85 for glomerular volume, 0.51 for glomerular density, 0.75 for interstitial fibrosis, 0.71 for tubular atrophy, and 0.73 for vascular intimal thickness, respectively. The algorithm had a good ability to predict significant (>25%) tubular atrophy and interstitial fibrosis level (receiver operator characteristic curve with an area under the curve, 0.92 and 0.91, respectively) or a significant vascular luminal stenosis (>50%) (area under the curve, 0.85). Conclusion This freely available tool enables the automated segmentation of kidney tissue to obtain prognostic histologic data in a fast, objective, reliable, and reproducible way.

[1]  Bo Chen,et al.  Role of clinicopathological features for the early prediction of prognosis in lupus nephritis , 2021, Immunologic Research.

[2]  M. Sharif,et al.  Skin Lesion Segmentation and Multiclass Classification Using Deep Learning Features and Improved Moth Flame Optimization , 2021, Diagnostics.

[3]  A. Dekker,et al.  Current applications of deep-learning in neuro-oncological MRI. , 2021, Physica medica : PM : an international journal devoted to the applications of physics to medicine and biology : official journal of the Italian Association of Biomedical Physics.

[4]  Brandon G. Ginley,et al.  Automated Computational Detection of Interstitial Fibrosis, Tubular Atrophy, and Glomerulosclerosis. , 2021, Journal of the American Society of Nephrology : JASN.

[5]  Karupppasamy Subburaj,et al.  A deep learning approach to the screening of malaria infection: Automated and rapid cell counting, object detection and instance segmentation using Mask R-CNN , 2021, Comput. Medical Imaging Graph..

[6]  J. Rebibou,et al.  Can Total Nephron Number Predict Progressive CKD after Radical Nephrectomy? , 2020, Journal of the American Society of Nephrology.

[7]  Peter Bankhead,et al.  Deep Learning-Based Segmentation and Quantification in Experimental Kidney Histopathology. , 2020, Journal of the American Society of Nephrology : JASN.

[8]  A. Rule,et al.  Kidney Microstructural Features at the Time of Donation Predict Long-term Risk of Chronic Kidney Disease in Living Kidney Donors. , 2020, Mayo Clinic proceedings.

[9]  A. Rule,et al.  Larger Nephron Size and Nephrosclerosis Predict Progressive CKD and Mortality after Radical Nephrectomy for Tumor and Independent of Kidney Function. , 2020, Journal of the American Society of Nephrology : JASN.

[10]  C. Nast,et al.  Artificial Intelligence: The Next Frontier in Kidney Biopsy Evaluation. , 2020, Clinical journal of the American Society of Nephrology : CJASN.

[11]  C. Grana,et al.  Evaluation of the Classification Accuracy of the Kidney Biopsy Direct Immunofluorescence through Convolutional Neural Networks. , 2020, Clinical journal of the American Society of Nephrology : CJASN.

[12]  Catherine P. Jayapandian,et al.  Development and evaluation of deep learning–based segmentation of histologic structures in the kidney cortex with multiple histologic stains , 2020, Kidney international.

[13]  C. Zeng,et al.  Identification of glomerular lesions and intrinsic glomerular cell types in kidney diseases via deep learning , 2020, The Journal of pathology.

[14]  A. Burlacu,et al.  Using Artificial Intelligence Resources in Dialysis and Kidney Transplant Patients: A Literature Review , 2020, BioMed research international.

[15]  Zhiguang Zhou,et al.  Obesity-Related Glomerulopathy: A Latent Change in Obesity Requiring More Attention , 2020, Kidney and Blood Pressure Research.

[16]  David Mayerich,et al.  Artificial intelligence and machine learning in nephropathology. , 2020, Kidney international.

[17]  Pinaki Sarder,et al.  Artificial intelligence driven next-generation renal histomorphometry. , 2020, Current opinion in nephrology and hypertension.

[18]  A. Rule,et al.  Kidney Structural Features from Living Donors Predict Graft Failure in the Recipient. , 2020, Journal of the American Society of Nephrology : JASN.

[19]  Kanata Suzuki,et al.  Classification of glomerular pathological findings using deep learning and nephrologist-AI collective intelligence approach , 2020, medRxiv.

[20]  D. Rueckert,et al.  Deep Learning for Cardiac Image Segmentation: A Review , 2019, Frontiers in Cardiovascular Medicine.

[21]  Lei Xing,et al.  Machine Learning Techniques for Biomedical Image Segmentation: An Overview of Technical Aspects and Introduction to State-of-Art Applications , 2019, Medical physics.

[22]  Ross B. Girshick,et al.  Mask R-CNN , 2017, 1703.06870.

[23]  Zhihong Liu,et al.  Artificial Intelligence in Nephrology: How Can Artificial Intelligence Augment Nephrologists’ Intelligence? , 2019, Kidney Diseases.

[24]  Lisa E. Vaughan,et al.  Larger nephron size, low nephron number, and nephrosclerosis on biopsy as predictors of kidney function after donating a kidney , 2019, American journal of transplantation : official journal of the American Society of Transplantation and the American Society of Transplant Surgeons.

[25]  Hyunna Lee,et al.  A Fully Automated System Using A Convolutional Neural Network to Predict Renal Allograft Rejection: Extra-validation with Giga-pixel Immunostained Slides , 2019, Scientific Reports.

[26]  Juho Kannala,et al.  Mask-RCNN and U-Net Ensembled for Nuclei Segmentation , 2019, 2019 IEEE 16th International Symposium on Biomedical Imaging (ISBI 2019).

[27]  Yusuke Okabayashi,et al.  Volume Ratio of Glomerular Tufts to Bowman Capsules and Renal Outcomes in Nephrosclerosis , 2018, American journal of hypertension.

[28]  Bart Smeets,et al.  Deep Learning-Based Histopathologic Assessment of Kidney Tissue. , 2019, Journal of the American Society of Nephrology : JASN.

[29]  Yusuke Okabayashi,et al.  Biopsy-based estimation of total nephron number in Japanese living kidney donors , 2019, Clinical and Experimental Nephrology.

[30]  F. Locatelli,et al.  Is there long-term value of pathology scoring in immunoglobulin A nephropathy? A validation study of the Oxford Classification for IgA Nephropathy (VALIGA) update. , 2018, Nephrology, dialysis, transplantation : official publication of the European Dialysis and Transplant Association - European Renal Association.

[31]  S. Joshua Swamidass,et al.  Deep Learning Global Glomerulosclerosis in Transplant Kidney Frozen Sections , 2018, bioRxiv.

[32]  H. Heerspink,et al.  Glomerular Hyperfiltration in Diabetes: Mechanisms, Clinical Significance, and Treatment. , 2017, Journal of the American Society of Nephrology : JASN.

[33]  A. Rule,et al.  The Substantial Loss of Nephrons in Healthy Human Kidneys with Aging. , 2017, Journal of the American Society of Nephrology : JASN.

[34]  D. Giavarina Understanding Bland Altman analysis , 2015, Biochemia medica.

[35]  L. Melton,et al.  Association of kidney function and metabolic risk factors with density of glomeruli on renal biopsy samples from living donors. , 2011, Mayo Clinic proceedings.

[36]  Bernhard Glodny,et al.  Normal kidney size and its influencing factors - a 64-slice MDCT study of 1.040 asymptomatic patients , 2009, BMC urology.

[37]  M. Hughson,et al.  Nephron number, glomerular volume, renal disease and hypertension , 2008, Current opinion in nephrology and hypertension.

[38]  Jan Gorodkin,et al.  Comparing two K-category assignments by a K-category correlation coefficient , 2004, Comput. Biol. Chem..

[39]  E. Weibel,et al.  A principle for counting tissue structures on random sections. , 1962, Journal of applied physiology.