Neural Network Segmentation of Interstitial Fibrosis, Tubular Atrophy, and Glomerulosclerosis in Renal Biopsies

Glomerulosclerosis, interstitial fibrosis, and tubular atrophy (IFTA) are histologic indicators of irrecoverable kidney injury. In standard clinical practice, the renal pathologist visually assesses, under the microscope, the percentage of sclerotic glomeruli and the percentage of renal cortical involvement by IFTA. Estimation of IFTA is a subjective process due to a varied spectrum and definition of morphological manifestations. Modern artificial intelligence and computer vision algorithms have the ability to reduce inter-observer variability through rigorous quantitation. In this work, we apply convolutional neural networks for the segmentation of glomerulosclerosis and IFTA in periodic acid-Schiff stained renal biopsies. The convolutional network approach achieves high performance in intra-institutional holdout data, and achieves moderate performance in inter-intuitional holdout data, which the network had never seen in training. The convolutional approach demonstrated interesting properties, such as learning to predict regions better than the provided ground truth as well as developing its own conceptualization of segmental sclerosis. Subsequent estimations of IFTA and glomerulosclerosis percentages showed high correlation with ground truth.

[1]  John E. Tomaszewski,et al.  An integrated iterative annotation technique for easing neural network training in medical image analysis , 2019, Nat. Mach. Intell..

[2]  M. Stegall,et al.  Changing Kidney Allograft Histology Early Posttransplant: Prognostic Implications of 1‐Year Protocol Biopsies , 2016, American journal of transplantation : official journal of the American Society of Transplantation and the American Society of Transplant Surgeons.

[3]  Iasonas Kokkinos,et al.  DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Sandrine Florquin,et al.  Interobserver agreement of scoring of histopathological characteristics and classification of lupus nephritis. , 2007, Nephrology, dialysis, transplantation : official publication of the European Dialysis and Transplant Association - European Renal Association.

[5]  Gloria Bueno,et al.  Glomerulus Classification with Convolutional Neural Networks , 2017, MIUA.

[6]  Daniel A Beard,et al.  Region-Based Convolutional Neural Nets for Localization of Glomeruli in Trichrome-Stained Whole Kidney Sections. , 2018, Journal of the American Society of Nephrology : JASN.

[7]  R. Sutton,et al.  Prognostic factors in diffuse proliferative lupus glomerulonephritis. , 1988, Kidney international.

[8]  Zhengyang Wang,et al.  Smoothed dilated convolutions for improved dense prediction , 2018, Data Mining and Knowledge Discovery.

[9]  Lee Hebert,et al.  The classification of glomerulonephritis in systemic lupus erythematosus revisited. , 2004, Kidney international.

[10]  A Bohle,et al.  The pathogenesis of chronic renal failure in diabetic nephropathy. Investigation of 488 cases of diabetic glomerulosclerosis. , 1991, Pathology, research and practice.

[11]  Jai Radhakrishnan,et al.  Pathologic classification of diabetic nephropathy. , 2010, Journal of the American Society of Nephrology : JASN.

[12]  Jeffrey P. Mower PREP-Mt: predictive RNA editor for plant mitochondrial genes , 2005, BMC Bioinformatics.

[13]  S. Agarwal,et al.  The evolution of the Banff classification schema for diagnosing renal allograft rejection and its implications for clinicians , 2010, Indian journal of nephrology.

[14]  T. Nagao,et al.  Histological predictors for renal prognosis in diabetic nephropathy in diabetes mellitus type 2 patients with overt proteinuria , 2012, Nephrology.

[15]  Anand Srivastava,et al.  The Prognostic Value of Histopathologic Lesions in Native Kidney Biopsy Specimens: Results from the Boston Kidney Biopsy Cohort Study. , 2018, Journal of the American Society of Nephrology : JASN.

[16]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[17]  Rabi Yacoub,et al.  Computational Segmentation and Classification of Diabetic Glomerulosclerosis. , 2019, Journal of the American Society of Nephrology : JASN.

[18]  Thomas J. Fuchs,et al.  Clinical-grade computational pathology using weakly supervised deep learning on whole slide images , 2019, Nature Medicine.

[19]  F. Moreso,et al.  Protocol biopsies in renal transplantation: prognostic value of structural monitoring. , 2007, Kidney international.

[20]  R. Colvin,et al.  Banff Fibrosis Study: Multicenter Visual Assessment and Computerized Analysis of Interstitial Fibrosis in Kidney Biopsies , 2014, American journal of transplantation : official journal of the American Society of Transplantation and the American Society of Transplant Surgeons.

[21]  B. Matthews Comparison of the predicted and observed secondary structure of T4 phage lysozyme. , 1975, Biochimica et biophysica acta.

[22]  Martín Abadi,et al.  TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems , 2016, ArXiv.

[23]  Pietro Perona,et al.  Microsoft COCO: Common Objects in Context , 2014, ECCV.

[24]  Jai Radhakrishnan,et al.  A proposal for standardized grading of chronic changes in native kidney biopsy specimens. , 2017, Kidney international.

[25]  Heikki Helin,et al.  IgM nephropathy: clinical picture and long-term prognosis. , 2003, American journal of kidney diseases : the official journal of the National Kidney Foundation.

[26]  Fernand,et al.  The Oxford classification of IgA nephropathy: pathology definitions, correlations, and reproducibility. , 2009, Kidney international.

[27]  R. Goldschmeding,et al.  Histological assessment of pre‐transplant kidney biopsies is reproducible and representative , 2010, Histopathology.