Deep Learning-Based Segmentation and Quantification in Experimental Kidney Histopathology.

BACKGROUND Nephropathologic analyses provide important outcomes-related data in experiments with the animal models that are essential for understanding kidney disease pathophysiology. Precision medicine increases the demand for quantitative, unbiased, reproducible, and efficient histopathologic analyses, which will require novel high-throughput tools. A deep learning technique, the convolutional neural network, is increasingly applied in pathology because of its high performance in tasks like histology segmentation. METHODS We investigated use of a convolutional neural network architecture for accurate segmentation of periodic acid-Schiff-stained kidney tissue from healthy mice and five murine disease models and from other species used in preclinical research. We trained the convolutional neural network to segment six major renal structures: glomerular tuft, glomerulus including Bowman's capsule, tubules, arteries, arterial lumina, and veins. To achieve high accuracy, we performed a large number of expert-based annotations, 72,722 in total. RESULTS Multiclass segmentation performance was very high in all disease models. The convolutional neural network allowed high-throughput and large-scale, quantitative and comparative analyses of various models. In disease models, computational feature extraction revealed interstitial expansion, tubular dilation and atrophy, and glomerular size variability. Validation showed a high correlation of findings with current standard morphometric analysis. The convolutional neural network also showed high performance in other species used in research-including rats, pigs, bears, and marmosets-as well as in humans, providing a translational bridge between preclinical and clinical studies. CONCLUSIONS We developed a deep learning algorithm for accurate multiclass segmentation of digital whole-slide images of periodic acid-Schiff-stained kidneys from various species and renal disease models. This enables reproducible quantitative histopathologic analyses in preclinical models that also might be applicable to clinical studies.

[1]  Jakob Nikolas Kather,et al.  Deep learning can predict microsatellite instability directly from histology in gastrointestinal cancer , 2019, Nature Medicine.

[2]  Gloria Bueno,et al.  Data for glomeruli characterization in histopathological images , 2020, Data in brief.

[3]  P. Boor,et al.  Quantitative Micro-Computed Tomography Imaging of Vascular Dysfunction in Progressive Kidney Diseases. , 2016, Journal of the American Society of Nephrology : JASN.

[4]  Nasir M. Rajpoot,et al.  Locality Sensitive Deep Learning for Detection and Classification of Nuclei in Routine Colon Cancer Histology Images , 2016, IEEE Trans. Medical Imaging.

[5]  Michael Gadermayr,et al.  Stain independent segmentation of whole slide images: A case study in renal histology , 2018, 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018).

[6]  Susan M Sheehan,et al.  Automatic glomerular identification and quantification of histological phenotypes using image analysis and machine learning. , 2018, American journal of physiology. Renal physiology.

[7]  John E. Tomaszewski,et al.  An integrated iterative annotation technique for easing neural network training in medical image analysis , 2019, Nat. Mach. Intell..

[8]  Vijaya B. Kolachalama,et al.  Segmentation of Glomeruli Within Trichrome Images Using Deep Learning. , 2019, Kidney international reports.

[9]  Zhipeng Jia,et al.  Large scale tissue histopathology image classification, segmentation, and visualization via deep convolutional activation features , 2017, BMC Bioinformatics.

[10]  Oscar Déniz-Suárez,et al.  Glomerulosclerosis identification in whole slide images using semantic segmentation , 2019, Comput. Methods Programs Biomed..

[11]  P. Boor,et al.  Cellular and Molecular Mechanisms of Kidney Injury in 2,8-Dihydroxyadenine Nephropathy. , 2020, Journal of the American Society of Nephrology : JASN.

[12]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[13]  P. Boor,et al.  Determination of the Preferred Conditions for the Isolated Perfusion of Porcine Kidneys , 2014, European Surgical Research.

[14]  P. Boor,et al.  Macrophage Migration Inhibitory Factor Mediates Proliferative GN via CD74. , 2016, Journal of the American Society of Nephrology : JASN.

[15]  Burr Settles,et al.  Active Learning Literature Survey , 2009 .

[16]  P. Boor,et al.  Glucagon-Like Peptide 1 and Its Cleavage Products Are Renoprotective in Murine Diabetic Nephropathy , 2018, Diabetes.

[17]  Michael Gadermayr,et al.  Generative Adversarial Networks for Facilitating Stain-Independent Supervised and Unsupervised Segmentation: A Study on Kidney Histology , 2019, IEEE Transactions on Medical Imaging.

[18]  Klaus H. Maier-Hein,et al.  nnU-Net: Breaking the Spell on Successful Medical Image Segmentation , 2019, ArXiv.

[19]  Michael Gadermayr,et al.  Segmenting renal whole slide images virtually without training data , 2017, Comput. Biol. Medicine.

[20]  Rabi Yacoub,et al.  Computational Segmentation and Classification of Diabetic Glomerulosclerosis. , 2019, Journal of the American Society of Nephrology : JASN.

[21]  Hao Chen,et al.  DCAN: Deep contour‐aware networks for object instance segmentation from histology images , 2017, Medical Image Anal..

[22]  Thomas Brox,et al.  U-Net: deep learning for cell counting, detection, and morphometry , 2018, Nature Methods.

[23]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[24]  P. Boor,et al.  A collagen-binding protein enables molecular imaging of kidney fibrosis in vivo. , 2019, Kidney international.

[25]  Peter Bankhead,et al.  QuPath: Open source software for digital pathology image analysis , 2017, Scientific Reports.

[26]  Bart Smeets,et al.  Deep Learning-Based Histopathologic Assessment of Kidney Tissue. , 2019, Journal of the American Society of Nephrology : JASN.

[27]  P. Boor Artificial intelligence in nephropathology , 2019, Nature Reviews Nephrology.

[28]  Liyuan Liu,et al.  On the Variance of the Adaptive Learning Rate and Beyond , 2019, ICLR.

[29]  P. Boor,et al.  Keratins are novel markers of renal epithelial cell injury. , 2016, Kidney international.

[30]  D. Kennedy,et al.  Anatomic segmentation and volumetric calculations in nuclear magnetic resonance imaging. , 1989, IEEE transactions on medical imaging.

[31]  Seyed-Ahmad Ahmadi,et al.  V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation , 2016, 2016 Fourth International Conference on 3D Vision (3DV).

[32]  J. M. Crawford,et al.  Pathologist workforce in the United States: I. Development of a predictive model to examine factors influencing supply. , 2013, Archives of pathology & laboratory medicine.

[33]  Shenghua Gao,et al.  CE-Net: Context Encoder Network for 2D Medical Image Segmentation , 2019, IEEE Transactions on Medical Imaging.