Cycle-consistent GAN-based stain translation of renal pathology images with glomerulus detection application

Abstract Motivation: Renal biopsy is an irreplaceable diagnostic tool for kidney diseases. Glomeruli provide important information for an accurate disease diagnosis. This paper applies deep learning techniques to automate translation of renal pathology images and glomerulus detection to improve the efficiency and accuracy on pathological diagnoses. Methods: This paper first proposes a new method for automatic translation of different renal pathology staining styles using the cycle-consistent Generative Adversarial Network (GAN). This paper then proposes the combination of faster region-based convolutional neural network (R-CNN) with an aspect ratio filter to detect glomeruli in light microscopy images processed with four different stains at various optical magnifications. Finally, this paper improves glomerulus detection at different stains by using translated image stains from the CycleGAN. Results: To show the effectiveness of the translation and detection methods, in addition to quantitative analysis of the results, the involvement of assessment from four physicians is also performed. Experimental results show that the physicians fail to differentiate real and translated stains and the automatic glomerulus detection method outperforms that manually labeled by the physicians. Conclusion: The proposed method works well and improves the efficiency of renal pathological diagnosis. This work contributes in the area of automated medical diagnosis.

[1]  J. Berns,et al.  The Native Kidney Biopsy: Update and Evidence for Best Practice. , 2016, Clinical journal of the American Society of Nephrology : CJASN.

[2]  Tom Duff,et al.  Compositing digital images , 1984, SIGGRAPH.

[3]  Yoshihiro Hirohashi,et al.  Segmental HOG: new descriptor for glomerulus detection in kidney microscopy image , 2015, BMC Bioinformatics.

[4]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[5]  Chia-Feng Juang,et al.  Moving Object Classification Using a Combination of Static Appearance Features and Spatial and Temporal Entropy Values of Optical Flows , 2015, IEEE Transactions on Intelligent Transportation Systems.

[6]  Chia-Feng Juang,et al.  Object Detection Using Color Entropies and a Fuzzy Classifier , 2013, IEEE Computational Intelligence Magazine.

[7]  Gloria Bueno,et al.  Glomerulus Classification and Detection Based on Convolutional Neural Networks , 2018, J. Imaging.

[8]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[10]  Gang Yang,et al.  Recovering Quantitative Remote Sensing Products Contaminated by Thick Clouds and Shadows Using Multitemporal Dictionary Learning , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[11]  Jie Xu,et al.  A new convolutional neural network model for peripapillary atrophy area segmentation from retinal fundus images , 2020, Appl. Soft Comput..

[12]  S. Agarwal,et al.  Basics of kidney biopsy: A nephrologist's perspective , 2013, Indian journal of nephrology.

[13]  Antonio Oseas de Carvalho Filho,et al.  Generative adversarial network and texture features applied to automatic glaucoma detection , 2020, Appl. Soft Comput..

[14]  Gloria Bueno,et al.  Glomerulus Classification with Convolutional Neural Networks , 2017, MIUA.

[15]  Nilanjan Dey,et al.  Measurement of glomerulus diameter and Bowman's space width of renal albino rats , 2016, Comput. Methods Programs Biomed..

[16]  Hyunseok Min,et al.  Neural Stain-Style Transfer Learning using GAN for Histopathological Images , 2017, ArXiv.

[17]  Feng Jiang,et al.  Convolutional descriptors aggregation via cross-net for skin lesion recognition , 2020, Appl. Soft Comput..

[18]  Paul Babyn,et al.  Generative Adversarial Network in Medical Imaging: A Review , 2018, Medical Image Anal..

[19]  Nassir Navab,et al.  Staingan: Stain Style Transfer for Digital Histological Images , 2018, 2019 IEEE 16th International Symposium on Biomedical Imaging (ISBI 2019).

[20]  D. Santoro,et al.  Renal biopsy: Still a landmark for the nephrologist. , 2016, World journal of nephrology.

[21]  F. Hobbs,et al.  Global Prevalence of Chronic Kidney Disease – A Systematic Review and Meta-Analysis , 2016, PloS one.

[22]  Chia-Feng Juang,et al.  An Interval Type-2 Neural Fuzzy Classifier Learned Through Soft Margin Minimization and its Human Posture Classification Application , 2015, IEEE Transactions on Fuzzy Systems.

[23]  F. Cosio,et al.  Banff 07 Classification of Renal Allograft Pathology: Updates and Future Directions , 2008, American journal of transplantation : official journal of the American Society of Transplantation and the American Society of Transplant Surgeons.

[24]  Huanfeng Shen,et al.  A robust mosaicking procedure for high spatial resolution remote sensing images , 2015 .

[25]  Patrick Pérez,et al.  Poisson image editing , 2003, ACM Trans. Graph..

[26]  Kazuhiko Ohe,et al.  Faster R-CNN-Based Glomerular Detection in Multistained Human Whole Slide Images , 2018, J. Imaging.