Splenomegaly segmentation using global convolutional kernels and conditional generative adversarial networks

Spleen volume estimation using automated image segmentation technique may be used to detect splenomegaly (abnormally enlarged spleen) on Magnetic Resonance Imaging (MRI) scans. In recent years, Deep Convolutional Neural Networks (DCNN) segmentation methods have demonstrated advantages for abdominal organ segmentation. However, variations in both size and shape of the spleen on MRI images may result in large false positive and false negative labeling when deploying DCNN based methods. In this paper, we propose the Splenomegaly Segmentation Network (SSNet) to address spatial variations when segmenting extraordinarily large spleens. SSNet was designed based on the framework of image-to-image conditional generative adversarial networks (cGAN). Specifically, the Global Convolutional Network (GCN) was used as the generator to reduce false negatives, while the Markovian discriminator (PatchGAN) was used to alleviate false positives. A cohort of clinically acquired 3D MRI scans (both T1 weighted and T2 weighted) from patients with splenomegaly were used to train and test the networks. The experimental results demonstrated that a mean Dice coefficient of 0.9260 and a median Dice coefficient of 0.9262 using SSNet on independently tested MRI volumes of patients with splenomegaly.

[1]  Alexei A. Efros,et al.  Image-to-Image Translation with Conditional Adversarial Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  Ellen M Yetter,et al.  Estimating splenic volume: sonographic measurements correlated with helical CT determination. , 2003, AJR. American journal of roentgenology.

[3]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[4]  M. Raissaki,et al.  Determination of normal splenic volume on computed tomography in relation to age, gender and body habitus , 1997, European Radiology.

[5]  Camille Couprie,et al.  Semantic Segmentation using Adversarial Networks , 2016, NIPS 2016.

[6]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[7]  A. Lev-Toaff,et al.  Normal splenic volumes estimated using three‐dimensional ultrasonography. , 1999, Journal of ultrasound in medicine : official journal of the American Institute of Ultrasound in Medicine.

[8]  G. Cerri,et al.  Sonographic assessment of normal spleen volume , 1995, Clinical anatomy.

[9]  Li Fei-Fei,et al.  ImageNet: A large-scale hierarchical image database , 2009, CVPR.

[10]  R. Reznek,et al.  Spleen size: how well do linear ultrasound measurements correlate with three-dimensional CT volume assessments? , 2002, The British journal of radiology.

[11]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[12]  D. DeLong,et al.  Sonographic evaluation of spleen size in tall healthy athletes. , 2005, AJR. American journal of roentgenology.

[13]  Xiangyu Zhang,et al.  Large Kernel Matters — Improve Semantic Segmentation by Global Convolutional Network , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[14]  Bennett A Landman,et al.  Efficient multi-atlas abdominal segmentation on clinically acquired CT with SIMPLE context learning , 2015, Medical Image Anal..

[15]  Yuankai Huo,et al.  Multi-atlas segmentation enables robust multi-contrast MRI spleen segmentation for splenomegaly , 2017, Medical Imaging.

[16]  Jialin Peng,et al.  Automatic 3D liver segmentation based on deep learning and globally optimized surface evolution , 2016, Physics in medicine and biology.

[17]  Yuankai Huo,et al.  Robust Multicontrast MRI Spleen Segmentation for Splenomegaly Using Multi-Atlas Segmentation , 2017, IEEE Transactions on Biomedical Engineering.

[18]  E J Rummeny Imaging of the spleen. , 1990, Current opinion in radiology.

[19]  Pablo R. Ros,et al.  Imaging of Spleen Disorders , 2002 .

[20]  Yuankai Huo,et al.  Multi-atlas spleen segmentation on CT using adaptive context learning , 2017, Medical Imaging.

[21]  Ronald M. Summers,et al.  Assessing splenomegaly: automated volumetric analysis of the spleen. , 2013, Academic radiology.

[22]  Matthew J. McAuliffe,et al.  Medical Image Processing, Analysis and Visualization in clinical research , 2001, Proceedings 14th IEEE Symposium on Computer-Based Medical Systems. CBMS 2001.

[23]  Muneeb Ahmed,et al.  Determination of splenomegaly by CT: is there a place for a single measurement? , 2005, AJR. American journal of roentgenology.

[24]  E. Eichner,et al.  Splenic function: normal, too much and too little. , 1979, The American journal of medicine.

[25]  Lin Yang,et al.  MDNet: A Semantically and Visually Interpretable Medical Image Diagnosis Network , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).