RBC Semantic Segmentation for Sickle Cell Disease Based on Deformable U-Net

Reliable cell segmentation and classification from biomedical images is a crucial step for both scientific research and clinical practice. A major challenge for more robust segmentation and classification methods is the large variations in the size, shape and viewpoint of the cells, combining with the low image quality caused by noise and artifacts. To address this issue, in this work we propose a learning-based, simultaneous cell segmentation and classification method based on the U-Net structure with deformable convolution layers. The U-Net architecture has been shown to offer a precise localization for image semantic segmentation. Moreover, deformable convolution enables the free form deformation of the feature learning process, thus making the whole network more robust to various cell morphologies and image settings. The proposed method is tested on microscopic red blood cell images from patients with sickle cell disease. The results show that U-Net with deformable convolution achieves the highest accuracy for both segmentation and classification tasks, compared with the original U-Net structure and unsupervised methods.

[1]  Hong Zhao,et al.  A deep convolutional neural network for classification of red blood cells in sickle cell anemia , 2017, PLoS Comput. Biol..

[2]  R. Safabakhsh,et al.  An unsupervised GVF snake approach for white blood cell segmentation based on nucleus , 2006, 2006 8th international Conference on Signal Processing.

[3]  Jean-Marc Chassery,et al.  An Iterative Segmentation Method Based on a Contextual Color and Shape Criterion , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Anne E Carpenter,et al.  CellProfiler: image analysis software for identifying and quantifying cell phenotypes , 2006, Genome Biology.

[5]  Christophoros Nikou,et al.  Watershed-based segmentation of cell nuclei boundaries in Pap smear images , 2010, Proceedings of the 10th IEEE International Conference on Information Technology and Applications in Biomedicine.

[6]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[7]  S. P. Narote,et al.  Blood cell segmentation from microscopic blood images , 2015, 2015 International Conference on Information Processing (ICIP).

[8]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[9]  Heung-Il Suk,et al.  Deep Learning in Medical Image Analysis. , 2017, Annual review of biomedical engineering.

[10]  Ali Selman Aydin,et al.  CNN Based Yeast Cell Segmentation in Multi-modal Fluorescent Microscopy Data , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[11]  Johannes E. Schindelin,et al.  Fiji: an open-source platform for biological-image analysis , 2012, Nature Methods.

[12]  Lin Yang,et al.  3D Segmentation of Glial Cells Using Fully Convolutional Networks and k-Terminal Cut , 2016, MICCAI.

[13]  Yi Li,et al.  Deformable Convolutional Networks , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[14]  Ahmet Sacan,et al.  CellTrack: an open-source software for cell tracking and motility analysis , 2008, Bioinform..