CircleSnake: Instance Segmentation with Circle Representation

. Circle representation has recently been introduced as a “medical imaging optimized” representation for more effective instance object detection on ball-shaped medical objects. With its superior performance on instance detection, it is appealing to extend the circle representation to instance medical object segmentation. In this work, we propose CircleSnake, a simple end-to-end circle contour deformation-based segmentation method for ball-shaped medical objects. Compared to the prevalent DeepSnake method, our contribution is three-fold: (1) We replace the complicated bounding box to octagon contour transfor-mation with a computation-free and consistent bounding circle to circle contour adaption for segmenting ball-shaped medical objects; (2) Circle representation has fewer degrees of freedom (DoF=2) as compared with the octagon representation (DoF=8), thus yielding a more robust segmentation performance and better rotation consistency; (3) To the best of our knowledge, the proposed CircleSnake method is the first end-to-end circle representation deep segmentation pipeline method with consistent circle detection, circle contour proposal, and circular convolution. The key innovation is to integrate the circular graph convolution with circle detection into an end-to-end instance segmentation framework, enabled by the proposed simple and consistent circle contour representation. Glomeruli are used to evaluate the performance of the benchmarks. From the results, CircleSnake increases the average precision of glomerular detection from 0.559 to 0.614. The Dice score increased from 0.804 to 0.849. The code has been released: https://github.com/hrlblab/CircleSnake

[1]  Ethan H. Nguyen,et al.  Circle Representation for Medical Object Detection , 2021, IEEE Transactions on Medical Imaging.

[2]  Dimitris N. Metaxas,et al.  SCPM-Net: An Anchor-free 3D Lung Nodule Detection Network using Sphere Representation and Center Points Matching , 2021, Medical Image Anal..

[3]  Michele Fúlvia Angelo,et al.  Automatic glomerulus detection in renal histological images , 2021, Medical Imaging.

[4]  QUAN LIU,et al.  AI Applications in Renal Pathology. , 2021, Kidney international.

[5]  Bennett A. Landman,et al.  CircleNet: Anchor-Free Glomerulus Detection with Circle Representation , 2020, MICCAI.

[6]  Germain Forestier,et al.  Real-Time Detection of Glomeruli in Renal Pathology , 2020, 2020 IEEE 33rd International Symposium on Computer-Based Medical Systems (CBMS).

[7]  H. Bao,et al.  Deep Snake for Real-Time Instance Segmentation , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[8]  Oscar Déniz-Suárez,et al.  Glomerulosclerosis identification in whole slide images using semantic segmentation , 2019, Comput. Methods Programs Biomed..

[9]  Ross B. Girshick,et al.  Focal Loss for Dense Object Detection , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Ross B. Girshick,et al.  Mask R-CNN , 2017, 1703.06870.

[11]  Rabi Yacoub,et al.  Computational Segmentation and Classification of Diabetic Glomerulosclerosis. , 2019, Journal of the American Society of Nephrology : JASN.

[12]  Xingyi Zhou,et al.  Objects as Points , 2019, ArXiv.

[13]  Hei Law,et al.  CornerNet: Detecting Objects as Paired Keypoints , 2018, International Journal of Computer Vision.

[14]  Cheng-Jian Lin,et al.  Glomerulus Detection on Light Microscopic Images of Renal Pathology with the Faster R-CNN , 2018, ICONIP.

[15]  Kazuhiko Ohe,et al.  Faster R-CNN-Based Glomerular Detection in Multistained Human Whole Slide Images , 2018, J. Imaging.

[16]  Vijaya B. Kolachalama,et al.  Segmentation of Glomeruli Within Trichrome Images Using Deep Learning , 2018, bioRxiv.

[17]  Trevor Darrell,et al.  Deep Layer Aggregation , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[18]  Michael Gadermayr,et al.  CNN Cascades for Segmenting Whole Slide Images of the Kidney , 2017, Comput. Medical Imaging Graph..

[19]  Pietro Perona,et al.  Microsoft COCO: Common Objects in Context , 2014, ECCV.

[20]  V. D’Agati,et al.  The rise of renal pathology in nephrology: structure illuminates function. , 2013, American journal of kidney diseases : the official journal of the National Kidney Foundation.

[21]  Victor G Puelles,et al.  Glomerular number and size variability and risk for kidney disease , 2011, Current opinion in nephrology and hypertension.