Circle Representation for Medical Object Detection

Box representation has been extensively used for object detection in computer vision. Such representation is efficacious but not necessarily optimized for biomedical objects (e.g., glomeruli), which play an essential role in renal pathology. In this paper, we propose a simple circle representation for medical object detection and introduce CircleNet, an anchor-free detection framework. Compared with the conventional bounding box representation, the proposed bounding circle representation innovates in three-fold: (1) it is optimized for ball-shaped biomedical objects; (2) The circle representation reduced the degree of freedom compared with box representation; (3) It is naturally more rotation invariant. When detecting glomeruli and nuclei on pathological images, the proposed circle representation achieved superior detection performance and be more rotation-invariant, compared with the bounding box. The code has been made publicly available: https://github.com/hrlblab/CircleNet.

[1]  Yunhong Wang,et al.  Receptive Field Block Net for Accurate and Fast Object Detection , 2017, ECCV.

[2]  Pietro Perona,et al.  Microsoft COCO: Common Objects in Context , 2014, ECCV.

[3]  Fuchun Sun,et al.  Deep Feature Pyramid Reconfiguration for Object Detection , 2018, ECCV.

[4]  Yoshihiro Hirohashi,et al.  Segmental HOG: new descriptor for glomerulus detection in kidney microscopy image , 2015, BMC Bioinformatics.

[5]  Kazuhiko Ohe,et al.  Faster R-CNN-Based Glomerular Detection in Multistained Human Whole Slide Images , 2018, J. Imaging.

[6]  Huajun Feng,et al.  Libra R-CNN: Towards Balanced Learning for Object Detection , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[7]  Ling-Yu Duan,et al.  Towards Accurate One-Stage Object Detection With AP-Loss , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[8]  Xiangyu Zhang,et al.  Bounding Box Regression With Uncertainty for Accurate Object Detection , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[9]  Luca Maria Gambardella,et al.  Mitosis Detection in Breast Cancer Histology Images with Deep Neural Networks , 2013, MICCAI.

[10]  Germain Forestier,et al.  Real-Time Detection of Glomeruli in Renal Pathology , 2020, 2020 IEEE 33rd International Symposium on Computer-Based Medical Systems (CBMS).

[11]  Cheng-Jian Lin,et al.  Glomerulus Detection on Light Microscopic Images of Renal Pathology with the Faster R-CNN , 2018, ICONIP.

[12]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[13]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[14]  Larry S. Davis,et al.  AutoFocus: Efficient Multi-Scale Inference , 2018, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[15]  Mun-Cheon Kang,et al.  Parallel Feature Pyramid Network for Object Detection , 2018, ECCV.

[16]  Trevor Darrell,et al.  Deep Layer Aggregation , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[17]  Surabhi Bhargava,et al.  A Dataset and a Technique for Generalized Nuclear Segmentation for Computational Pathology , 2017, IEEE Transactions on Medical Imaging.

[18]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Hujun Bao,et al.  Deep Snake for Real-Time Instance Segmentation , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[20]  Gloria Bueno,et al.  Glomerulus Classification and Detection Based on Convolutional Neural Networks , 2018, J. Imaging.

[21]  Bennett A. Landman,et al.  CircleNet: Anchor-Free Glomerulus Detection with Circle Representation , 2020, MICCAI.

[22]  Roman Monczak,et al.  Computer-Aided Breast Cancer Diagnosis Based on the Analysis of Cytological Images of Fine Needle Biopsies , 2013, IEEE Transactions on Medical Imaging.

[23]  Victor G Puelles,et al.  Glomerular number and size variability and risk for kidney disease , 2011, Current opinion in nephrology and hypertension.

[24]  Rabi Yacoub,et al.  Computational Segmentation and Classification of Diabetic Glomerulosclerosis. , 2019, Journal of the American Society of Nephrology : JASN.

[25]  Wei Liu,et al.  SSD: Single Shot MultiBox Detector , 2015, ECCV.

[26]  Nikolai Dechev,et al.  Machine vision-based localization of nucleic and cytoplasmic injection sites on low-contrast adherent cells , 2011, Medical & Biological Engineering & Computing.

[27]  Nilanjan Dey,et al.  Measurement of glomerulus diameter and Bowman's space width of renal albino rats , 2016, Comput. Methods Programs Biomed..

[28]  Chanho Jung,et al.  Segmenting Clustered Nuclei Using H-minima Transform-Based Marker Extraction and Contour Parameterization , 2010, IEEE Transactions on Biomedical Engineering.

[29]  Ross B. Girshick,et al.  Mask R-CNN , 2017, 1703.06870.

[30]  Ross B. Girshick,et al.  Focal Loss for Dense Object Detection , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[31]  Shiguang Shan,et al.  Structure Inference Net: Object Detection Using Scene-Level Context and Instance-Level Relationships , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[32]  Shifeng Zhang,et al.  Bridging the Gap Between Anchor-Based and Anchor-Free Detection via Adaptive Training Sample Selection , 2019, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[33]  QUAN LIU,et al.  AI Applications in Renal Pathology. , 2021, Kidney international.

[34]  Tao Mei,et al.  ScratchDet: Training Single-Shot Object Detectors From Scratch , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[35]  Michael Gadermayr,et al.  CNN Cascades for Segmenting Whole Slide Images of the Kidney , 2017, Comput. Medical Imaging Graph..

[36]  Germain Forestier,et al.  Detection of glomeruli in renal pathology by mutual comparison of multiple staining modalities , 2017, Proceedings of the 10th International Symposium on Image and Signal Processing and Analysis.

[37]  Abhinav Gupta,et al.  Contextual Priming and Feedback for Faster R-CNN , 2016, ECCV.

[38]  Kaiming He,et al.  Feature Pyramid Networks for Object Detection , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[39]  Nuno Vasconcelos,et al.  Cascade R-CNN: Delving Into High Quality Object Detection , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[40]  Hao Chen,et al.  A Multi-Organ Nucleus Segmentation Challenge , 2020, IEEE Transactions on Medical Imaging.

[41]  Jeremiah W. Johnson,et al.  Adapting Mask-RCNN for Automatic Nucleus Segmentation , 2018, ArXiv.

[42]  Vladlen Koltun,et al.  Tracking Objects as Points , 2020, ECCV.

[43]  Oscar Déniz-Suárez,et al.  Glomerulosclerosis identification in whole slide images using semantic segmentation , 2019, Comput. Methods Programs Biomed..

[44]  John E. Tomaszewski,et al.  Glomerular detection and segmentation from multimodal microscopy images using a Butterworth band-pass filter , 2018, Medical Imaging.

[45]  Xingyi Zhou,et al.  Bottom-Up Object Detection by Grouping Extreme and Center Points , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[46]  Rogério Schmidt Feris,et al.  A Unified Multi-scale Deep Convolutional Neural Network for Fast Object Detection , 2016, ECCV.

[47]  Zhiqiang Shen,et al.  DSOD: Learning Deeply Supervised Object Detectors from Scratch , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[48]  Larry S. Davis,et al.  G-CNN: An Iterative Grid Based Object Detector , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[49]  Wei Liu,et al.  DSSD : Deconvolutional Single Shot Detector , 2017, ArXiv.

[50]  Abhinav Gupta,et al.  Training Region-Based Object Detectors with Online Hard Example Mining , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[51]  Heesung Kwon,et al.  ME R-CNN: Multi-Expert R-CNN for Object Detection , 2017, IEEE Transactions on Image Processing.

[52]  Fuchun Sun,et al.  RON: Reverse Connection with Objectness Prior Networks for Object Detection , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[53]  Michele Fúlvia Angelo,et al.  Automatic glomerulus detection in renal histological images , 2021, Medical Imaging.

[54]  Bo Wang,et al.  Single-Shot Object Detection with Enriched Semantics , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[55]  Larry S. Davis,et al.  An Analysis of Scale Invariance in Object Detection - SNIP , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[56]  Jinglu Hu,et al.  Glomerulus extraction by using genetic algorithm for edge patching , 2009, 2009 IEEE Congress on Evolutionary Computation.

[57]  Jia Deng,et al.  Stacked Hourglass Networks for Human Pose Estimation , 2016, ECCV.

[58]  Huaici Zhao,et al.  RTM3D: Real-time Monocular 3D Detection from Object Keypoints for Autonomous Driving , 2020, ECCV.

[59]  Vijaya B. Kolachalama,et al.  Segmentation of Glomeruli Within Trichrome Images Using Deep Learning , 2018, bioRxiv.

[60]  Lijuan Duan,et al.  An automated method with anchor-free detection and U-shaped segmentation for nuclei instance segmentation , 2021, MMAsia.

[61]  Ross B. Girshick,et al.  Fast R-CNN , 2015, 1504.08083.

[62]  Abhinav Gupta,et al.  A-Fast-RCNN: Hard Positive Generation via Adversary for Object Detection , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[63]  Tetsuhiro Kakimoto,et al.  Quantitative analysis of markers of podocyte injury in the rat puromycin aminonucleoside nephropathy model. , 2015, Experimental and toxicologic pathology : official journal of the Gesellschaft fur Toxikologische Pathologie.

[64]  Qi Qian,et al.  Learning to Rank Proposals for Object Detection , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[65]  Fahad Shahbaz Khan,et al.  Learning Rich Features at High-Speed for Single-Shot Object Detection , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[66]  Hei Law,et al.  CornerNet: Detecting Objects as Paired Keypoints , 2018, ECCV.

[67]  Rabi Yacoub,et al.  Unsupervised labeling of glomerular boundaries using Gabor filters and statistical testing in renal histology , 2017, Journal of medical imaging.

[68]  V. D’Agati,et al.  The rise of renal pathology in nephrology: structure illuminates function. , 2013, American journal of kidney diseases : the official journal of the National Kidney Foundation.

[69]  Yi Li,et al.  R-FCN: Object Detection via Region-based Fully Convolutional Networks , 2016, NIPS.

[70]  Dimitris N. Metaxas,et al.  SCPM-Net: An Anchor-free 3D Lung Nodule Detection Network using Sphere Representation and Center Points Matching , 2022, Medical Image Anal..

[71]  Yoshihiro Hirohashi,et al.  Automated image analysis of a glomerular injury marker desmin in spontaneously diabetic Torii rats treated with losartan. , 2014, The Journal of endocrinology.

[72]  Kavita Bala,et al.  Inside-Outside Net: Detecting Objects in Context with Skip Pooling and Recurrent Neural Networks , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[73]  Xingyi Zhou,et al.  Objects as Points , 2019, ArXiv.

[74]  Zhe Chen,et al.  Context Refinement for Object Detection , 2018, ECCV.

[75]  Jean-Christophe Olivo-Marin,et al.  An approach for detection of glomeruli in multisite digital pathology , 2016, 2016 IEEE 13th International Symposium on Biomedical Imaging (ISBI).