Cell Detection in Domain Shift Problem Using Pseudo-Cell-Position Heatmap

The domain shift problem is an important issue in automatic cell detection. A detection network trained with training data under a specific condition (source domain) may not work well in data under other conditions (target domain). We propose an unsupervised domain adaptation method for cell detection using the pseudo-cell-position heatmap, where a cell centroid becomes a peak with a Gaussian distribution in the map. In the prediction result for the target domain, even if a peak location is correct, the signal distribution around the peak often has a non-Gaussian shape. The pseudo-cell-position heatmap is re-generated using the peak positions in the predicted heatmap to have a clear Gaussian shape. Our method selects confident pseudo-cell-position heatmaps using a Bayesian network and adds them to the training data in the next iteration. The method can incrementally extend the domain from the source domain to the target domain in a semi-supervised manner. In the experiments using 8 combinations of domains, the proposed method outperformed the existing domain adaptation methods.

[1]  Florian Jug,et al.  Cell segmentation methods for label-free contrast microscopy: review and comprehensive comparison , 2019, BMC Bioinformatics.

[2]  Trevor Darrell,et al.  Semi-Supervised Domain Adaptation via Minimax Entropy , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[3]  Yousef Al-Kofahi,et al.  Improved Automatic Detection and Segmentation of Cell Nuclei in Histopathology Images , 2010, IEEE Transactions on Biomedical Engineering.

[4]  Qingming Huang,et al.  Gradually Vanishing Bridge for Adversarial Domain Adaptation , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  Ye Zhou,et al.  Segmentation of petrographic images by integrating edge detection and region growing , 2004, Comput. Geosci..

[6]  Lee E. Weiss,et al.  Phase contrast time-lapse microscopy datasets with automated and manual cell tracking annotations , 2018, Scientific Data.

[7]  Changick Kim,et al.  Attract, Perturb, and Explore: Learning a Feature Alignment Network for Semi-supervised Domain Adaptation , 2020, ECCV.

[8]  F. Markowetz,et al.  Quantitative Image Analysis of Cellular Heterogeneity in Breast Tumors Complements Genomic Profiling , 2012, Science Translational Medicine.

[9]  Victor S. Lempitsky,et al.  Unsupervised Domain Adaptation by Backpropagation , 2014, ICML.

[10]  Timothy Hospedales,et al.  Online Meta-Learning for Multi-Source and Semi-Supervised Domain Adaptation , 2020, ECCV.

[11]  Ryoma Bise,et al.  Weakly Supervised Cell Instance Segmentation by Propagating from Detection Response , 2019, MICCAI.

[12]  Takeo Kanade,et al.  Understanding the phase contrast optics to restore artifact-free microscopy images for segmentation , 2012, Medical Image Anal..

[13]  Zoubin Ghahramani,et al.  Bayesian Convolutional Neural Networks with Bernoulli Approximate Variational Inference , 2015, ArXiv.

[14]  Zhedong Zheng,et al.  Rectifying Pseudo Label Learning via Uncertainty Estimation for Domain Adaptive Semantic Segmentation , 2021, Int. J. Comput. Vis..

[15]  Mengjie Zhang,et al.  Deep Reconstruction-Classification Networks for Unsupervised Domain Adaptation , 2016, ECCV.

[16]  Junzhou Huang,et al.  Adversarial Domain Adaptation for Cell Segmentation , 2020, MIDL.

[17]  Toby P. Breckon,et al.  Unsupervised Domain Adaptation via Structured Prediction Based Selective Pseudo-Labeling , 2019, AAAI.

[18]  Yunfeng Shao,et al.  Bidirectional Adversarial Training for Semi-Supervised Domain Adaptation , 2020, IJCAI.

[19]  Xianhua Han,et al.  Cell Detection and Segmentation in Microscopy Images with Improved Mask R-CNN , 2020, ACCV Workshops.

[20]  Aditya Prasad,et al.  Unsupervised Hard Example Mining from Videos for Improved Object Detection , 2018, ECCV.

[21]  Jean Paul Thiery,et al.  EMT: 2016 , 2016, Cell.

[22]  Zoubin Ghahramani,et al.  Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learning , 2015, ICML.

[23]  N. Otsu A threshold selection method from gray level histograms , 1979 .

[24]  Dapeng Chen,et al.  Mutual Mean-Teaching: Pseudo Label Refinery for Unsupervised Domain Adaptation on Person Re-identification , 2020, ICLR.

[25]  Vincent Lepetit,et al.  You Should Use Regression to Detect Cells , 2015, MICCAI.

[26]  Pengfei Ge,et al.  Domain Adaptation and Image Classification via Deep Conditional Adaptation Network , 2020, ArXiv.

[27]  Yi-Hsuan Tsai,et al.  Domain Adaptation for Structured Output via Disentangled Patch Representations , 2018 .

[28]  Yaser Sheikh,et al.  OpenPose: Realtime Multi-Person 2D Pose Estimation Using Part Affinity Fields , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[29]  Trevor Darrell,et al.  Adversarial Discriminative Domain Adaptation , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[30]  Kate Saenko,et al.  Strong-Weak Distribution Alignment for Adaptive Object Detection , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[31]  Frederic Maire,et al.  Semi-supervised Keypoint Localization , 2021, ICLR.

[32]  Zhiqiang Hu,et al.  Signet Ring Cell Detection with a Semi-supervised Learning Framework , 2019, IPMI.

[33]  Dimitris N. Metaxas,et al.  Multi-scale Cell Instance Segmentation with Keypoint Graph based Bounding Boxes , 2019, MICCAI.

[34]  John Meyer,et al.  Grading nuclear pleomorphism on histological micrographs , 2008, 2008 19th International Conference on Pattern Recognition.