A Two-Path Network for Cell Counting

The density map is an effective manner to infer how many cells a cell image contains, and it carries valuable information. However, a fine-grained density map requires rich spatial information to recover the distribution details. In this paper, we propose a cell counting network with two paths, i.e. detail path and context path, which respectively extract spatial details and semantics. The detail path encodes the spatial information with small convolutional kernels. The context path rapidly enlarges the receptive field and extracts multi-scale features with an atrous spatial pyramid pooling. At the end of the two paths, we design a feature fusion module to merge the high-level feature maps from the two paths. To decrease the parameters and computation, we directly upsample the fused feature maps to the input size and decode them to obtain the density map. The proposed model is evaluated on three cell datasets and a popular crowd dataset Shanghaitech Part-B. The experiments illustrated that the proposed model not only achieves superior performance on cell datasets but also generalizes well on the crowd dataset.

[1]  Ullrich Köthe,et al.  Learning to count with regression forest and structured labels , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[2]  Deyu Meng,et al.  DecideNet: Counting Varying Density Crowds Through Attention Guided Detection and Density Estimation , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[3]  Parvaneh Saeedi,et al.  Cell-Net: Embryonic Cell Counting and Centroid Localization via Residual Incremental Atrous Pyramid and Progressive Upsampling Convolution , 2019, IEEE Access.

[4]  Noel E. O'Connor,et al.  People, Penguins and Petri Dishes: Adapting Object Counting Models to New Visual Domains and Object Types Without Forgetting , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[5]  Guorong Wu,et al.  SAU-Net: A Universal Deep Network for Cell Counting , 2019, BCB.

[6]  Ellen T. Gelfand,et al.  The Genotype-Tissue Expression (GTEx) project , 2013, Nature Genetics.

[7]  Janne Heikkila,et al.  An efficient solution for semantic segmentation: ShuffleNet V2 with atrous separable convolutions , 2019, SCIA.

[8]  Pan Zhou,et al.  DA-Net: Learning the Fine-Grained Density Distribution With Deformation Aggregation Network , 2018, IEEE Access.

[9]  Mark Sandler,et al.  MobileNetV2: Inverted Residuals and Linear Bottlenecks , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[10]  Aimin Hao,et al.  An Extended Type Cell Detection and Counting Method based on FCN , 2017, 2017 IEEE 17th International Conference on Bioinformatics and Bioengineering (BIBE).

[11]  Juho Kannala,et al.  Cell Segmentation Proposal Network for Microscopy Image Analysis , 2016, LABELS/DLMIA@MICCAI.

[12]  Changming Sun,et al.  Segmentation of clustered nuclei based on curvature weighting , 2012, IVCNZ '12.

[13]  Faliang Chang,et al.  Multi-resolution attention convolutional neural network for crowd counting , 2019, Neurocomputing.

[14]  Pan Zhou,et al.  Enhanced 3D convolutional networks for crowd counting , 2019, BMVC.

[15]  Yoshua Bengio,et al.  Count-ception: Counting by Fully Convolutional Redundant Counting , 2017, 2017 IEEE International Conference on Computer Vision Workshops (ICCVW).

[16]  Bo Chen,et al.  MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications , 2017, ArXiv.

[17]  José M. F. Moura,et al.  FCN-rLSTM: Deep Spatio-Temporal Neural Networks for Vehicle Counting in City Cameras , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[18]  Chanho Jung,et al.  Segmenting Clustered Nuclei Using H-minima Transform-Based Marker Extraction and Contour Parameterization , 2010, IEEE Transactions on Biomedical Engineering.

[19]  Andrew Zisserman,et al.  Microscopy cell counting and detection with fully convolutional regression networks , 2018, Comput. methods Biomech. Biomed. Eng. Imaging Vis..

[20]  Shenghua Gao,et al.  Single-Image Crowd Counting via Multi-Column Convolutional Neural Network , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[21]  Reza Moradi Rad,et al.  Blastomere Cell Counting and Centroid Localization in Microscopic Images of Human Embryo , 2018, 2018 IEEE 20th International Workshop on Multimedia Signal Processing (MMSP).

[22]  Nithesh Singh Sanjay,et al.  MobileNet-Tiny: A Deep Neural Network-Based Real-Time Object Detection for Rasberry Pi , 2019, 2019 18th IEEE International Conference On Machine Learning And Applications (ICMLA).

[23]  Shubhra Aich,et al.  Improving Object Counting with Heatmap Regulation , 2018, ArXiv.

[24]  Peng Wang,et al.  MobileCount: An Efficient Encoder-Decoder Framework for Real-Time Crowd Counting , 2019, PRCV.

[25]  Vincent Lepetit,et al.  You Should Use Regression to Detect Cells , 2015, MICCAI.

[26]  Jiwei Chen,et al.  Crowd counting with crowd attention convolutional neural network , 2020, Neurocomputing.

[27]  Daniel Oñoro-Rubio,et al.  Towards Perspective-Free Object Counting with Deep Learning , 2016, ECCV.

[28]  Liang Lin,et al.  Efficient Crowd Counting via Structured Knowledge Transfer , 2020, ACM Multimedia.

[29]  Stéphane Mallat,et al.  Rigid-Motion Scattering for Texture Classification , 2014, ArXiv.

[30]  Zhenbing Liu,et al.  Cell detection in pathology and microscopy images with multi-scale fully convolutional neural networks , 2018, World Wide Web.

[31]  George Papandreou,et al.  Rethinking Atrous Convolution for Semantic Image Segmentation , 2017, ArXiv.

[32]  Yu Cheng,et al.  Attend To Count: Crowd Counting with Adaptive Capacity Multi-scale CNNs , 2019, Neurocomputing.

[33]  Nan Wang,et al.  Counting challenging crowds robustly using a multi-column multi-task convolutional neural network , 2018, Signal Process. Image Commun..

[34]  M. F. Miswan,et al.  Red blood cell segmentation using masking and watershed algorithm: A preliminary study , 2012, 2012 International Conference on Biomedical Engineering (ICoBE).

[35]  Xiangyu Zhang,et al.  ShuffleNet V2: Practical Guidelines for Efficient CNN Architecture Design , 2018, ECCV.

[36]  Gang Yu,et al.  BiSeNet V2: Bilateral Network with Guided Aggregation for Real-Time Semantic Segmentation , 2020, International Journal of Computer Vision.

[37]  Andrew Zisserman,et al.  Learning To Count Objects in Images , 2010, NIPS.

[38]  Yuhong Li,et al.  CSRNet: Dilated Convolutional Neural Networks for Understanding the Highly Congested Scenes , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[39]  Andrew Zisserman,et al.  Class-Agnostic Counting , 2018, ACCV.

[40]  Rahul Kumar Gupta,et al.  Detection and Counting of Red Blood Cells in Blood Cell Images using Hough Transform , 2012 .

[41]  Ayoub Al-Hamadi,et al.  Face Attribute Detection with MobileNetV2 and NasNet-Mobile , 2019, 2019 11th International Symposium on Image and Signal Processing and Analysis (ISPA).

[42]  Shiping Wen,et al.  Crowd Counting via Hierarchical Scale Recalibration Network , 2020, ECAI.

[43]  Gang Yu,et al.  BiSeNet: Bilateral Segmentation Network for Real-time Semantic Segmentation , 2018, ECCV.

[44]  Vishal M. Patel,et al.  HA-CCN: Hierarchical Attention-Based Crowd Counting Network , 2019, IEEE Transactions on Image Processing.

[45]  Andrew Zisserman,et al.  Interactive Object Counting , 2014, ECCV.

[46]  Xiangyu Zhang,et al.  ShuffleNet: An Extremely Efficient Convolutional Neural Network for Mobile Devices , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[47]  Jian Sun,et al.  ExFuse: Enhancing Feature Fusion for Semantic Segmentation , 2018, ECCV.