Chicken Image Segmentation via Multi-Scale Attention-Based Deep Convolutional Neural Network

Accurate segmentation and analysis for each animal in surveillance video images will help poultry farmers to monitor and promote animal welfare. However, it is challenging to accurately segment each animal due to the similar appearance, different scales, rapid growth and adhesive areas of group animals. Meanwhile, lacking of useful training data also limits the effectiveness of animal segmentation algorithms. To address these problems, we first construct a chicken image segmentation dataset to study the behavior of chickens for intelligent monitoring and analysis. Then, we propose an effective end-to-end framework for chicken image segmentation, which can also be used for other animal image segmentation. An end-to-end multi-scale based encoder-decoder network is first utilized to extract multi-scale features. Then, an attention-based module is employed to extract and intensify effective features, thus better segmentation results can be obtained. Finally, a multi-output combined loss function is proposed to make effective supervision for better segmentation. Experimental results demonstrate the promising performance of the proposed framework for chicken image segmentation.

[1]  Deqin Xiao,et al.  Feeding behavior recognition for group-housed pigs with the Faster R-CNN , 2018, Comput. Electron. Agric..

[2]  Zhuowen Tu,et al.  Aggregated Residual Transformations for Deep Neural Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[3]  Ross B. Girshick,et al.  Mask R-CNN , 2017, 1703.06870.

[4]  Weixing Zhu,et al.  Multi-object extraction from topview group-housed pig images based on adaptive partitioning and multilevel thresholding segmentation , 2015 .

[5]  Roberto Cipolla,et al.  SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Lei Zhang,et al.  Automatic individual pig detection and tracking in surveillance videos , 2018, ArXiv.

[7]  Daniel Berckmans,et al.  Automatic Identification of Marked Pigs in a Pen Using Image Pattern Recognition , 2013, MDA.

[8]  Wei Li,et al.  DeepUNet: A Deep Fully Convolutional Network for Pixel-Level Sea-Land Segmentation , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[9]  S. Dwivedi,et al.  Obesity May Be Bad: Compressed Convolutional Networks for Biomedical Image Segmentation , 2020 .

[10]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[11]  Steven C. H. Hoi,et al.  Salient Object Detection With Pyramid Attention and Salient Edges , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  Hairong Zheng,et al.  CLCI-Net: Cross-Level fusion and Context Inference Networks for Lesion Segmentation of Chronic Stroke , 2019, MICCAI.

[13]  Qingjie Liu,et al.  Road Extraction by Deep Residual U-Net , 2017, IEEE Geoscience and Remote Sensing Letters.

[14]  Yongchao Gong,et al.  Mask Scoring R-CNN , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[15]  George Papandreou,et al.  MaskLab: Instance Segmentation by Refining Object Detection with Semantic and Direction Features , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[16]  B. Sturm,et al.  Implementation of machine vision for detecting behaviour of cattle and pigs , 2017 .

[17]  M. Dawkins A user's guide to animal welfare science. , 2006, Trends in ecology & evolution.

[18]  Christer Bergsten,et al.  Learning Based Image Segmentation of Pigs in a Pen , 2014 .

[19]  Xunmu Zhu,et al.  Automatic recognition of lactating sow postures from depth images by deep learning detector , 2018, Comput. Electron. Agric..

[20]  Yong Xia,et al.  D-UNet: A Dimension-Fusion U Shape Network for Chronic Stroke Lesion Segmentation , 2019, IEEE/ACM Transactions on Computational Biology and Bioinformatics.

[21]  Hong Chen,et al.  Automated pig counting using deep learning , 2019, Comput. Electron. Agric..

[22]  Vijayan K. Asari,et al.  Recurrent Residual Convolutional Neural Network based on U-Net (R2U-Net) for Medical Image Segmentation , 2018, ArXiv.

[23]  Jean-Marie Aerts,et al.  Is precision livestock farming an engineer's daydream or nightmare, an animal's friend or foe, and a farmer's panacea or pitfall? , 2008 .

[24]  Ross B. Girshick,et al.  Fast R-CNN , 2015, 1504.08083.

[25]  Xinlei Chen,et al.  TensorMask: A Foundation for Dense Object Segmentation , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[26]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[27]  Joris IJsselmuiden,et al.  Object discrimination in poultry housing using spectral reflectivity , 2018 .

[28]  Andrew J. Davison,et al.  End-To-End Multi-Task Learning With Attention , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[29]  Kehan Qi,et al.  MSDF-Net: Multi-Scale Deep Fusion Network for Stroke Lesion Segmentation , 2019, IEEE Access.

[30]  Ruigang Yang,et al.  Channel Attention Based Iterative Residual Learning for Depth Map Super-Resolution , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[31]  Ruigang Yang,et al.  ApolloCar3D: A Large 3D Car Instance Understanding Benchmark for Autonomous Driving , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[32]  Jaume Bacardit,et al.  Automated Individual Pig Localisation, Tracking and Behaviour Metric Extraction Using Deep Learning , 2019, IEEE Access.

[33]  Xiaochun Cao,et al.  Joint Optic Disc and Cup Segmentation Based on Multi-Label Deep Network and Polar Transformation , 2018, IEEE Transactions on Medical Imaging.

[34]  Jian Sun,et al.  Guided Image Filtering , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[35]  Melvyn L. Smith,et al.  Towards on-farm pig face recognition using convolutional neural networks , 2018, Comput. Ind..

[36]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[37]  Abhishek Dutta,et al.  The VIA Annotation Software for Images, Audio and Video , 2019, ACM Multimedia.

[38]  Shihao Zhang,et al.  Guided M-Net for High-Resolution Biomedical Image Segmentation with Weak Boundaries , 2019, OMIA@MICCAI.

[39]  Qiegen Liu,et al.  X-Net: Brain Stroke Lesion Segmentation Based on Depthwise Separable Convolution and Long-range Dependencies , 2019, MICCAI.

[40]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[41]  Weixing Zhu,et al.  Foreground detection of group-housed pigs based on the combination of Mixture of Gaussians using prediction mechanism and threshold segmentation , 2014 .