An Enhanced Mask R-CNN for Herd Segmentation

Livestock image segmentation is an important task in the field of vision and image processing. Since utilizing the concentration of forage in the grazing area with shielding the surrounding farm plants and crops is necessary for making effective cattle ranch arrangement, there is a need for a segmentation method that can handle multiple objects segmentation. Moreover, the indistinct boundaries and irregular shapes of cattle bodies discourage the application of the existing Mask R-CNN which was primarily modeled for the segmentation of natural images. To address this, an enhanced Mask R-CNN method is proposed for multiple objects instance segmentation to support indistinct boundaries and irregular shapes of cattle body for precision livestock farming. The contributions of this method are in multiple folds: (1) provision of optimal filter size that was smaller than ResNet101 (the backbone of Mask R-CNN) for the extraction of smaller and composite features, thereby, the number of parameters required for the training was decreased; (2) utilization of multiscale semantic features using region proposals and (3) fully connected layer of existing Mask R-CNN integrated with a sub-network for enhanced segmentation. The experiment conducted on pre-processed datasets produced 0.93 mAP higher than any results from existing state-of-the-art methods.

[1]  R. T. Oglesby Challenges in the Face of Uncertainty , 1992 .

[2]  Ahmad Sufril Azlan Mohamed,et al.  Image-based Individual Cow Recognition using Body Patterns , 2020 .

[3]  Pietro Perona,et al.  Microsoft COCO: Common Objects in Context , 2014, ECCV.

[4]  Joachim Krieter,et al.  Instance Segmentation with Mask R-CNN Applied to Loose-Housed Dairy Cows in a Multi-Camera Setting , 2020, Animals : an open access journal from MDPI.

[5]  R. W. Bello,et al.  Development of a Software Package for Cattle Identification in Nigeria , 2019 .

[6]  P. Feindt,et al.  The Quantified Animal: Precision Livestock Farming and the Ethical Implications of Objectification , 2018, Food Ethics.

[7]  Ronan Collobert,et al.  Learning to Refine Object Segments , 2016, ECCV.

[8]  Ross B. Girshick,et al.  Fast R-CNN , 2015, 1504.08083.

[9]  Melvyn L. Smith,et al.  Automated monitoring of dairy cow body condition, mobility and weight using a single 3D video capture device , 2018, Comput. Ind..

[10]  Jitendra Malik,et al.  Iterative Instance Segmentation , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[11]  Rotimi-Williams BELLO,et al.  Deep Learning-Based Architectures for Recognition of Cow Using Cow Nose Image Pattern , 2020, GAZI UNIVERSITY JOURNAL OF SCIENCE.

[12]  Jian Sun,et al.  Instance-Aware Semantic Segmentation via Multi-task Network Cascades , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[13]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Jaewook Jung,et al.  Building Extraction from Satellite Images Using Mask R-CNN with Building Boundary Regularization , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[15]  Kang Xi,et al.  Automatic recognition of dairy cow mastitis from thermal images by a deep learning detector , 2020, Comput. Electron. Agric..

[16]  George Papandreou,et al.  MaskLab: Instance Segmentation by Refining Object Detection with Semantic and Direction Features , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[17]  Dongjian He,et al.  Automatic detection of ruminant cows’ mouth area during rumination based on machine vision and video analysis technology , 2019, International Journal of Agricultural and Biological Engineering.

[18]  Yubin Lan,et al.  Novel method for real-time detection and tracking of pig body and its different parts , 2020 .

[19]  Jintao Liu,et al.  Method for segmentation of overlapping fish images in aquaculture , 2019 .

[20]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Yuan Yu,et al.  TensorFlow: A system for large-scale machine learning , 2016, OSDI.

[22]  Robert Ross,et al.  Beef Cattle Instance Segmentation Using Fully Convolutional Neural Network , 2018, BMVC.

[23]  Antonio Torralba,et al.  LabelMe: A Database and Web-Based Tool for Image Annotation , 2008, International Journal of Computer Vision.

[24]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[25]  Ahmad Sufril Azlan Mohamed,et al.  Contour Extraction of Individual Cattle From an Image Using Enhanced Mask R-CNN Instance Segmentation Method , 2021, IEEE Access.

[26]  Jitendra Malik,et al.  Region-Based Convolutional Networks for Accurate Object Detection and Segmentation , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  Ronan Collobert,et al.  Learning to Segment Object Candidates , 2015, NIPS.

[28]  Rotimi-Williams BELLO,et al.  Deep Belief Network Approach for Recognition of Cow using Cow Nose Image Pattern , 2021 .

[30]  Shaodi You,et al.  Cattle detection and counting in UAV images based on convolutional neural networks , 2019, International Journal of Remote Sensing.

[31]  K. Marshall,et al.  Using body measurements to estimate live weight of dairy cattle in low-input systems in Senegal , 2018 .

[32]  Ali Farhadi,et al.  YOLO9000: Better, Faster, Stronger , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[33]  Wensheng Zhang,et al.  Mask SSD: An Effective Single-Stage Approach to Object Instance Segmentation , 2020, IEEE Transactions on Image Processing.