Cow identification based on fusion of deep parts features

Livestock identification is of great significance for achieving precision livestock farming as it is a prerequisite of modern livestock management and automatic behaviour analysis. With respect to cow identification, methods based on computer vision have been widely considered due to their advantage of non-contact and practicality. In this paper, a novel non-contact cow identification method based on fusion of deep parts features is proposed. First, a set of side-view images of cows were captured, and then the YOLO object detection model was applied to locate the cow object in each original image, which was then divided into three parts, head, trunk and legs, by a part segmentation algorithm using frame differencing and segmentation span analysis. Then, three independent convolutional neural networks (CNNs) were trained to extract deep features from these three parts, and a feature fusion strategy was designed to fuse the features, i.e., deep parts feature fusion. Finally, a support vector machine (SVM) classifier trained by the fused features was used to identify each individual cow. The proposed method achieved 98.36% cow identification accuracy on a dataset containing side-view images of 93 cows, which outperformed existing works. Experimental results showed the effectiveness of the proposed cow identification method and the good potential for this method in individual identification of other livestock.

[1]  Lin Wang,et al.  Automatic individual identification of Holstein dairy cows using tailhead images , 2017 .

[2]  D M Weary,et al.  Technical note: Validation of a system for monitoring feeding behavior of dairy cows. , 2003, Journal of dairy science.

[3]  Matteo Barbari,et al.  Spatial identification of animals in different breeding systems to monitor behavior. , 2008 .

[4]  Alejandro Zunino,et al.  Body condition estimation on cows from depth images using Convolutional Neural Networks , 2018, Comput. Electron. Agric..

[5]  Jian Sun,et al.  Individual identification of dairy cows based on convolutional neural networks , 2019, Multimedia Tools and Applications.

[6]  Ming Yang,et al.  DeepFace: Closing the Gap to Human-Level Performance in Face Verification , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Benjamin P. Neal,et al.  A quick, easy and non‐intrusive method for underwater volume and surface area evaluation of benthic organisms by 3D computer modelling , 2015 .

[8]  Lorenz Gygax,et al.  Accuracy and validation of a radar-based automatic local position measurement system for tracking dairy cows in free-stall barns , 2007 .

[9]  Du-Ming Tsai,et al.  A motion and image analysis method for automatic detection of estrus and mating behavior in cattle , 2014 .

[10]  Václav Snásel,et al.  Biometric cattle identification approach based on Weber's Local Descriptor and AdaBoost classifier , 2016, Comput. Electron. Agric..

[11]  Amit Kumar Singh,et al.  Deep Learning Framework for Recognition of Cattle Using Muzzle Point Image Pattern , 2018 .

[12]  H. Kühl,et al.  Animal biometrics: quantifying and detecting phenotypic appearance. , 2013, Trends in ecology & evolution.

[13]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[14]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[15]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[16]  Ke Wang,et al.  LSSA_CAU: An interactive 3d point clouds analysis software for body measurement of livestock with similar forms of cows or pigs , 2017, Comput. Electron. Agric..

[17]  Charalampos Z. Patrikakis,et al.  A complete farm management system based on animal identification using RFID technology , 2010 .

[18]  Pietro Perona,et al.  Microsoft COCO: Common Objects in Context , 2014, ECCV.

[19]  Dongjian He,et al.  FLYOLOv3 deep learning for key parts of dairy cow body detection , 2019, Comput. Electron. Agric..

[20]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[21]  Ilan Halachmi,et al.  3D Computer-vision system for automatically estimating heifer height and body mass , 2017, Biosystems Engineering.

[22]  Jukka Ahokas,et al.  Evaluation of instrumentation for cow positioning and tracking indoors , 2007 .

[23]  Yael Edan,et al.  Development of automatic body condition scoring using a low-cost 3-dimensional Kinect camera. , 2016, Journal of dairy science.

[24]  Santosh Kumar,et al.  Face Recognition of Cattle: Can it be Done? , 2016, Proceedings of the National Academy of Sciences, India Section A: Physical Sciences.

[25]  Ben. G. Weinstein A computer vision for animal ecology. , 2018, The Journal of animal ecology.

[26]  Claudia Arcidiacono,et al.  The automatic detection of dairy cow feeding and standing behaviours in free-stall barns by a computer vision-based system , 2015 .

[27]  A. H. Ipema,et al.  Validation and application of an indoor localization system for animals , 2013 .

[28]  K. Abdul Jabbar,et al.  Early and non-intrusive lameness detection in dairy cows using 3-dimensional video , 2017 .

[29]  Claudia Arcidiacono,et al.  A computer vision-based system for the automatic detection of lying behaviour of dairy cows in free-stall barns , 2013 .

[30]  Li Yang,et al.  Automatic monitoring system for individual dairy cows based on a deep learning framework that provides identification via body parts and estimation of body condition score. , 2019, Journal of dairy science.

[31]  Claudia Arcidiacono,et al.  Localisation and identification performances of a real-time location system based on ultra wide band technology for monitoring and tracking dairy cow behaviour in a semi-open free-stall barn , 2014 .

[32]  F Universit,et al.  Recognition of individual dairy cattle based on convolutional neural networks , 2015 .

[33]  Andrea Pezzuolo,et al.  A Feasibility Study on the Use of a Structured Light Depth-Camera for Three-Dimensional Body Measurements of Dairy Cows in Free-Stall Barns , 2018, Sensors.

[34]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[35]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[36]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, International Journal of Computer Vision.

[37]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[38]  Wolfgang Junge,et al.  A multi-Kinect cow scanning system: Calculating linear traits from manually marked recordings of Holstein-Friesian dairy cows , 2017 .

[39]  Pietro Perona,et al.  One-shot learning of object categories , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[40]  Sanja Fidler,et al.  Detect What You Can: Detecting and Representing Objects Using Holistic Models and Body Parts , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[41]  Saeid Nahavandi,et al.  Semantic body parts segmentation for quadrupedal animals , 2016, 2016 IEEE International Conference on Systems, Man, and Cybernetics (SMC).