FLYOLOv3 deep learning for key parts of dairy cow body detection

Abstract Accurate detection of the key parts of dairy cows is important to the intelligent behavior perception of cows. Owing to the complex background of dairy farms, the object characteristics of dairy cows are not obvious, and traditional object detection algorithms cannot detect the key parts with high precision. In this study, a deep learning network named FLYOLOv3 (FilterLayer YOLOv3) based on FilterLayer was tested to achieve the detection of key parts of dairy cows in complex scenes. Since images are unstable during the training process and initialization, particle noise was generated in feature maps after convolution. Therefore, the mean filtering algorithm was carried out, and a leaky rectifier function (Leaky ReLU) was applied to integrate the custom FilterLayer layer to reduce training interference. The artificial annotation was used firstly to mark the borders of the cow's head, back and legs in 1000 cow images, and then the FLYOLOv3 network was trained with the labeled samples. Finally, in order to verify the effectiveness of the algorithm, 500 images were randomly selected from 1000 cow images as the original training images, and the remaining images were used as test images. The proposed method was compared with the Faster R-CNN and YOLOv3 algorithm by using indicators such as accuracy, recall rate, average frame rate, and average accuracy. Test results showed that the accuracy of FLYOLOv3 algorithm was 99.18%, the recall rate was 97.51%, the average frame rate was 21 f/s, and the average precision was 93.73%. All the results showed that the proposed algorithm could be used for high-precision detection of the key parts of dairy cows.

[1]  Earnest Paul Ijjina,et al.  Illumination invariant face recognition using convolutional neural networks , 2015, 2015 IEEE International Conference on Signal Processing, Informatics, Communication and Energy Systems (SPICES).

[2]  Luc Van Gool,et al.  The Pascal Visual Object Classes (VOC) Challenge , 2010, International Journal of Computer Vision.

[3]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Alejandro Zunino,et al.  Body condition estimation on cows from depth images using Convolutional Neural Networks , 2018, Comput. Electron. Agric..

[5]  Gabriel Thomas,et al.  Human Activity Recognition using Binary Motion Image and Deep Learning , 2015, Procedia Computer Science.

[6]  Zhao Kaixuan,et al.  Target detection method for moving cows based on background subtraction , 2015 .

[7]  Klaus D. Tönnies,et al.  Vertebral body segmentation in wide range clinical routine spine MRI data , 2018, Comput. Methods Programs Biomed..

[8]  P. Hemsworth,et al.  Lame cows on Australian dairy farms: A comparison of farmer-identified lameness and formal lameness scoring, and the position of lame cows within the milking order. , 2019, Journal of dairy science.

[9]  N. Chapinal,et al.  Validation of an automated method to count steps while cows stand on a weighing platform and its application as a measure to detect lameness. , 2012, Journal of dairy science.

[10]  J. Gatien,et al.  Can video cameras replace visual estrus detection in dairy cows? , 2012, Theriogenology.

[11]  Haider A. Alwzwazy,et al.  Handwritten Digit Recognition Using Convolutional Neural Networks , 2016 .

[12]  Hayato Ohwada,et al.  Automatic Measurement and Determination of Body Condition Score of Cows Based on 3D Images Using CNN , 2018, J. Robotics Mechatronics.

[13]  Huchuan Lu,et al.  Human body segmentation in static images by models with shape as guidance , 2018, Neurocomputing.

[14]  Dina Khattab,et al.  Modified GrabCut for human face segmentation , 2014 .

[15]  Bo Jiang,et al.  Lameness detection of dairy cows based on a double normal background statistical model , 2019, Comput. Electron. Agric..

[16]  Sheikh Abujar,et al.  Bangla Handwritten Digit Recognition Using Convolutional Neural Network , 2018, Advances in Intelligent Systems and Computing.

[17]  Lianwen Jin,et al.  DropSample: A New Training Method to Enhance Deep Convolutional Neural Networks for Large-Scale Unconstrained Handwritten Chinese Character Recognition , 2015, Pattern Recognit..

[18]  Steven C. H. Hoi,et al.  Face Detection using Deep Learning: An Improved Faster RCNN Approach , 2017, Neurocomputing.

[19]  Christian Ammon,et al.  Monitoring the body temperature of cows and calves using video recordings from an infrared thermography camera , 2012, Veterinary Research Communications.

[20]  Hari Om,et al.  Newborn face recognition using deep convolutional neural network , 2017, Multimedia Tools and Applications.