An Improved Single Shot Multibox Detector Method Applied in Body Condition Score for Dairy Cows

Simple Summary Body condition score (BCS) is an important work for feeding management and cow welfare on the farm. The aim of our study is to assess the BCS automatically and replace the traditional manual method. In this study, we firstly built a non-contact and no-stress platform with a network camera, which can monitor the BCS of dairy cow remotely, and the back-view images of the cows were collected and the data set labeled by veterinary experts was built. Secondly, the improved Sing Shot multi-box Detector (SSD) algorithm was introduced to assess the BCS of each image. Finally, the experiments were carried out and the results showed the improved SSD had advantages of higher detecting speed and smaller model size compared with the original SSD. Abstract Body condition scores (BCS) is an important parameter, which is in high correlation with the health status of a dairy cow, metabolic disorder and milk composition during the production period. To evaluate BCS, the traditional methods rely on veterinary experts or skilled staff to look at a cow and touch it. These methods have low efficiency especially on large-scale farms. Computer vision methods are widely used but there are some improvements to increase BCS accuracy. In this study, a low cost BCS evaluation method based on deep learning and machine vision is proposed. Firstly, the back-view images of the cows are captured by network cameras, resulting in 8972 images that constituted the sample data set. The camera is a common 2D camera, which is cheaper and easier to install compared with 3D cameras. Secondly, the key body parts such as tails, pins and rump in the images were labeled manually, the Sing Shot multi-box Detector (SSD) method was used to detect the tail and evaluate the BCS. Inspired by DenseNet and Inception-v4, a new SSD was introduced by changing the network connection method of the original SSD. Finally, the experiments show that the improved SSD method can achieve 98.46% classification accuracy and 89.63% location accuracy, and it has: (1) faster detection speed with 115 fps; (2) smaller model size with 23.1 MB compared to original SSD and YOLO-v3, these are significant advantages for reducing hardware costs.

[1]  N. Friggens,et al.  On-farm estimation of energy balance in dairy cows using only frequent body weight measurements and body condition score. , 2012, Journal of dairy science.

[2]  Melvyn L. Smith,et al.  Automated monitoring of dairy cow body condition, mobility and weight using a single 3D video capture device , 2018, Comput. Ind..

[3]  J M Bewley,et al.  Potential for estimation of body condition scores in dairy cattle from digital images. , 2008, Journal of dairy science.

[4]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  J. Loor,et al.  Body condition score at calving affects systemic and hepatic transcriptome indicators of inflammation and nutrient metabolism in grazing dairy cows. , 2015, Journal of dairy science.

[6]  J. R. Gillespie Modern livestock & poultry production , 1983 .

[7]  S. Kersten,et al.  Effects of Body Condition and Concentrate Proportion of the Ration on Mobilization of Fat Depots and Energetic Condition in Dairy Cows during Early Lactation Based on Ultrasonic Measurements , 2019, Animals : an open access journal from MDPI.

[8]  Alejandro Zunino,et al.  Estimating Body Condition Score in Dairy Cows From Depth Images Using Convolutional Neural Networks, Transfer Learning and Model Ensembling Techniques , 2019, Agronomy.

[9]  Joseph Redmon,et al.  YOLOv3: An Incremental Improvement , 2018, ArXiv.

[10]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[11]  Yan Song,et al.  Inception Single Shot MultiBox Detector for object detection , 2017, 2017 IEEE International Conference on Multimedia & Expo Workshops (ICMEW).

[12]  J. Loor,et al.  Calving body condition score affects indicators of health in grazing dairy cows. , 2013, Journal of dairy science.

[13]  Guoliang He,et al.  Regression Analysis for Dairy Cattle Body Condition Scoring Based on Dorsal Images , 2018, IScIDE.

[14]  Zhiqiang Shen,et al.  DSOD: Learning Deeply Supervised Object Detectors from Scratch , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[15]  Р Ю Чуйков,et al.  Обнаружение транспортных средств на изображениях загородных шоссе на основе метода Single shot multibox Detector , 2017 .

[16]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[17]  K. Macdonald Condition Scoring Made Easy , 2004 .

[18]  Ikuo Kobayashi,et al.  Estimating body condition score of cows from images with the newly developed approach , 2017, 2017 18th IEEE/ACIS International Conference on Software Engineering, Artificial Intelligence, Networking and Parallel/Distributed Computing (SNPD).

[19]  Alejandro Zunino,et al.  Body condition estimation on cows from depth images using Convolutional Neural Networks , 2018, Comput. Electron. Agric..

[20]  J D Ferguson,et al.  Body condition assessment using digital images. , 2006, Journal of dairy science.

[21]  Sergey Ioffe,et al.  Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning , 2016, AAAI.

[22]  Ross B. Girshick,et al.  Fast R-CNN , 2015, 1504.08083.

[23]  Dr. Shailendra Narayan Singh,et al.  Region-based Object Detection and Classification using Faster R-CNN , 2018, 2018 4th International Conference on Computational Intelligence & Communication Technology (CICT).

[24]  Ikuo Kobayashi,et al.  An Automatic Estimation of Dairy Cow Body Condition Score Using Analytic Geometric Image Features , 2018, 2018 IEEE 7th Global Conference on Consumer Electronics (GCCE).

[25]  J. Elmore,et al.  Evaluation of age, weaning weight, body condition score, and reproductive tract score in pre-selected beef heifers relative to reproductive potential , 2019, Journal of Animal Science and Biotechnology.

[26]  Ikuo Kobayashi,et al.  Automatic evaluation of Cow's body-condition-score using 3D camera , 2017, 2017 IEEE 6th Global Conference on Consumer Electronics (GCCE).

[27]  Wei Liu,et al.  SSD: Single Shot MultiBox Detector , 2015, ECCV.

[28]  Ilan Halachmi,et al.  Automatic assessment of dairy cattle body condition score using thermal imaging , 2013 .

[29]  Yael Edan,et al.  Development of automatic body condition scoring using a low-cost 3-dimensional Kinect camera. , 2016, Journal of dairy science.

[30]  Hayato Ohwada,et al.  Automatic Measurement and Determination of Body Condition Score of Cows Based on 3D Images Using CNN , 2018, J. Robotics Mechatronics.

[31]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[32]  P. E. Wagner,et al.  A Dairy Cow Body Condition Scoring System and Its Relationship to Selected Production Characteristics , 1982 .