A computer vision-based method for spatial-temporal action recognition of tail-biting behaviour in group-housed pigs

As a typical harmful social behaviour, tail biting is considered to be a welfare-reducing problem with economic consequences for pig production. Taking a computer-vision based approach, in this study, we have developed a novel method to automatically identify and locate tail-biting interactions in group-housed pigs. The method employs a tracking-by-detection algorithm to simplify the group-level behaviour to pairwise interactions. Then, a convolution neural network (CNN) and a recurrent neural network (RNN) are combined to extract the spatial-temporal features and classify behaviour categories. The performance of the proposed method was evaluated by quantifying the localisation accuracy and behaviour classification accuracy. The results demonstrate that the tracking-by-detection approach is capable of obtaining the trajectories of biters and victims with a localisation accuracy of 92.71%. The spatial-temporal features trained by CNN and RNN are robust and effective with a category accuracy of 96.25%. In total, our proposed method is capable to identify and locate 89.23% of tail-biting behaviour in group-housed pigs.

[1]  Xunmu Zhu,et al.  Automatic recognition of lactating sow postures from depth images by deep learning detector , 2018, Comput. Electron. Agric..

[2]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[3]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[4]  Daniel Berckmans,et al.  Classification of aggressive behaviour in pigs by activity index and multilayer feed forward neural network , 2014 .

[5]  Weixing Zhu,et al.  Recognition of aggressive episodes of pigs based on convolutional neural network and long short-term memory , 2020, Comput. Electron. Agric..

[6]  L. Pedersen,et al.  Changes in activity and object manipulation before tail damage in finisher pigs as an early detector of tail biting. , 2019, Animal : an international journal of animal bioscience.

[7]  Eric Psota,et al.  Multi-Pig Part Detection and Association with a Fully-Convolutional Network , 2019, Sensors.

[8]  B Kemp,et al.  Characteristics of biter and victim piglets apparent before a tail-biting outbreak. , 2011, Animal : an international journal of animal bioscience.

[9]  Sergio Guadarrama,et al.  Speed/Accuracy Trade-Offs for Modern Convolutional Object Detectors , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[10]  Dries Berckmans,et al.  Precision Livestock Farming: An international review of scientific and commercial aspects , 2012 .

[11]  Pietro Perona,et al.  Microsoft COCO: Common Objects in Context , 2014, ECCV.

[12]  Weixing Zhu,et al.  Detection of aggressive behaviours in pigs using a RealSence depth sensor , 2019, Comput. Electron. Agric..

[13]  Daniel Berckmans,et al.  Tail biting in pigs--causes and management intervention strategies to reduce the behavioural disorder. A review. , 2013, Berliner und Munchener tierarztliche Wochenschrift.

[14]  Chen Chen,et al.  Image motion feature extraction for recognition of aggressive behaviors among group-housed pigs , 2017, Comput. Electron. Agric..

[15]  Qiming Zhu,et al.  Automatic early warning of tail biting in pigs: 3D cameras can detect lowered tail posture before an outbreak , 2018, PloS one.

[16]  Trevor Darrell,et al.  Long-term recurrent convolutional networks for visual recognition and description , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[17]  Xindong Wu,et al.  Object Detection With Deep Learning: A Review , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[18]  David C J Main,et al.  Tail-biting: a new perspective. , 2010, Veterinary journal.

[19]  Michael T Mendl,et al.  Predicting tail-biting from behaviour of pigs prior to outbreaks , 2009 .

[20]  Ronan Collobert,et al.  Learning to Segment Object Candidates , 2015, NIPS.

[21]  Weixing Zhu,et al.  A kinetic energy model based on machine vision for recognition of aggressive behaviours among group-housed pigs , 2018, Livestock Science.

[22]  Andrew W. Senior,et al.  Long short-term memory recurrent neural network architectures for large scale acoustic modeling , 2014, INTERSPEECH.

[23]  Luc Van Gool,et al.  The Pascal Visual Object Classes (VOC) Challenge , 2010, International Journal of Computer Vision.

[24]  Kai Chen,et al.  MMDetection: Open MMLab Detection Toolbox and Benchmark , 2019, ArXiv.

[25]  Håkan Ardö,et al.  Convolutional neural network-based cow interaction watchdog , 2017, IET Comput. Vis..

[26]  Wei Liu,et al.  SSD: Single Shot MultiBox Detector , 2015, ECCV.

[27]  Ilias Kyriazakis,et al.  Early detection of health and welfare compromises through automated detection of behavioural changes in pigs , 2016, Veterinary journal.

[28]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[29]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[30]  Stefano Viazzi,et al.  Image feature extraction for classification of aggressive interactions among pigs , 2014 .

[31]  Cornelis G. van Reenen,et al.  Tail biting behaviour and tail damage in pigs and the relationship with general behaviour: Predicting the inevitable? , 2014 .

[32]  Yongwha Chung,et al.  Automatic Recognition of Aggressive Behavior in Pigs Using a Kinect Depth Sensor , 2016, Sensors.

[33]  Andrew Zisserman,et al.  Convolutional Two-Stream Network Fusion for Video Action Recognition , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[34]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[35]  Ross B. Girshick,et al.  Fast R-CNN , 2015, 1504.08083.

[36]  David J. Mellor,et al.  Updating Animal Welfare Thinking: Moving beyond the “Five Freedoms” towards “A Life Worth Living” , 2016, Animals : an open access journal from MDPI.

[37]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[38]  Lorenzo Torresani,et al.  Learning Spatiotemporal Features with 3D Convolutional Networks , 2014, 2015 IEEE International Conference on Computer Vision (ICCV).

[39]  Ali Farhadi,et al.  YOLOv3: An Incremental Improvement , 2018, ArXiv.

[40]  Deqin Xiao,et al.  Feeding behavior recognition for group-housed pigs with the Faster R-CNN , 2018, Comput. Electron. Agric..