Multi target pigs tracking loss correction algorithm based on Faster R-CNN

In order to solve the problem that target tracking frames are lost during the visual tracking of pigs, this research proposed an algorithm for multi target pigs tracking loss correction based on Faster R-CNN. The video of live pigs was processed by Faster R-CNN to get the object bounding box. Then, the SURF and background difference method were combined to predict whether the target pig will be occluded in the next frame. According to the occlusion condition, the maximum value of the horizontal and vertical coordinate offset of the bounding box in the adjacent two frames of the frame image in continuous N (N is the value of the video frame rate) were calculated. When bounding boxes in a video frame are merged into one bounding box, this maximum value was used to correct the current tracking frame offset in order to achieve the purpose of solving the tracking target loss problem. The experiment results showed that the success rate range of RP Faster-RCNN in the data set was 80%-97% while in term of Faster-RCNN was 40%-85%. And the average center point error of RP Faster-RCNN was 1.46 lower than Faster-RCNN which was about 2.60. The new algorithm was characterized by good robustness and adaptability, which could solve the problem of missing tracking target and accurately track multiple targets when the targets occlude each other. Keywords: object tracking, Faster-RCNN, individual pig, target occlusion DOI: 10.25165/j.ijabe.20181105.4232 Citation: Sun L Q, Zou Y B, Li Y, Cai Z D, Li Y, Luo B, et al. Multi target pigs tracking loss correction algorithm based on Faster R-CNN. Int J Agric & Biol Eng, 2018; 11(5): 192–197.

[1]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[3]  Yongwha Chung,et al.  An index algorithm for tracking pigs in pigsty , 2014 .

[4]  P. Sanders,et al.  On the Manhattan-Distance Between Points on Space-Filling Mesh-Indexings , 1996 .

[5]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Matthijs C. Dorst.  Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[7]  Yi Wu,et al.  Online Object Tracking: A Benchmark , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[8]  Wenguan Wang,et al.  Occlusion-Aware Real-Time Object Tracking , 2017, IEEE Transactions on Multimedia.

[9]  Song Han,et al.  Deep Compression: Compressing Deep Neural Network with Pruning, Trained Quantization and Huffman Coding , 2015, ICLR.

[10]  Cordelia Schmid,et al.  Occlusion and Motion Reasoning for Long-Term Tracking , 2014, ECCV.

[11]  Jun Li,et al.  Automatic Monitoring of Pig Excretory Behavior Based on Motion Feature , 2014 .

[12]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[13]  Koen E. A. van de Sande,et al.  Selective Search for Object Recognition , 2013, International Journal of Computer Vision.

[14]  Martín Abadi,et al.  TensorFlow: learning functions at scale , 2016, ICFP.

[15]  Amit K. Roy-Chowdhury,et al.  Distributed Multi-Target Tracking and Data Association in Vision Networks , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Ming-Hsuan Yang,et al.  Hierarchical Convolutional Features for Visual Tracking , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[17]  Fabio Poiesi,et al.  Online Multi-target Tracking with Strong and Weak Detections , 2016, ECCV Workshops.

[18]  Xiaogang Wang,et al.  Deeply learned face representations are sparse, selective, and robust , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[19]  Cordelia Schmid,et al.  Online Object Tracking with Proposal Selection , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[20]  Claudia Arcidiacono,et al.  A computer vision-based system for the automatic detection of lying behaviour of dairy cows in free-stall barns , 2013 .

[21]  Sun Longqing,et al.  Individual pig object detection algorithm based on Gaussian mixture model , 2017 .

[22]  Konrad Schindler,et al.  An analytical formulation of global occlusion reasoning for multi-target tracking , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).

[23]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..