Towards on-farm pig face recognition using convolutional neural networks

Abstract Identification of individual livestock such as pigs and cows has become a pressing issue in recent years as intensification practices continue to be adopted and precise objective measurements are required (e.g. weight). Current best practice involves the use of RFID tags which are time-consuming for the farmer and distressing for the animal to fit. To overcome this, non-invasive biometrics are proposed by using the face of the animal. We test this in a farm environment, on 10 individual pigs using three techniques adopted from the human face recognition literature: Fisherfaces, the VGG-Face pre-trained face convolutional neural network (CNN) model and our own CNN model that we train using an artificially augmented data set. Our results show that accurate individual pig recognition is possible with accuracy rates of 96.7% on 1553 images. Class Activated Mapping using Grad-CAM is used to show the regions that our network uses to discriminate between pigs.

[1]  Adrian R. Allen,et al.  Evaluation of retinal imaging technology for the biometric identification of bovine animals in Northern Ireland , 2008 .

[2]  Kunihiko Fukushima,et al.  Neocognitron: A self-organizing neural network model for a mechanism of pattern recognition unaffected by shift in position , 1980, Biological Cybernetics.

[3]  Kristof Mertens,et al.  Validation of a High Frequency Radio Frequency Identification (HF RFID) system for registering feeding patterns of growing-finishing pigs , 2014 .

[4]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[5]  Torben Gregersen,et al.  Original papers: Development of a real-time computer vision system for tracking loose-housed pigs , 2011 .

[6]  Claudia Arcidiacono,et al.  A computer vision-based system for the automatic detection of lying behaviour of dairy cows in free-stall barns , 2013 .

[7]  Andrew Zisserman,et al.  Deep Face Recognition , 2015, BMVC.

[8]  David J. Kriegman,et al.  Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection , 1996, ECCV.

[9]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[10]  A. Valros,et al.  Tear staining in pigs: a potential tool for welfare assessment on commercial farms. , 2016, Animal : an international journal of animal bioscience.

[11]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[12]  Claudia Arcidiacono,et al.  The automatic detection of dairy cow feeding and standing behaviours in free-stall barns by a computer vision-based system , 2015 .

[13]  Sanjay Kumar Singh,et al.  Monitoring of pet animal in smart cities using animal biometrics , 2016, Future Gener. Comput. Syst..

[14]  Abhishek Das,et al.  Grad-CAM: Why did you say that? , 2016, ArXiv.

[15]  Václav Snásel,et al.  Biometric cattle identification approach based on Weber's Local Descriptor and AdaBoost classifier , 2016, Comput. Electron. Agric..

[16]  C. Arcidiacono,et al.  Development of a threshold-based classifier for real-time recognition of cow feeding and standing behavioural activities from accelerometer data , 2017, Comput. Electron. Agric..

[17]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[18]  Amit Kumar Singh,et al.  Muzzle point pattern based techniques for individual cattle identification , 2017, IET Image Process..

[19]  Aboul Ella Hassanien,et al.  Cattle Identification Based on Muzzle Images Using Gabor Features and SVM Classifier , 2014, AMLTA.

[20]  Francis Butler,et al.  Assessment of retinal recognition technology as a biometric method for sheep identification , 2008 .

[21]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[22]  Rama Chellappa,et al.  Face Processing: Advanced Modeling and Methods , 2006, J. Electronic Imaging.

[23]  Ah Chung Tsoi,et al.  Face recognition: a convolutional neural-network approach , 1997, IEEE Trans. Neural Networks.

[24]  Ming Yang,et al.  DeepFace: Closing the Gap to Human-Level Performance in Face Verification , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[25]  Marwan Mattar,et al.  Labeled Faces in the Wild: A Database forStudying Face Recognition in Unconstrained Environments , 2008 .