Estimation of Muscle Scores of Live Pigs Using a Kinect Camera

The muscle grading of livestock is a primary component of valuation in the meat industry. In pigs, the muscularity of a live animal is traditionally estimated by visual and tactile inspection from an experienced assessor. In addition to being a time-consuming process, scoring of this kind suffers from inconsistencies inherent to the subjectivity of human assessment. On the other hand, accurate, computer-driven methods for carcass composition estimation, such as magnetic resonance imaging (MRI) and computed tomography scans (CT-scans), are expensive and cumbersome to both the animals and their handlers. In this paper, we propose a method that is fast, inexpensive, and non-invasive for estimating the muscularity of live pigs, using RGB-D computer vision and machine learning. We used morphological features extracted from the depth images of pigs to train a classifier that estimates the muscle scores that are likely to be given by a human assessor. The depth images were obtained from a Kinect v1 camera which was placed over an aisle through which the pigs passed freely. The data came from 3246 pigs, each having 20 depth images, and a muscle score from 1 to 7 (reduced later to 5 scores) assigned by an experienced assessor. The classification based on morphological features of the pig’s body shape–using a gradient boosted classifier–resulted in a mean absolute error of 0.65 in tenfold cross-validation. Notably, the majority of the errors corresponded to pigs being classified as having muscle scores adjacent to the groundtruth labels given by the assessor. According to the end users of this application, the proposed approach could be used to replace expert assessors at the farm.

[1]  Wei Li,et al.  Validity of the Microsoft Kinect sensor for assessment of normal walking patterns in pigs , 2015, Comput. Electron. Agric..

[2]  Tianqi Chen,et al.  XGBoost: A Scalable Tree Boosting System , 2016, KDD.

[3]  A. D. Mitchell,et al.  Non-invasive methods for the determination of body and carcass composition in livestock: dual-energy X-ray absorptiometry, computed tomography, magnetic resonance imaging and ultrasound: invited review , 2015, Animal : an international journal of animal bioscience.

[4]  Lars Drugge,et al.  Machine learning to classify and predict objective and subjective assessments of vehicle dynamics: the case of steering feel , 2018 .

[5]  Andrew Hines,et al.  Objective Assessment of Perceptual Audio Quality Using ViSQOLAudio , 2017, IEEE Transactions on Broadcasting.

[6]  Zhengyou Zhang,et al.  Microsoft Kinect Sensor and Its Effect , 2012, IEEE Multim..

[7]  Mark J. Carlotto,et al.  Effect of errors in ground truth on classification accuracy , 2009 .

[8]  Lucia Maddalena,et al.  Background Subtraction for Moving Object Detection in RGBD Data: A Survey , 2018, J. Imaging.

[9]  Yongwha Chung,et al.  Automatic Recognition of Aggressive Behavior in Pigs Using a Kinect Depth Sensor , 2016, Sensors.

[10]  Alina Delia Calin,et al.  Interchangeability of Kinect and Orbbec Sensors for Gesture Recognition , 2018, 2018 IEEE 14th International Conference on Intelligent Computer Communication and Processing (ICCP).

[11]  Marjorie Skubic,et al.  VicoVR-Based Wireless Daily Activity Recognition and Assessment System for Stroke Rehabilitation , 2018, 2018 IEEE International Conference on Bioinformatics and Biomedicine (BIBM).

[12]  M. Gispert,et al.  Predicting fat, lean and the weights of primal cuts for growing pigs of different genotypes and sexes using computed tomography. , 2015, Journal of animal science.

[13]  Mark W. Schmidt,et al.  3D Variational Brain Tumor Segmentation using a High Dimensional Feature Set , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[14]  M. Gispert,et al.  Imaging technologies to study the composition of live pigs: A review , 2016 .

[15]  Xinhua Zhuang,et al.  Image Analysis Using Mathematical Morphology , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  J. A. Marchant,et al.  Pig growth and conformation monitoring using image analysis , 1999 .

[17]  Andrea Pezzuolo,et al.  On-barn pig weight estimation based on body measurements by a Kinect v1 depth camera , 2018, Comput. Electron. Agric..

[18]  Eirini Liotou,et al.  No-reference video quality measurement: added value of machine learning , 2015, J. Electronic Imaging.

[19]  Massimo Piccardi,et al.  Background subtraction techniques: a review , 2004, 2004 IEEE International Conference on Systems, Man and Cybernetics (IEEE Cat. No.04CH37583).

[20]  Jørgen Kongsro,et al.  Estimation of pig weight using a Microsoft Kinect prototype imaging system , 2014 .

[21]  H. R. Cross,et al.  Beef Carcass Evaluation by Use of a Video Image Analysis System , 1983 .

[22]  M. Gispert,et al.  Estimation of carcass composition and cut composition from computed tomography images of live growing pigs of different genotypes. , 2015, Animal : an international journal of animal bioscience.

[23]  Andrea Esuli,et al.  Evaluation Measures for Ordinal Regression , 2009, 2009 Ninth International Conference on Intelligent Systems Design and Applications.

[24]  Ilias Kyriazakis,et al.  Early detection of health and welfare compromises through automated detection of behavioural changes in pigs , 2016, Veterinary journal.

[25]  Colin T. Whittemore,et al.  The relationship between the body shape of living pigs and their carcass morphology and composition. , 2004 .

[26]  Ronald M. Summers,et al.  Machine learning and radiology , 2012, Medical Image Anal..

[27]  Ling Shao,et al.  Enhanced Computer Vision With Microsoft Kinect Sensor: A Review , 2013, IEEE Transactions on Cybernetics.