Dynamic cattle behavioural classification using supervised ensemble classifiers

Cattle behavioural classification using cattle tag and supervised ensemble classifiers.Unsupervised hybrid clustering used to study inherent natural grouping in data set.Best classification accuracy was 96% using the bagging ensemble with Tree learner.A mechanism for the early detection and quantitative assessment of animal health. In this paper various supervised machine learning techniques were applied to classify cattle behaviour patterns recorded using collar systems with 3-axis accelerometer and magnetometer, fitted to individual dairy cows to infer their physical behaviours. Cattle collar data was collected at the Tasmanian Institute of Agriculture (TIA) Dairy Research Facility in Tasmania. In the first stage of analysis a novel hybrid unsupervised clustering framework, comprised of probabilistic principal component analysis, Fuzzy C Means, and Self Organizing Map network algorithms was developed and used to study the natural structure of the sensor data. Findings from this unsupervised clustering were used to guide the next stage of supervised machine learning. Five major behaviour classes, namely, Grazing, Ruminating, Resting, Walking, and other behaviour were identified for the classification trials. An ensemble of classifiers approach was used to learn models of cow behaviour using sensor data and ground truth behaviour observations acquired from the field. Ensemble classification using bagging, Random Subspace and AdaBoost methods along with conventional supervised classification methods, namely, Binary Tree, Linear Discriminant Analysis classifier, Naive Bayes classifier, k-Nearest Neighbour classifier, and Adaptive Neuro Fuzzy Inference System classifier were compared. The highest average correct classification accuracy of 96% was achieved using the bagging ensemble classification with Tree learner, which had 97% sensitivity, 89% specificity, 89% F1 score and 9% false discovery rate. This study has shown that cattle behaviours can be classified with a high accuracy using supervised machine learning technique. As dairy and beef systems become more intensive, the ability to identify the changes in the behaviours of individual livestock becomes increasingly difficult. Accurate behavioural monitoring through sensors provides a significant potential in providing a mechanism for the early detection and quantitative assessment of animal health issues such a lameness, informing key management events such as the identification of oestrus, or informing changes in supplementary feeding requirements.

[1]  Gerard V. Trunk,et al.  A Problem of Dimensionality: A Simple Example , 1979, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Juan Carlos Niebles,et al.  Unsupervised Learning of Human Action Categories Using Spatial-Temporal Words , 2008, International Journal of Computer Vision.

[3]  Zhouyu Fu,et al.  Music classification via the bag-of-features approach , 2011, Pattern Recognit. Lett..

[4]  Lars Relund Nielsen,et al.  Quantifying walking and standing behaviour of dairy cows using a moving average based on output from an accelerometer. , 2010 .

[5]  Sergios Theodoridis,et al.  Pattern Recognition, Fourth Edition , 2008 .

[6]  Xin Yao,et al.  Diversity creation methods: a survey and categorisation , 2004, Inf. Fusion.

[7]  Ian Witten,et al.  Data Mining , 2000 .

[8]  Chuen-Tsai Sun,et al.  Neuro-fuzzy And Soft Computing: A Computational Approach To Learning And Machine Intelligence [Books in Brief] , 1997, IEEE Transactions on Neural Networks.

[9]  Wojtek J. Krzanowski,et al.  Principles of multivariate analysis : a user's perspective. oxford , 1988 .

[10]  M. Kolehmainen,et al.  Cow behaviour pattern recognition using a three-dimensional accelerometer and support vector machines , 2009 .

[11]  Erkki Oja,et al.  Independent component analysis: algorithms and applications , 2000, Neural Networks.

[12]  David A. Landgrebe,et al.  Supervised classification in high-dimensional space: geometrical, statistical, and asymptotical properties of multivariate data , 1998, IEEE Trans. Syst. Man Cybern. Part C.

[13]  Ian H. Witten,et al.  Data mining: practical machine learning tools and techniques, 3rd Edition , 1999 .

[14]  Teuvo Kohonen,et al.  Self-organization and associative memory: 3rd edition , 1989 .

[15]  Conrad Bessant,et al.  Electronic-Nose Technology Using Sputum Samples in Diagnosis of Patients with Tuberculosis , 2010, Journal of Clinical Microbiology.

[16]  Peter I. Corke,et al.  Transforming Agriculture through Pervasive Wireless Sensor Networks , 2007, IEEE Pervasive Computing.

[17]  E. Bush,et al.  Data normalization before statistical analysis: keeping the horse before the cart. , 1988, Trends in pharmacological sciences.

[18]  Tom Armstrong,et al.  Using Modified Multivariate Bag-of-Words Models to Classify Physiological Data , 2011, 2011 IEEE 11th International Conference on Data Mining Workshops.

[19]  L A González,et al.  Pain mitigation after band castration of beef calves and its effects on performance, behavior, Escherichia coli, and salivary cortisol. , 2010, Journal of animal science.

[20]  I. Jolliffe Principal Component Analysis , 2002 .

[21]  David G. Renter,et al.  Evaluation of three-dimensional accelerometers to monitor and classify behavior patterns in cattle , 2009 .

[22]  Greg Bishop-Hurley,et al.  Behavioral classification of data from collars containing motion sensors in grazing cattle , 2015, Comput. Electron. Agric..

[23]  Klaus Seyerlehner,et al.  FRAME LEVEL AUDIO SIMILARITY - A CODEBOOK APPROACH , 2008 .

[24]  D. Opitz,et al.  Popular Ensemble Methods: An Empirical Study , 1999, J. Artif. Intell. Res..

[25]  T. Wark,et al.  Fleck - A platform for real-world outdoor sensor networks , 2007, 2007 3rd International Conference on Intelligent Sensors, Sensor Networks and Information.

[26]  Anders Krogh,et al.  Learning with ensembles: How overfitting can be useful , 1995, NIPS.

[27]  Lior Rokach,et al.  Ensemble-based classifiers , 2010, Artificial Intelligence Review.

[28]  Ludmila I. Kuncheva,et al.  Measures of Diversity in Classifier Ensembles and Their Relationship with the Ensemble Accuracy , 2003, Machine Learning.

[29]  Xiaoli Z. Fern,et al.  Audio Classification of Bird Species: A Statistical Manifold Approach , 2009, 2009 Ninth IEEE International Conference on Data Mining.

[30]  Eugene D. Ungar,et al.  Inference of Animal Activity From GPS Collar Data on Free-Ranging Cattle , 2005 .

[31]  Ritabrata Dutta,et al.  Intelligent Bayes Classifier (IBC) for ENT infection classification in hospital environment , 2006, Biomedical engineering online.

[32]  C. C. Ketelaar-de Lauwere,et al.  The influence of social hierarchy on the time budget of cows and their visits to an automatic milking system , 1996 .