A Feasibility Study on the Use of a Structured Light Depth-Camera for Three-Dimensional Body Measurements of Dairy Cows in Free-Stall Barns

Frequent checks on livestock’s body growth can help reducing problems related to cow infertility or other welfare implications, and recognizing health’s anomalies. In the last ten years, optical methods have been proposed to extract information on various parameters while avoiding direct contact with animals’ body, generally causes stress. This research aims to evaluate a new monitoring system, which is suitable to frequently check calves and cow’s growth through a three-dimensional analysis of their bodies’ portions. The innovative system is based on multiple acquisitions from a low cost Structured Light Depth-Camera (Microsoft Kinect™ v1). The metrological performance of the instrument is proved through an uncertainty analysis and a proper calibration procedure. The paper reports application of the depth camera for extraction of different body parameters. Expanded uncertainty ranging between 3 and 15 mm is reported in the case of ten repeated measurements. Coefficients of determination R² > 0.84 and deviations lower than 6% from manual measurements where in general detected in the case of head size, hips distance, withers to tail length, chest girth, hips, and withers height. Conversely, lower performances where recognized in the case of animal depth (R² = 0.74) and back slope (R² = 0.12).

[1]  I. Veissier,et al.  Short communication: Early modification of the circadian organization of cow activity in relation to disease or estrus. , 2017, Journal of dairy science.

[2]  Enrico Savio,et al.  Geometrical modelling of scanning probe microscopes and characterization of errors , 2009 .

[3]  Yoshihiro Okada,et al.  3D Model Generation of Cattle Using Multiple Depth-Maps for ICT Agriculture , 2017, CISIS.

[4]  Jiahua Wu,et al.  Extracting the three-dimensional shape of live pigs using stereo photogrammetry , 2004 .

[5]  Zhengyou Zhang,et al.  Microsoft Kinect Sensor and Its Effect , 2012, IEEE Multim..

[6]  Yael Edan,et al.  Development of automatic body condition scoring using a low-cost 3-dimensional Kinect camera. , 2016, Journal of dairy science.

[7]  Kikuhito Kawasue,et al.  Black cattle body shape and temperature measurement using thermography and KINECT sensor , 2017, Artificial Life and Robotics.

[8]  Yongwha Chung,et al.  Depth-Based Detection of Standing-Pigs in Moving Noise Environments , 2017, Sensors.

[9]  J. A. Marchant,et al.  Extending the snake image processing algorithm for outlining pigs in scenes , 1993 .

[10]  Andrea Pezzuolo,et al.  Determination of forest road surface roughness by Kinect depth imaging , 2017 .

[11]  T Grandin,et al.  Assessment of stress during handling and transport. , 1997, Journal of animal science.

[12]  Toru Tamaki,et al.  A preliminarily study for predicting body weight and milk properties in lactating Holstein cows using a three-dimensional camera system , 2015, Comput. Electron. Agric..

[13]  Wolfgang Junge,et al.  Automated calculation of udder depth and rear leg angle in Holstein-Friesian cows using a multi-Kinect cow scanning system , 2017 .

[14]  D Berckmans,et al.  Analysis of individual classification of lameness using automatic measurement of back posture in dairy cattle. , 2013, Journal of dairy science.

[15]  Claudia Bahr,et al.  Lameness Detection in Dairy Cows: Part 2. Use of Sensors to Automatically Register Changes in Locomotion or Behavior , 2015, Animals : an open access journal from MDPI.

[16]  F. Marinello,et al.  Application of the Kinect sensor for dynamic soil surface characterization , 2015, Precision Agriculture.

[17]  Jørgen Kongsro,et al.  Estimation of pig weight using a Microsoft Kinect prototype imaging system , 2014 .

[18]  Sander Oude Elberink,et al.  Accuracy and Resolution of Kinect Depth Data for Indoor Mapping Applications , 2012, Sensors.

[19]  A Alempijevic,et al.  Live animal assessments of rump fat and muscle score in Angus cows and steers using 3-dimensional imaging. , 2017, Journal of animal science.

[20]  Claudia Arcidiacono,et al.  The automatic detection of dairy cow feeding and standing behaviours in free-stall barns by a computer vision-based system , 2015 .

[21]  José Dorado,et al.  An Approach to the Use of Depth Cameras for Weed Volume Estimation , 2016, Sensors.

[22]  Ephraim Maltz,et al.  Automatic lameness detection based on consecutive 3D-video recordings , 2014 .

[23]  Michael Riis Andersen,et al.  Kinect Depth Sensor Evaluation for Computer Vision Applications , 2012 .

[24]  Ilan Halachmi,et al.  Automatic assessment of dairy cattle body condition score using thermal imaging , 2013 .

[25]  G. Hoffmann,et al.  First investigations to refine video-based IR thermography as a non-invasive tool to monitor the body temperature of calves. , 2016, Animal : an international journal of animal bioscience.

[26]  J. A. Marchant,et al.  Monitoring pig growth using a prototype imaging system , 1999 .

[27]  Wolfgang Junge,et al.  A multi-Kinect cow scanning system: Calculating linear traits from manually marked recordings of Holstein-Friesian dairy cows , 2017 .

[28]  Daniel Berckmans,et al.  Classification of aggressive behaviour in pigs by activity index and multilayer feed forward neural network , 2014 .

[29]  Marcella Guarino,et al.  An innovative approach to predict the growth in intensive poultry farming , 2015, Comput. Electron. Agric..

[30]  Wolfgang Junge,et al.  Estimation of backfat thickness using extracted traits from an automatic 3D optical system in lactating Holstein-Friesian cows , 2014 .

[31]  Dries Berckmans,et al.  Developing precision livestock farming tools for precision dairy farming , 2017 .

[32]  Francesco Maria Tangorra,et al.  Static spatial requirements of growing-finishing and heavy pigs , 2006 .

[33]  Jacob Goldberger,et al.  Obstacle detection in a greenhouse environment using the Kinect sensor , 2015, Comput. Electron. Agric..

[34]  Andrea Pezzuolo,et al.  Influence of automatic feeding systems on design and management of dairy farms , 2017 .

[35]  D Berckmans,et al.  Lameness detection in dairy cattle: single predictor v. multivariate analysis of image-based posture processing and behaviour and performance sensing. , 2016, Animal : an international journal of animal bioscience.

[36]  Erik Jørgensen,et al.  Determination of live weight of pigs from dimensions measured using image analysis , 1996 .

[37]  Y. Wang,et al.  Walk-through weighing of pigs using machine vision and an artificial neural network , 2008 .

[38]  David Reiser,et al.  3-D Imaging Systems for Agricultural Applications—A Review , 2016, Sensors.

[39]  M Nilsson,et al.  Development of automatic surveillance of animal behaviour and welfare using image analysis and machine learned segmentation technique. , 2015, Animal : an international journal of animal bioscience.

[40]  D. Hodgins,et al.  Factors associated with morbidity, mortality, and growth of dairy heifer calves up to 3 months of age. , 2014, Preventive veterinary medicine.

[41]  Enrico Savio,et al.  Metrology of freeform shaped parts , 2007 .

[42]  J D Ferguson,et al.  Objective estimation of body condition score by modeling cow body shape from digital images. , 2011, Journal of dairy science.

[43]  Claudia Bahr,et al.  Original paper: Real-time automatic lameness detection based on back posture extraction in dairy cattle: Shape analysis of cow with image processing techniques , 2010 .

[44]  D Berckmans,et al.  Computer-assisted image analysis to quantify daily growth rates of broiler chickens , 2003, British poultry science.

[45]  M. B. R. Mollah,et al.  Digital image analysis to estimate the live weight of broiler , 2010 .

[46]  George Azzari,et al.  Rapid Characterization of Vegetation Structure with a Microsoft Kinect Sensor , 2013, Sensors.

[47]  Andrea Pezzuolo,et al.  On-barn pig weight estimation based on body measurements by a Kinect v1 depth camera , 2018, Comput. Electron. Agric..

[48]  D Berckmans,et al.  Automatic measurement of touch and release angles of the fetlock joint for lameness detection in dairy cattle using vision techniques. , 2012, Journal of dairy science.

[49]  X. Song,et al.  Body measurements of dairy calf using a 3-D camera in an automatic feeding system , 2014 .

[50]  Ling Shao,et al.  Enhanced Computer Vision With Microsoft Kinect Sensor: A Review , 2013, IEEE Transactions on Cybernetics.

[51]  Bengt-Göran Rosén,et al.  Software relocation of 3D surface topography measurements , 2001 .

[52]  D. Stajnko,et al.  Estimation of bull live weight through thermographically measured body dimensions , 2008 .

[53]  P. Negretti,et al.  Visual image analysis to estimate morphological and weight measurements in rabbits. , 2010 .

[54]  Du-Ming Tsai,et al.  A motion and image analysis method for automatic detection of estrus and mating behavior in cattle , 2014 .

[55]  Yongwha Chung,et al.  Automatic Recognition of Aggressive Behavior in Pigs Using a Kinect Depth Sensor , 2016, Sensors.

[56]  I Halachmi,et al.  Editorial: Precision livestock farming: a 'per animal' approach using advanced monitoring technologies. , 2016, Animal : an international journal of animal bioscience.

[57]  Y. Bozkurt,et al.  The relationship of parameters of body measures and body weight by using digital image analysis in pre-slaughter cattle , 2008 .

[58]  Francesco Marinello,et al.  Last generation instrument for agriculture multispectral data collection , 2017 .