Depth-Based Detection of Standing-Pigs in Moving Noise Environments

In a surveillance camera environment, the detection of standing-pigs in real-time is an important issue towards the final goal of 24-h tracking of individual pigs. In this study, we focus on depth-based detection of standing-pigs with “moving noises”, which appear every night in a commercial pig farm, but have not been reported yet. We first apply a spatiotemporal interpolation technique to remove the moving noises occurring in the depth images. Then, we detect the standing-pigs by utilizing the undefined depth values around them. Our experimental results show that this method is effective for detecting standing-pigs at night, in terms of both cost-effectiveness (using a low-cost Kinect depth sensor) and accuracy (i.e., 94.47%), even with severe moving noises occluding up to half of an input depth image. Furthermore, without any time-consuming technique, the proposed method can be executed in real-time.

[1]  Torben Gregersen,et al.  Original papers: Development of a real-time computer vision system for tracking loose-housed pigs , 2011 .

[2]  Lene Juul Pedersen,et al.  Illumination and Reflectance Estimation with its Application in Foreground Detection , 2015, Sensors.

[3]  Esteban Walter Gonzalez Clua,et al.  A Comparison between Background Subtraction Algorithms using a Consumer Depth Camera , 2012, VISAPP.

[4]  Measuring the Accuracy of Object Detectors and Trackers , 2017, 1704.07293.

[5]  Claudia Bahr,et al.  Automatic monitoring of pig locomotion using image analysis , 2014 .

[6]  Stefano Viazzi,et al.  Image feature extraction for classification of aggressive interactions among pigs , 2014 .

[7]  Wei Li,et al.  Validity of the Microsoft Kinect sensor for assessment of normal walking patterns in pigs , 2015, Comput. Electron. Agric..

[8]  Ehsan Khoramshahi,et al.  Real-time recognition of sows in video: A supervised approach , 2014 .

[9]  N. Otsu.  A threshold selection method from gray level histograms , 1979 .

[10]  Po-Hsun Cheng,et al.  Temporal and Spatial Denoising of Depth Maps , 2015, Sensors.

[11]  D. Wood‐Gush,et al.  The significance of motivation and environment in the development of exploration in pigs. , 1990 .

[12]  Jørgen Kongsro,et al.  Estimation of pig weight using a Microsoft Kinect prototype imaging system , 2014 .

[13]  Partha Pratim Das,et al.  Characterizations of Noise in Kinect Depth Images: A Review , 2014, IEEE Sensors Journal.

[14]  Lene Juul Pedersen,et al.  Segmentation of sows in farrowing pens , 2014, IET Image Process..

[15]  Weixing Zhu,et al.  Pig target extraction based on adaptive elliptic block and wavelet edge detection , 2016, ICSPS 2016.

[16]  D. Berckmans,et al.  Precision Livestock Farming: An international review of scientific and commercial aspects , 2012 .

[17]  Jianhua Zhang,et al.  Review of automatic detection of pig behaviours by using image analysis , 2017 .

[18]  C. P. Schofield.  Evaluation of image analysis as a means of estimating the weight of pigs. , 1990 .

[19]  Lene Juul Pedersen,et al.  Foreground detection using loopy belief propagation , 2013 .

[20]  R. Koch,et al.  Randomized global optimization for robust pose estimation of multiple targets in image sequences , 2019 .

[21]  Daniel Berckmans,et al.  Automated video analysis of pig activity at pen level highly correlates to human observations of behavioural activities , 2014 .

[22]  Supachai Pathumnakul,et al.  An approach based on digital image analysis to estimate the live weights of pigs in farm environments , 2015, Comput. Electron. Agric..

[23]  Weixing Zhu,et al.  Foreground detection of group-housed pigs based on the combination of Mixture of Gaussians using prediction mechanism and threshold segmentation , 2014 .

[24]  Yongwha Chung,et al.  A Cost-Effective Pigsty Monitoring System Based on a Video Sensor , 2014, KSII Trans. Internet Inf. Syst..

[25]  I. Hulsegge,et al.  Lying characteristics as determinants for space requirements in pigs , 2003 .

[26]  Rony Geers,et al.  Image-analysis parameters as inputs for automatic environmental temperature control in piglet houses , 1990 .

[27]  Suresh Neethirajan,et al.  Recent advances in wearable sensors for animal health management , 2017 .

[28]  Ali Farhadi,et al.  YOLO9000: Better, Faster, Stronger , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[29]  Daniel Berckmans,et al.  Automatic Identification of Marked Pigs in a Pen Using Image Pattern Recognition , 2013, MDA.

[30]  Kai Liu,et al.  Automatic recognition of lactating sow behaviors through depth image processing , 2016, Comput. Electron. Agric..

[31]  B. Sturm,et al.  A new approach for categorizing pig lying behaviour based on a Delaunay triangulation method. , 2017, Animal : an international journal of animal bioscience.

[32]  Sandra A. Edwards,et al.  Automatic detection of mounting behaviours among pigs using image analysis , 2016, Comput. Electron. Agric..

[33]  Bin Liang,et al.  Depth Errors Analysis and Correction for Time-of-Flight (ToF) Cameras , 2017, Sensors.

[34]  Julia Brendle,et al.  Investigation of distances covered by fattening pigs measured with VideoMotionTracker , 2011 .

[35]  Uwe Richter,et al.  Using machine vision for investigation of changes in pig group lying patterns , 2015, Comput. Electron. Agric..

[36]  Yongwha Chung,et al.  Automatic Recognition of Aggressive Behavior in Pigs Using a Kinect Depth Sensor , 2016, Sensors.

[37]  Thomas Banhazi,et al.  A brief review of the application of machine vision in livestock behaviour analysis. , 2016 .

[38]  Yongwha Chung,et al.  An index algorithm for tracking pigs in pigsty , 2014 .

[39]  Daniel Berckmans,et al.  Image-processing technique to measure pig activity in response to climatic variation in a pig barn , 2014 .

[40]  Kanda Runapongsa Saikaew,et al.  Boundary Detection of Pigs in Pens Based on Adaptive Thresholding Using an Integral Image and Adaptive Partitioning , 2017 .

[41]  Daniel Berckmans,et al.  Automatic weight estimation of individual pigs using image analysis , 2014 .

[42]  Ilias Kyriazakis,et al.  Early detection of health and welfare compromises through automated detection of behavioural changes in pigs , 2016, Veterinary journal.

[43]  Marcella Guarino,et al.  Precision livestock farming : an overview of image and sound labelling , 2013 .

[44]  Weixing Zhu,et al.  Multi-object extraction from topview group-housed pig images based on adaptive partitioning and multilevel thresholding segmentation , 2015 .

[45]  Daniel Berckmans,et al.  The automatic monitoring of pigs water use by cameras , 2013 .

[46]  C. Bench,et al.  The automated analysis of clustering behaviour of piglets from thermal images in response to immune challenge by vaccination. , 2018, Animal : an international journal of animal bioscience.

[47]  Jinchang Ren,et al.  Automatic Animal Detection from Kinect Sensed Images for Livestock Monitoring and Assessment , 2015, 2015 IEEE International Conference on Computer and Information Technology; Ubiquitous Computing and Communications; Dependable, Autonomic and Secure Computing; Pervasive Intelligence and Computing.

[48]  Li Yan,et al.  An automatic splitting method for the adhesive piglets' gray scale image based on the ellipse shape feature , 2016, Comput. Electron. Agric..

[49]  Sandra A. Edwards,et al.  Using automated image analysis in pig behavioural research: Assessment of the influence of enrichment substrate provision on lying behaviour , 2017 .

[50]  M Nilsson,et al.  Development of automatic surveillance of animal behaviour and welfare using image analysis and machine learned segmentation technique. , 2015, Animal : an international journal of animal bioscience.

[51]  S. Robert,et al.  Some observations on the role of environment and genetics in behaviour of wild and domestic forms of Sus scrofa (European wild boars and domestic pigs) , 1987 .

[52]  Daniel Berckmans,et al.  Automatic estimation of number of piglets in a pen during farrowing, using image analysis , 2016 .

[53]  Chen Shi,et al.  An approach of pig weight estimation using binocular stereo system based on LabVIEW , 2016, Comput. Electron. Agric..