Feather Damage Monitoring System Using RGB-Depth-Thermal Model for Chickens

Simple Summary Feather coverage reflects the production efficiency and animal welfare of poultry. Monitoring the feather-cover condition of chickens is of great significance. Infrared thermography can be used to evaluate the probable existence of inflammatory or tissue damage processes due to the variation in skin temperature, which can be used to objectively determine the depth of the feather damage. In this study, a 3D reconstruction pipeline of chicken monitoring was developed, with color, depth and thermal information for the comprehensive feather damage monitoring of chickens. The results demonstrated that the proposed method can better assess the feather damage compared to a 2D color image or thermal infrared image. The depth of chicken feather damage can be assessed by the 3D model. The method provided ideas for automation and intelligent feather-damage monitoring in poultry farming. Abstract Feather damage is a continuous health and welfare challenge among laying hens. Infrared thermography is a tool that can evaluate the changes in the surface temperature, derived from an inflammatory process that would make it possible to objectively determine the depth of the damage to the dermis. Therefore, the objective of this article was to develop an approach to feather damage assessment based on visible light and infrared thermography. Fusing information obtained from these two bands can highlight their strengths, which is more evident in the assessment of feather damage. A novel pipeline was proposed to reconstruct the RGB-Depth-Thermal maps of the chicken using binocular color cameras and a thermal infrared camera. The process of stereo matching based on binocular color images allowed for a depth image to be obtained. Then, a heterogeneous image registration method was presented to achieve image alignment between thermal infrared and color images so that the thermal infrared image was also aligned with the depth image. The chicken image was segmented from the background using a deep learning-based network based on the color and depth images. Four kinds of images, namely, color, depth, thermal and mask, were utilized as inputs to reconstruct the 3D model of a chicken with RGB-Depth-Thermal maps. The depth of feather damage can be better assessed with the proposed model compared to the 2D thermal infrared image or color image during both day and night, which provided a reference for further research in poultry farming.

[1]  Xiaoling Zhao,et al.  Farm Environmental Enrichments Improve the Welfare of Layer Chicks and Pullets: A Comprehensive Review , 2022, Animals : an open access journal from MDPI.

[2]  A. Casas,et al.  Efficacy and Function of Feathers, Hair, and Glabrous Skin in the Thermoregulation Strategies of Domestic Animals , 2021, Animals : an open access journal from MDPI.

[3]  Gourab Sen Gupta,et al.  Making Use of 3D Models for Plant Physiognomic Analysis: A Review , 2021, Remote. Sens..

[4]  Mário Mollo Neto,et al.  Unrest index for estimating thermal comfort of poultry birds (Gallus gallus domesticus) using computer vision techniques , 2021 .

[5]  L. Chai,et al.  A Machine Vision-Based Method Optimized for Restoring Broiler Chicken Images Occluded by Feeding and Drinking Equipment , 2021, Animals : an open access journal from MDPI.

[6]  C. Baes,et al.  A meta-analysis on the effect of environmental enrichment on feather pecking and feather damage in laying hens. , 2020, Poultry science.

[7]  I. Halachmi,et al.  Automatic broiler temperature measuring by thermal camera , 2020 .

[8]  G. Cronin,et al.  Causes of feather pecking and subsequent welfare issues for the laying hen: a review , 2020 .

[9]  D. Mota-Rojas,et al.  Advances in infrared thermography: Surgical aspects, vascular changes, and pain monitoring in veterinary medicine. , 2020, Journal of thermal biology.

[10]  Monique Frize,et al.  Thermal and RGB-D Imaging for Necrotizing Enterocolitis Detection , 2020, 2020 IEEE International Symposium on Medical Measurements and Applications (MeMeA).

[11]  N. Kemper,et al.  The Effects of UV-A Light Provided in Addition to Standard Lighting on Plumage Condition in Laying Hens , 2020, Animals : an open access journal from MDPI.

[12]  Juyong Zhang,et al.  AANet: Adaptive Aggregation Network for Efficient Stereo Matching , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[13]  F. V. Alves,et al.  Infrared thermography for evaluation of the environmental thermal comfort for livestock , 2020, International Journal of Biometeorology.

[14]  Siyu Zhu,et al.  Cascade Cost Volume for High-Resolution Multi-View Stereo and Stereo Matching , 2019, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[15]  Hailin Zhang,et al.  A machine vision system for early detection and prediction of sick birds: A broiler chicken model , 2019, Biosystems Engineering.

[16]  C. Baes,et al.  Development of a Scoring System to Assess Feather Damage in Canadian Laying Hen Flocks , 2019, Animals : an open access journal from MDPI.

[17]  Henry Fuchs,et al.  StereoDRNet: Dilated Residual StereoNet , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[18]  Xiuqin Rao,et al.  Behavior-induced health condition monitoring of caged chickens using binocular vision , 2019, Comput. Electron. Agric..

[19]  Pritam Chanda,et al.  DeepSort: deep convolutional networks for sorting haploid maize seeds , 2018, BMC Bioinformatics.

[20]  Fei Luo,et al.  RedNet: Residual Encoder-Decoder Network for indoor RGB-D Semantic Segmentation , 2018, ArXiv.

[21]  L. Keeling,et al.  Towards Farm Animal Welfare and Sustainability , 2018, Animals : an open access journal from MDPI.

[22]  Kun Duan,et al.  Multimodal Sensor System for Pressure Ulcer Wound Assessment and Care , 2018, IEEE Transactions on Industrial Informatics.

[23]  Iasonas Kokkinos,et al.  DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  N. Kemper,et al.  Assessment of Plumage and Integument Condition in Dual-Purpose Breeds and Conventional Layers , 2017, Animals : an open access journal from MDPI.

[25]  Seungyong Lee,et al.  RDFNet: RGB-D Multi-level Residual Feature Fusion for Indoor Semantic Segmentation , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[26]  Hongguang Li,et al.  Image Registration and Fusion of Visible and Infrared Integrated Camera for Medium-Altitude Unmanned Aerial Vehicle Remote Sensing , 2017, Remote. Sens..

[27]  B. Bilcík,et al.  Assessment of the effect of housing on feather damage in laying hens using IR thermography. , 2017, Animal : an international journal of animal bioscience.

[28]  Srikanth Saripalli,et al.  Cross-Calibration of RGB and Thermal Cameras with a LIDAR for RGB-Depth-Thermal Mapping , 2017, Unmanned Syst..

[29]  Thomas Brox,et al.  FlowNet 2.0: Evolution of Optical Flow Estimation with Deep Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[30]  Roberto Cipolla,et al.  SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[31]  Uwe Stilla,et al.  Evaluation of Methods for Coregistration and Fusion of Rpas-Based 3d Point Clouds and Thermal Infrared Images , 2016 .

[32]  Julian Szymański,et al.  Depth Images Filtering In Distributed Streaming , 2016 .

[33]  Hong-Shuang Li,et al.  Matlab codes of Subset Simulation for reliability analysis and structural optimization , 2016, Structural and Multidisciplinary Optimization.

[34]  Onur Mutlu,et al.  Fast Bulk Bitwise AND and OR in DRAM , 2015, IEEE Computer Architecture Letters.

[35]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[36]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[37]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[38]  V. Redaelli,et al.  Potential application of thermography (IRT) in animal production and for animal welfare. A case report of working dogs. , 2014, Annali dell'Istituto superiore di sanita.

[39]  Richard S Gates,et al.  Machine vision to identify broiler breeder behavior , 2013 .

[40]  Youngjib Ham,et al.  An automated vision-based method for rapid 3D energy performance modeling of existing buildings using thermal and digital imagery , 2013, Adv. Eng. Informatics.

[41]  Basilio Sierra,et al.  RGB-D, Laser and Thermal Sensor Fusion for People following in a Mobile Robot , 2013 .

[42]  H. Xin,et al.  Use of infrared thermography to assess laying-hen feather coverage. , 2013, Poultry science.

[43]  D. McCafferty.  Applications of thermal imaging in avian science , 2013 .

[44]  Justyna Cilulko,et al.  Infrared thermal imaging in studies of wild animals , 2013, European Journal of Wildlife Research.

[45]  Xing Mei,et al.  On building an accurate stereo matching system on graphics hardware , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).

[46]  Pedro Arias,et al.  Automation of thermographic 3D modelling through image fusion and image matching techniques , 2011 .

[47]  Carsten Rother,et al.  PatchMatch Stereo - Stereo Matching with Slanted Support Windows , 2011, BMVC.

[48]  D. P. Neves,et al.  Broiler surface temperature distribution of 42 day old chickens , 2010 .

[49]  Heiko Hirschmüller,et al.  Stereo Processing by Semiglobal Matching and Mutual Information , 2008, IEEE Trans. Pattern Anal. Mach. Intell..

[50]  Antonio Torralba,et al.  LabelMe: A Database and Web-Based Tool for Image Annotation , 2008, International Journal of Computer Vision.

[51]  R. C. Newberry,et al.  Behaviour when young as a predictor of severe feather pecking in adult laying hens: The redirected foraging hypothesis revisited , 2007 .

[52]  Xianyong Fang,et al.  An improved RANSAC homography algorithm for feature based image mosaic , 2007 .

[53]  H. van de Weerd,et al.  Rearing factors that influence the propensity for injurious feather pecking in laying hens , 2006 .

[54]  N. Cook,et al.  Assessing feather cover of laying hens by infrared thermography , 2006 .

[55]  Richard Szeliski,et al.  A Comparison and Evaluation of Multi-View Stereo Reconstruction Algorithms , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[56]  K. Holm,et al.  Applied scoring of integument and health in laying hens. , 2005 .

[57]  G. LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[58]  Luigi di Stefano,et al.  A fast area-based stereo matching algorithm , 2004, Image Vis. Comput..

[59]  Philip H. S. Torr,et al.  The Development and Comparison of Robust Methods for Estimating the Fundamental Matrix , 1997, International Journal of Computer Vision.

[60]  Sarvar Patel,et al.  Luby-Rackoff Ciphers: Why XOR Is Not So Exclusive , 2002, Selected Areas in Cryptography.

[61]  J. Kjaer,et al.  Feather pecking and cannibalism in free-range laying hens as affected by genotype, dietary level of methionine + cystine, light intensity during rearing and age at first access to the range area , 2002 .

[62]  P. Glatz.  Effect of Poor Feather Cover on Feed Intake and Production of Aged Laying Hens , 2001 .

[63]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[64]  B. Wechsler,et al.  Stress and feather pecking in laying hens in relation to housing conditions , 2000, British poultry science.

[65]  M. Macleod,et al.  Incidence of pecking damage in growing bantams in relation to food form, group size, stocking density, dietary tryptophan concentration and dietary protein source. , 1999, British poultry science.

[66]  C. Savory,et al.  Feather pecking in groups of growing bantams in relation to floor litter substrate and plumage colour. , 1999, British poultry science.

[67]  L. Keeling,et al.  Changes in feather condition in relation to feather pecking and aggressive behaviour in laying hens. , 1999, British poultry science.

[68]  C. Savory.  Feather pecking and cannibalism , 1995 .

[69]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[70]  B. Tzschentke,et al.  Influence of feather cover on heat balance in laying hens (Gallus domesticus) , 1986 .

[71]  R. Tauson,et al.  Evaluation of Procedures for Scoring the Integument of Laying Hens—Independent Scoring of Plumage Condition , 1984 .

[72]  P. R. Smith,et al.  Bilinear interpolation of digital images , 1981 .

[73]  N. Otsu.  A threshold selection method from gray level histograms , 1979 .