Agricultural robotics research applicable to poultry production: A review

Abstract The advent of agricultural robotics research worldwide has brought substantial improvement for various applications. This article provides a comprehensive review of published research and development work, emphasizing robotics enabling machine capabilities. These machine capabilities of perception, reasoning and learning, communication, task planning and execution, and systems integration have opened possibilities for intelligent automation of current and future agricultural operations, including precision livestock farming. We have focused on the Agricultural Intelligent Automation Systems which have a high potential to be applied to agricultural production and processing, especially with applicability to poultry production. Most of the published work on agricultural robotics has been in the areas of perception and reasoning. The emphases have been in the identification of objects, evaluation of product quality, monitoring of plant and animal growth and development, yield prediction, and machine guidance. There has been limited published work on the task execution and systems integration aspects of agricultural robotics. Moreover, we have reviewed agricultural robotics research from 24 universities worldwide. Agricultural robots can be divided into three categories (monitor, harvester, and both) according to various functions. Several tables are presented to summarize the information on the key subject areas reviewed in this article. We have found that there are still many challenges that need to be addressed in robotizing agricultural tasks in general and in poultry production specifically. The most common challenges in robotics applications have been developing robots for specific agricultural tasks. Examples in poultry production include monitoring environmental conditions and chicken health, egg picking, and encouraging chicken movement. The approaches to addressing the technical needs have been creating intelligent movable machines for use alongside the chickens in poultry house. The most noticeable results include Octopus Poultry Safe (OPS) robot for sanitizing poultry houses autonomously, PoultryBot for picking floor eggs, and Spoutnic for training hens to move. This trend of research and development is expected to continue. An emerging research emphasis is systems approach to study the interactions of automated tasks to achieve high efficiency in whole poultry house management.

[1]  Eldert J. van Henten,et al.  Design of an eye-in-hand sensing and servo control framework for harvesting robotics in dense vegetation , 2016 .

[2]  Yang Wang,et al.  A new ventilation system to reduce temperature fluctuations in laying hen housing in continental climate , 2019, Biosystems Engineering.

[3]  Joris IJsselmuiden,et al.  Probabilistic localisation in repetitive environments: Estimating a robot's position in an aviary poultry house , 2016, Comput. Electron. Agric..

[4]  Thomas Nickson,et al.  Monitoring chicken flock behaviour provides early warning of infection by human pathogen Campylobacter , 2016, Proceedings of the Royal Society B: Biological Sciences.

[5]  C. Rufener,et al.  Laying hen’s mobility is impaired by keel bone fractures and does not improve with paracetamol treatment , 2019, Applied Animal Behaviour Science.

[6]  Kuan Chong Ting.  Systems analysis, integration, and economic feasibility , 1998 .

[7]  Rui Li,et al.  Kiwifruit detection in field images using Faster R-CNN with VGG16 , 2019, IFAC-PapersOnLine.

[8]  Manoj Karkee,et al.  Shake-and-Catch Harvesting for Fresh Market Apples in Trellis-Trained Trees , 2017 .

[9]  Andy Mauromoustakos,et al.  Dynamics of nutrient utilization, heat production, and body composition in broiler breeder hens during egg production , 2018, Poultry science.

[10]  D. Berckmans,et al.  Precision livestock farming technologies for welfare management in intensive livestock systems. , 2014, Revue scientifique et technique.

[11]  Yuanshen Zhao,et al.  A review of key techniques of vision-based control for harvesting robot , 2016, Comput. Electron. Agric..

[12]  Yoshio Makino,et al.  Hyperspectral imaging and multispectral imaging as the novel techniques for detecting defects in raw and processed meat products: Current state-of-the-art research advances , 2018 .

[13]  Andrea Conti,et al.  An Overview on Wireless Sensor Networks Technology and Evolution , 2009, Sensors.

[14]  J M Lorenzo,et al.  Effect of chicken meat replacement by spent laying hen meat on physicochemical properties and sensorial characteristics of fresh sausage , 2019, British poultry science.

[15]  Deqin Xiao,et al.  Feeding behavior recognition for group-housed pigs with the Faster R-CNN , 2018, Comput. Electron. Agric..

[16]  D. Berckmans,et al.  Lameness assessment with automatic monitoring of activity in commercial broiler flocks. , 2017, Poultry science.

[17]  Ashutosh Kumar Singh,et al.  Machine Learning for High-Throughput Stress Phenotyping in Plants. , 2016, Trends in plant science.

[18]  Hongwei Xin,et al.  Precision livestock farming in egg production , 2017 .

[19]  Hans-Wilhelm Windhorst.  Dynamics and Patterns of Global Poultry-Meat Production , 2017 .

[20]  C. Donnelly,et al.  Chicken welfare is influenced more by housing conditions than by stocking density , 2004, Nature.

[21]  Vasileios Exadaktylos,et al.  Detection of embryo mortality and hatch using thermal differences among incubated chicken eggs , 2016 .

[22]  I. D. M. Gangnat,et al.  Carcass and meat quality of dual‐purpose chickens (Lohmann Dual, Belgian Malines, Schweizerhuhn) in comparison to broiler and layer chicken types , 2018, Poultry science.

[23]  Rafael Rieder,et al.  Computer vision and artificial intelligence in precision agriculture for grain crops: A systematic review , 2018, Comput. Electron. Agric..

[24]  V. Alchanatis,et al.  Review: Sensing technologies for precision specialty crop production , 2010 .

[25]  A. Aydin,et al.  Using 3D vision camera system to automatically assess the level of inactivity in broiler chickens , 2017, Comput. Electron. Agric..

[26]  Joseph Wang,et al.  A wearable chemical–electrophysiological hybrid biosensing system for real-time health and fitness monitoring , 2016, Nature Communications.

[27]  Yufeng Ge,et al.  A multi-sensor system for high throughput field phenotyping in soybean and wheat breeding , 2016, Comput. Electron. Agric..

[28]  Hongwei Xin,et al.  Effects of litter floor access and inclusion of experienced hens in aviary housing on floor eggs, litter condition, air quality, and hen welfare , 2018, Poultry science.

[29]  N. A. Aziz,et al.  Binary classification using SVM for sick and healthy chicken based on chicken’s excrement image , 2017 .

[30]  Narendra Singh Raghuwanshi,et al.  Wireless sensor networks for agriculture: The state-of-the-art in practice and future challenges , 2015, Comput. Electron. Agric..

[31]  Richard S Gates,et al.  Machine vision to identify broiler breeder behavior , 2013 .

[32]  Daniel Berckmans,et al.  Appropriate data visualisation is key to Precision Livestock Farming acceptance , 2017, Comput. Electron. Agric..

[33]  Q. Zhang,et al.  Sensors and systems for fruit detection and localization: A review , 2015, Comput. Electron. Agric..

[34]  Tiemin Zhang,et al.  Development of an early warning algorithm to detect sick broilers , 2018, Comput. Electron. Agric..

[35]  Zhi‐Hui Zhu,et al.  Online Discriminant Model of Blood Spot Eggs Based on Spectroscopy , 2017 .

[36]  Jinming Pan,et al.  Artificial light and biological responses of broiler chickens: dose-response. , 2018, Journal of animal science.

[37]  Anders Krogh Mortensen,et al.  Weight prediction of broiler chickens using 3D computer vision , 2016, Comput. Electron. Agric..

[38]  Keith D. Shepherd,et al.  Soil Spectroscopy: An Alternative to Wet Chemistry for Soil Monitoring , 2015 .

[39]  Da-Wen Sun,et al.  Comparison of hyperspectral imaging and computer vision for automatic differentiation of organically and conventionally farmed salmon , 2017 .

[40]  Mauro Zaninelli,et al.  A Monitoring System for Laying Hens That Uses a Detection Sensor Based on Infrared Technology and Image Pattern Recognition , 2017, Sensors.

[41]  D. Berckmans,et al.  Review: Precision livestock farming: building 'digital representations' to bring the animals closer to the farmer. , 2019, Animal : an international journal of animal bioscience.

[42]  Jochen Hemming,et al.  Fruit Detectability Analysis for Different Camera Positions in Sweet-Pepper † , 2014, Sensors.

[43]  Wang Cheng,et al.  Cloud-based data management system for automatic real-time data acquisition from large-scale laying-hen farms , 2016 .

[44]  Girish Chowdhary,et al.  Under canopy light detection and ranging‐based autonomous navigation , 2018, J. Field Robotics.

[45]  Anders Ringgaard Kristensen,et al.  Prioritizing alarms from sensor-based detection models in livestock production - A review on model performance and alarm reducing methods , 2017, Comput. Electron. Agric..

[46]  A. Buccioni,et al.  Nutritional characteristics and quality of eggs from laying hens fed on a diet supplemented with chestnut tannin extract (Castanea sativa Miller) , 2016, British poultry science.

[47]  Marta Castro-Giraldez,et al.  Development of a non-destructive detection system of Deep Pectoral Myopathy in poultry by dielectric spectroscopy , 2018, Journal of Food Engineering.

[48]  Tsvetelina Georgieva,et al.  An indirect approach for egg weight sorting using image processing , 2018, Journal of Food Measurement and Characterization.

[49]  Irenilza de Alencar Nääs,et al.  Image analysis method to evaluate beak and head motion of broiler chickens during feeding , 2015, Comput. Electron. Agric..

[50]  João Batista Freire de Souza,et al.  The relationship between corn particle size and thermoregulation of laying hens in an equatorial semi-arid environment , 2014, International Journal of Biometeorology.

[51]  Tristan Perez,et al.  Autonomous Sweet Pepper Harvesting for Protected Cropping Systems , 2017, IEEE Robotics and Automation Letters.

[52]  R. Moe,et al.  Effects of subclinical footpad dermatitis and emotional arousal on surface foot temperature recorded with infrared thermography in turkey toms (Meleagris gallopavo) , 2018, Poultry science.

[53]  Yael Edan,et al.  Harvesting Robots for High‐value Crops: State‐of‐the‐art Review and Challenges Ahead , 2014, J. Field Robotics.

[54]  H. Xin,et al.  Comparative evaluation of three egg production systems : Housing characteristics and management practices , 2015 .

[55]  Naoshi Kondo,et al.  Robotics for Plant Production , 1998, Artificial Intelligence Review.

[56]  Guanghui Teng,et al.  A Sound Source Localisation Analytical Method for Monitoring the Abnormal Night Vocalisations of Poultry , 2018, Sensors.

[57]  Lie Tang,et al.  Automated morphological traits extraction for sorghum plants via 3D point cloud data analysis , 2019, Comput. Electron. Agric..

[58]  Joris IJsselmuiden,et al.  Evaluation of the performance of PoultryBot, an autonomous mobile robotic platform for poultry houses , 2018, Biosystems Engineering.

[59]  Dong Wang,et al.  Dairy goat detection based on Faster R-CNN from surveillance video , 2018, Comput. Electron. Agric..

[60]  Siva Kumar Balasundram,et al.  Research and development in agricultural robotics: a perspective of digital farming. , 2018 .

[61]  C L Daigle,et al.  Noncaged laying hens remain unflappable while wearing body-mounted sensors: Levels of agonistic behaviors remain unchanged and resource use is not reduced after habituation. , 2012, Poultry science.

[62]  W. Zheng,et al.  Design and performance evaluation of the upgraded portable monitoring unit for air quality in animal housing , 2016, Comput. Electron. Agric..

[63]  E. J. van Henten,et al.  Field Test of an Autonomous Cucumber Picking Robot , 2003 .

[64]  Pablo Prieto,et al.  LiDAR and thermal images fusion for ground-based 3D characterisation of fruit trees , 2016 .

[65]  Hongwei Xin,et al.  Digital Repository @ Iowa State University Automated Tracking and Behavior Quantification of Laying Hens Using 3D Computer Vision and Radio Frequency Identification Technologies , 2022 .

[66]  Baskar Ganapathysubramanian,et al.  An explainable deep machine vision framework for plant stress phenotyping , 2018, Proceedings of the National Academy of Sciences.

[67]  Peter McCloskey,et al.  A Mobile-Based Deep Learning Model for Cassava Disease Diagnosis , 2019, Front. Plant Sci..

[68]  David Ball,et al.  Vision‐based Obstacle Detection and Navigation for an Agricultural Robot , 2016, J. Field Robotics.

[69]  Yongwha Chung,et al.  Stress Detection and Classification of Laying Hens by Sound Analysis , 2015, Asian-Australasian journal of animal sciences.

[70]  O. Vendrametto,et al.  Precision livestock tools to improve products and processes in broiler production: a review , 2009 .

[71]  Volker Steinhage,et al.  High-precision 3D detection and reconstruction of grapes from laser range data for efficient phenotyping based on supervised learning , 2017, Comput. Electron. Agric..

[72]  Peter I. Corke,et al.  Monitoring Animal Behaviour and Environmental Interactions Using Wireless Sensor Networks, GPS Collars and Satellite Remote Sensing , 2009, Sensors.

[73]  En Li,et al.  Apple detection during different growth stages in orchards using the improved YOLO-V3 model , 2019, Comput. Electron. Agric..

[74]  Jacob Fraden,et al.  Handbook of modern sensors , 1997 .

[75]  Kuan Chong Ting,et al.  Machine Vision Assisted Robotic Seedling Transplanting , 1994 .

[76]  Jochen Hemming,et al.  Performance Evaluation of a Harvesting Robot for Sweet Pepper , 2017, J. Field Robotics.

[77]  Clive J. C. Phillips,et al.  Hens vary their vocal repertoire and structure when anticipating different types of reward , 2017, Animal Behaviour.

[78]  Veronica Redaelli,et al.  First Results of a Detection Sensor for the Monitoring of Laying Hens Reared in a Commercial Organic Egg Production Farm Based on the Use of Infrared Technology , 2016, Sensors.

[79]  Ian Stavness,et al.  Deep Plant Phenomics: A Deep Learning Platform for Complex Plant Phenotyping Tasks , 2017, Front. Plant Sci..

[80]  J. M. Molina-Martínez,et al.  A new portable application for automatic segmentation of plants in agriculture , 2017 .

[81]  Peter I. Corke,et al.  Localization and Navigation Assisted by Networked Cooperating Sensors and Robots , 2005, Int. J. Robotics Res..

[82]  Patrick S. Schnable,et al.  Field‐based robotic phenotyping of sorghum plant architecture using stereo vision , 2018, J. Field Robotics.

[83]  H. Li,et al.  Effects of two different broiler flooring systems on production performances, welfare, and environment under commercial production conditions , 2017, Poultry science.

[84]  Alexander Wendel,et al.  Spectral filter design based on in-field hyperspectral imaging and machine learning for mango ripeness estimation , 2019, Comput. Electron. Agric..

[85]  Kamel Barkaoui,et al.  Performability evaluation of server virtualized systems under bursty workload , 2018 .

[86]  Reza Ehsani,et al.  Task Assignment and Trajectory Planning Algorithm for a Class of Cooperative Agricultural Robots , 2015 .

[87]  Achim Walter,et al.  Remote, aerial phenotyping of maize traits with a mobile multi-sensor approach , 2015, Plant Methods.

[88]  Daniel Berckmans,et al.  A real-time monitoring tool to automatically measure the feed intakes of multiple broiler chickens by sound analysis , 2015, Comput. Electron. Agric..

[89]  Jean-Marie Aerts,et al.  Is precision livestock farming an engineer's daydream or nightmare, an animal's friend or foe, and a farmer's panacea or pitfall? , 2008 .

[90]  A. Wolc,et al.  Establishment of Hy-Line commercial laying hen whole blood gas and biochemistry reference intervals utilizing portable i-STAT1 clinical analyzer. , 2019, Poultry science.

[91]  Saman Abdanan Mehdizadeh,et al.  Application of computer vision and support vector regression for weight prediction of live broiler chicken , 2017 .

[92]  Changki Mo,et al.  Design, integration, and field evaluation of a robotic apple harvester , 2017, J. Field Robotics.

[93]  Eldert J. van Henten,et al.  Path planning for the autonomous collection of eggs on floors , 2014 .

[94]  Yibin Ying,et al.  A new method to manipulate broiler chicken growth and metabolism: Response to mixed LED light system , 2016, Scientific Reports.

[95]  Daniel Berckmans,et al.  Using sound technology to automatically detect the short-term feeding behaviours of broiler chickens , 2016, Comput. Electron. Agric..

[96]  Peter I. Corke,et al.  Transforming Agriculture through Pervasive Wireless Sensor Networks , 2007, IEEE Pervasive Computing.

[97]  Yankun Peng,et al.  Optical Methods and Techniques for Meat Quality Inspection , 2015 .

[98]  Mahmoud Omid,et al.  Egg volume prediction using machine vision technique based on pappus theorem and artificial neural network , 2015, Journal of Food Science and Technology.

[99]  Joris IJsselmuiden,et al.  Object discrimination in poultry housing using spectral reflectivity , 2018 .

[100]  Andreas Kamilaris,et al.  Deep learning in agriculture: A survey , 2018, Comput. Electron. Agric..

[101]  D. Berckmans,et al.  Predicting broiler gait scores from activity monitoring and flock data , 2018, Biosystems Engineering.

[102]  C. Small,et al.  Mapping and Monitoring Rice Agriculture with Multisensor Temporal Mixture Models , 2019 .

[103]  Roland Siegwart,et al.  Introduction to Autonomous Mobile Robots , 2004 .

[104]  Dries Berckmans,et al.  General introduction to precision livestock farming , 2017 .

[105]  Moon S. Kim,et al.  Hyperspectral Determination of Fluorescence Wavebands for Multispectral Imaging Detection of Multiple Animal Fecal Species Contaminations on Romaine Lettuce , 2018, Food and Bioprocess Technology.

[106]  Reza Ehsani,et al.  Detection of multi-tomato leaf diseases (late blight, target and bacterial spots) in different stages by using a spectral-based sensor , 2018, Scientific Reports.

[107]  Akanksha Rastogi,et al.  Teat detection algorithm: YOLO vs. Haar-cascade , 2019 .

[108]  Daniel Berckmans,et al.  Sound analysis to model weight of broiler chickens , 2017, Poultry science.

[109]  E. J. van Henten,et al.  Stem localization of sweet-pepper plants using the support wire as a visual cue , 2014 .

[110]  D Banerjee,et al.  Detection of jumping and landing force in laying hens using wireless wearable sensors. , 2014, Poultry science.

[111]  Frank Tuyttens,et al.  Performance, Welfare, Health and Hygiene of Laying Hens in Non-Cage Systems in Comparison with Cage Systems , 2012 .

[112]  Vincent Baeten,et al.  Hyperspectral Imaging Applications in Agriculture and Agro-Food Product Quality and Safety Control: A Review , 2013 .