Fusing Animal Biometrics with Autonomous Robotics: Drone-based Search and Individual ID of Friesian Cattle (Extended Abstract)

This work covers the robotic drone integration of a re-identification system for Friesian Cattle. We have built a computationally-enhanced M100 UAV platform with an on-board deep learning inference system for integrated computer vision and navigation able to autonomously find and visually identify by coat pattern individual Holstein Friesian cattle in freely moving herds. For autonomous drone-based identification we describe an approach that utilises three deep convolutional neural network architectures running live onboard the aircraft; that is, a YoloV2-based species detector, a dual-stream Convolutional Neural Network (CNN) delivering exploratory agency and an InceptionV3-based biometric Long-term Recurrent Convoluational Network (LRCN) for individual animal identification. We evaluate the performance of components offline, and also online via real-world field tests of autonomous low-altitude flight in a farm environment. The presented proof-of-concept system is a successful step towards autonomous biometric identification of individual animals from the air in open pasture environments and inside farms for tag-less AI support in farming and ecology. The work is published in full in IROS 2019 [4].

[1]  Yoram Koren,et al.  Real-time obstacle avoidance for fast mobile robots in cluttered environments , 1990, Proceedings., IEEE International Conference on Robotics and Automation.

[2]  Jean-Michel Morel,et al.  ASIFT: A New Framework for Fully Affine Invariant Image Comparison , 2009, SIAM J. Imaging Sci..

[3]  S. Kondo,et al.  Stabilization of social hierarchy in dairy cows , 1990 .

[4]  Ali Farhadi,et al.  YOLO9000: Better, Faster, Stronger , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[6]  G. G. Stokes.  "J." , 1890, The New Yale Book of Quotations.

[7]  Francisco Bonin-Font,et al.  Visual Navigation for Mobile Robots: A Survey , 2008, J. Intell. Robotic Syst..

[8]  R. Ungerfeld,et al.  Time budget differences of high- and low-social rank grazing dairy cows , 2014 .

[9]  Neill W. Campbell,et al.  Automatic individual holstein friesian cattle identification via selective local coat pattern matching in RGB-D imagery , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[10]  A. Hodgson,et al.  Unmanned Aerial Vehicles (UAVs) for Surveying Marine Fauna: A Dugong Case Study , 2013, PloS one.

[11]  B. Sowell,et al.  Social behavior of grazing beef cattle: Implications for management , 2000 .

[12]  Jürgen Schmidhuber,et al.  A Machine Learning Approach to Visual Perception of Forest Trails for Mobile Robots , 2016, IEEE Robotics and Automation Letters.

[13]  Giulio Sandini,et al.  Divergent stereo for robot navigation: learning from bees , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[14]  Agathoniki Trigoni,et al.  Supporting Search and Rescue Operations with UAVs , 2010, 2010 International Conference on Emerging Security Technologies.

[15]  Luc Van Gool,et al.  The Pascal Visual Object Classes (VOC) Challenge , 2010, International Journal of Computer Vision.

[16]  Xiaolong Hui,et al.  Vision-based autonomous navigation approach for unmanned aerial vehicle transmission-line inspection , 2018 .

[17]  H. Kühl,et al.  Animal biometrics: quantifying and detecting phenotypic appearance. , 2013, Trends in ecology & evolution.

[18]  Airam Rodríguez,et al.  The Eye in the Sky: Combined Use of Unmanned Aerial Systems and GPS Data Loggers for Ecological Research and Conservation of Small Birds , 2012, PloS one.

[19]  G. Oriolo,et al.  On-line map building and navigation for autonomous mobile robots , 1995, Proceedings of 1995 IEEE International Conference on Robotics and Automation.

[20]  P. Gregorini,et al.  Diurnal grazing pattern: its physiological basis and strategic management , 2011 .

[21]  Colin Greatwood,et al.  Deep Learning for Exploration and Recovery of Uncharted and Dynamic Targets from UAV-like Vision , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[22]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[23]  Wen Yang,et al.  An Intelligent Unmanned Aircraft System for Wilderness Search and Rescue , 2017 .

[24]  Hans-J. Briegel,et al.  Projective simulation applied to the grid-world and the mountain-car problem , 2014, Artif. Intell. Res..

[25]  Avinash C. Kak,et al.  Vision for Mobile Robot Navigation: A Survey , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[26]  Trent L. McDonald,et al.  Evaluation of an Unmanned Airborne System for Monitoring Marine Mammals , 2009 .

[27]  C. Phillips,et al.  The effects of social dominance on the production and behavior of grazing dairy cows offered forage supplements. , 2002, Journal of dairy science.

[28]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[29]  Takuji Nishimura,et al.  Mersenne twister: a 623-dimensionally equidistributed uniform pseudo-random number generator , 1998, TOMC.

[30]  Tomonari Furukawa,et al.  Autonomous robotic strategies for urban search and rescue , 2012 .

[31]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[32]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[33]  William Andrew,et al.  Aerial Animal Biometrics: Individual Friesian Cattle Recovery and Visual Identification via an Autonomous UAV with Onboard Deep Inference , 2019, 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[34]  Yanning Zhang,et al.  Convolutional Neural Network-Based Robot Navigation Using Uncalibrated Spherical Images , 2017, Sensors.

[35]  James L. Crowley,et al.  Appearance based process for visual navigation , 1997, Proceedings of the 1997 IEEE/RSJ International Conference on Intelligent Robot and Systems. Innovative Robotics for Real-World Applications. IROS '97.

[36]  Amr Abd-Elrahman,et al.  Development of Pattern Recognition Algorithm for Automatic Bird Detection from Unmanned Aerial Vehicle Imagery , 2005 .

[37]  Trevor Darrell,et al.  Long-term recurrent convolutional networks for visual recognition and description , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[38]  Wolfram Burgard,et al.  Neural SLAM: Learning to Explore with External Memory , 2017, 1706.09520.

[39]  Colin Greatwood,et al.  Visual Localisation and Individual Identification of Holstein Friesian Cattle via Deep Learning , 2017, 2017 IEEE International Conference on Computer Vision Workshops (ICCVW).

[40]  Stacey A. Gunter,et al.  Behavior and Daily Grazing Patterns of Cattle , 2006 .

[41]  Parvaneh Saeedi,et al.  Vision-based 3-D trajectory tracking for unknown environments , 2006, IEEE Transactions on Robotics.

[42]  Avinash C. Kak,et al.  Fast Vision-guided Mobile Robot Navigation Using Model-based Reasoning And Prediction Of Uncertainties , 1992, Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems.

[43]  Ning Qian,et al.  On the momentum term in gradient descent learning algorithms , 1999, Neural Networks.

[44]  Hans P. Moravec,et al.  The Stanford Cart and the CMU Rover , 1983, Proceedings of the IEEE.

[45]  Richard M. Everson,et al.  Video tracking of dairy cows for assessing mobility scores , 2013 .

[46]  Angelos Antonopoulos,et al.  Towards Autonomous Modular UAV Missions: The Detection, Geo-Location and Landing Paradigm , 2016, Sensors.

[47]  Masayuki Inaba,et al.  Visual navigation using view-sequenced route representation , 1996, Proceedings of IEEE International Conference on Robotics and Automation.

[48]  Michael A. Goodrich,et al.  UAV intelligent path planning for Wilderness Search and Rescue , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.