A first step towards automated species recognition from camera trap images of mammals using AI in a European temperate forest

Camera traps are used worldwide to monitor wildlife. Despite the increasing availability of Deep Learning (DL) models, the effective usage of this technology to support wildlife monitoring is limited. This is mainly due to the complexity of DL technology and high computing requirements. This paper presents the implementation of the light-weight and state-of-the-art YOLOv5 architecture for automated labeling of camera trap images of mammals in the Białowieża Forest (BF), Poland. The camera trapping data were organized and harmonized using TRAPPER software, an open-source application for managing large-scale wildlife monitoring projects. The proposed image recognition pipeline achieved an average accuracy of 85% F1-score in the identification of the 12 most commonly occurring medium-size and large mammal species in BF, using a limited set of training and testing data (a total of 2659 images with animals).Based on the preliminary results, we have concluded that the YOLOv5 object detection and classification model is a fine and promising DL solution after the adoption of the transfer learning technique. It can be efficiently plugged in via an API into existing web-based camera trapping data processing platforms such as e.g. TRAPPER system. Since TRAPPER is already used to manage and classify (manually) camera trapping datasets by many research groups in Europe, the implementation of AI-based automated species classification will significantly speed up the data processing workflow and thus better support data-driven wildlife monitoring and conservation. Moreover, YOLOv5 has been proven to perform well on edge devices, which may open a new chapter in animal population monitoring in real-time directly from camera trap devices.

[1]  C. Lintott,et al.  Snapshot Serengeti, high-frequency annotated camera trap images of 40 mammalian species in an African savanna , 2015, Scientific Data.

[2]  Jakub W. Bubnicki,et al.  trapper: an open source web‐based application to manage camera trapping projects , 2016 .

[3]  Pietro Perona,et al.  Recognition in Terra Incognita , 2018, ECCV.

[4]  A. Ford,et al.  The ecology of human–carnivore coexistence , 2020, Proceedings of the National Academy of Sciences.

[5]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Oliver R. Wearn,et al.  Snap happy: camera traps are an effective sampling tool when compared with alternative methods , 2019, Royal Society Open Science.

[7]  M. Heurich,et al.  Keep the wolf from the door: How to conserve wolves in Europe's human-dominated landscapes? , 2019, Biological Conservation.

[8]  Shu Liu,et al.  Path Aggregation Network for Instance Segmentation , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[9]  Sergey Ioffe,et al.  Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning , 2016, AAAI.

[10]  Mohammad Sadegh Norouzzadeh,et al.  A deep active learning system for species identification and counting in camera trap images , 2019, Methods in Ecology and Evolution.

[11]  Jennifer L. Stenglein,et al.  Abundance estimation of unmarked animals based on camera‐trap data , 2020, Conservation Biology.

[12]  Hui Xiong,et al.  A Comprehensive Survey on Transfer Learning , 2019, Proceedings of the IEEE.

[13]  Kenji Doya,et al.  Sigmoid-Weighted Linear Units for Neural Network Function Approximation in Reinforcement Learning , 2017, Neural Networks.

[14]  Dan Morris,et al.  Efficient Pipeline for Camera Trap Image Review , 2019, ArXiv.

[15]  Ross T. Pitman,et al.  Robust ecological analysis of camera trap data labelled by a machine learning model , 2021, Methods in Ecology and Evolution.

[16]  Hong-Yuan Mark Liao,et al.  YOLOv4: Optimal Speed and Accuracy of Object Detection , 2020, ArXiv.

[17]  David W. Macdonald,et al.  Collapse of the world’s largest herbivores , 2015, Science Advances.

[18]  O. Liberg,et al.  Recovery of large carnivores in Europe’s modern human-dominated landscapes , 2014, Science.