FoxMask: a new automated tool for animal detection in camera trap images

Camera traps now represent a reliable, efficient and cost-effective technique to monitor wildlife and collect biological data in the field. However, efficiently extracting information from the massive amount of images generated is often extremely time-consuming and may now represent the most rate-limiting step in camera trap studies. To help overcome this challenge, we developed FoxMask, a new tool performing the automatic detection of animal presence in short sequences of camera trap images. FoxMask uses background estimation and foreground segmentation algorithms to detect the presence of moving objects (most likely, animals) on images. We analyzed a sample dataset from camera traps used to monitor activity on arctic fox Vulpes lagopus dens to test the parameter settings and the performance of the algorithm. The shape and color of arctic foxes, their background at snowmelt and during the summer growing season were highly variable, thus offering challenging testing conditions. We compared the automated animal detection performed by FoxMask to a manual review of the image series. The performance analysis indicated that the proportion of images correctly classified by FoxMask as containing an animal or not was very high (> 90%). FoxMask is thus highly efficient at reducing the workload by eliminating most false triggers (images without an animal). We provide parameter recommendations to facilitate usage and we present the cases where the algorithm performs less efficiently to stimulate further development. FoxMask is an easy-to-use tool freely available to ecologists performing camera trap data extraction. By minimizing analytical time, computer-assisted image analysis will allow collection of increased sample sizes and testing of new biological questions.

[1]  C. Lintott,et al.  Snapshot Serengeti, high-frequency annotated camera trap images of 40 mammalian species in an African savanna , 2015, Scientific Data.

[2]  Rahel Sollmann,et al.  camtrapR: an R package for efficient camera trap data management , 2016 .

[3]  C. Carbone,et al.  Surveys using camera traps: are we looking to a brighter future? , 2008 .

[4]  Jamie McCallum,et al.  Changing use of camera traps in mammalian field research: habitats, taxa and study types , 2013 .

[5]  Tony X. Han,et al.  Ensemble Video Object Cut in Highly Dynamic Scenes , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[7]  Hany Farid,et al.  A computer‐assisted system for photographic mark–recapture analysis , 2012 .

[8]  Chandra Krintz,et al.  Where's the Bear? - Automating Wildlife Image Processing Using IoT and Edge Cloud Systems , 2017, 2017 IEEE/ACM Second International Conference on Internet-of-Things Design and Implementation (IoTDI).

[9]  C. V. Jawahar,et al.  The truth about cats and dogs , 2011, 2011 International Conference on Computer Vision.

[10]  Ben. G. Weinstein A computer vision for animal ecology. , 2018, The Journal of animal ecology.

[11]  Julie Linchant,et al.  HOW MANY HIPPOS (HOMHIP): ALGORITHM FOR AUTOMATIC COUNTS OF ANIMALS WITH INFRA-RED THERMAL IMAGERY FROM UAV , 2015 .

[12]  Stanley J. Reeves,et al.  AnimalFinder: A semi-automated system for animal detection in time-lapse camera trap images , 2016, Ecol. Informatics.

[13]  Jacob S. Ivan,et al.  Cpw Photo Warehouse: a custom database to facilitate archiving, identifying, summarizing and managing photo data collected from camera traps , 2016 .

[14]  Margaret Kosmala,et al.  Automatically identifying wild animals in camera trap images with deep learning , 2017, ArXiv.

[15]  Prabhu Ramachandran,et al.  ViXeN: An open-source package for managing multimedia data , 2017 .

[16]  Jiangping Wang,et al.  Automated identification of animal species in camera trap images , 2013, EURASIP J. Image Video Process..

[17]  Ben G. Weinstein,et al.  MotionMeerkat: integrating motion video detection and ecological monitoring , 2015 .

[18]  Kristijn R. R. Swinnen,et al.  A Novel Method to Reduce Time Investment When Processing Videos from Camera Trap Studies , 2014, PloS one.

[19]  Paul D. Meek,et al.  User-based design specifications for the ultimate camera trap for wildlife research , 2012, Wildlife Research.

[20]  Brian C. Lovell,et al.  A Low-Complexity Algorithm for Static Background Estimation from Cluttered Image Sequences in Surveillance Contexts , 2013, EURASIP J. Image Video Process..

[21]  Jesús Francisco Vargas-Bonilla,et al.  Towards automatic wild animal monitoring: Identification of animal species in camera-trap images using very deep convolutional neural networks , 2016, Ecol. Informatics.

[22]  Brian C. Lovell,et al.  Improved Foreground Detection via Block-Based Classifier Cascade With Probabilistic Decision Integration , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[23]  T. Cutler Using remote photography in wildlife ecology : a review , 1999 .