Real-time identification of animals found in domestic areas of Europe

This paper presents a method for identifying 34 animal classes corresponding to the most conventional animals found in the domestic areas of Europe by using four types of Convolutional Neural Networks (CNNs), namely VGG-19, InceptionV3, ResNet-50, and MobileNetV2. We also built a system capable of classifying all these 34 animal classes from images as well as in real-time from videos or a webcam. Additionally, our system is capable to automatically generate two new datasets, one dataset containing textual information (i.e. animal class name, date and time interval when the animal was present in the frame) and one dataset containing images of the animal classes present and identified in videos or in front of a webcam. Our experimental results show a high overall test accuracy for all 4 proposed architectures (90.56% for VGG-19 model, 93.41% for InceptionV3 model, 93.49 for ResNet-50 model and 94.54% for MobileNetV2 model), proving that such systems enable an unobtrusive method for gathering a rich collection of information about the vast numbers of animal classes that are being identified such as providing insights about what animal classes are present at a given date and time in a certain area and how they look, resulting in valuable datasets especially for researchers in the area of ecology

[1]  Gyanendra K. Verma,et al.  Wild Animal Detection Using Deep Convolutional Neural Network , 2017, CVIP.

[2]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[3]  Zhongqi Miao,et al.  A comparison of visual features used by humans and machines to classify wildlife , 2018, bioRxiv.

[4]  Sorin Liviu Jurj,et al.  Position Optimization Method for a Solar Tracking Device Using the Cast-Shadow Principle , 2018, 2018 IEEE 24th International Symposium for Design and Technology in Electronic Packaging​ (SIITME).

[5]  Éric Gaussier,et al.  A Probabilistic Interpretation of Precision, Recall and F-Score, with Implication for Evaluation , 2005, ECIR.

[6]  Margaret Kosmala,et al.  Automatically identifying, counting, and describing wild animals in camera-trap images with deep learning , 2017, Proceedings of the National Academy of Sciences.

[7]  G. Hemantha Kumar,et al.  Convolutional Neural Network with SVM for Classification of Animal Images , 2019, Lecture Notes in Electrical Engineering.

[8]  Eugenio Culurciello,et al.  An Analysis of Deep Neural Network Models for Practical Applications , 2016, ArXiv.

[9]  Michael A. Tabak,et al.  Machine learning to classify animal species in camera trap images: applications in ecology , 2018, bioRxiv.

[10]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[11]  Tu Dinh Nguyen,et al.  Animal Recognition and Identification with Deep Convolutional Neural Networks for Automated Wildlife Monitoring , 2017, 2017 IEEE International Conference on Data Science and Advanced Analytics (DSAA).

[12]  G. Hemantha Kumar,et al.  Deep Learning Approach for Classification of Animal Videos , 2019 .

[13]  Vogelwarte Radolfzell,et al.  New technologies for monitoring bird migration and behaviour , 2009 .

[14]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).