Unique Animal Identification using Deep Transfer Learning For Data Fusion in Siamese Networks

The unique automated identification of animals of various species is a pressing challenge ecologically, environmentally and economically. A broader question relates to how one might exploit the somewhat more mature technologies and techniques used within human visual biometrics to automate this same task for other species. One specific technique is the use of region proposal networks and deep transfer learning in siamese networks for individual animal identification. We report that although it is relatively easy to achieve state of the art performance in uniquely identifying individuals for the easy target of zebras, trying to use the same pipeline to obtain useable, top-10> 85%, results for a more challenging species such as nyala is still an open research problem. We argue that uniquely identifying individuals such as nyala who actively try to disguise themselves in their environments require improved few-shot learning techniques and perhaps more data than the current open dataset we have provided to stimulate this area of research.

[1]  Graham W. Taylor,et al.  Similarity Learning Networks for Animal Individual Re-Identification - Beyond the Capabilities of a Human Observer , 2019, 2020 IEEE Winter Applications of Computer Vision Workshops (WACVW).

[2]  Sixue Gong,et al.  Face Recognition: Primates in the Wild , 2018, 2018 IEEE 9th International Conference on Biometrics Theory, Applications and Systems (BTAS).

[3]  Yang Song,et al.  The iNaturalist Challenge 2017 Dataset , 2017, ArXiv.

[4]  Yann LeCun,et al.  Dimensionality Reduction by Learning an Invariant Mapping , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[5]  Margaret Kosmala,et al.  Automatically identifying, counting, and describing wild animals in camera-trap images with deep learning , 2017, Proceedings of the National Academy of Sciences.

[6]  Jürgen Schmidhuber,et al.  Multimodal Similarity-Preserving Hashing , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Tanya Y. Berger-Wolf,et al.  Biometric animal databases from field photographs: identification of individual zebra in the wild , 2011, ICMR.

[8]  David A. Forsyth,et al.  Building models of animals from video , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Andrew Gilman,et al.  Individual Common Dolphin Identification Via Metric Embedding Learning , 2018, 2018 International Conference on Image and Vision Computing New Zealand (IVCNZ).

[10]  Chris D. Nugent,et al.  Transfer Learning and Data Fusion Approach to Recognize Activities of Daily Life , 2018, PervasiveHealth.

[11]  Yann LeCun,et al.  Learning a similarity metric discriminatively, with application to face verification , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[12]  Simone Calderara,et al.  Multi-views Embedding for Cattle Re-identification , 2018, 2018 14th International Conference on Signal-Image Technology & Internet-Based Systems (SITIS).

[13]  Ping Lu,et al.  Person re-identification by enhanced local maximal occurrence representation and generalized similarity metric learning , 2018, Neurocomputing.

[14]  Weiyao Lin,et al.  Amur Tiger Re-identification in the Wild , 2019, ArXiv.

[15]  Frédéric Maire,et al.  Robust Re-identification of Manta Rays from Natural Markings by Learning Pose Invariant Embeddings , 2019, 2021 Digital Image Computing: Techniques and Applications (DICTA).

[16]  Sanjay Kumar Singh,et al.  Visual animal biometrics: survey , 2017, IET Biom..

[17]  Federico Castanedo,et al.  A Review of Data Fusion Techniques , 2013, TheScientificWorldJournal.

[18]  Kian Hsiang Low,et al.  Gaussian process decentralized data fusion meets transfer learning in large-scale distributed cooperative perception , 2017, Autonomous Robots.

[19]  Eric Bruno,et al.  Multimodal Preference Aggregation for Multimedia Information Retrieval , 2009, J. Multim..

[20]  Patrick Mäder,et al.  Plant species classification using flower images—A comparative study of local feature representations , 2017, PloS one.

[21]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Abdulrahman O. Ibraheem On the Choice of Inter-Class Distance Maximization Term in Siamese Neural Networks , 2018, Neural Processing Letters.

[23]  Shan Gao,et al.  Performance evaluation of early and late fusion methods for generic semantics indexing , 2013, Pattern Analysis and Applications.

[24]  Yu Zheng,et al.  Methodologies for Cross-Domain Data Fusion: An Overview , 2015, IEEE Transactions on Big Data.

[25]  Tilo Burghardt,et al.  Individual Animal Identification using Visual Biometrics on Deformable Coat-Patterns , 2007, ICVS 2007.

[26]  Y. B. Liu,et al.  Pairwise Generalization Network for Cross-Domain Image Recognition , 2019, Neural Processing Letters.

[27]  Ben. G. Weinstein A computer vision for animal ecology. , 2018, The Journal of animal ecology.

[28]  Graham W. Taylor,et al.  Past, present and future approaches using computer vision for animal re‐identification from camera trap data , 2018, Methods in Ecology and Evolution.

[29]  Jiangping Wang,et al.  Automated identification of animal species in camera trap images , 2013, EURASIP J. Image Video Process..

[30]  Tanya Y. Berger-Wolf,et al.  An Animal Detection Pipeline for Identification , 2018, 2018 IEEE Winter Conference on Applications of Computer Vision (WACV).