Siamese Network Based Pelage Pattern Matching for Ringed Seal Re-identification

In this paper we propose a method to match pelage patterns of the Saimaa ringed seals enabling the re-identification of individuals. First, the pelage pattern is extracted from the seal’s fur using a method based on the Sato tubeness filter. After this, the similarities of the pelage pattern patches are computed using a siamese network trained with a triplet loss function and a large dataset of manually selected patches. The similarities are then used to find the best matching patches from the images in the database of known individuals. Furthermore, we employ the proposed pattern matching method to build a full framework for the ringed seal re-identification, consisting of CNN-based animal segmentation, patch correspondence detection, and ranking the images in the database of known seal individuals based on the similarity to the query image. Our experiments on challenging datasets of Saimaa ringed seals show that the proposed method achieves promising identification results, providing a useful tool for the Saimaa ringed seal monitoring.

[1]  Luc Van Gool,et al.  The 2005 PASCAL Visual Object Classes Challenge , 2005, MLCW.

[2]  George Papandreou,et al.  Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation , 2018, ECCV.

[3]  Tuomas Eerola,et al.  Identification of Saimaa Ringed Seal Individuals Using Transfer Learning , 2018, ACIVS.

[4]  Margaret Kosmala,et al.  Automatically identifying, counting, and describing wild animals in camera-trap images with deep learning , 2017, Proceedings of the National Academy of Sciences.

[5]  Yang Song,et al.  Learning Fine-Grained Image Similarity with Deep Ranking , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Lucas Beyer,et al.  In Defense of the Triplet Loss for Person Re-Identification , 2017, ArXiv.

[7]  Tanya Y. Berger-Wolf,et al.  Wildbook: Crowdsourcing, computer vision, and data science for conservation , 2017, ArXiv.

[8]  Joachim Denzler,et al.  Towards Automated Visual Monitoring of Individual Gorillas in the Wild , 2017, 2017 IEEE International Conference on Computer Vision Workshops (ICCVW).

[9]  Tuomas Eerola,et al.  Automatic individual identification of Saimaa ringed seals , 2018, IET Comput. Vis..

[10]  M. Becker,et al.  Applying computer‐aided photo‐identification to messy datasets: a case study of Thornicroft's giraffe (Giraffa camelopardalis thornicrofti) , 2015 .

[11]  Lijun Guo,et al.  Part-Pose Guided Amur Tiger Re-Identification , 2019, 2019 IEEE/CVF International Conference on Computer Vision Workshop (ICCVW).

[12]  M. Niemi,et al.  A mark–recapture approach for estimating population size of the endangered ringed seal (Phoca hispida saimensis) , 2019, PloS one.

[13]  Simone Calderara,et al.  Multi-views Embedding for Cattle Re-identification , 2018, 2018 14th International Conference on Signal-Image Technology & Internet-Based Systems (SITIS).

[14]  Tuomas Eerola,et al.  Segmentation of Saimaa Ringed Seals for Identification Purposes , 2015, ISVC.

[15]  Weiyao Lin,et al.  Amur Tiger Re-identification in the Wild , 2019, ArXiv.

[16]  Gregory R. Koch,et al.  Siamese Neural Networks for One-Shot Image Recognition , 2015 .

[17]  Guido Gerig,et al.  Three-dimensional multi-scale line filter for segmentation and visualization of curvilinear structures in medical images , 1998, Medical Image Anal..

[18]  Frédéric Maire,et al.  Robust Re-identification of Manta Rays from Natural Markings by Learning Pose Invariant Embeddings , 2019, 2021 Digital Image Computing: Techniques and Applications (DICTA).

[19]  Tanya Y. Berger-Wolf,et al.  HotSpotter — Patterned species instance recognition , 2013, 2013 IEEE Workshop on Applications of Computer Vision (WACV).

[20]  Graham W. Taylor,et al.  Similarity Learning Networks for Animal Individual Re-Identification - Beyond the Capabilities of a Human Observer , 2019, 2020 IEEE Winter Applications of Computer Vision Workshops (WACVW).

[21]  Nir Ailon,et al.  Deep Metric Learning Using Triplet Network , 2014, SIMBAD.

[22]  Sixue Gong,et al.  Face Recognition: Primates in the Wild , 2018, 2018 IEEE 9th International Conference on Biometrics Theory, Applications and Systems (BTAS).

[23]  Jiangping Wang,et al.  Automated identification of animal species in camera trap images , 2013, EURASIP J. Image Video Process..

[24]  Xiaogang Wang,et al.  DeepReID: Deep Filter Pairing Neural Network for Person Re-identification , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[25]  Marco Sannolo,et al.  Comparison of photo‐matching algorithms commonly used for photographic capture–recapture studies , 2017, Ecology and evolution.