EDEN: Deep Feature Distribution Pooling for Saimaa Ringed Seals Pattern Matching

In this paper, pelage pattern matching is considered to solve the individual re-identification of the Saimaa ringed seals. Animal reidentification together with the access to large amount of image material through camera traps and crowd-sourcing provide novel possibilities for animal monitoring and conservation. We propose a novel feature pooling approach that allow aggregating the local pattern features to get a fixed size embedding vector that incorporate global features by taking into account the spatial distribution of features. This is obtained by eigen decomposition of covariances computed for probability mass functions representing feature maps. Embedding vectors can then be used to find the best match in the database of known individuals allowing animal re-identification. The results show that the proposed pooling method outperforms the existing methods on the challenging Saimaa ringed seal image data.

[1]  Stefanos Zafeiriou,et al.  ArcFace: Additive Angular Margin Loss for Deep Face Recognition , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  Simon Osindero,et al.  Cross-Dimensional Weighting for Aggregated Deep Convolutional Features , 2015, ECCV Workshops.

[3]  Nir Ailon,et al.  Deep Metric Learning Using Triplet Network , 2014, SIMBAD.

[4]  Ronan Sicre,et al.  Particular object retrieval with integral max-pooling of CNN activations , 2015, ICLR.

[5]  Wei Chen,et al.  Deep Image Retrieval: A Survey , 2021, ArXiv.

[6]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[7]  Jongtack Kim,et al.  Combination of Multiple Global Descriptors for Image Retrieval , 2019, ArXiv.

[8]  Ross B. Girshick,et al.  Mask R-CNN , 2017, 1703.06870.

[9]  Qian Wang,et al.  Detection Features as Attention (Defat): A Keypoint-Free Approach to Amur Tiger Re-Identification , 2020, 2020 IEEE International Conference on Image Processing (ICIP).

[10]  Victor S. Lempitsky,et al.  Aggregating Local Deep Features for Image Retrieval , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[11]  Jana Kosecka,et al.  Deep Convolutional Features for Image Based Retrieval and Scene Categorization , 2015, ArXiv.

[12]  T. Nyman,et al.  Sealed in a lake — Biology and conservation of the endangered Saimaa ringed seal: A review , 2021 .

[13]  Alexandros Stergiou,et al.  Refining activation downsampling with SoftPool , 2021, 2021 IEEE/CVF International Conference on Computer Vision (ICCV).

[14]  Tuomas Eerola,et al.  Segmentation of Saimaa Ringed Seals for Identification Purposes , 2015, ISVC.

[15]  Tuomas Eerola,et al.  Identification of Saimaa Ringed Seal Individuals Using Transfer Learning , 2018, ACIVS.

[16]  Giorgos Tolias,et al.  Fine-Tuning CNN Image Retrieval with No Human Annotation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Frédéric Maire,et al.  Learning Landmark Guided Embeddings for Animal Re-identification , 2020, 2020 IEEE Winter Applications of Computer Vision Workshops (WACVW).

[18]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[19]  Tuomas Eerola,et al.  Automatic individual identification of Saimaa ringed seals , 2018, IET Comput. Vis..

[20]  Tuomas Eerola,et al.  Siamese Network Based Pelage Pattern Matching for Ringed Seal Re-identification , 2020, 2020 IEEE Winter Applications of Computer Vision Workshops (WACVW).

[21]  Meeri Koivuniemi,et al.  Photo-ID as a tool for studying and monitoring the endangered Saimaa ringed seal , 2016 .

[22]  Krystian Mikolajczyk,et al.  SOLAR: Second-Order Loss and Attention for Image Retrieval , 2020, ECCV.

[23]  Frank Hutter,et al.  Decoupled Weight Decay Regularization , 2017, ICLR.

[24]  Graham W. Taylor,et al.  Similarity Learning Networks for Animal Individual Re-Identification - Beyond the Capabilities of a Human Observer , 2019, 2020 IEEE Winter Applications of Computer Vision Workshops (WACVW).