A contrastive learning approach for individual re-identification in a wild fish population

In both terrestrial and marine ecology, physical tagging is a frequently used method to study population dynamics and behavior. However, such tagging techniques are increasingly being replaced by individual re-identification using image analysis. This paper introduces a contrastive learning-based model for identifying individuals. The model uses the first parts of the Inception v3 network, supported by a projection head, and we use contrastive learning to find similar or dissimilar image pairs from a collection of uniform photographs. We apply this technique for corkwing wrasse, Symphodus melops, an ecologically and commercially important fish species. Photos are taken during repeated catches of the same individuals from a wild population, where the intervals between individual sightings might range from a few days to several years. Our model achieves a one-shot accuracy of 0.35, a 5-shot accuracy of 0.56, and a 100-shot accuracy of 0.88, on our dataset.

[1]  Kailin Jiang,et al.  Fish Face Identification Based on Rotated Object Detection: Dataset and Exploration , 2022, Fishes.

[2]  Morten Goodwin,et al.  Hierarchical Object Detection applied to Fish Species , 2022, Nordic Machine Intelligence.

[3]  Liu Changyu,et al.  ultralytics/yolov5: v6.0 - YOLOv5n 'Nano' models, Roboflow integration, TensorFlow export, OpenCV DNN support , 2021 .

[4]  Morten Goodwin Olsen,et al.  Unlocking the potential of deep learning for marine ecology: overview, applications, and outlook , 2021, ArXiv.

[5]  Ellen M. Ditria,et al.  Automating the analysis of fish grazing behaviour from videos using image classification and optical flow , 2021, Animal Behaviour.

[6]  H. Browman,et al.  Movement patterns of temperate wrasses (Labridae) within a small Marine Protected Area. , 2021, Journal of fish biology.

[7]  Kerstin Bach,et al.  FishNet: A Unified Embedding for Salmon Recognition , 2020, ECAI.

[8]  Lei Jiao,et al.  Temperate fish detection and classification: a deep learning based approach , 2020, Applied Intelligence.

[9]  Thomas B. Moeslund,et al.  Re-Identification of Zebrafish using Metric Learning , 2020, 2020 IEEE Winter Applications of Computer Vision Workshops (WACVW).

[10]  Jose Manuel Lopez-Guede,et al.  Video Image Enhancement and Machine Learning Pipeline for Underwater Animal Detection and Classification at Cabled Observatories , 2020, Sensors.

[11]  Frédéric Maire,et al.  Robust Re-identification of Manta Rays from Natural Markings by Learning Pose Invariant Embeddings , 2019, 2021 Digital Image Computing: Techniques and Applications (DICTA).

[12]  Graham W. Taylor,et al.  Similarity Learning Networks for Animal Individual Re-Identification - Beyond the Capabilities of a Human Observer , 2019, 2020 IEEE Winter Applications of Computer Vision Workshops (WACVW).

[13]  Graham W. Taylor,et al.  Past, present and future approaches using computer vision for animal re‐identification from camera trap data , 2018, Methods in Ecology and Evolution.

[14]  Ben. G. Weinstein A computer vision for animal ecology. , 2018, The Journal of animal ecology.

[15]  Scott Lundberg,et al.  A Unified Approach to Interpreting Model Predictions , 2017, NIPS.

[16]  Tonje Knutsen Sørdalen,et al.  Sex- and size-selective harvesting of corkwing wrasse (Symphodus melops)—a cleaner fish used in salmonid aquaculture , 2017 .

[17]  Tonje Knutsen Sørdalen,et al.  Male-biased sexual size dimorphism in the nest building corkwing wrasse (Symphodus melops): implications for a size regulated fishery , 2016 .

[18]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[19]  Nir Ailon,et al.  Deep Metric Learning Using Triplet Network , 2014, SIMBAD.

[20]  G. Rosenqvist,et al.  Phenotypic variation between dimorphic males in corkwing wrasse , 2000 .

[21]  Yann LeCun,et al.  Signature Verification Using A "Siamese" Time Delay Neural Network , 1993, Int. J. Pattern Recognit. Artif. Intell..

[22]  Kristian Muri Knausgård,et al.  An Accurate Convolutional Neural Networks Approach to Wound Detection for Farmed Salmon , 2022, International Conference on Engineering Applications of Neural Networks.