PhotoId-Whale: Blue whale dorsal fin classification for mobile devices

Photo-identification (photo-id) is a method used in field studies by biologists to monitor animals according to their density, movement patterns and behavior, with the aim of predicting and preventing ecological risks. However, these methods can introduce subjectivity when manually classifying an individual animal, creating uncertainty or inaccuracy in the data as a result of the human criteria involved. One of the main objectives in photo-id is to implement an automated mechanism that is free of biases, portable, and easy to use. The main aim of this work is to develop an autonomous and portable photo-id system through the optimization of image classification algorithms that have high statistical dependence, with the goal of classifying dorsal fin images of the blue whale through offline information processing on a mobile platform. The new proposed methodology is based on the Scale Invariant Feature Transform (SIFT) that, in conjunction with statistical discriminators such as the variance and the standard deviation, fits the extracted data and selects the closest pixels that comprise the edges of the dorsal fin of the blue whale. In this way, we ensure the elimination of the most common external factors that could affect the quality of the image, thus avoiding the elimination of relevant sections of the dorsal fin. The photo-id method presented in this work has been developed using blue whale images collected off the coast of Baja California Sur. The results shown have qualitatively and quantitatively validated the method in terms of its sensitivity, specificity and accuracy on the Jetson Tegra TK1 mobile platform. The solution optimizes classic SIFT, balancing the results obtained with the computational cost, provides a more economical form of processing and obtains a portable system that could be beneficial for field studies through mobile platforms, making it available to scientists, government and the general public.

[1]  Hans-Peter Kriegel,et al.  A Density-Based Algorithm for Discovering Clusters in Large Spatial Databases with Noise , 1996, KDD.

[2]  A. Ponzo,et al.  Long-Term Photo-Identification Reveals the Population Dynamics and Strong Site Fidelity of Adult Whale Sharks to the Coastal Waters of Donsol, Philippines , 2018, Front. Mar. Sci..

[3]  Johan A. K. Suykens,et al.  Least Squares Support Vector Machine Classifiers , 1999, Neural Processing Letters.

[4]  James B. Grand,et al.  Variation in Detection Among Passive Infrared Triggered-cameras Used in Wildlife Research , 2010 .

[5]  R. A. Reijns,et al.  A computer‐aided program for pattern‐matching of natural marks on the spotted raggedtooth shark Carcharias taurus , 2007 .

[6]  Sparsh Mittal,et al.  A Survey on optimized implementation of deep learning models on the NVIDIA Jetson platform , 2019, J. Syst. Archit..

[7]  Jennifer Preece,et al.  Citizen Science: New Research Challenges for Human–Computer Interaction , 2016, Int. J. Hum. Comput. Interact..

[8]  Antonio Romano,et al.  APHIS: A new software for photo-matching in ecological studies , 2015, Ecol. Informatics.

[9]  Hany Farid,et al.  A computer‐assisted system for photographic mark–recapture analysis , 2012 .

[10]  Thanchira Suriyamongkol,et al.  Feasibility of Using Computer-Assisted Software for Recognizing Individual Rio Grande Cooter (Pseudemys gorzugi) , 2018, Copeia.

[11]  Feng Zhao,et al.  Optimal-selection-based suppressed fuzzy c-means clustering algorithm with self-tuning non local spatial information for image segmentation , 2014, Expert Syst. Appl..

[12]  Richard Inger,et al.  Smartphones in ecology and evolution: a guide for the app-rehensive , 2013, Ecology and evolution.

[13]  L. Herman,et al.  Movements and Population Structure of Humpback Whales in the North Pacific , 2001 .

[14]  Robert A. Davis,et al.  Incorporating Field Studies into Species Distribution and Climate Change Modelling: A Case Study of the Koomal Trichosurus vulpecula hypoleucus (Phalangeridae) , 2016, PloS one.

[15]  M. Rasmussen,et al.  An assessment of the natural marking patterns used for photo-identification of common minke whales and white-beaked dolphins in Icelandic waters , 2015, Journal of the Marine Biological Association of the United Kingdom.

[16]  I. Cuthill,et al.  Spotting the difference: towards fully-automated population monitoring of African penguins Spheniscus demersus , 2010 .

[17]  Alison Donnelly,et al.  The role of citizen science in monitoring biodiversity in Ireland , 2014, International Journal of Biometeorology.

[18]  Zaven Arzoumanian,et al.  An astronomical pattern-matching algorithm for computer-aided identification of whale sharks Rhincodon typus , 2005 .

[19]  Nasser Kehtarnavaz,et al.  An affine invariant curve matching method for photo-identification of marine mammals , 2005, Pattern Recognit..

[20]  B. Soheilian,et al.  EVALUATION OF SIFT AND SURF FOR VISION BASED LOCALIZATION , 2016 .

[21]  D. Gendron,et al.  A new classification method to simplify blue whale photo-identification technique , 2023, J. Cetacean Res. Manage..

[22]  Qihao Weng,et al.  A survey of image classification methods and techniques for improving classification performance , 2007 .

[23]  Daoliang Li,et al.  An improved KK-means clustering algorithm for fish image segmentation , 2013, Math. Comput. Model..

[24]  S. Ravela,et al.  Multi‐scale features for identifying individuals in large biological databases: an application of pattern recognition technology to the marbled salamander Ambystoma opacum , 2007 .

[25]  Eric S. Zolman,et al.  Automating Image Matching, Cataloging, and Analysis for Photo-Identification Research , 2006 .

[26]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[27]  A. Richardson,et al.  Photographic identification and citizen science combine to reveal long distance movements of individual reef manta rays Mobula alfredi along Australia’s east coast , 2019, Marine Biodiversity Records.

[28]  Chun-Yuan Lin,et al.  Embedded-Based Graphics Processing Unit Cluster Platform for Multiple Sequence Alignments , 2017, Evolutionary bioinformatics online.

[29]  C. Town,et al.  Manta Matcher: automated photographic identification of manta rays using keypoint features , 2013, Ecology and evolution.

[30]  Amit P. Sheth,et al.  Citizen Sensing, Social Signals, and Enriching Human Experience , 2009, IEEE Internet Computing.

[31]  Peter L. Tyack,et al.  Cetacean societies : field studies of dolphins and whales , 2001 .

[32]  B. Würsig,et al.  ECOLOGY, BEHAVIOR AND SOCIAL ORGANIZATION OF THE BOTTLENOSE DOLPHIN: A REVIEW , 1986 .

[33]  R. Reulke,et al.  Remote Sensing and Spatial Information Sciences , 2005 .

[34]  M. Bigg An assessment of killer whale (Orcinus orca) stocks off Vancouver Island, British Columbia , 1982 .

[35]  Dr. Kim M. Parsons Procedural Guideline No . 4 – 5 Using photographic identification techniques for assessing bottlenose dolphin ( Tursiops truncatus ) abundance and behaviour , 2004 .

[36]  Hal Whitehead,et al.  Comparison of Two Computer-Assisted Photo-Identification Methods Applied to Sperm Whales (Physeter macrocephalus) , 2005 .

[37]  Charles V. Stewart,et al.  Integral Curvature Representation and Matching Algorithms for Identification of Dolphins and Whales , 2017, 2017 IEEE International Conference on Computer Vision Workshops (ICCVW).

[38]  Ahmed Chater,et al.  New approach to the identification of the easy expression recognition system by robust techniques (SIFT, PCA-SIFT, ASIFT and SURF) , 2020 .

[39]  Marcella J. Kelly,et al.  COMPUTER-AIDED PHOTOGRAPH MATCHING IN STUDIES USING INDIVIDUAL IDENTIFICATION: AN EXAMPLE FROM SERENGETI CHEETAHS , 2001 .

[40]  D. Swann,et al.  Infrared-triggered cameras for detecting wildlife: an evaluation and review , 2004 .

[41]  Francisco J. Gallegos Funes,et al.  Photo-id of blue whale by means of the dorsal fin using clustering algorithms and color local complexity estimation for mobile devices , 2017, EURASIP J. Image Video Process..

[42]  Bill Carroll,et al.  An automated program to find animals and crop photographs for individual recognition , 2019, Ecol. Informatics.

[43]  Carol A. Sanders-Reed,et al.  Use of photo-identification data to quantify mother-calf association patterns in bottlenose dolphins , 2003 .

[44]  Luigi Cinque,et al.  Identifying elephant photos by multi-curve matching , 2008, Pattern Recognit..