Biodiversity Information Retrieval Through Large Scale Content-Based Identification: A Long-Term Evaluation

Identifying and naming living plants or animals is usually impossible for the general public and often a difficult task for professionals and naturalists. Bridging this gap is a key challenge towards enabling effective biodiversity information retrieval systems. This taxonomic gap was actually already identified as one of the main ecological challenges to be solved during the Rio de Janeiro United Nations “Earth Summit” in 1992. Since 2011, the LifeCLEF challenges conducted in the context of the CLEF evaluation forum have been boosting and evaluating the advances in this domain. Data collections with an unprecedented volume and diversity have been shared with the scientific community to allow repeatable and long-term experiments. This paper describes the methodology of the conducted evaluation campaigns as well as providing a synthesis of the main results and lessons learned along the years.

[1]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  Thomas Mensink,et al.  Image Classification with the Fisher Vector: Theory and Practice , 2013, International Journal of Computer Vision.

[3]  Ellen M. Voorhees,et al.  The TREC-8 Question Answering Track Report , 1999, TREC.

[4]  Pierre Bonnet,et al.  Plant Identification Based on Noisy Web Data: the Amazing Performance of Deep Learning (LifeCLEF 2017) , 2017, CLEF.

[5]  Hervé Glotin,et al.  Bird detection in audio: A survey and a challenge , 2016, 2016 IEEE 26th International Workshop on Machine Learning for Signal Processing (MLSP).

[6]  Paul Roe,et al.  A toolbox for animal call recognition , 2012 .

[7]  Itheri Yahiaoui,et al.  Interactive plant identification based on social image data , 2014, Ecol. Informatics.

[8]  Nozha Boujemaa,et al.  The imageCLEF plant identification task 2013 , 2013, MAED '13.

[9]  Thomas G. Dietterich,et al.  The eBird enterprise: An integrated approach to development and application of citizen science , 2014 .

[10]  Stefan Kahl,et al.  Large-Scale Bird Sound Classification using Convolutional Neural Networks , 2017, CLEF.

[11]  Charles E Taylor,et al.  Automated species recognition of antbirds in a Mexican rainforest using hidden Markov models. , 2008, The Journal of the Acoustical Society of America.

[12]  Nozha Boujemaa,et al.  The CLEF 2011 Plant Images Classification Task , 2011, CLEF.

[13]  Simon N. Stuart,et al.  2004 IUCN Red List of Threatened Species: A Global Species Assessment edited by Jonathan E.M. Baillie, Craig Hilton-Taylor & Simon N. Stuart (2004), xxiii + 191 pp., IUCN, Gland, Switzerland and Cambridge, UK. ISBN 2 8317 0826 5 (pbk), £18.50. , 2005, Oryx.

[14]  Ingo Schmitt,et al.  BTU DBIS' Plant Identification Runs at ImageCLEF 2012 , 2012, CLEF.

[15]  Anne Verroust-Blondet,et al.  Inria's Participation at ImageCLEF 2013 Plant Identification Task , 2013, CLEF.

[16]  Sungbin Choi Fish Identification in Underwater Video with Deep Convolutional Neural Network: SNUMedinfo at LifeCLEF Fish task 2015 , 2015, CLEF.

[17]  Jinhai Cai,et al.  Sensor Network for the Monitoring of Ecosystem: Bird Species Recognition , 2007, 2007 3rd International Conference on Intelligent Sensors, Sensor Networks and Information.

[18]  Hervé Glotin,et al.  LifeCLEF Bird Identification Task 2016: The arrival of Deep learning , 2016, CLEF.

[19]  Mario Lasseck Large-scale Identification of Birds in Audio Recordings , 2014, CLEF.

[20]  Dah-Jye Lee,et al.  Contour matching for a fish recognition and migration-monitoring system , 2004, SPIE Optics East.

[21]  Hervé Glotin,et al.  Audio Bird Classification with Inception-v4 extended with Time and Time-Frequency Attention Mechanisms , 2017, CLEF.

[22]  Hervé Glotin,et al.  Fine-grained object recognition in underwater visual data , 2016, Multimedia Tools and Applications.

[23]  Nozha Boujemaa,et al.  The ImageCLEF 2012 Plant Identification Task , 2012, CLEF.

[24]  Hideki Nakayama NLab-UTokyo at ImageCLEF 2013 Plant Identification Task , 2013, CLEF.

[25]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[26]  Jean-Christophe Lombardo,et al.  Unsupervised Individual Whales Identification: Spot the Difference in the Ocean , 2016, CLEF.

[27]  W. John Kress,et al.  Leafsnap: A Computer Vision System for Automatic Plant Species Identification , 2012, ECCV.

[28]  Hervé Glotin,et al.  Efficient Instance-based Fish Species Visual Identification by Global Representation , 2014, CLEF.

[29]  Andrew Zisserman,et al.  Automated Flower Classification over a Large Number of Classes , 2008, 2008 Sixth Indian Conference on Computer Vision, Graphics & Image Processing.

[30]  Mostafa Mehdipour-Ghazi,et al.  Sabanci-Okan System in LifeCLEF 2015 Plant Identification Competition , 2015, CLEF.

[31]  Sungbin Choi Plant Identification with Deep Convolutional Neural Network: SNUMedinfo at LifeCLEF Plant Identification Task 2015 , 2015, CLEF.

[32]  Jon Rosewell,et al.  Crowdsourcing the identification of organisms: A case-study of iSpot , 2015, ZooKeys.

[33]  M. O'Neill,et al.  Automated species identification: why not? , 2004, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[34]  Qiang Chen,et al.  IBM Research Australia at LifeCLEF2014: Plant Identification Task , 2014, CLEF.

[35]  Alexis Joly,et al.  LifeCLEF Plant Identification Task 2014 , 2014, CLEF.