LifeCLEF 2016: Multimedia Life Species Identification Challenges

Using multimedia identification tools is considered as one of the most promising solutions to help bridge the taxonomic gap and build accurate knowledge of the identity, the geographic distribution and the evolution of living species. Large and structured communities of nature observers (e.g., iSpot, Xeno-canto, Tela Botanica, etc.) as well as big monitoring equipment have actually started to produce outstanding collections of multimedia records. Unfortunately, the performance of the state-of-the-art analysis techniques on such data is still not well understood and is far from reaching real world requirements. The LifeCLEF lab proposes to evaluate these challenges around 3 tasks related to multimedia information retrieval and fine-grained classification problems in 3 domains. Each task is based on large volumes of real-world data and the measured challenges are defined in collaboration with biologists and environmental stakeholders to reflect realistic usage scenarios. For each task, we report the methodology, the data sets as well as the results and the main outcome

[1]  Mostafa Mehdipour-Ghazi,et al.  Open-set Plant Identification Using an Ensemble of Deep Convolutional Neural Networks , 2016, CLEF.

[2]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[3]  Dávid Papp,et al.  Object Detection, Classification, Tracking and individual Recognition for Sea Images and Videos , 2016, CLEF.

[4]  Thi-Lan Le,et al.  MICA at LifeCLEF 2015: Multi-organ Plant Identification , 2015, CLEF.

[5]  Faisal Shafait,et al.  Automated Fish Detection in Underwater Images Using Shape‐Based Level Sets , 2015 .

[6]  Nozha Boujemaa,et al.  The ImageCLEF 2012 Plant Identification Task , 2012, CLEF.

[7]  Gözde B. Ünal,et al.  Plant Image Retrieval Using Color, Shape and Texture Features , 2011, Comput. J..

[8]  André Ricardo Backes,et al.  Plant Leaf Identification Based on Volumetric Fractal Dimension , 2009, Int. J. Pattern Recognit. Artif. Intell..

[9]  W. John Kress,et al.  Next-Generation Field Guides , 2013 .

[10]  Charles E Taylor,et al.  Automated species recognition of antbirds in a Mexican rainforest using hidden Markov models. , 2008, The Journal of the Acoustical Society of America.

[11]  Hervé Glotin,et al.  High Performance Computer Acoustic Data Accelerator: A New System for Exploring Marine Mammal Acoustics for Big Data Applications , 2015, ArXiv.

[12]  Simon N. Stuart,et al.  2004 IUCN Red List of Threatened Species: A Global Species Assessment edited by Jonathan E.M. Baillie, Craig Hilton-Taylor & Simon N. Stuart (2004), xxiii + 191 pp., IUCN, Gland, Switzerland and Cambridge, UK. ISBN 2 8317 0826 5 (pbk), £18.50. , 2005, Oryx.

[13]  Grigorios Tsoumakas,et al.  The 9th annual MLSP competition: New methods for acoustic classification of multiple simultaneous bird species in a noisy environment , 2013, 2013 IEEE International Workshop on Machine Learning for Signal Processing (MLSP).

[14]  Thomas Hofmann,et al.  Audio Based Bird Species Identification using Deep Learning Techniques , 2016, CLEF.

[15]  Mario Lasseck,et al.  Improved Automatic Bird Identification through Decision Tree based Feature Selection and Bagging , 2015, CLEF.

[16]  Bálint Tóth,et al.  Convolutional Neural Networks for Large-Scale Bird Song Classification in Noisy Environment , 2016, CLEF.

[17]  Simone Palazzo,et al.  A rule-based event detection system for real-life underwater domain , 2013, Machine Vision and Applications.

[18]  Ellen M. Voorhees,et al.  The TREC-8 Question Answering Track Report , 1999, TREC.

[19]  Alexis Joly,et al.  Floristic participation at LifeCLEF 2016 Plant Identification Task , 2016, CLEF.

[20]  Hervé Glotin,et al.  Bag of MFCC-based Words for Bird Identification , 2016, CLEF.

[21]  Paolo Remagnino,et al.  Plant Identification System based on a Convolutional Neural Network for the LifeClef 2016 Plant Classification Task , 2016, CLEF.

[22]  Jiri Matas,et al.  Very Deep Residual Networks with MaxOut for Plant Identification in the Wild , 2016, CLEF.

[23]  Caroline Pollock,et al.  2000 IUCN red list of threatened species , 2000 .

[24]  Ajmal Mian,et al.  A review of techniques for the identification and measurement of fish in underwater stereo-video image sequences , 2013, Optical Metrology.

[25]  Sungbin Choi Fish Identification in Underwater Video with Deep Convolutional Neural Network: SNUMedinfo at LifeCLEF Fish task 2015 , 2015, CLEF.

[26]  Kresimir Williams,et al.  Advances in Methods for Marine Mammal and Fish Stock Assessments: Thermal Imagery and CamTrawl , 2015 .

[27]  Laure Tougne,et al.  A Parametric Active Polygon for Leaf Segmentation and Shape Estimation , 2011, ISVC.

[28]  Andreas Rauber,et al.  LifeCLEF Bird Identification Task 2017 , 2017, CLEF.

[29]  Andrew Zisserman,et al.  Automated Flower Classification over a Large Number of Classes , 2008, 2008 Sixth Indian Conference on Computer Vision, Graphics & Image Processing.

[30]  Mostafa Mehdipour-Ghazi,et al.  Sabanci-Okan System in LifeCLEF 2015 Plant Identification Competition , 2015, CLEF.

[31]  Pierre Bonnet,et al.  Participation of INRIA & Pl@ntNet to ImageCLEF 2011 Plant Images Classification Task , 2011, CLEF.

[32]  Peter I. Corke,et al.  Content Specific Feature Learning for Fine-Grained Plant Classification , 2015, CLEF.

[33]  Concetto Spampinato,et al.  Proceedings of the 1st ACM international workshop on Multimedia analysis for ecological data , 2012, MM 2012.

[34]  Alvaro Rodríguez,et al.  Fish Monitoring and Sizing Using Computer Vision , 2015, IWINAC.

[35]  Nozha Boujemaa,et al.  The ImageCLEF 2011 plant images classification task , 2011 .

[36]  Thomas Mensink,et al.  Improving the Fisher Kernel for Large-Scale Image Classification , 2010, ECCV.

[37]  Koen E. A. van de Sande,et al.  Selective Search for Object Recognition , 2013, International Journal of Computer Vision.

[38]  Dah-Jye Lee,et al.  Contour matching for a fish recognition and migration-monitoring system , 2004, SPIE Optics East.

[39]  Pierre Bonnet,et al.  Plant Identification in an Open-world (LifeCLEF 2016) , 2016, CLEF.

[40]  Anne Verroust-Blondet,et al.  Advanced shape context for plant species identification using leaf image retrieval , 2012, ICMR.

[41]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[42]  Terrance E. Boult,et al.  Towards Open World Recognition , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[43]  Karol J. Piczak Recognizing Bird Species in Audio Recordings using Deep Convolutional Neural Networks , 2016, CLEF.

[44]  Paul Roe,et al.  A toolbox for animal call recognition , 2012 .

[45]  Jean-Christophe Lombardo,et al.  Unsupervised Individual Whales Identification: Spot the Difference in the Ocean , 2016, CLEF.

[46]  W. John Kress,et al.  Leafsnap: A Computer Vision System for Automatic Plant Species Identification , 2012, ECCV.

[47]  Maximilien Servajean,et al.  A Comparative Study of Fine-grained Classification Methods in the Context of the LifeCLEF Plant Identification Challenge 2015 , 2015, CLEF.

[48]  Xiaoli Z. Fern,et al.  Acoustic classification of multiple simultaneous bird species: a multi-instance multi-label approach. , 2012, The Journal of the Acoustical Society of America.

[49]  Hervé Glotin,et al.  Clusterized Mel Filter Cepstral Coefficients and Support Vector Machines for Bird Song Identification , 2014 .

[50]  Radford M. Neal Pattern Recognition and Machine Learning , 2007, Technometrics.

[51]  Mario Lasseck Improving Bird Identification using Multiresolution Template Matching and Feature Selection during Training , 2016, CLEF.

[52]  Robert B. Fisher,et al.  A research tool for long-term and continuous analysis of fish assemblage in coral-reefs using underwater camera footage , 2014, Ecol. Informatics.

[53]  Jinhai Cai,et al.  Sensor Network for the Monitoring of Ecosystem: Bird Species Recognition , 2007, 2007 3rd International Conference on Intelligent Sensors, Sensor Networks and Information.

[54]  Hervé Glotin,et al.  LifeCLEF Bird Identification Task 2016: The arrival of Deep learning , 2016, CLEF.

[55]  Berrin A. Yanikoglu,et al.  Morphological features for leaf based plant recognition , 2013, 2013 IEEE International Conference on Image Processing.

[56]  Dan Stowell BirdCLEF 2015 Submission: Unsupervised Feature Learning from Audio , 2015, CLEF.

[57]  Juan C. Caicedo,et al.  Fine-tuning Deep Convolutional Networks for Plant Recognition , 2015, CLEF.

[58]  Bo Li,et al.  Invasive alien plants in China: diversity and ecological insights , 2008, Biological Invasions.

[59]  Alexis Joly,et al.  LifeCLEF Plant Identification Task 2014 , 2014, CLEF.

[60]  D. Pimentel,et al.  Update on the environmental and economic costs associated with alien-invasive species in the United States , 2005 .

[61]  M. O'Neill,et al.  Automated species identification: why not? , 2004, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[62]  S. Kundu,et al.  Shape Oriented Feature Selection for Tomato Plant Identification , 2013 .

[63]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[64]  Peter I. Corke,et al.  Feature Learning via Mixtures of DCNNs for Fine-Grained Plant Classification , 2016, CLEF.

[65]  Itheri Yahiaoui,et al.  Interactive plant identification based on social image data , 2014, Ecol. Informatics.

[66]  Nozha Boujemaa,et al.  Visual-based plant species identification from crowdsourced data , 2011, ACM Multimedia.

[67]  Nozha Boujemaa,et al.  The imageCLEF plant identification task 2013 , 2013, MAED '13.

[68]  Paolo Remagnino,et al.  Deep-plant: Plant identification with convolutional neural networks , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[69]  Sungbin Choi Plant Identification with Deep Convolutional Neural Network: SNUMedinfo at LifeCLEF Plant Identification Task 2015 , 2015, CLEF.

[70]  Jon Rosewell,et al.  Crowdsourcing the identification of organisms: A case-study of iSpot , 2015, ZooKeys.

[71]  Robert B. Fisher,et al.  Understanding fish behavior during typhoon events in real-life underwater environments , 2012, Multimedia Tools and Applications.

[72]  Márton József Tóth,et al.  Deep Learning and SVM Classification for Plant Recognition in Content-Based Large Scale Image Retrieval , 2016, CLEF.

[73]  Joachim Denzler,et al.  SeaCLEF 2016: Object Proposal Classification for Fish Detection in Underwater Videos , 2016, CLEF.

[74]  Jiwen Lu,et al.  PCANet: A Simple Deep Learning Baseline for Image Classification? , 2014, IEEE Transactions on Image Processing.

[75]  Concetto Spampinato,et al.  MTAP special issue on methods and tools for ground truth collection in multimedia applications , 2014, Multimedia Tools and Applications.

[76]  Hervé Glotin,et al.  Fine-grained object recognition in underwater visual data , 2016, Multimedia Tools and Applications.

[77]  Terrance E. Boult,et al.  Probability Models for Open Set Recognition , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[78]  Masaki Aono,et al.  Bluefield (KDE TUT) at LifeCLEF 2016 Plant Identification Task , 2016, CLEF.

[79]  Leo Breiman,et al.  Bagging Predictors , 1996, Machine Learning.

[80]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[81]  Fiona F. Evans Detecting fish in underwater video using the EM algorithm , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[82]  Mario Fernando Montenegro Campos,et al.  Particle Filter-Based Predictive Tracking for Robust Fish Counting , 2005, XVIII Brazilian Symposium on Computer Graphics and Image Processing (SIBGRAPI'05).

[83]  E. Weber,et al.  Assessing the risk of potentially invasive plant species in central Europe , 2004 .

[84]  Nozha Boujemaa,et al.  Pl@ntNet mobile app , 2013, ACM Multimedia.

[85]  Serguei A. Mokhov A MARFCLEF Approach to LifeCLEF 2015 Tasks , 2015, CLEF.

[86]  Robert B. Fisher,et al.  Detecting, Tracking and Counting Fish in Low Quality Unconstrained Underwater Videos , 2008, VISAPP.

[87]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[88]  Olivier Buisson,et al.  Shared Nearest Neighbors Match Kernel for Bird Songs Identification - LifeCLEF 2015 Challenge , 2015, CLEF.