Recognition of the Amazonian flora by InceptionNetworks with Test-time Class Prior Estimation

The paper describes an automatic system for recognition of 10,000 plant species, with focus on species from the Guiana shield and the Amazon rain forest. The proposed system achieves the best results on the PlantCLEF 2019 test set with 31.9% accuracy. Compared against human experts in plant recognition, the system performed better than 3 of the 5 participating human experts and achieved 41.0% accuracy on the subset for expert evaluation. The proposed system is based on the Inception-v4 and Inception-ResNet-v2 Convolutional Neural Network (CNN) architectures. Performance improvements were achieved by: adjusting the CNN predictions according to the estimated change of the class prior probabilities, replacing network parameters with their running averages, testtime data augmentation, filtering the provided training set and adding additional training images from GBIF.

[1]  Jiri Matas,et al.  Improving CNN Classifiers by Estimating Test-Time Priors , 2018, 2019 IEEE/CVF International Conference on Computer Vision Workshop (ICCVW).

[2]  Pierre Bonnet,et al.  Overview of LifeCLEF Plant Identification Task 2019: diving into Data Deficient Tropical Countries , 2019, CLEF.

[3]  Stefan Kahl,et al.  Overview of LifeCLEF 2019: Identification of Amazonian Plants, South & North American Birds, and Niche Prediction , 2019, CLEF.

[4]  Sergey Ioffe,et al.  Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning , 2016, AAAI.

[5]  Giorgos Tolias,et al.  Fine-Tuning CNN Image Retrieval with No Human Annotation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Stella X. Yu,et al.  Large-Scale Long-Tailed Recognition in an Open World , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[7]  Pierre Bonnet,et al.  Overview of ExpertLifeCLEF 2018: how far Automated Identification Systems are from the Best Experts? , 2018, CLEF.

[8]  Marco Saerens,et al.  Adjusting the Outputs of a Classifier to New a Priori Probabilities: A Simple Procedure , 2002, Neural Computation.

[9]  Pierre Bonnet,et al.  Plant Identification Based on Noisy Web Data: the Amazing Performance of Deep Learning (LifeCLEF 2017) , 2017, CLEF.

[10]  Pierre Bonnet,et al.  Plant Identification in an Open-world (LifeCLEF 2016) , 2016, CLEF.

[11]  Jiri Matas,et al.  Plant Recognition by Inception Networks with Test-time Class Prior Estimation , 2018, CLEF.