Fine-Grained Image Classification for Pollen Grain Microscope Images

Pollen classification is an important task in many fields, including allergology, archaeobotany and biodiversity conservation. However, the visual classification of pollen grains is a major challenge due to the difficulty in identifying the subtle variations between the subcategories of objects. The pollen image analysis process is often timeconsuming and require expert evaluations. Even simple tasks, such as image classification or segmentation requires significant efforts from experts in aerobiology. Hence, there is a strong need to develop automatic solutions for microscopy image analysis. These considerations underline the effort to study and develop new efficient algorithms. With the growing interest in Deep Learning (DL), much research efforts have been spent to the development of several approaches to accomplish this task. Hence, this study covers the application of effective Deep Learning methods in combination with Fine-Grained Visual Classification (FGVC) approaches, comparing them with other Deep Learning-based methods from the state-of-art. All experiments were conducted using the dataset Pollen13K, composed of more than 13,000 pollen objects subdivided in 4 classes. The results of experiments confirmed the effectiveness of our proposed pipeline that reached over 97% in terms of accuracy and F1score.

[1]  S. Battiato,et al.  Pollen Grain Classification Challenge 2020 , 2021 .

[2]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[3]  Quoc V. Le,et al.  EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks , 2019, ICML.

[4]  Hongyi Zhang,et al.  mixup: Beyond Empirical Risk Minimization , 2017, ICLR.

[5]  Seong Joon Oh,et al.  CutMix: Regularization Strategy to Train Strong Classifiers With Localizable Features , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[6]  Pollen Grain Classification Challenge 2020 - Challenge Report , 2020, ICPR Workshops.

[7]  Yann LeCun,et al.  Transformation Invariance in Pattern Recognition-Tangent Distance and Tangent Propagation , 1996, Neural Networks: Tricks of the Trade.

[8]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[9]  Tao Mei,et al.  Destruction and Construction Learning for Fine-Grained Image Recognition , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[10]  Sebastiano Battiato,et al.  Detection and Classification of Pollen Grain Microscope Images , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[11]  J. Kiefer,et al.  Stochastic Estimation of the Maximum of a Regression Function , 1952 .

[12]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[13]  Atsuto Maki,et al.  A systematic study of the class imbalance problem in convolutional neural networks , 2017, Neural Networks.

[14]  Xiaogang Wang,et al.  Residual Attention Network for Image Classification , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[15]  Luca Antiga,et al.  Automatic differentiation in PyTorch , 2017 .

[16]  Qian Zhang,et al.  Densely Connected Search Space for More Flexible Neural Architecture Search , 2019, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[17]  Yann LeCun,et al.  Transformation Invariance in Pattern Recognition - Tangent Distance and Tangent Propagation , 2012, Neural Networks: Tricks of the Trade.

[18]  Yi-Zhe Song,et al.  Fine-Grained Visual Classification via Progressive Multi-Granularity Training of Jigsaw Patches , 2020, ECCV.

[19]  Younghoon Kim,et al.  Learning Loss for Test-Time Augmentation , 2020, NeurIPS.

[20]  Qi Tian,et al.  Iterative Reorganization With Weak Spatial Constraints: Solving Arbitrary Jigsaw Puzzles for Unsupervised Representation Learning , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[21]  Sebastiano Battiato,et al.  POLLEN13K: A Large Scale Microscope Pollen Grain Image Dataset , 2020, 2020 IEEE International Conference on Image Processing (ICIP).