Improving classification of pollen grain images of the POLEN23E dataset through three different applications of deep learning convolutional neural networks

In palynology, the visual classification of pollen grains from different species is a hard task which is usually tackled by human operators using microscopes. Its complete automatization would save a high quantity of resources and provide valuable improvements especially for allergy-related information systems, but also for other application fields as paleoclimate reconstruction, quality control of honey based products, collection of evidences in criminal investigations or fabric dating and tracking. This paper presents three state-of-the-art deep learning classification methods applied to the recently published POLEN23E image dataset. The three methods make use of convolutional neural networks: the first one is strictly based on the idea of transfer learning, the second one is based on feature extraction and the third one represents a hybrid approach, combining transfer learning and feature extraction. The results from the three methods are indeed very good, reaching over 97% correct classification rates in images not previously seen by the models, where other authors reported around 70.

[1]  K. Holt,et al.  Principles and methods for automated palynology. , 2014, The New phytologist.

[2]  Mark Bush,et al.  Pollen Grain Recognition Using Deep Learning , 2016, ISVC.

[3]  Carlos M. Travieso,et al.  Pollen classification based on contour features , 2011, 2011 15th IEEE International Conference on Intelligent Engineering Systems.

[4]  R. Fisher THE USE OF MULTIPLE MEASUREMENTS IN TAXONOMIC PROBLEMS , 1936 .

[5]  Jeffrey A. Golden,et al.  Deep Learning Algorithms for Detection of Lymph Node Metastases From Breast Cancer: Helping Artificial Intelligence Be Seen. , 2017, JAMA.

[6]  Ariadne Barbosa Gonçalves,et al.  14634 - Identificação computadorizada de tipos polínicos através de “Bag of Words” , 2013 .

[7]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[8]  Ariadne Barbosa Gonçalves,et al.  Application of wavelet transform in the classification of pollen grains , 2014 .

[9]  Yi Li,et al.  Gene expression inference with deep learning , 2015, bioRxiv.

[10]  Jürgen Schmidhuber,et al.  Multi-column deep neural networks for image classification , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[11]  D. Tcheng,et al.  Classifying black and white spruce pollen using layered machine learning. , 2012, The New phytologist.

[12]  Lawrence D. Jackel,et al.  Handwritten Digit Recognition with a Back-Propagation Network , 1989, NIPS.

[13]  Ariadne Barbosa Gonçalves,et al.  Feature Extraction and Machine Learning for the Classification of Brazilian Savannah Pollen Grains , 2016, PloS one.

[14]  Manuel Chica,et al.  Authentication of bee pollen grains in bright‐field microscopy by combining one‐class classification techniques and image processing , 2012, Microscopy research and technique.

[15]  E. Cernadas,et al.  Automatic detection and classification of grains of pollen based on shape and texture , 2006, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[16]  Jonathan Krause,et al.  Using deep learning and Google Street View to estimate the demographic makeup of neighborhoods across the United States , 2017, Proceedings of the National Academy of Sciences.

[17]  Shu Kong,et al.  Spatially Aware Dictionary Learning and Coding for Fossil Pollen Identification , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[18]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[19]  Pedro M. Domingos A few useful things to know about machine learning , 2012, Commun. ACM.

[20]  J. R. Flenley,et al.  Towards automation of palynology 1: analysis of pollen shape and ornamentation using simple geometric measures, derived from scanning electron microscope images , 2004 .

[21]  Franck Marzani,et al.  Analysis of Relevant Features for Pollen Classification , 2014, AIAI.

[22]  Dpto,et al.  IMPROVED CLASSIFICATION OF POLLEN TEXTURE IMAGES USING SVM AND MLP , 2003 .

[23]  A.W.G. Duller,et al.  A new approach to automated pollen analysis , 2000 .