Artificial Intelligence for Automated Plant Species Identification: A Review

—Plants are very important for life on Earth. There is a wide variety of plant species and their number increases each year. The plants identification using conventional keys is complex, takes time and it is frustrating for non-experts because of the use of specific botanical terms/techniques. This creates a difficult obstacle to overcome for novices interested in acquiring knowledge about species, which is very important to develop any environmental study, like climate change anticipation models for example. Today, there is an increasing interest in automating the species identification process. The availability and omnipresence of relevant technologies, such as digital cameras, mobile devices, pattern recognition and artificial intelligence techniques in general, have allowed the idea of automated species identification to become a reality. In this paper, we present a review of automated plant identification over all significant available studies in literature. The main result of this synthesis is that the performance of advanced deep learning models, despite the presence of several challenges, is becoming close to the most advanced human expertise.

[1]  Stefan Kahl,et al.  Overview of LifeCLEF 2020: A System-Oriented Evaluation of Automated Species Identification and Species Distribution Prediction , 2020, CLEF.

[2]  K. Faez,et al.  SWP-LeafNET: A novel multistage approach for plant leaf identification based on deep CNN , 2020, Expert Syst. Appl..

[3]  Serge J. Belongie,et al.  An algorithm competition for automatic species identification from herbarium specimens , 2020, Applications in plant sciences.

[4]  Pierre Bonnet,et al.  Overview of LifeCLEF Plant Identification Task 2019: diving into Data Deficient Tropical Countries , 2019, CLEF.

[5]  Patrick Mäder,et al.  Flowers, leaves or both? How to obtain suitable images for automated plant identification , 2019, Plant methods.

[6]  Taghi M. Khoshgoftaar,et al.  A survey on Image Data Augmentation for Deep Learning , 2019, Journal of Big Data.

[7]  Prabhpreet Kaur,et al.  Plant Species Identification based on Plant Leaf Using Computer Vision and Machine Learning Techniques , 2019, J. Multim. Inf. Syst..

[8]  R. GeethaRamani,et al.  Identification of plant leaf diseases using a nine-layer deep convolutional neural network , 2019, Comput. Electr. Eng..

[9]  Aydin Kaya,et al.  Analysis of transfer learning for deep neural network based plant classification models , 2019, Comput. Electron. Agric..

[10]  Patrick Mäder,et al.  Image-based classification of plant genus and family for trained and untrained plant species , 2019, BMC Bioinformatics.

[11]  Shengping Zhang,et al.  Plant identification based on very deep convolutional neural networks , 2018, Multimedia Tools and Applications.

[12]  Ashok T. Gaikwad,et al.  Plant Classification Using Image Processing and Neural Network , 2018, Data Management, Analytics and Innovation.

[13]  Hervé Goëau,et al.  Automated Identification of Herbarium Specimens at Different Taxonomic Levels , 2018, Multimedia Tools and Applications for Environmental & Biodiversity Informatics.

[14]  Abdelouahab Moussaoui,et al.  Deep Learning for Plant Diseases: Detection and Saliency Map Visualisation , 2018, Human and Machine Learning.

[15]  Patrick Mäder,et al.  Automated plant species identification—Trends and future directions , 2018, PLoS Comput. Biol..

[16]  Konstantinos P. Ferentinos,et al.  Deep learning models for plant disease detection and diagnosis , 2018, Comput. Electron. Agric..

[17]  Paolo Remagnino,et al.  How deep learning extracts and learns leaf features for plant classification , 2017, Pattern Recognit..

[18]  Paul A. Beardsley,et al.  Editable Parametric Dense Foliage from 3D Capture , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[19]  Pierre Bonnet,et al.  Plant Identification Based on Noisy Web Data: the Amazing Performance of Deep Learning (LifeCLEF 2017) , 2017, CLEF.

[20]  P. Bonnet,et al.  Going deeper in the automated identification of Herbarium specimens , 2017, BMC Evolutionary Biology.

[21]  Ben C. Stöver,et al.  LeafNet: A computer vision system for automatic plant species identification , 2017, Ecol. Informatics.

[22]  Yu Sun,et al.  Deep Learning for Plant Identification in Natural Environment , 2017, Comput. Intell. Neurosci..

[23]  Sarinder Kaur Dhillon,et al.  Automated plant identification using artificial neural network and support vector machine , 2017 .

[24]  D. Merhof,et al.  Computer vision applied to herbarium specimens of German trees: testing the future utility of the millions of herbarium specimen images for automated identification , 2016, BMC Evolutionary Biology.

[25]  Henrik Skov Midtiby,et al.  Plant species classification using deep convolutional neural network , 2016 .

[26]  Pierre Bonnet,et al.  Plant Identification in an Open-world (LifeCLEF 2016) , 2016, CLEF.

[27]  Pablo M. Granitto,et al.  Deep learning for plant identification using vein morphological patterns , 2016, Comput. Electron. Agric..

[28]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[29]  Erick Mata-Montero,et al.  Combining Leaf Shape and Texture for Costa Rican Plant Species Identification , 2016, CLEI Electron. J..

[30]  Forrest N. Iandola,et al.  SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <1MB model size , 2016, ArXiv.

[31]  N. Boujemaa,et al.  Plant identification: man vs. machine , 2016, Multimedia Tools and Applications.

[32]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[33]  Marcel Salathé,et al.  An open access repository of images on plant health to enable the development of mobile disease diagnostics through machine learning and crowdsourcing , 2015, ArXiv.

[34]  Aimen Aakif,et al.  Automatic classification of plants based on their leaves , 2015 .

[35]  Ana Carolina Quintao Siravenha,et al.  Exploring the Use of Leaf Shape Frequencies for Plant Classification , 2015, 2015 28th SIBGRAPI Conference on Graphics, Patterns and Images.

[36]  Jyotismita Chaki,et al.  Plant leaf recognition using texture and shape features with neural classifiers , 2015, Pattern Recognit. Lett..

[37]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[38]  Alexis Joly,et al.  LifeCLEF Plant Identification Task 2014 , 2014, CLEF.

[39]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[40]  Nozha Boujemaa,et al.  The imageCLEF plant identification task 2013 , 2013, MAED '13.

[41]  Ji-Xiang Du,et al.  Recognition of plant leaf image based on fractal dimension features , 2013, Neurocomputing.

[42]  André R. S. Marçal,et al.  Evaluation of Features for Leaf Discrimination , 2013, ICIAR.

[43]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[44]  Y. Herdiyeni,et al.  Mobile application for Indonesian medicinal plants identification using Fuzzy Local Binary Pattern and Fuzzy Color Histogram , 2012, 2012 International Conference on Advanced Computer Science and Information Systems (ICACSIS).

[45]  W. John Kress,et al.  Leafsnap: A Computer Vision System for Automatic Plant Species Identification , 2012, ECCV.

[46]  Nozha Boujemaa,et al.  The ImageCLEF 2012 Plant Identification Task , 2012, CLEF.

[47]  Fei-Fei Li,et al.  ImageNet: A large-scale hierarchical image database , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[48]  Yuxuan Wang,et al.  A Leaf Recognition Algorithm for Plant Classification Using Probabilistic Neural Network , 2007, 2007 IEEE International Symposium on Signal Processing and Information Technology.

[49]  M. O'Neill,et al.  Automated species identification: why not? , 2004, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[50]  J. C. BurgesChristopher.  A Tutorial on Support Vector Machines for Pattern Recognition , 1998 .

[51]  A. Maćkiewicz,et al.  Principal Components Analysis (PCA) , 1993 .

[52]  Alexis Joly,et al.  Overview of PlantCLEF 2021: cross-domain plant identification , 2021, CLEF.

[53]  D. P. Acharjya,et al.  Deep Residual Networks for Plant Identification , 2019, Procedia Computer Science.

[54]  Upasana Singh,et al.  Automatic Recognition of Medicinal Plants using Machine Learning Techniques , 2017 .

[55]  L. Devroye,et al.  The nearest neighbor distance , 2015 .

[56]  Nozha Boujemaa,et al.  The CLEF 2011 Plant Images Classification Task , 2011, CLEF.

[57]  Anil K. Jain,et al.  Performance evaluation of fingerprint verification systems , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[58]  Oskar Söderkvist,et al.  Computer Vision Classification of Leaves from Swedish Trees , 2001 .