Plant species identification using color learning resources, shape, texture, through machine learning and artificial neural networks

Morphological characteristics are still the most used tools for the identification of plant species. In this context, leaves are the most available plant organ used, given their perenniality and diversity. Computer-based image analysis help extract morphological features for botanical identification and maybe a solution to taxonomic problems requiring extensively trained specialists that use visual identification as the primary method for this approach. In this study, were collected 40 leaves from 30 trees and shrub species from 19 different families. Here, we compared two popular image capture devices: a scanner and a mobile phone. Features analyzed comprised color, shape, and texture. The performance of both devices was compared through three machine learning algorithms (adaptive boosting—AdaBoost, random forest, support vector machine—SVM) and an artificial neural network model (deep learning). Computer vision showed to be efficient in the identification of species (higher than 93%), with similar results obtained for both mobile phones and scanners. The algorithms SVM, random forest and deep learning performed more efficiently than AdaBoost. Based on the results, we present the Inovtaxon Plant Species Identification Software, available at https://github.com/DeborahBambil/Inovtaxon .

[1]  Tapio Pahikkala,et al.  Comparison of chlorophyll fluorescence curves and texture analysis for automatic plant identification , 2013, Precision Agriculture.

[2]  Syed Yasser Arafat,et al.  Comparison of techniques for leaf classification , 2016, 2016 Sixth International Conference on Digital Information and Communication Technology and its Applications (DICTAP).

[3]  Dzulkifli Mohamad,et al.  Recognition of Partially Occluded Objects Based on the Three Different Color Spaces (RGB, YCbCr, HSV) , 2015 .

[4]  Charles E. Heckler,et al.  Applied Multivariate Statistical Analysis , 2005, Technometrics.

[5]  Sunghyu Han,et al.  In Situ Leaf Classification Using Histograms of Oriented Gradients , 2015, 2015 International Conference on Digital Image Computing: Techniques and Applications (DICTA).

[6]  Donald Geman,et al.  Visual Turing test for computer vision systems , 2015, Proceedings of the National Academy of Sciences.

[7]  Pablo M. Granitto,et al.  Automatic classification of legumes using leaf vein image features , 2014, Pattern Recognit..

[8]  Panos Nasiopoulos,et al.  The Effect of Frame Rate on 3D Video Quality and Bitrate , 2015, 1803.04826.

[9]  Christopher Beckham,et al.  WekaDeeplearning4j: A deep learning package for Weka based on Deeplearning4j , 2019, Knowl. Based Syst..

[10]  Thi-Lan Le,et al.  Computer aided plant identification system , 2013, 2013 International Conference on Computing, Management and Telecommunications (ComManTel).

[11]  J. Lundberg,et al.  An update of the Angiosperm Phylogeny Group classification for the orders and families of flowering plants : APG II THE ANGIOSPERM PHYLOGENY GROUP * , 2003 .

[12]  Kiriakos N. Kutulakos,et al.  Light-Efficient Photography , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Thomas P. Seager,et al.  Technology and science: innovation at the International Symposium on Sustainable Systems and Technology , 2017, Environment Systems and Decisions.

[14]  Luiz Eduardo Soares de Oliveira,et al.  Forest species recognition using macroscopic images , 2014, Machine Vision and Applications.

[15]  J. Patil,et al.  Analysis of content based image retrieval for plant leaf diseases using color, shape and texture features , 2017 .

[16]  Milan Tuba,et al.  Leaf recognition algorithm using support vector machine with Hu moments and local binary patterns , 2017, 2017 IEEE 15th International Symposium on Applied Machine Intelligence and Informatics (SAMI).

[17]  Yucel Inan,et al.  Leaves Recognition System Using a Neural Network , 2016 .

[18]  Abdulhamit Subasi,et al.  Performance of random forest and SVM in face recognition , 2016, Int. Arab J. Inf. Technol..

[19]  Ling Shao,et al.  A rapid learning algorithm for vehicle classification , 2015, Inf. Sci..

[20]  Patrick Mäder,et al.  Plant Species Identification Using Computer Vision Techniques: A Systematic Literature Review , 2017, Archives of Computational Methods in Engineering.

[21]  H. X. Kan,et al.  Classification of medicinal plant leaf image based on multi-feature extraction , 2017, Pattern Recognition and Image Analysis.