Leaf recognition using convolutional neural networks based features

There is a warning light for the loss of plant habitats worldwide that entails concerted efforts to conserve plant biodiversity. Thus, plant species classification is of crucial importance to address this environmental challenge. In recent years, there is a considerable increase in the number of studies related to plant taxonomy. While some researchers try to improve their recognition performance using novel approaches, others concentrate on computational optimization for their framework. In addition, a few studies are diving into feature extraction to gain significantly in terms of accuracy. In this paper, we propose an effective method for the leaf recognition problem. In our proposed approach, a leaf goes through some pre-processing to extract its refined color image, vein image, xy-projection histogram, handcrafted shape, texture features, and Fourier descriptors. These attributes are then transformed into a better representation by neural network-based encoders before a support vector machine (SVM) model is utilized to classify different leaves. Overall, our approach performs a state-of-the-art result on the Flavia leaf dataset, achieving the accuracy of 99.58% on test sets under random 10-fold The first two authors have equal distribution Boi M. Quach Dublin City University, Ireland Dinh V. Cuong Dublin City University, Ireland Nhung Pham University of Science, Ho Chi Minh City, Vietnam Vietnam National University in Ho Chi Minh City Huynh T. Dang AISIA Research Lab, Ho Chi Minh City, Vietnam Hong Bang International University, Ho Chi Minh City, Vietnam Binh T. Nguyen (Corresponding Author) AISIA Research Lab, Ho Chi Minh City, Vietnam University of Science, Ho Chi Minh City, Vietnam Vietnam National University in Ho Chi Minh City E-mail: ngtbinh@hcmus.edu.vn ar X iv :2 10 8. 01 80 8v 2 [ cs .C V ] 2 S ep 2 02 1 2 Boi M. Quach et al. cross-validation and bypassing the previous methods. We also release our codes for contributing to the research community in the leaf classification problem.

[1]  Faruq Mohammad,et al.  Feature decision-making ant colony optimization system for an automated recognition of plant species , 2015, Expert Syst. Appl..

[2]  Parul Mittal,et al.  Combined Classifier for Plant Classification and Identification from Leaf Image Based on Visual Attributes , 2018, 2018 International Conference on Intelligent Circuits and Systems (ICICS).

[3]  Shangsong Liang,et al.  Plant Species Classification Using Leaf Shape and Texture , 2012, 2012 International Conference on Industrial Control and Electronics Engineering.

[4]  Paolo Remagnino,et al.  How deep learning extracts and learns leaf features for plant classification , 2017, Pattern Recognit..

[5]  Usman Ghani Khan,et al.  AN AUTOMATIC LEAF BASED PLANT IDENTIFICATION SYSTEM , 2016 .

[6]  Aimen Aakif,et al.  Automatic classification of plants based on their leaves , 2015 .

[7]  R. Hudec,et al.  Novel Method for Color Textures Features Extraction Based on GLCM , 2007 .

[8]  Suyash P. Awate,et al.  Leaf classification using marginalized shape context and shape+texture dual-path deep convolutional neural network , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[9]  Ahmet Burak Can,et al.  A Plant Recognition Approach Using Shape and Color Features in Leaf Images , 2013, ICIAP.

[10]  Pablo M. Granitto,et al.  Deep learning for plant identification using vein morphological patterns , 2016, Comput. Electron. Agric..

[11]  A. Ugur,et al.  Recognition of leaves based on morphological features derived from two half-regions , 2012, 2012 International Symposium on Innovations in Intelligent Systems and Applications.

[12]  Paolo Remagnino,et al.  Shape and Texture Based Plant Leaf Classification , 2010, ACIVS.

[13]  Yuxuan Wang,et al.  A Leaf Recognition Algorithm for Plant Classification Using Probabilistic Neural Network , 2007, 2007 IEEE International Symposium on Signal Processing and Information Technology.

[14]  Yide Ma,et al.  Plant recognition based on intersecting cortical model , 2014, 2014 International Joint Conference on Neural Networks (IJCNN).

[15]  Paulus Insap Santosa,et al.  EXPERIMENTS OF ZERNIKE MOMENTS FOR LEAF IDENTIFICATION , 2012 .

[16]  M GranittoPablo,et al.  Deep learning for plant identification using vein morphological patterns , 2016 .

[17]  Davut Hanbay,et al.  Combination of Deep Features and KNN Algorithm for Classification of Leaf-Based Plant Species , 2019, 2019 International Artificial Intelligence and Data Processing Symposium (IDAP).

[18]  M. Ashraful Amin,et al.  Leaf shape identification based plant biometrics , 2010, 2010 13th International Conference on Computer and Information Technology (ICCIT).

[19]  Ralph Roskies,et al.  Fourier Descriptors for Plane Closed Curves , 1972, IEEE Transactions on Computers.

[20]  Robert M. Haralick,et al.  Textural Features for Image Classification , 1973, IEEE Trans. Syst. Man Cybern..

[21]  Richard K. G. Do,et al.  Convolutional neural networks: an overview and application in radiology , 2018, Insights into Imaging.

[22]  Sameerchand Pudaruth,et al.  Plant Leaf Recognition Using Shape Features and Colour Histogram with K-nearest Neighbour Classifiers , 2015 .

[23]  Aboul Ella Hassanien,et al.  Leaf Plant Identification System Based on Hidden Naïve Bays Classifier , 2015, 2015 4th International Conference on Advanced Information Technology and Sensor Application (AITS).

[24]  Muammer Türkoğlu.  Plant recognition system based on extreme learning machine by using shearlet transform and new geometric features , 2019 .

[25]  Asem Khmag,et al.  Recognition system for leaf images based on its leaf contour and centroid , 2017, 2017 IEEE 15th Student Conference on Research and Development (SCOReD).

[26]  Li Shang,et al.  Hybrid Deep Learning for Plant Leaves Classification , 2015, ICIC.

[27]  Qingliang Chen,et al.  Fast Plant Leaf Recognition Using Improved Multiscale Triangle Representation and KNN for Optimization , 2020, IEEE Access.

[28]  Sang-Yong Rhee,et al.  Plant Leaf Recognition Using a Convolution Neural Network , 2017, Int. J. Fuzzy Log. Intell. Syst..

[29]  C. Arun Priya,et al.  An efficient leaf recognition algorithm for plant classification using support vector machine , 2012, International Conference on Pattern Recognition, Informatics and Medical Engineering (PRIME-2012).

[30]  I. Wright,et al.  Leaf size estimation based on leaf length, width and shape. , 2021, Annals of botany.

[31]  C. Wen,et al.  Color Image Models and Its Applications to Document Examination , 2004 .

[32]  Pullela S V V S R Kumar,et al.  Leaf classification based on shape and edge feature with k-NN classifier , 2016, 2016 2nd International Conference on Contemporary Computing and Informatics (IC3I).

[33]  Muammer Turkoglu,et al.  Recognition of plant leaves: An approach with hybrid features produced by dividing leaf images into two and four parts , 2019, Appl. Math. Comput..

[34]  Jing Hu,et al.  A Multiscale Fusion Convolutional Neural Network for Plant Leaf Recognition , 2018, IEEE Signal Processing Letters.