Leaf Classification for Plant Recognition with Deep Transfer Learning

Plant recognition systems that developed by computer vision researchers, help botanists in faster recognition and detection of unknown plant species. Until now, multiple studies focused on the process or algorithms that maximize use of botanical datasets for plants prediction modeling, but this method depends on leaf characteristics which can be changed with botanical data and different feature extraction techniques. On the other hand, recently, due to the popularity and successful implementation of deep learning-based methods in various areas such as image classification, object detection, and speech recognition, the researchers directed from traditional feature-based methods to deep learning. In this research, one more efficient method presented that use transfer learning to recognize plant for leaf classification, which first uses a pre-trained deep neural network model for learning useful leaf characteristics directly from the input data representation. Then use a logistic regression classifier for leaf classification. It is seen that transfer learning from a large dataset to limited botanical dataset in plant recognition task is well done. The proposed method is evaluated on two well-known botanical datasets, i.e., Flavia with 32 classes and Leafsnap with 184 classes, and has succeeded in achieving an accuracy of 99.6% and 90.54%, respectively. The results show that despite the large change in the number of classes in these two datasets, the proposed method, have a good performance and show the better result than methods based on the hand-crafted feature and other methods based on the deep learning in terms of memory and precision.

[1]  Plamen Angelov,et al.  A Comprehensive Review on Handcrafted and Learning-Based Action Representation Approaches for Human Activity Recognition , 2017 .

[2]  Ranjan Parekh,et al.  Plant Leaf Recognition using Shape based Features and Neural Network classifiers , 2011 .

[3]  W. John Kress,et al.  Leafsnap: A Computer Vision System for Automatic Plant Species Identification , 2012, ECCV.

[4]  Bohyung Han,et al.  Learning Multi-domain Convolutional Neural Networks for Visual Tracking , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  Paolo Remagnino,et al.  Plant species identification using digital morphometrics: A review , 2012, Expert Syst. Appl..

[6]  A. Samal,et al.  Plant species identification using Elliptic Fourier leaf shape analysis , 2006 .

[7]  Cem Kalyoncu,et al.  Geometric leaf classification , 2015, Comput. Vis. Image Underst..

[8]  Bo Chen,et al.  MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications , 2017, ArXiv.

[9]  Andrew Zisserman,et al.  Return of the Devil in the Details: Delving Deep into Convolutional Nets , 2014, BMVC.

[10]  Ling Shao,et al.  From handcrafted to learned representations for human action recognition: A survey , 2016, Image Vis. Comput..

[11]  André Ricardo Backes,et al.  Plant Leaf Identification Using Multi-scale Fractal Dimension , 2009, ICIAP.

[12]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[13]  Xiaofeng Wang,et al.  Human action recognition using transfer learning with deep representations , 2017, 2017 International Joint Conference on Neural Networks (IJCNN).

[14]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[15]  Sergey Ioffe,et al.  Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning , 2016, AAAI.

[16]  Shengcai Liao,et al.  Deep Hybrid Similarity Learning for Person Re-Identification , 2018, IEEE Transactions on Circuits and Systems for Video Technology.

[17]  Jing Hu,et al.  A Multiscale Fusion Convolutional Neural Network for Plant Leaf Recognition , 2018, IEEE Signal Processing Letters.

[18]  H. S. Nagendraswamy,et al.  Classification of medicinal plants: An approach using modified LBP with symbolic representation , 2016, Neurocomputing.

[19]  Li Shang,et al.  Hybrid Deep Learning for Plant Leaves Classification , 2015, ICIC.

[20]  Ivan Laptev,et al.  Learning and Transferring Mid-level Image Representations Using Convolutional Neural Networks , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[21]  Stefan Carlsson,et al.  CNN Features Off-the-Shelf: An Astounding Baseline for Recognition , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[22]  Paolo Remagnino,et al.  The Extraction of Venation from Leaf Images by Evolved Vein Classifiers and Ant Colony Algorithms , 2010, ACIVS.

[23]  Xuelong Li,et al.  Transfer learning for pedestrian detection , 2013, Neurocomputing.

[24]  Li Fei-Fei Knowledge transfer in learning to recognize visual objects classes , 2006 .

[25]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[26]  Ling Shao,et al.  Transfer Learning for Visual Categorization: A Survey , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[27]  Ah Chung Tsoi,et al.  EAGLE: A novel descriptor for identifying plant species using leaf lamina vascular features , 2014, 2014 IEEE International Conference on Multimedia and Expo Workshops (ICMEW).

[28]  Andreas Kamilaris,et al.  Deep learning in agriculture: A survey , 2018, Comput. Electron. Agric..

[29]  Paulus Insap Santosa,et al.  Leaf Classification Using Shape, Color, and Texture Features , 2013, ArXiv.

[30]  Sunghyu Han,et al.  In Situ Leaf Classification Using Histograms of Oriented Gradients , 2015, 2015 International Conference on Digital Image Computing: Techniques and Applications (DICTA).

[31]  Meng Joo Er,et al.  A local binary pattern based texture descriptors for classification of tea leaves , 2015, Neurocomputing.

[32]  Xiao-Feng Wang,et al.  HOG-Based Approach for Leaf Classification , 2010, ICIC.

[33]  Paolo Remagnino,et al.  Plant Texture Classification Using Gabor Co-occurrences , 2010, ISVC.

[34]  Paolo Remagnino,et al.  Venation Pattern Analysis of Leaf Images , 2006, ISVC.

[35]  Hai Tao,et al.  Evaluating Appearance Models for Recognition, Reacquisition, and Tracking , 2007 .

[36]  Aimen Aakif,et al.  Automatic classification of plants based on their leaves , 2015 .

[37]  Paolo Remagnino,et al.  Shape and Texture Based Plant Leaf Classification , 2010, ACIVS.

[38]  한보형,et al.  Learning Deconvolution Network for Semantic Segmentation , 2015 .

[39]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[40]  Winston H. Hsu,et al.  Transfer Learning for Video Recognition with Scarce Training Data , 2014, ArXiv.

[41]  Yuxuan Wang,et al.  A Leaf Recognition Algorithm for Plant Classification Using Probabilistic Neural Network , 2007, 2007 IEEE International Symposium on Signal Processing and Information Technology.

[42]  Ling Shao,et al.  One shot learning gesture recognition from RGBD images , 2012, 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[43]  Paolo Remagnino,et al.  Deep-plant: Plant identification with convolutional neural networks , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[44]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[45]  Jyotismita Chaki,et al.  Plant leaf recognition using texture and shape features with neural classifiers , 2015, Pattern Recognit. Lett..

[46]  Paolo Remagnino,et al.  How deep learning extracts and learns leaf features for plant classification , 2017, Pattern Recognit..

[47]  Atsuto Maki,et al.  From generic to specific deep representations for visual recognition , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[48]  Anne Verroust-Blondet,et al.  Advanced shape context for plant species identification using leaf image retrieval , 2012, ICMR.

[49]  François Chollet,et al.  Xception: Deep Learning with Depthwise Separable Convolutions , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[50]  Rob Fergus,et al.  Visualizing and Understanding Convolutional Networks , 2013, ECCV.

[51]  Konstantinos P. Ferentinos,et al.  Deep learning models for plant disease detection and diagnosis , 2018, Comput. Electron. Agric..

[52]  Pablo M. Granitto,et al.  Automatic classification of legumes using leaf vein image features , 2014, Pattern Recognit..

[53]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[54]  Pablo M. Granitto,et al.  Deep learning for plant identification using vein morphological patterns , 2016, Comput. Electron. Agric..

[55]  Niko Sünderhauf,et al.  Evaluation of Features for Leaf Classification in Challenging Conditions , 2015, 2015 IEEE Winter Conference on Applications of Computer Vision.