SWP-Leaf NET: a novel multistage approach for plant leaf identification based on deep learning

Modern scientific and technological advances are allowing botanists to use computer vision-based approaches for plant identification tasks. These approaches have their own challenges. Leaf classification is a computer-vision task performed for the automated identification of plant species, a serious challenge due to variations in leaf morphology, including its size, texture, shape, and venation. Researchers have recently become more inclined toward deep learning-based methods rather than conventional feature-based methods due to the popularity and successful implementation of deep learning methods in image analysis, object recognition, and speech recognition. In this paper, a botanist's behavior was modeled in leaf identification by proposing a highly-efficient method of maximum behavioral resemblance developed through three deep learning-based models. Different layers of the three models were visualized to ensure that the botanist's behavior was modeled accurately. The first and second models were designed from scratch.Regarding the third model, the pre-trained architecture MobileNetV2 was employed along with the transfer-learning technique. The proposed method was evaluated on two well-known datasets: Flavia and MalayaKew. According to a comparative analysis, the suggested approach was more accurate than hand-crafted feature extraction methods and other deep learning techniques in terms of 99.67% and 99.81% accuracy. Unlike conventional techniques that have their own specific complexities and depend on datasets, the proposed method required no hand-crafted feature extraction, and also increased accuracy and distributability as compared with other deep learning techniques. It was further considerably faster than other methods because it used shallower networks with fewer parameters and did not use all three models recurrently.

[1]  Kang-Hyun Jo,et al.  Advanced Intelligent Computing Theories and Applications. With Aspects of Artificial Intelligence , 2008, Lecture Notes in Computer Science.

[2]  A. Samal,et al.  Plant species identification using Elliptic Fourier leaf shape analysis , 2006 .

[3]  Kapil,et al.  Plant Species Identification using Leaf Image Retrieval: A Study , 2018, 2018 International Conference on Computing, Power and Communication Technologies (GUCON).

[4]  Winston H. Hsu,et al.  Transfer Learning for Video Recognition with Scarce Training Data , 2014, ArXiv.

[5]  Paolo Remagnino,et al.  Plant species identification using digital morphometrics: A review , 2012, Expert Syst. Appl..

[6]  Leslie N. Smith,et al.  Cyclical Learning Rates for Training Neural Networks , 2015, 2017 IEEE Winter Conference on Applications of Computer Vision (WACV).

[7]  Li Shang,et al.  Hybrid Deep Learning for Plant Leaves Classification , 2015, ICIC.

[8]  Paolo Remagnino,et al.  Deep-plant: Plant identification with convolutional neural networks , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[9]  Niko Sünderhauf,et al.  Evaluation of Features for Leaf Classification in Challenging Conditions , 2015, 2015 IEEE Winter Conference on Applications of Computer Vision.

[10]  Yihong Gong,et al.  Linear spatial pyramid matching using sparse coding for image classification , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[11]  Yakup Genc,et al.  On identifying leaves: A comparison of CNN with classical ML methods , 2017, 2017 25th Signal Processing and Communications Applications Conference (SIU).

[12]  Ah Chung Tsoi,et al.  EAGLE: A novel descriptor for identifying plant species using leaf lamina vascular features , 2014, 2014 IEEE International Conference on Multimedia and Expo Workshops (ICMEW).

[13]  Pablo M. Granitto,et al.  Automatic classification of legumes using leaf vein image features , 2014, Pattern Recognit..

[14]  Andreas Kamilaris,et al.  Deep learning in agriculture: A survey , 2018, Comput. Electron. Agric..

[15]  Alireza Mehridehnavi,et al.  Macular OCT Classification Using a Multi-Scale Convolutional Neural Network Ensemble , 2018, IEEE Transactions on Medical Imaging.

[16]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[17]  Meng Joo Er,et al.  A local binary pattern based texture descriptors for classification of tea leaves , 2015, Neurocomputing.

[18]  Pablo M. Granitto,et al.  Deep learning for plant identification using vein morphological patterns , 2016, Comput. Electron. Agric..

[19]  Paolo Remagnino,et al.  Plant Texture Classification Using Gabor Co-occurrences , 2010, ISVC.

[20]  Xiao-Feng Wang,et al.  HOG-Based Approach for Leaf Classification , 2010, ICIC.

[21]  N. Ahmed,et al.  Automated analysis of visual leaf shape features for plant classification , 2019, Comput. Electron. Agric..

[22]  Karim Faez,et al.  Leaf Classification for Plant Recognition with Deep Transfer Learning , 2018, 2018 4th Iranian Conference on Signal Processing and Intelligent Systems (ICSPIS).

[23]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[24]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[25]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[26]  Shesheng Gao,et al.  Image Segmentation-Based Multi-Focus Image Fusion Through Multi-Scale Convolutional Neural Network , 2017, IEEE Access.

[27]  ErMeng Joo,et al.  A local binary pattern based texture descriptors for classification of tea leaves , 2015 .

[28]  Yu Sun,et al.  Deep Learning for Plant Identification in Natural Environment , 2017, Comput. Intell. Neurosci..

[29]  Konstantinos P. Ferentinos,et al.  Deep learning models for plant disease detection and diagnosis , 2018, Comput. Electron. Agric..

[30]  Yoshua Bengio,et al.  Understanding the difficulty of training deep feedforward neural networks , 2010, AISTATS.

[31]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[32]  Alessandro Sperduti,et al.  Challenges in Deep Learning , 2016, ESANN.

[33]  Paolo Remagnino,et al.  How deep learning extracts and learns leaf features for plant classification , 2017, Pattern Recognit..

[34]  Sergey Ioffe,et al.  Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning , 2016, AAAI.

[35]  Jing Hu,et al.  A Multiscale Fusion Convolutional Neural Network for Plant Leaf Recognition , 2018, IEEE Signal Processing Letters.

[36]  Ben C. Stöver,et al.  LeafNet: A computer vision system for automatic plant species identification , 2017, Ecol. Informatics.

[37]  François Chollet,et al.  Xception: Deep Learning with Depthwise Separable Convolutions , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[38]  Cem Kalyoncu,et al.  Geometric leaf classification , 2015, Comput. Vis. Image Underst..

[39]  H. S. Nagendraswamy,et al.  Classification of medicinal plants: An approach using modified LBP with symbolic representation , 2016, Neurocomputing.

[40]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[41]  Anne Verroust-Blondet,et al.  Advanced shape context for plant species identification using leaf image retrieval , 2012, ICMR.

[42]  W. John Kress,et al.  Leafsnap: A Computer Vision System for Automatic Plant Species Identification , 2012, ECCV.

[43]  Paolo Remagnino,et al.  Venation Pattern Analysis of Leaf Images , 2006, ISVC.

[44]  Yide Ma,et al.  Leaf recognition based on PCNN , 2015, Neural Computing and Applications.

[45]  Mark Sandler,et al.  MobileNetV2: Inverted Residuals and Linear Bottlenecks , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[46]  Yuxuan Wang,et al.  A Leaf Recognition Algorithm for Plant Classification Using Probabilistic Neural Network , 2007, 2007 IEEE International Symposium on Signal Processing and Information Technology.

[47]  D. P. Acharjya,et al.  Deep Residual Networks for Plant Identification , 2019, Procedia Computer Science.