Plant identification based on very deep convolutional neural networks

Plant identification is a critical step in protecting plant diversity. However, many existing identification systems prohibitively rely on hand-crafted features for plant species identification. In this paper, a deep learning method is employed to extract discriminative features from plant images along with a linear SVM for plant identification. To offer a self-learning feature representation for different plant organs, we choose a very deep convolutional neural networks (CNNs), which consists of sixteen convolutional layers followed by three Fully-Connected (FC) layers and a final soft-max layer. Five max-pooling layers are performed over a 2×2 pixel window with stride 2. Extensive experiments on several plant datasets demonstrate the remarkable performance of the very deep neural network compared to the hand-crafted features.

[1]  Sean White,et al.  Searching the World's Herbaria: A System for Visual Identification of Plant Species , 2008, ECCV.

[2]  R. Sablatnig,et al.  Automated identification of tree species from images of the bark , leaves and needles , 2010 .

[3]  Yihong Gong,et al.  Linear spatial pyramid matching using sparse coding for image classification , 2009, CVPR.

[4]  Thi-Lan Le,et al.  Leaf based plant identification system for Android using SURF features in combination with Bag of Words model and supervised learning , 2013, 2013 International Conference on Advanced Technologies for Communications (ATC 2013).

[5]  Shengping Zhang,et al.  Plant identification via multipath sparse coding , 2017, Multimedia Tools and Applications.

[6]  Manu Chopra,et al.  TreeID : An Image Recognition System for Plant Species Identification Manu Chopra , 2015 .

[7]  Paolo Remagnino,et al.  Deep-plant: Plant identification with convolutional neural networks , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[8]  Carlos Caballero,et al.  Plant species identification using leaf image retrieval , 2010, CIVR '10.

[9]  Dieter Fox,et al.  Multipath Sparse Coding Using Hierarchical Matching Pursuit , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Usman Ghani Khan,et al.  AN AUTOMATIC LEAF BASED PLANT IDENTIFICATION SYSTEM , 2016 .

[11]  Nozha Boujemaa,et al.  Multi-organ plant identification , 2012, MAED '12.

[12]  Xuelong Li,et al.  Robust Visual Tracking Using Structurally Random Projection and Weighted Least Squares , 2015, IEEE Transactions on Circuits and Systems for Video Technology.

[13]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[14]  Tanvi Kulkarni,et al.  IMPLEMENTATION OF IMAGE BASED FLOWER CLASSIFICATION SYSTEM , 2014 .

[15]  Vijay Satti AN AUTOMATIC LEAF RECOGNITION SYSTEM FOR PLANT IDENTIFICATION USING MACHINE VISION TECHNOLOGY , 2013 .

[16]  Yang Zhao,et al.  An Efficient Multi-scale Overlapped Block LBP Approach for Leaf Image Recognition , 2012, ICIC.

[17]  Seon-Jong Kim,et al.  Tree recognition for landscape using by combination of features of its leaf, flower and bark , 2011, SICE Annual Conference 2011.

[18]  Jungong Han,et al.  Cross-View Retrieval via Probability-Based Semantics-Preserving Hashing , 2017, IEEE Transactions on Cybernetics.

[19]  Zhiyong Wang,et al.  Shape based leaf image retrieval , 2003 .

[20]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[21]  Zhenyu He,et al.  Deep convolutional neural networks for thermal infrared object tracking , 2017, Knowl. Based Syst..

[22]  Jing Wang,et al.  ApLeafis: An Android-Based Plant Leaf Identification System , 2013, ICIC.

[23]  Zheru Chi,et al.  Leaf Image Classification with Shape Context and SIFT Descriptors , 2011, 2011 International Conference on Digital Image Computing: Techniques and Applications.

[24]  Pong C. Yuen,et al.  Robust Visual Tracking via Basis Matching , 2017, IEEE Transactions on Circuits and Systems for Video Technology.

[25]  Manjunath V. Joshi,et al.  Fruit Detection using Improved Multiple Features based Algorithm , 2011 .

[26]  V. S Veena Devi,et al.  Leaf Recognition Based on Feature Extractionand Zernike Moments , 2014 .

[27]  Yihong Gong,et al.  Locality-constrained Linear Coding for image classification , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[28]  Xindong Wu,et al.  Plant Leaf Identification via a Growing Convolution Neural Network with Progressive Sample Learning , 2014, ACCV.

[29]  Cong Zhao,et al.  Plant identification using leaf shapes - A pattern counting approach , 2015, Pattern Recognit..

[30]  Anne Verroust-Blondet,et al.  Advanced shape context for plant species identification using leaf image retrieval , 2012, ICMR.

[31]  Shengping Zhang,et al.  Computer vision cracks the leaf code , 2016, Proceedings of the National Academy of Sciences.

[32]  Graham W. Taylor,et al.  Adaptive deconvolutional networks for mid and high level feature learning , 2011, 2011 International Conference on Computer Vision.

[33]  De-Shuang Huang,et al.  Support Vector Machine Committee for Classification , 2004, ISNN.

[34]  Kwang-seok Hong,et al.  An Implementation of Leaf Recognition System using Leaf Vein and Shape , 2013 .

[35]  Arnab Bhattacharya,et al.  A Plant Identification System using Shape and Morphological Features on Segmented Leaflets: Team IITK, CLEF 2012 , 2012, CLEF.

[36]  Ben C. Stöver,et al.  LeafNet: A computer vision system for automatic plant species identification , 2017, Ecol. Informatics.

[37]  Li-Wei Kang,et al.  Learning sparse representation for leaf image recognition , 2014, 2014 IEEE International Conference on Consumer Electronics - Taiwan.

[38]  Xiao-Feng Wang,et al.  HOG-Based Approach for Leaf Classification , 2010, ICIC.

[39]  Seong-Ran Lee The Application Effect of a Medical Information Management System for the Prevention of Depression in Mastectomy Patients , 2013, BSBT 2013.

[40]  Andrew Zisserman,et al.  Automated Flower Classification over a Large Number of Classes , 2008, 2008 Sixth Indian Conference on Computer Vision, Graphics & Image Processing.

[41]  C. Glasbey,et al.  Automatic fruit recognition and counting from multiple images , 2014 .

[42]  Anne Verroust-Blondet,et al.  An android application for leaf-based plant identification , 2013, ICMR.

[43]  Cordelia Schmid,et al.  Beyond Bags of Features: Spatial Pyramid Matching for Recognizing Natural Scene Categories , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[44]  Yue Gao,et al.  Zero-Shot Learning With Transferred Samples , 2017, IEEE Transactions on Image Processing.

[45]  Rob Fergus,et al.  Visualizing and Understanding Convolutional Networks , 2013, ECCV.

[46]  Xiaofeng Wang,et al.  Classification of plant leaf images with complicated background , 2008, Appl. Math. Comput..

[47]  Tristan Perez,et al.  Fine-Grained Plant Classification Using Convolutional Neural Networks for Feature Extraction , 2014, CLEF.

[48]  Prabin Kumar Bora,et al.  Leaf Identification Using Shape and Texture Features , 2016, CVIP.

[49]  Ling Shao,et al.  Learning to Hash With Optimized Anchor Embedding for Scalable Retrieval , 2017, IEEE Transactions on Image Processing.

[50]  Yang Gao,et al.  Multi-layered gesture recognition with Kinect , 2015, J. Mach. Learn. Res..

[51]  Jean Ponce,et al.  Learning mid-level features for recognition , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[52]  Ling Shao,et al.  Action Recognition Using 3D Histograms of Texture and A Multi-Class Boosting Classifier , 2017, IEEE Transactions on Image Processing.

[53]  Qingming Huang,et al.  Hedging Deep Features for Visual Tracking , 2019, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[54]  George Papadourakis,et al.  Plant Leaf Recognition Using Zernike Moments and Histogram of Oriented Gradients , 2014, SETN.

[55]  Matthijs C. Dorst Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[56]  Trevor Darrell,et al.  DeCAF: A Deep Convolutional Activation Feature for Generic Visual Recognition , 2013, ICML.

[57]  W. John Kress,et al.  Leafsnap: A Computer Vision System for Automatic Plant Species Identification , 2012, ECCV.

[58]  D. S. Guru,et al.  Texture Features and KNN in Classification of Flower Images , 2010 .

[59]  Xiaofeng Wang,et al.  Leaf shape based plant species recognition , 2007, Appl. Math. Comput..

[60]  Pierre Bonnet,et al.  Plant Identification in an Open-world (LifeCLEF 2016) , 2016, CLEF.

[61]  Feng Jiang,et al.  Point-to-Set Distance Metric Learning on Deep Representations for Visual Tracking , 2018, IEEE Transactions on Intelligent Transportation Systems.

[62]  Ezzeddine Zagrouba,et al.  Image flower recognition based on a new method for color feature extraction , 2014, 2014 International Conference on Computer Vision Theory and Applications (VISAPP).

[63]  Vishakha Metre,et al.  An Overview of the Research on Texture Based Plant Leaf Classification , 2013, ArXiv.

[64]  Honglak Lee,et al.  Convolutional deep belief networks for scalable unsupervised learning of hierarchical representations , 2009, ICML '09.

[65]  Pan Zhou,et al.  A Convolutional Neural Network for Leaves Recognition Using Data Augmentation , 2015, 2015 IEEE International Conference on Computer and Information Technology; Ubiquitous Computing and Communications; Dependable, Autonomic and Secure Computing; Pervasive Intelligence and Computing.

[66]  Ranjan Parekh,et al.  Plant Leaf Recognition using Shape based Features and Neural Network classifiers , 2011 .

[67]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[68]  Xuelong Li,et al.  A Biologically Inspired Appearance Model for Robust Visual Tracking , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[69]  Li-Wei Kang,et al.  Comparative study of leaf image recognition with a novel learning-based approach , 2014, 2014 Science and Information Conference.