Plant identification using deep neural networks via optimization of transfer learning parameters

We use deep convolutional neural networks to identify the plant species captured in a photograph and evaluate different factors affecting the performance of these networks. Three powerful and popular deep learning architectures, namely GoogLeNet, AlexNet, and VGGNet, are used for this purpose. Transfer learning is used to fine-tune the pre-trained models, using the plant task datasets of LifeCLEF 2015. To decrease the chance of overfitting, data augmentation techniques are applied based on image transforms such as rotation, translation, reflection, and scaling. Furthermore, the networks' parameters are adjusted and different classifiers are fused to improve overall performance. Our best combined system has achieved an overall accuracy of 80% on the validation set and an overall inverse rank score of 0.752 on the official test set. A comparison of our results against the results of the LifeCLEF 2015 plant identification campaign shows that we have improved the overall validation accuracy of the top system by 15% points and its overall inverse rank score on the test set by 0.1 while outperforming the top three competition participants in all categories. The system recently obtained a very close second place in the PlantCLEF 2016.

[1]  Paolo Remagnino,et al.  The Extraction of Venation from Leaf Images by Evolved Vein Classifiers and Ant Colony Algorithms , 2010, ACIVS.

[2]  Berrin A. Yanikoglu,et al.  Morphological features for leaf based plant recognition , 2013, 2013 IEEE International Conference on Image Processing.

[3]  Peter I. Corke,et al.  Content Specific Feature Learning for Fine-Grained Plant Classification , 2015, CLEF.

[4]  Andrew Zisserman,et al.  Delving deeper into the whorl of flower segmentation , 2010, Image Vis. Comput..

[5]  Alexis Joly,et al.  LifeCLEF Plant Identification Task 2014 , 2014, CLEF.

[6]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[7]  Yee Whye Teh,et al.  A Fast Learning Algorithm for Deep Belief Nets , 2006, Neural Computation.

[8]  Paolo Remagnino,et al.  Shape and Texture Based Plant Leaf Classification , 2010, ACIVS.

[9]  Maximilien Servajean,et al.  A Comparative Study of Fine-grained Classification Methods in the Context of the LifeCLEF Plant Identification Challenge 2015 , 2015, CLEF.

[10]  G. G. Stokes "J." , 1890, The New Yale Book of Quotations.

[11]  Berrin A. Yanikoglu,et al.  Automatic plant identification from photographs , 2014, Machine Vision and Applications.

[12]  Sungbin Choi Plant Identification with Deep Convolutional Neural Network: SNUMedinfo at LifeCLEF Plant Identification Task 2015 , 2015, CLEF.

[13]  Bolei Zhou,et al.  Learning Deep Features for Scene Recognition using Places Database , 2014, NIPS.

[14]  Paolo Remagnino,et al.  Plant species identification using digital morphometrics: A review , 2012, Expert Syst. Appl..

[15]  Camille Couprie,et al.  Learning Hierarchical Features for Scene Labeling , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Xiaofeng Wang,et al.  Leaf shape based plant species recognition , 2007, Appl. Math. Comput..

[17]  Paolo Remagnino,et al.  Venation Pattern Analysis of Leaf Images , 2006, ISVC.

[18]  Jude Shavlik,et al.  Chapter 11 Transfer Learning , 2009 .

[19]  Yan Li,et al.  Leaf Vein Extraction Using Independent Component Analysis , 2006, 2006 IEEE International Conference on Systems, Man and Cybernetics.

[20]  A. Samal,et al.  Plant species identification using Elliptic Fourier leaf shape analysis , 2006 .

[21]  Syamsiah Mashohor,et al.  A texture-based approach for content based image retrieval system for plant leaves images , 2011, 2011 IEEE 7th International Colloquium on Signal Processing and its Applications.

[22]  Nozha Boujemaa,et al.  The ImageCLEF 2012 Plant Identification Task , 2012, CLEF.

[23]  Garrison W. Cottrell,et al.  Bikers Are Like Tobacco Shops, Formal Dressers Are Like Suits: Recognizing Urban Tribes with Caffe , 2015, 2015 IEEE Winter Conference on Applications of Computer Vision.

[24]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[25]  Qiang Chen,et al.  IBM Research Australia at LifeCLEF2014: Plant Identification Task , 2014, CLEF.

[26]  Xiaofeng Wang,et al.  Multiple Classification of Plant Leaves Based on Gabor Transform and LBP Operator , 2008, ICIC.

[27]  Gang Chen,et al.  A flower image retrieval method based on ROI feature , 2004, Journal of Zhejiang University. Science.

[28]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[29]  Chia-Ling Lee,et al.  Classification of leaf images , 2006, Int. J. Imaging Syst. Technol..

[30]  J. Mothe,et al.  LifeCLEF 2015 : Multimedia Life Species Identification Challenges , 2014 .

[31]  Odemir Martinez Bruno,et al.  Fractal dimension applied to plant identification , 2008, Inf. Sci..

[32]  Yoshua Bengio,et al.  How transferable are features in deep neural networks? , 2014, NIPS.

[33]  Gaines E. Miles,et al.  MACHINE VISION AND IMAGE PROCESSING FOR PLANT IDENTIFICATION. , 1986 .

[34]  Zhe Wang,et al.  Towards Good Practices for Very Deep Two-Stream ConvNets , 2015, ArXiv.

[35]  Y-Lan Boureau,et al.  Learning Convolutional Feature Hierarchies for Visual Recognition , 2010, NIPS.

[36]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[37]  Trevor Darrell,et al.  Caffe: Convolutional Architecture for Fast Feature Embedding , 2014, ACM Multimedia.

[38]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[39]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..