Plant Identification Based on Image Set Analysis

Plant identification is crucial in plant protection, crop breeding and agriculture research area. With the development of information technology, computer vision-based plant identification is an effective and efficient solution. Many tradition plant identification algorithms utilize only one type of plant images, such as images from leaves, flowers and stems etc., which may bring misclassifications. In order to recognize plant accurately, we propose a new plant identification scheme based on image set analysis. In this method, uses image set as a taxonomic unit, each image set consists of multiple images (whole plant, fruits, leaves, flowers, stems, branches, leaves scan), the characteristics of plants are fused together as a basis for plant identification. Compared to the traditional single feature, this study has more characteristics and provides more information in the classification process. A face recognition algorithm based on image collection is used in our research, for example: AHISD/CHISD (Affine/Convex Hull based Image Set Distance), PLRC (Pairwise Linear Regression Classification), SSDML (Set-to-Set Distance Metric Learning), SANP (Sparse Approximated Nearest Point), RNP (Regularized Nearest Points). Data set contains 64,150 plant images, it can be divided into 369 training set (each training set contains 50 pictures) and 914 test sets (each test set contains 50 picture). The results show that CHISD has the highest recognition rate, at 77.02%, which is more suitable for requiring higher accuracy. RNP identifies a plant class took an average of 0.75 s, the algorithm is more suitable for the occasion with higher time requirement. Therefore, the plant identification based on image set is feasible and low cost, which can be extended to agricultural production.

[1]  Takeshi Saitoh,et al.  Automatic recognition of wild flowers , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[2]  Seyed Hadi Mirisaee,et al.  A new method for fruits recognition system , 2009, 2009 International Conference on Electrical Engineering and Informatics.

[3]  Yuxuan Wang,et al.  A Leaf Recognition Algorithm for Plant Classification Using Probabilistic Neural Network , 2007, 2007 IEEE International Symposium on Signal Processing and Information Technology.

[4]  Yicong Zhou,et al.  Pairwise Linear Regression Classification for Image Set Retrieval , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  Matti Pietikäinen,et al.  Face Description with Local Binary Patterns: Application to Face Recognition , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Mehrtash Tafazzoli Harandi,et al.  From Manifold to Manifold: Geometry-Aware Dimensionality Reduction for SPD Matrices , 2014, ECCV.

[7]  Mohammed Bennamoun,et al.  Deep Reconstruction Models for Image Set Classification , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  David Zhang,et al.  From Point to Set: Extend the Learning of Distance Metrics , 2013, 2013 IEEE International Conference on Computer Vision.

[9]  Xiaofeng Wang,et al.  Leaf Recognition Based on the Combination of Wavelet Transform and Gaussian Interpolation , 2005, ICIC.

[10]  Ajmal S. Mian,et al.  Sparse approximated nearest points for image set classification , 2011, CVPR 2011.

[11]  Hakan Cevikalp,et al.  Face recognition based on image sets , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[12]  Yeni Herdiyeni,et al.  Fusion of Local Binary Patterns features for tropical medicinal plants identification , 2013, 2013 International Conference on Advanced Computer Science and Information Systems (ICACSIS).

[13]  Lei Zhang,et al.  Face recognition based on regularized nearest points between image sets , 2013, 2013 10th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG).

[14]  Z. Chi,et al.  Plant species recognition based on bark patterns using novel Gabor filter banks , 2003, International Conference on Neural Networks and Signal Processing, 2003. Proceedings of the 2003.

[15]  K. Lunau,et al.  Innate Flower Recognition in Bumblebees (Bombus terrestris, B. lucorum; Apidae): Optical Signals from Stamens as Landing Reaction Releasers , 2010 .

[16]  Shiguang Shan,et al.  Discriminant analysis on Riemannian manifold of Gaussian distributions for face recognition with image sets , 2015, CVPR.

[17]  Gang Wang,et al.  Multi-manifold deep metric learning for image set classification , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[18]  Liang Chen,et al.  Dual Linear Regression Based Classification for Face Cluster Recognition , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[19]  Thi-Lan Le,et al.  Leaf based plant identification system for Android using SURF features in combination with Bag of Words model and supervised learning , 2013, 2013 International Conference on Advanced Technologies for Communications (ATC 2013).

[20]  Xiaoou Tang,et al.  Joint Face Representation Adaptation and Clustering in Videos , 2016, ECCV.

[21]  Ranjan Parekh,et al.  Plant Leaf Recognition using Shape based Features and Neural Network classifiers , 2011 .

[22]  Larry S. Davis,et al.  Covariance discriminative learning: A natural and efficient approach to image set classification , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[23]  Erick Mata-Montero,et al.  Combining Leaf Shape and Texture for Costa Rican Plant Species Identification , 2016, CLEI Electron. J..