Plant recognition via leaf shape and margin features

Botanists and foresters empirically determine plant categories mainly via visual features of leaves, e.g. leaf shape, leaf margin, leaf arrangement and leaf venation. The leaf shape and leaf margin can be captured easily with cheap devices. As a result, automatic plant recognition is generally based on leaf shape or margin features. In this paper, a set of features that depict leaf shape and margin are proposed to improve the performance of plant recognition. The proposed margin features utilize the area ratio to quantify the convexity/concavity of each contour point at different scales and such margin features are effective in capturing the global information and contour details. The area ratio is the ration of the disk to the inside of the contour. The proposed shape features use a combination of morphological features to characterize the global shape of the leaf, which has merits in preserving the geometric properties of leaf shape. Additionally, a series of multi-grained fusion methods that combine the margin feature and global shape feature are proposed as a better representation of a leaf. To validate the effectiveness and generalization, we evaluate our methods on two public datasets: Swedish Leaf dataset and ICL Leaf dataset. The experimental results show the superiority of our methods over state-of-the-art shape methods.

[1]  P. Tzionas Plant leaves classification based on morphological features and a fuzzy surface selection technique , 2005 .

[2]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[3]  Jitendra Malik,et al.  Shape matching and object recognition using shape contexts , 2010, 2010 3rd International Conference on Computer Science and Information Technology.

[4]  Longin Jan Latecki,et al.  Locally constrained diffusion process on locally densified distance spaces with applications to shape retrieval , 2009, CVPR.

[5]  Xiaoou Tang,et al.  2D Shape Matching by Contour Flexibility , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Vijay Satti AN AUTOMATIC LEAF RECOGNITION SYSTEM FOR PLANT IDENTIFICATION USING MACHINE VISION TECHNOLOGY , 2013 .

[7]  Naif Alajlan,et al.  Shape retrieval using triangle-area representation and dynamic space warping , 2007, Pattern Recognit..

[8]  Hui Wei,et al.  Multiscale Triangular Centroid Distance for Shape-Based Plant Leaf Recognition , 2016, ECAI.

[9]  Yilong Yin,et al.  Distribution-oriented Aesthetics Assessment for Image Search , 2017, SIGIR.

[10]  Yuxuan Wang,et al.  A Leaf Recognition Algorithm for Plant Classification Using Probabilistic Neural Network , 2007, 2007 IEEE International Symposium on Signal Processing and Information Technology.

[11]  Wei Jia,et al.  Multiscale Distance Matrix for Fast Plant Leaf Recognition , 2012, IEEE Transactions on Image Processing.

[12]  Nello Cristianini,et al.  An Introduction to Support Vector Machines and Other Kernel-based Learning Methods , 2000 .

[13]  Xiaofeng Wang,et al.  Leaf shape based plant species recognition , 2007, Appl. Math. Comput..

[14]  Oskar Söderkvist,et al.  Computer Vision Classification of Leaves from Swedish Trees , 2001 .

[15]  D. Wijesingha,et al.  Automatic Detection System for the Identification of Plants Using Herbarium Specimen Images , 2012 .

[16]  C. Arun Priya,et al.  An efficient leaf recognition algorithm for plant classification using support vector machine , 2012, International Conference on Pattern Recognition, Informatics and Medical Engineering (PRIME-2012).

[17]  Jyotismita Chaki,et al.  Plant leaf recognition using texture and shape features with neural classifiers , 2015, Pattern Recognit. Lett..

[18]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[19]  Plant Leaf Classification for a Mobile Field Guide , 2010 .

[20]  Guojun Lu,et al.  Review of shape representation and description techniques , 2004, Pattern Recognit..

[21]  James M. Rehg,et al.  CENTRIST: A Visual Descriptor for Scene Categorization , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Peter E. Hart,et al.  Nearest neighbor pattern classification , 1967, IEEE Trans. Inf. Theory.

[23]  Haibin Ling,et al.  Shape Classification Using the Inner-Distance , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  Ukrit Watchareeruetai,et al.  Shape recognition by using Scale Invariant Feature Transform for contour , 2017, 2017 14th International Joint Conference on Computer Science and Software Engineering (JCSSE).

[25]  N. Otsu A threshold selection method from gray level histograms , 1979 .

[26]  W. John Kress,et al.  Leafsnap: A Computer Vision System for Automatic Plant Species Identification , 2012, ECCV.

[27]  Joshua D. Schwartz,et al.  Hierarchical Matching of Deformable Shapes , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[28]  Cem Kalyoncu,et al.  Geometric leaf classification , 2015, Comput. Vis. Image Underst..

[29]  Junwei Wang,et al.  Shape matching and classification using height functions , 2012, Pattern Recognit. Lett..

[30]  Sean White,et al.  Searching the World's Herbaria: A System for Visual Identification of Plant Species , 2008, ECCV.

[31]  Paolo Remagnino,et al.  Deep-plant: Plant identification with convolutional neural networks , 2015, 2015 IEEE International Conference on Image Processing (ICIP).