Unsupervised segmentation of greenhouse plant images based on modified Latent Dirichlet Allocation

Agricultural greenhouse plant images with complicated scenes are difficult to precisely manually label. The appearance of leaf disease spots and mosses increases the difficulty in plant segmentation. Considering these problems, this paper proposed a statistical image segmentation algorithm MSBS-LDA (Mean-shift Bandwidths Searching Latent Dirichlet Allocation), which can perform unsupervised segmentation of greenhouse plants. The main idea of the algorithm is to take advantage of the language model LDA (Latent Dirichlet Allocation) to deal with image segmentation based on the design of spatial documents. The maximum points of probability density function in image space are mapped as documents and Mean-shift is utilized to fulfill the word-document assignment. The proportion of the first major word in word frequency statistics determines the coordinate space bandwidth, and the spatial LDA segmentation procedure iteratively searches for optimal color space bandwidth in the light of the LUV distances between classes. In view of the fruits in plant segmentation result and the ever-changing illumination condition in greenhouses, an improved leaf segmentation method based on watershed is proposed to further segment the leaves. Experiment results show that the proposed methods can segment greenhouse plants and leaves in an unsupervised way and obtain a high segmentation accuracy together with an effective extraction of the fruit part.

[1]  Carme Torras,et al.  Robotized Plant Probing: Leaf Segmentation Utilizing Time-of-Flight Data , 2013, IEEE Robotics & Automation Magazine.

[2]  Alexandre Escolà,et al.  Innovative LIDAR 3D Dynamic Measurement System to Estimate Fruit-Tree Leaf Area , 2011, Sensors.

[3]  J. Shan,et al.  Building boundary tracing and regularization from airborne lidar point clouds , 2007 .

[4]  Yung-Sheng Chen,et al.  Leaf segmentation, classification, and three-dimensional recovery from a few images with close viewpoints , 2011 .

[5]  Jean-Michel Pape,et al.  Utilizing machine learning approaches to improve the prediction of leaf counts and individual leaf segmentation of rosette plant images , 2015 .

[6]  Sotirios A. Tsaftaris,et al.  Image-based plant phenotyping with incremental learning and active contours , 2014, Ecol. Informatics.

[7]  David B. Dunson,et al.  Probabilistic topic models , 2011, KDD '11 Tutorials.

[8]  Hongdong Li,et al.  Connected contours: A new contour completion model that respects the closure effect , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[9]  Wei Guo,et al.  The Implementation of Driver Model Based on the Attention Transfer Process , 2017 .

[10]  S. D. Noble And R.B. Brown Spectral band selection and testing of edge-subtraction leaf segmentation , 2008 .

[11]  Jean-François Cardoso,et al.  Precision cosmology with the cosmic microwave background , 2010, IEEE Signal Processing Magazine.

[12]  Richard S. Zemel,et al.  End-to-End Instance Segmentation with Recurrent Attention , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[13]  H. Søgaard Weed Classification by Active Shape Models , 2005 .

[14]  Pascal Fua,et al.  SLIC Superpixels Compared to State-of-the-Art Superpixel Methods , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Gilles Rabatel,et al.  AE—Automation and Emerging Technologies: Weed Leaf Image Segmentation by Deformable Templates , 2001 .

[16]  Cui Yanli,et al.  Research on the color image segmentation of plant disease in the greenhouse , 2011, 2011 International Conference on Consumer Electronics, Communications and Networks (CECNet).

[17]  Lihong Xu,et al.  Automatic Segmentation for Plant Leaves via Multiview Stereo Reconstruction , 2017 .

[18]  Qian Wang,et al.  Mean-shift-based color segmentation of images containing green vegetation , 2009 .

[19]  S. N. Geethalakshmi,et al.  Hybrid Image Segmentation Algorithm for Leaf Recognition and Characterization , 2011, 2011 International Conference on Process Automation, Control and Computing.

[20]  Hanno Scharr,et al.  Leaf segmentation in plant phenotyping: a collation study , 2016, Machine Vision and Applications.

[21]  Won Suk Lee,et al.  Recognition of partially occluded plant leaves using a modified watershed algorithm , 2004 .

[22]  Pietro Perona,et al.  A Bayesian hierarchical model for learning natural scene categories , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[23]  Jangmyung Lee,et al.  In Situ 3D Segmentation of Individual Plant Leaves Using a RGB-D Camera for Agricultural Automation , 2015, Sensors.

[24]  Carme Torras,et al.  3D modelling of leaves from color and ToF data for robotized plant measuring , 2011, 2011 IEEE International Conference on Robotics and Automation.

[25]  Manhua Liu,et al.  Leaf Extraction from Complicated Background , 2009, 2009 2nd International Congress on Image and Signal Processing.

[26]  Alexei A. Efros,et al.  Using Multiple Segmentations to Discover Objects and their Extent in Image Collections , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[27]  Roland Wilson,et al.  Surface Modelling of Plants from Stereo Images , 2007, Sixth International Conference on 3-D Digital Imaging and Modeling (3DIM 2007).

[28]  Vladlen Koltun,et al.  Efficient Inference in Fully Connected CRFs with Gaussian Edge Potentials , 2011, NIPS.

[29]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[30]  Dorin Comaniciu,et al.  Real-time tracking of non-rigid objects using mean shift , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[31]  C. Lawrence Zitnick,et al.  Fast Edge Detection Using Structured Forests , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[32]  A. Srikaew,et al.  Grape leaf disease detection from color imagery using hybrid intelligent system , 2008, 2008 5th International Conference on Electrical Engineering/Electronics, Computer, Telecommunications and Information Technology.

[33]  Lingxian Zhang,et al.  A segmentation method for greenhouse vegetable foliar disease spots images using color information and region growing , 2017, Comput. Electron. Agric..

[34]  Christophe Fiorio,et al.  Weed leaf recognition in complex natural scenes by model-guided edge pairing. , 2003 .

[35]  Mark Steyvers,et al.  Finding scientific topics , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[36]  Antonio Criminisi,et al.  Object categorization by learned universal visual dictionary , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[37]  David M. Blei,et al.  Probabilistic topic models , 2012, Commun. ACM.

[38]  Michael I. Jordan,et al.  Latent Dirichlet Allocation , 2001, J. Mach. Learn. Res..

[39]  Yang Yu,et al.  Remote sensing image classification using layer-by-layer feature associative conditional random field , 2014 .

[40]  Fernando Ramos-Quintana,et al.  Method for Segmenting Tomato Plants in Uncontrolled Environments , 2012 .

[41]  K. Madhava Krishna,et al.  Semantic Motion Segmentation Using Dense CRF Formulation , 2014, ICVGIP.

[42]  Hanno Scharr,et al.  Annotated Image Datasets of Rosette Plants , 2014 .

[43]  W. Eric L. Grimson,et al.  Spatial Latent Dirichlet Allocation , 2007, NIPS.

[44]  Björn Åstrand,et al.  Classification of crops and weeds extracted by active shape models , 2008 .

[45]  Philip H. S. Torr,et al.  Recurrent Instance Segmentation , 2015, ECCV.

[46]  Li Fei-Fei,et al.  Spatially coherent latent topic model for concurrent object segmentation and classification , 2007 .

[47]  Fei-Fei Li,et al.  Spatially Coherent Latent Topic Model for Concurrent Segmentation and Classification of Objects and Scenes , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[48]  Laure Tougne,et al.  A Parametric Active Polygon for Leaf Segmentation and Shape Estimation , 2011, ISVC.

[49]  S. N. Geethalakshmi,et al.  Plant Leaf Segmentation Using Non Linear K means Clustering , 2012 .