Unsupervised Greenhouse Tomato Plant Segmentation Based on Self-Adaptive Iterative Latent Dirichlet Allocation from Surveillance Camera

It has long been a great concern in deep learning that we lack massive data for high-precision training sets, especially in the agriculture field. Plants in images captured in greenhouses, from a distance or up close, not only have various morphological structures but also can have a busy background, leading to huge challenges in labeling and segmentation. This article proposes an unsupervised statistical algorithm SAI-LDA (self-adaptive iterative latent Dirichlet allocation) to segment greenhouse tomato images from a field surveillance camera automatically, borrowing the language model LDA. Hierarchical wavelet features with an overlapping grid word document design and a modified density-based method quick-shift are adopted, respectively, according to different kinds of images, which are classified by specific proportions between fruits, leaves, and the background. We also utilize the feature correlation between several layers of the image to make further optimization through three rounds of iteration of LDA, with updated documents to achieve finer segmentation. Experiment results show that our method can automatically label the organs of the greenhouse plant under complex circumstances, fast and precisely, overcoming the difficulty of inferior real-time image quality caused by a surveillance camera, and thus obtain large amounts of valuable training sets.

[1]  Samory Kpotufe,et al.  Modal-set estimation with an application to clustering , 2016, AISTATS.

[2]  Svend Christensen,et al.  Development of a Mobile Multispectral Imaging Platform for Precise Field Phenotyping , 2014 .

[3]  S. Bharkad,et al.  Fingerprint matching using discreet wavelet packet transform , 2013, 2013 3rd IEEE International Advance Computing Conference (IACC).

[4]  T. Cardi,et al.  Sensing Technologies for Precision Phenotyping in Vegetable Crops: Current Status and Future Challenges , 2018 .

[5]  Stefano Soatto,et al.  Quick Shift and Kernel Methods for Mode Seeking , 2008, ECCV.

[6]  Zhao Wei-dong,et al.  Contour-Based Plant Leaf Image Segmentation Using Visual Saliency , 2015, ICIG 2015.

[7]  Przemyslaw Prusinkiewicz,et al.  The use of plant models in deep learning: an application to leaf counting in rosette plants , 2018, Plant Methods.

[8]  Cui Yanli,et al.  Research on the color image segmentation of plant disease in the greenhouse , 2011, 2011 International Conference on Consumer Electronics, Communications and Networks (CECNet).

[9]  Jidong Lv,et al.  Recognition method for apple fruit based on SUSAN and PCNN , 2018, Multimedia Tools and Applications.

[10]  Pascal Bertolino,et al.  Multiresolution segmentation using the irregular pyramid , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[11]  W. Eric L. Grimson,et al.  Unsupervised Activity Perception by Hierarchical Bayesian Models , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[12]  Gang Hua,et al.  Spatial-DiscLDA for visual recognition , 2011, CVPR 2011.

[13]  David Mason,et al.  On the Estimation of the Gradient Lines of a Density and the Consistency of the Mean-Shift Algorithm , 2016, J. Mach. Learn. Res..

[14]  Mahmood Fathy,et al.  Informative visual words construction to improve bag of words image representation , 2014, IET Image Process..

[15]  Nuno Vasconcelos,et al.  Latent Dirichlet Allocation Models for Image Classification , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  David Wettergreen,et al.  In-field segmentation and identification of plant structures using 3D imaging , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[17]  Zhihan Lv,et al.  Spatially Regularized Latent Topic Model for Simultaneous Object Discovery and Segmentation , 2015, 2015 IEEE International Conference on Systems, Man, and Cybernetics.

[18]  Gioia Capelli,et al.  First detection of Cytauxzoon spp. infection in European wildcats (Felis silvestris silvestris) of Italy. , 2016, Ticks and tick-borne diseases.

[19]  Alex A. Freitas,et al.  A survey of hierarchical classification across different application domains , 2010, Data Mining and Knowledge Discovery.

[20]  Hanno Scharr,et al.  Leaf segmentation in plant phenotyping: a collation study , 2016, Machine Vision and Applications.

[21]  Byung Ryong Lee,et al.  An image segmentation approach for fruit defect detection using k-means clustering and graph-based algorithm , 2015, Vietnam Journal of Computer Science.

[22]  Salah Sukkarieh,et al.  Orchard fruit segmentation using multi-spectral feature learning , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[23]  Mark Steyvers,et al.  Finding scientific topics , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[24]  B. S. Manjunath,et al.  Multi-scale edge detection and image segmentation , 2005, 2005 13th European Signal Processing Conference.

[25]  Hongliang Li,et al.  Unsupervised Multiclass Region Cosegmentation via Ensemble Clustering and Energy Minimization , 2014, IEEE Transactions on Circuits and Systems for Video Technology.

[26]  W. Eric L. Grimson,et al.  Spatial Latent Dirichlet Allocation , 2007, NIPS.

[27]  Antonio Criminisi,et al.  Object categorization by learned universal visual dictionary , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[28]  Sotirios A. Tsaftaris,et al.  Image-based plant phenotyping with incremental learning and active contours , 2014, Ecol. Informatics.

[29]  De Xu,et al.  Bag-of-words image representation based on classified vector quantization , 2010, 2010 International Conference on Machine Learning and Cybernetics.

[30]  Michael I. Jordan,et al.  DiscLDA: Discriminative Learning for Dimensionality Reduction and Classification , 2008, NIPS.

[31]  Sanjoy Dasgupta,et al.  Optimal rates for k-NN density and mode estimation , 2014, NIPS.

[32]  Xinbo Gao,et al.  Knowledge-Based Topic Model for Unsupervised Object Discovery and Localization , 2018, IEEE Transactions on Image Processing.

[33]  David B. Dunson,et al.  Probabilistic topic models , 2012, Commun. ACM.

[34]  Yang Yu,et al.  Remote sensing image classification using layer-by-layer feature associative conditional random field , 2014 .

[35]  Qin Zhang,et al.  A Review of Imaging Techniques for Plant Phenotyping , 2014, Sensors.

[36]  José E. Chacón,et al.  A Population Background for Nonparametric Density-Based Clustering , 2014, 1408.1381.

[37]  Hideki Noda,et al.  MRF-based texture segmentation using wavelet decomposed images , 2000, Electronic Imaging.

[38]  Manhua Liu,et al.  Leaf Extraction from Complicated Background , 2009, 2009 2nd International Congress on Image and Signal Processing.

[39]  Yujie Liu,et al.  A More Effective Method for Image Representation: Topic Model Based on Latent Dirichlet Allocation , 2015, 2015 14th International Conference on Computer-Aided Design and Computer Graphics (CAD/Graphics).

[40]  Takeo Kanade,et al.  Mode-seeking by Medoidshifts , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[41]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[42]  Larry A. Wasserman,et al.  Non‐parametric inference for density modes , 2013, ArXiv.

[43]  Hagai Attias,et al.  Topic regression multi-modal Latent Dirichlet Allocation for image annotation , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[44]  Yongsheng Si,et al.  High-Throughput Phenotyping of Seed/Seedling Evaluation Using Digital Image Analysis , 2018 .

[45]  Pedro J. Navarro,et al.  Machine Learning and Computer Vision System for Phenotype Data Acquisition and Analysis in Plants , 2016, Sensors.

[46]  Seishi Ninomiya,et al.  On Plant Detection of Intact Tomato Fruits Using Image Analysis and Machine Learning Methods , 2014, Sensors.

[47]  Liu Yang,et al.  An improved FCM algorithm for ripe fruit image segmentation , 2013, 2013 IEEE International Conference on Information and Automation (ICIA).

[48]  Dong Hwan Kim,et al.  An automated, high-throughput plant phenotyping system using machine learning-based plant segmentation and image analysis , 2018, PloS one.

[49]  Shao Peng Zhu,et al.  The Agriculture Vision Image Segmentation Algorithm Based on Improved Quantum-Behaved Particle Swarm Optimization , 2015 .

[50]  Baskar Ganapathysubramanian,et al.  Computer vision and machine learning for robust phenotyping in genome-wide studies , 2017, Scientific Reports.

[51]  Tao Wang,et al.  Automatic Segmentation and Counting of Aphid Nymphs on Leaves Using Convolutional Neural Networks , 2018, Agronomy.

[52]  Michael I. Jordan,et al.  Latent Dirichlet Allocation , 2001, J. Mach. Learn. Res..

[53]  Jian-Ping Li,et al.  Content based grading of fresh fruits using Markov random field , 2016, 2016 3rd International Conference on Computing for Sustainable Global Development (INDIACom).

[54]  Tao Mei,et al.  Image tag refinement by regularized latent Dirichlet allocation , 2013, Comput. Vis. Image Underst..