Infield oilseed rape images segmentation via improved unsupervised learning models combined with supreme color features

Abstract The variability of illumination and weather conditions lead to a big challenge for infield image segmentation. Therefore, robust, fast, and automated algorithms are highly required to obtain reliable image segmentation results. This research was aimed to develop efficient unsupervised clustering algorithms for oilseed rape image segmentation in the field. The Naive Bayes rule was first employed to select a supreme color feature from ten color models. An initialization approach based on the genetic algorithm (GA) was then used to define the initial cluster centroids for subsequent Gaussian mixture model (GMM), self-organizing map (SOM), fuzzy c-mean (FCM), and k-means algorithms. The length of the chromosome was determined using cluster validity indices. Finally, the performances of these algorithms were evaluated based on the image segmentation quality and computation time. After testing the proposed method on the image datasets from two fields, the results revealed that the highest segmentation accuracy of 96% was obtained using the optimized SOM and the lowest computation time was obtained using the k-means. The GA-based initialization speeded up the convergence process and ensured consistent labeling between runs. All clustering algorithms were proved to be robust to varying illumination conditions and can process images with a very complex background in an automated fashion.

[1]  Andrew E. Suyker,et al.  An alternative method using digital cameras for continuous monitoring of crop status , 2012 .

[2]  Ashutosh Kumar Singh,et al.  Machine Learning for High-Throughput Stress Phenotyping in Plants. , 2016, Trends in plant science.

[3]  Edward Jones,et al.  A survey of image processing techniques for plant extraction and segmentation in the field , 2016, Comput. Electron. Agric..

[4]  A. K. Misra,et al.  Detection of plant leaf diseases using image segmentation and soft computing techniques , 2017 .

[5]  Zhiguo Cao,et al.  Crop segmentation from images by morphology modeling in the CIE L*a*b* color space , 2013 .

[6]  Pilsung Kang,et al.  Integrating cluster validity indices based on data envelopment analysis , 2018, Appl. Soft Comput..

[7]  Bala Srinivasan,et al.  Dynamic self-organizing maps with controlled growth for knowledge discovery , 2000, IEEE Trans. Neural Networks Learn. Syst..

[8]  Teuvo Kohonen,et al.  The self-organizing map , 1990 .

[9]  Marcin Kozak,et al.  “A Dendrite Method for Cluster Analysis” by Caliński and Harabasz: A Classical Work that is Far Too Often Incorrectly Cited , 2012 .

[10]  Miao Liu,et al.  An Adaptive Multiobjective Genetic Algorithm with Fuzzy -Means for Automatic Data Clustering , 2018 .

[11]  Jafar Massah,et al.  A farmer-assistant robot for nitrogen fertilizing management of greenhouse crops , 2017, Comput. Electron. Agric..

[12]  J. M. González-Esquiva,et al.  Optimal color space selection method for plant/soil segmentation in agriculture , 2016, Comput. Electron. Agric..

[13]  Ferani E. Zulvia,et al.  Integration of growing self-organizing map and bee colony optimization algorithm for part clustering , 2018, Comput. Ind. Eng..

[14]  Achim Walter,et al.  An image analysis pipeline for automated classification of imaging light conditions and for quantification of wheat canopy cover time series in field phenotyping , 2017, Plant Methods.

[15]  Zahid Iqbal,et al.  Detection and classification of citrus diseases in agriculture based on optimized weighted segmentation and feature selection , 2018, Comput. Electron. Agric..

[16]  Hirofumi Kadono,et al.  Highly sensitive optical interferometric technique reveals stress-dependent instantaneous nanometric growth fluctuations of Chinese chive leaf under heavy metal stress. , 2017, Ecotoxicology and environmental safety.

[17]  Ahmad Khan,et al.  Genetic algorithm and self organizing map based fuzzy hybrid intelligent method for color image segmentation , 2015, Appl. Soft Comput..

[18]  Ping Zhang,et al.  Unsupervised Segmentation of Greenhouse Plant Images Based on Statistical Method , 2018, Scientific Reports.

[19]  Donald W. Bouldin,et al.  A Cluster Separation Measure , 1979, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Salah Sukkarieh,et al.  Machine learning approaches for crop yield prediction and nitrogen status estimation in precision agriculture: A review , 2018, Comput. Electron. Agric..

[21]  Hwai-En Tseng,et al.  A Block-based genetic algorithm for disassembly sequence planning , 2018, Expert Syst. Appl..

[22]  Uwe Scholz,et al.  Quantitative monitoring of Arabidopsis thaliana growth and development using high-throughput plant phenotyping , 2016, Scientific Data.

[23]  Hiroshi Okamoto,et al.  Development of Crop Growth Mapping System Using Machine Vision (Part 2) , 2005 .

[24]  Gharpure Damayanti Chandrashekhar,et al.  Self-Organizing Map based Extended Fuzzy C-Means (SEEFC) algorithm for image segmentation , 2017, Appl. Soft Comput..

[25]  O. Vergara,et al.  Comparative performance of remote sensing methods in assessing wheat performance under Mediterranean conditions , 2016 .

[26]  Dongdong Zhang,et al.  A universal estimation model of fractional vegetation cover for different crops based on time series digital photographs , 2018, Comput. Electron. Agric..

[27]  J. M. Molina-Martínez,et al.  Study and comparison of color models for automatic image analysis in irrigation management applications , 2015 .

[28]  Mohammad Hossein Fazel Zarandi,et al.  Generalized Possibilistic Fuzzy C-Means with novel cluster validity indices for clustering noisy data , 2017, Appl. Soft Comput..

[29]  Jianping Fan,et al.  Statistical modeling and conceptualization of natural images , 2005, Pattern Recognit..

[30]  Joseph L. Gage,et al.  TIPS: a system for automated image-based phenotyping of maize tassels , 2017, Plant Methods.

[31]  C. Daughtry,et al.  Evaluation of Digital Photography from Model Aircraft for Remote Sensing of Crop Biomass and Nitrogen Status , 2005, Precision Agriculture.

[32]  Mohammad Shorif Uddin,et al.  Machine vision based papaya disease recognition , 2020, J. King Saud Univ. Comput. Inf. Sci..

[33]  J. Gardner,et al.  Food wedges: Framing the global food demand and supply challenge towards 2050 , 2014 .

[34]  J. Casadesús,et al.  Conventional digital cameras as a tool for assessing leaf area index and biomass for cereal breeding. , 2014, Journal of integrative plant biology.

[35]  Fernando Ramos-Quintana,et al.  Method for Segmenting Tomato Plants in Uncontrolled Environments , 2012 .

[36]  Joris IJsselmuiden,et al.  Synthetic bootstrapping of convolutional neural networks for semantic plant part segmentation , 2017, Comput. Electron. Agric..

[37]  Rui Xu,et al.  GPhenoVision: A Ground Mobile System with Multi-modal Imaging for Field-Based High Throughput Phenotyping of Cotton , 2018, Scientific Reports.

[38]  Sotirios A. Tsaftaris,et al.  Image-based plant phenotyping with incremental learning and active contours , 2014, Ecol. Informatics.

[39]  Pouria Sadeghi-Tehran,et al.  Multi-feature machine learning model for automatic segmentation of green fractional vegetation cover for high-throughput field phenotyping , 2017, Plant Methods.

[40]  Fernando Ramos-Quintana,et al.  Integrating SOMs and a Bayesian Classifier for Segmenting Diseased Plants in Uncontrolled Environments , 2014, TheScientificWorldJournal.

[41]  Arno Ruckelshausen,et al.  BreedVision — A Multi-Sensor Platform for Non-Destructive Field-Based Phenotyping in Plant Breeding , 2013, Sensors.

[42]  Yufeng Ge,et al.  A multi-sensor system for high throughput field phenotyping in soybean and wheat breeding , 2016, Comput. Electron. Agric..

[43]  Daniel F. Leite,et al.  Fuzzy clustering and fuzzy validity measures for knowledge discovery and decision making in agricultural engineering , 2018, Comput. Electron. Agric..

[44]  G. Meyer,et al.  Color indices for weed identification under various soil, residue, and lighting conditions , 1994 .

[45]  Hiroshi Okamoto,et al.  Development of Crop Growth Mapping System Using Machine Vision (Part 1) , 2004 .

[46]  Fuyu Ma,et al.  Use of a Digital Camera to Monitor the Growth and Nitrogen Status of Cotton , 2014, TheScientificWorldJournal.

[47]  Yang Xu,et al.  Weed identification based on K-means feature learning combined with convolutional neural network , 2017, Comput. Electron. Agric..