Crop feature extraction from images with probabilistic superpixel Markov random field

A specularity-invariant crop extraction method is first put forward.Our method is resistance to the specularity reflection utilizing markov random field.Our method also manifests the ability to identify crop from the cover of shadow.Our method achieves the highest performances with the lowest variations.This method can be utilized in practical automatic observation system. In the process of agriculture automation, mechanization and intelligentialization, image segmentation for crop extraction plays a crucial role. However, the performance of crop segmentation is closely related to the quality of the captured image, which is easily affected by the variability, randomness, and complexity of the natural illumination. The previously proposed crop extraction approaches produce inaccurate segmentation under natural illumination when highlight occurs. And specularity removal techniques are still hard to improve the crop extraction performance, because of the flaw of their assumption and the high requirement of the experimental configuration. In this paper, we propose a novel crop extraction method resistant to the strong illumination by using probabilistic superpixel Markov random field. Our method is based on the assumption that color changes gradually between highlight areas and its neighboring non-highlight areas and the same holds true for the other regions. This priori knowledge is embedded into the MRF-MAP framework by modeling the local and mutual evidences of nodes. Besides, superpixel and Fisher linear discriminant are utilized to construct the probabilistic superpixel patches. Loopy belief propagation algorithm is adopted in the optimization step. And the label for the crop segmentation is provided in the final iteration result. We also compare our method to the other state-of-the-art approaches. The results demonstrate that our method is resistant to the strong illumination and can be applied to generic species. Moreover, our approach is also capable of extracting the crop from the shadow regions. Statistics from comparative experiments manifest that our crop segmentation method yields the highest mean value of 92.29% with the lowest standard deviation of 4.65%, which can meet the requirement of practical uses in our agriculture automatic vision system.

[1]  Zhiguo Cao,et al.  Crop segmentation from images by morphology modeling in the CIE L*a*b* color space , 2013 .

[2]  N. Otsu A threshold selection method from gray level histograms , 1979 .

[3]  F. Truchetet,et al.  Crop/weed discrimination in perspective agronomic images , 2008 .

[4]  G. van Straten,et al.  A vision based row detection system for sugar beet , 2005 .

[5]  Robin Gebbers,et al.  Precision Agriculture and Food Security , 2010, Science.

[6]  Vladimir Y. Mariano,et al.  Automated rice leaf disease detection using color image analysis , 2011, International Conference on Digital Image Processing.

[7]  Sang Wook Lee,et al.  Detection of diffuse and specular interface reflections and inter-reflections by color image segmentation , 1996, International Journal of Computer Vision.

[8]  Jun Pang,et al.  Automatic segmentation of crop leaf spot disease images by integrating local threshold and seeded region growing , 2011, 2011 International Conference on Image Analysis and Signal Processing.

[9]  Yutaka Kaizu,et al.  A dual-spectral camera system for paddy rice seedling row detection , 2008 .

[10]  Pieter Peers,et al.  Rapid Acquisition of Specular and Diffuse Normal Maps from Polarized Spherical Gradient Illumination , 2007 .

[11]  N. Zhang,et al.  Precision agriculture—a worldwide overview , 2002 .

[12]  Pedro Antonio Gutiérrez,et al.  A logistic radial basis function regression method for discrimination of cover crops in olive orchards , 2010, Expert Syst. Appl..

[13]  Vijay Subramanian,et al.  Development of machine vision and laser radar based autonomous vehicle guidance systems for citrus grove navigation , 2006 .

[14]  Guy Godin,et al.  Separation of diffuse and specular components of surface reflection by use of polarization and statistical analysis of images , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  R. Fisher THE STATISTICAL UTILIZATION OF MULTIPLE MEASUREMENTS , 1938 .

[16]  Takeo Kanade,et al.  The measurement of highlights in color images , 1988, International Journal of Computer Vision.

[17]  Judith M. Hushon Expert Systems for Environmental Applications , 1998 .

[18]  Andrew E. Suyker,et al.  An alternative method using digital cameras for continuous monitoring of crop status , 2012 .

[19]  Stephen Lin,et al.  Diffuse-Specular Separation and Depth Recovery from Image Sequences , 2002, ECCV.

[20]  Ramesh Raskar,et al.  Removing photography artifacts using gradient projection and flash-exposure sampling , 2005, SIGGRAPH 2005.

[21]  Lei Tian,et al.  An automated stand-alone in-field remote sensing system (SIRSS) for in-season crop monitoring , 2011 .

[22]  T. Kataoka,et al.  Crop growth estimation system using machine vision , 2003, Proceedings 2003 IEEE/ASME International Conference on Advanced Intelligent Mechatronics (AIM 2003).

[23]  Qian Wang,et al.  Mean-shift-based color segmentation of images containing green vegetation , 2009 .

[24]  Zhenghong Yu,et al.  Automatic image-based detection technology for two critical growth stages of maize: Emergence and three-leaf stage , 2013 .

[25]  Pascal Fua,et al.  SLIC Superpixels Compared to State-of-the-Art Superpixel Methods , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  Gonzalo Pajares,et al.  Automatic expert system based on images for accuracy crop row detection in maize fields , 2013, Expert Syst. Appl..

[27]  George E. Meyer,et al.  Plant species identification, size, and enumeration using machine vision techniques on near-binary images , 1993, Other Conferences.

[28]  George E. Meyer,et al.  Machine vision detection parameters for plant species identification , 1999, Other Conferences.

[29]  N. D. Tillett,et al.  Automated Crop and Weed Monitoring in Widely Spaced Cereals , 2006, Precision Agriculture.

[30]  Judea Pearl,et al.  Probabilistic reasoning in intelligent systems - networks of plausible inference , 1991, Morgan Kaufmann series in representation and reasoning.

[31]  David J. Kriegman,et al.  Specularity Removal in Images and Videos: A PDE Approach , 2006, ECCV.

[32]  T. Kanade,et al.  USING A COLOR REFLECTION MODEL TO SEPARATE HIGHLIGHTS FROM OBJECT COLOR , 1987 .

[33]  S. Christensen,et al.  Colour and shape analysis techniques for weed detection in cereal fields , 2000 .

[34]  Stephen Lin,et al.  Highlight removal by illumination-constrained inpainting , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[35]  Jaime Gomez-Gil,et al.  Testing different color spaces based on hue for the environmentally adaptive segmentation algorithm (EASA) , 2009 .

[36]  Ramesh Raskar,et al.  Specular reflection reduction with multi-flash imaging , 2004, Proceedings. 17th Brazilian Symposium on Computer Graphics and Image Processing.

[37]  Noboru Noguchi,et al.  Agricultural automatic guidance research in North America , 2000 .

[38]  Lei Tian,et al.  Environmentally adaptive segmentation algorithm for outdoor image segmentation , 1998 .

[39]  George E. Meyer,et al.  Shape features for identifying young weeds using image analysis , 1994 .

[40]  Katsushi Ikeuchi,et al.  Separating Reflection Components of Textured Surfaces Using a Single Image , 2005, IEEE Trans. Pattern Anal. Mach. Intell..

[41]  J. C. Neto,et al.  A combined statistical-soft computing approach for classification and mapping weed species in minimum -tillage systems , 2004 .

[42]  J. L. Gonzalez-Andujar Expert system for pests, diseases and weeds identification in olive crops , 2009, Expert Syst. Appl..

[43]  Wei Guo,et al.  Illumination invariant segmentation of vegetation for time series wheat images based on decision tree model , 2013 .

[44]  Gonzalo Pajares,et al.  Support Vector Machines for crop/weeds identification in maize fields , 2012, Expert Syst. Appl..

[45]  Rainer Stiefelhagen,et al.  Improving foreground segmentations with probabilistic superpixel Markov random fields , 2012, 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[46]  Stephen Lin,et al.  Separation of Highlight Reflections on Textured Surfaces , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[47]  大西 仁,et al.  Pearl, J. (1988, second printing 1991). Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference. Morgan-Kaufmann. , 1994 .

[48]  César Hervás-Martínez,et al.  A multi-objective neural network based method for cover crop identification from remote sensed data , 2012, Expert Syst. Appl..

[49]  Honggang Zhang,et al.  Chromaticity-based separation of reflection components in a single image , 2008, Pattern Recognit..

[50]  Xavier P. Burgos-Artizzu,et al.  Real-time image processing for crop / weed discrimination in maize fields , 2012 .

[51]  Mahmoud Omid,et al.  Evaluating banana ripening status from measuring dielectric properties , 2011 .

[52]  Gonzalo Pajares,et al.  Automatic expert system for weeds/crops identification in images from maize fields , 2013, Expert Syst. Appl..