Grapes Visual Segmentation for Harvesting Robots Using Local Texture Descriptors

This paper investigates the performance of Local Binary Patterns variants in grape segmentation for autonomous agricultural robots, namely Agrobots, applied to viniculture and winery. Robust fruit detection is challenging and needs to be accurate to enable the Agrobot to execute demanding tasks of precise farming. Segmentation task is handled by classification with the supervised machine learning model k-Nearest Neighbor (\( k \)-NN), including extracted features from Local Binary Patterns (LBP) and their variants in combination of color components. LBP variants are tested for both varieties of red and white grapes, subject to performance measures of accuracy, recall and precision. The results for red grapes indicate an approximate intended accuracy of 94% of detection, while the results relating to white grapes confirm the concerns of complex indiscreet visual cues providing accuracies of 83%.

[1]  C. Rosenberger,et al.  Grape Detection By Image Processing , 2006, IECON 2006 - 32nd Annual Conference on IEEE Industrial Electronics.

[2]  Fatimah Khalid,et al.  A texture descriptor: BackGround Local Binary Pattern (BGLBP) , 2015, Multimedia Tools and Applications.

[3]  Lakhmi C. Jain,et al.  Local Binary Patterns: New Variants and Applications , 2013, Local Binary Patterns.

[4]  Jose L Pons,et al.  Design and implementation of an aided fruit‐harvesting robot (Agribot) , 1998 .

[5]  Matti Pietikäinen,et al.  A comparative study of texture measures with classification based on featured distributions , 1996, Pattern Recognit..

[6]  Matti Pietikäinen,et al.  Rotation-invariant texture classification using feature distributions , 2000, Pattern Recognit..

[7]  Giancarlo Troni,et al.  A pattern recognition strategy for visual grape bunch detection in vineyards , 2018, Comput. Electron. Agric..

[8]  Kaiming He,et al.  Mask R-CNN , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[9]  C. Schmid,et al.  Description of Interest Regions with Center-Symmetric Local Binary Patterns , 2006, ICVGIP.

[10]  Eduard Clotet,et al.  Vineyard Yield Estimation Based on the Analysis of High Resolution Images Obtained with Artificial Illumination at Night , 2015, Sensors.

[11]  Xiangjun Zou,et al.  Vision-based extraction of spatial information in grape clusters for harvesting robots , 2016 .

[12]  Matti Pietikäinen,et al.  Performance evaluation of texture measures with classification based on Kullback discrimination of distributions , 1994, Proceedings of 12th International Conference on Pattern Recognition.

[13]  Matti Pietikäinen,et al.  Modeling pixel process with scale invariant local patterns for background subtraction in complex scenes , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[14]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[15]  Xiangjun Zou,et al.  Robust Grape Cluster Detection in a Vineyard by Combining the AdaBoost Framework and Multiple Color Components , 2016, Sensors.

[16]  Dimitris E. Koulouriotis,et al.  Moment-based local binary patterns: A novel descriptor for invariant pattern recognition applications , 2013, Neurocomputing.

[17]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  Thierry Bouwmans,et al.  An eXtended Center-Symmetric Local Binary Pattern for Background Modeling and Subtraction in Videos , 2015, VISAPP.

[19]  Borja Millán,et al.  Grapevine flower estimation by applying artificial vision techniques on images with uncontrolled scene and multi-model analysis , 2015, Comput. Electron. Agric..

[20]  Matti Pietikäinen,et al.  Classification with color and texture: jointly or separately? , 2004, Pattern Recognit..

[21]  Won Suk Lee,et al.  Detection and counting of immature green citrus fruit based on the Local Binary Patterns (LBP) feature using illumination-normalized images , 2018, Precision Agriculture.