A new methodology for estimating the grapevine-berry number per cluster using image analysis

A new image analysis algorithm based on mathematical morphology and pixel classification for grapevine berry counting is presented in this paper. First, a set of berry candidates represented by connected components was extracted. Then, six descriptors were calculated using key features of these components, and were employed for false positive (FP) discrimination using a supervised approach. More specifically, the set of descriptors modelled the grapes' distinctive shape, light reflection pattern and colour. Two classifiers were tested, a three-layer neural network and an optimised support vector machine. A dataset of 152 images was acquired with a low-cost smart phone camera. Images came from seven grapevine varieties, 18 per variety, at the two phenological stages in the Baggiolini scale between berry set (named stage K; 94 images) and cluster-closure (named stage L; 32 images). 126 of these images were kept for external validation and the remaining 26 were used for training (12 at stage L and 14 at K). From these training images, 5438 true/false positive samples were generated and labelled in terms of the six descriptors. The neural network performed better than the support vector machine, yielding consistent Recall and Precision average values of 0.9572 and 0.8705, respectively. The presented algorithm, implemented as a smartphone application, can constitute a useful diagnosis tool for the in-the-field and non-destructive yield prediction and berry set assessing for the grape and wine industry.

[1]  Ribana Roscher,et al.  Image based evaluation for the detection of cluster parameters in grapevine , 2015 .

[2]  Stephen Nuske,et al.  Texture-based fruit detection via images using the smooth patterns on the fruit , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[3]  N. Otsu A threshold selection method from gray level histograms , 1979 .

[4]  Borja Millán,et al.  Grapevine flower estimation by applying artificial vision techniques on images with uncontrolled scene and multi-model analysis , 2015, Comput. Electron. Agric..

[5]  Nuria Aleixos,et al.  Assessment of cluster yield components by image analysis. , 2015, Journal of the science of food and agriculture.

[6]  Manuel A. Armada,et al.  Combination of RGB and Multispectral Imagery for Discrimination of Cabernet Sauvignon Grapevine Elements , 2013, Sensors.

[7]  Christine Connolly,et al.  A study of efficiency and accuracy in the transformation from RGB to CIELAB color space , 1997, IEEE Trans. Image Process..

[8]  Eduard Clotet,et al.  Vineyard Yield Estimation Based on the Analysis of High Resolution Images Obtained with Artificial Illumination at Night , 2015, Sensors.

[9]  Sanjiv Singh,et al.  Automated Visual Yield Estimation in Vineyards , 2014, J. Field Robotics.

[10]  Q. Zhang,et al.  Sensors and systems for fruit detection and localization: A review , 2015, Comput. Electron. Agric..

[11]  María-Paz Diago,et al.  Grapevine Yield and Leaf Area Estimation Using Supervised Classification Methodology on RGB Images Taken under Field Conditions , 2012, Sensors.

[12]  Ashfaqur Rahman,et al.  Identification of mature grape bunches using image processing and computational intelligence methods , 2014, 2014 IEEE Symposium on Computational Intelligence for Multimedia, Signal and Vision Processing (CIMSIVP).

[13]  Subana Shanmuganathan,et al.  Applications of image processing in viticulture: a review , 2013 .

[14]  Molly A. Williams,et al.  Viticultural Evaluation of French and California Chardonnay Clones Grown for Production of Sparkling Wine , 2008, American Journal of Enology and Viticulture.

[15]  Ribana Roscher,et al.  Initial steps for high-throughput phenotyping in vineyards , 2014 .

[16]  Stefano Poni,et al.  Mechanical yield regulation in winegrapes: comparison of early defoliation and crop thinning , 2012 .

[17]  Qin Zhang,et al.  A Review of Imaging Techniques for Plant Phenotyping , 2014, Sensors.

[18]  Nathan D. Miller,et al.  Image analysis is driving a renaissance in growth measurement. , 2013, Current opinion in plant biology.

[19]  Salviano F. S. P. Soares,et al.  Automatic Detection of White Grapes in Natural Environment Using Image Processing , 2011, SOCO.

[20]  J. Tukey Comparing individual means in the analysis of variance. , 1949, Biometrics.

[21]  Javier Tardáguila,et al.  Assessment of Vineyard Canopy Porosity Using Machine Vision , 2016, American Journal of Enology and Viticulture.

[22]  Pierre Soille,et al.  Morphological Image Analysis: Principles and Applications , 2003 .

[23]  Salviano F. S. P. Soares,et al.  Automatic detection of bunches of grapes in natural environment from color images , 2012, J. Appl. Log..

[24]  Yael Edan,et al.  Grape clusters and foliage detection algorithms for autonomous selective vineyard sprayer , 2010, Intell. Serv. Robotics.

[25]  Scarlett Liu,et al.  Towards Automated Yield Estimation in Viticulture , 2013 .

[26]  María-Paz Diago,et al.  vitisFlower®: Development and Testing of a Novel Android-Smartphone Application for Assessing the Number of Grapevine Flowers per Inflorescence Using Artificial Vision Techniques , 2015, Sensors.

[27]  A. Aquino,et al.  Image analysis-based modelling for flower number estimation in grapevine. , 2017, Journal of the science of food and agriculture.

[28]  J. Schanda,et al.  Colorimetry : understanding the CIE system , 2007 .

[29]  J. Araus,et al.  Field high-throughput phenotyping: the new crop breeding frontier. , 2014, Trends in plant science.

[30]  G. Rabatel,et al.  Grape berry calibration by computer vision using elliptical model fitting , 2007 .

[31]  José Blasco,et al.  A new method for assessment of bunch compactness using automated image analysis , 2015 .

[32]  María-Paz Diago,et al.  Using RPAS Multi-Spectral Imagery to Characterise Vigour, Leaf Development, Yield Components and Berry Composition Variability within a Vineyard , 2015, Remote. Sens..

[33]  Hanno Scharr,et al.  Image Analysis: The New Bottleneck in Plant Phenotyping [Applications Corner] , 2015, IEEE Signal Processing Magazine.

[34]  José Blasco,et al.  Assessment of flower number per inflorescence in grapevine by image analysis under field conditions. , 2014, Journal of the science of food and agriculture.

[35]  C. Rosenberger,et al.  Grape Detection By Image Processing , 2006, IECON 2006 - 32nd Annual Conference on IEEE Industrial Electronics.

[36]  A. Walter,et al.  Plant phenotyping: from bean weighing to image analysis , 2015, Plant Methods.

[37]  S. Omholt,et al.  Phenomics: the next challenge , 2010, Nature Reviews Genetics.

[38]  Daniel Cremers,et al.  Field phenotyping of grapevine growth using dense stereo reconstruction , 2015, BMC Bioinformatics.