Automated early yield prediction in vineyards from on-the-go image acquisition

Abstract Early grapevine yield assessment provides information to viticulturists to help taking management decisions to achieve the desired grape quality and yield amount. In previous works, image analysis has been explored to this effect, but with systems performing either manually, on a single variety or close to harvest-time, when there are few rectifiable agronomic aspects. This study presents a solution based on image analysis for the non-invasive and in-field yield prediction in vines of several varieties, at phenological stages previous to veraison, around 100 days from harvest. To this end, an all-terrain vehicle (ATV) was modified with equipment to autonomously capture images of 30 vine segments of five different varieties at night-time. The images were analysed with a new image analysis algorithm based on mathematical morphology and pixel classification, which yielded overall average Recall and Precision values of 0.8764 and 0.9582, respectively. Finally, a model was calibrated to produce yield predictions from the number of detected berries in images with a Root-Mean-Square-Error per vine of 0.16 kg. This accuracy makes the proposed methodology ideal for early yield prediction as a very helpful tool for the grape and wine industry.

[1]  Eduard Clotet,et al.  Vineyard Yield Estimation Based on the Analysis of High Resolution Images Obtained with Artificial Illumination at Night , 2015, Sensors.

[2]  Sanjiv Singh,et al.  Automated Visual Yield Estimation in Vineyards , 2014, J. Field Robotics.

[3]  Volker Steinhage,et al.  High-precision 3D detection and reconstruction of grapes from laser range data for efficient phenotyping based on supervised learning , 2017, Comput. Electron. Agric..

[4]  N. Otsu A threshold selection method from gray level histograms , 1979 .

[5]  Molly A. Williams,et al.  Viticultural Evaluation of French and California Chardonnay Clones Grown for Production of Sparkling Wine , 2008, American Journal of Enology and Viticulture.

[6]  Javier Tardáguila,et al.  A new methodology for estimating the grapevine-berry number per cluster using image analysis , 2017 .

[7]  Ashfaqur Rahman,et al.  Identification of mature grape bunches using image processing and computational intelligence methods , 2014, 2014 IEEE Symposium on Computational Intelligence for Multimedia, Signal and Vision Processing (CIMSIVP).

[8]  Salviano F. S. P. Soares,et al.  Automatic detection of bunches of grapes in natural environment from color images , 2012, J. Appl. Log..

[9]  Dennis Jarvis,et al.  Estimation of mango crop yield using image analysis - Segmentation method , 2013 .

[10]  R. Bramley,et al.  Understanding variability in winegrape production systems , 2004 .

[11]  Heiner Kuhlmann,et al.  Towards Automated Large-Scale 3D Phenotyping of Vineyards under Field Conditions , 2016, Sensors.

[12]  Scarlett Liu,et al.  A computer vision system for early stage grape yield estimation based on shoot detection , 2017, Comput. Electron. Agric..

[13]  Pierre Soille,et al.  Morphological Image Analysis , 1999 .

[14]  Ming-Kuei Hu,et al.  Visual pattern recognition by moment invariants , 1962, IRE Trans. Inf. Theory.

[15]  Javier Tardáguila,et al.  Effects of Timing of Manual and Mechanical Early Defoliation on the Aroma of Vitis vinifera L. Tempranillo Wine , 2010, American Journal of Enology and Viticulture.

[16]  Nathan D. Miller,et al.  Image analysis is driving a renaissance in growth measurement. , 2013, Current opinion in plant biology.

[17]  Christine Connolly,et al.  A study of efficiency and accuracy in the transformation from RGB to CIELAB color space , 1997, IEEE Trans. Image Process..

[18]  R. Bramley,et al.  Understanding variability in winegrape production systems 2. Within vineyard variation in quality over several vintages , 2005 .

[19]  Salviano F. S. P. Soares,et al.  Automatic Detection of White Grapes in Natural Environment Using Image Processing , 2011, SOCO.

[20]  E. Vilas,et al.  Estimating Vineyard Yields: Introduction to a Simple, Two-Step Method , 1992 .

[21]  Qin Zhang,et al.  A Review of Imaging Techniques for Plant Phenotyping , 2014, Sensors.

[22]  C. Rosenberger,et al.  Grape Detection By Image Processing , 2006, IECON 2006 - 32nd Annual Conference on IEEE Industrial Electronics.

[23]  Stephen R. Martin Crop forecasting in cool climate vineyards , 2002 .

[24]  R. Zhou,et al.  Using colour features of cv. ‘Gala’ apple fruits in an orchard in image processing to predict yield , 2012, Precision Agriculture.

[25]  Manuel A. Armada,et al.  Combination of RGB and Multispectral Imagery for Discrimination of Cabernet Sauvignon Grapevine Elements , 2013, Sensors.

[26]  Javier Tardaguila,et al.  Phenolic composition of Tempranillo wines following early defoliation of the vines. , 2012, Journal of the science of food and agriculture.

[27]  Stefano Poni,et al.  Mechanical yield regulation in winegrapes: comparison of early defoliation and crop thinning , 2012 .

[28]  Scarlett Liu,et al.  Towards Automated Yield Estimation in Viticulture , 2013 .