Automated Visual Yield Estimation in Vineyards

We present a vision system that automatically predicts yield in vineyards accurately and with high resolution. Yield estimation traditionally requires tedious hand measurement, which is destructive, sparse in sampling, and inaccurate. Our method is efficient, high-resolution, and it is the first such system evaluated in realistic experimentation over several years and hundreds of vines spread over several acres of different vineyards. Other existing research is limited to small test sets of 10 vines or less, or just isolated grape clusters, with tightly controlled image acquisition and with artificially induced yield distributions. The system incorporates cameras and illumination mounted on a vehicle driving through the vineyard. We process images by exploiting the three prominent visual cues of texture, color, and shape into a strong classifier that detects berries even when they are of similar color to the vine leaves. We introduce methods to maximize the spatial and the overall accuracy of the yield estimates by optimizing the relationship between image measurements and yield. Our experimentation is conducted over four growing seasons in several wine and table-grape vineyards. These are the first such results from experimentation that is sufficiently sized for fair evaluation against true yield variation and real-world imaging conditions from a moving vehicle. Analysis of the results demonstrates yield estimates that capture up to 75% of spatial yield variance and with an average error between 3% and 11% of total yield.

[1]  Suman Mukherjee,et al.  Application of terahertz Gouy phase shift from curved surfaces for estimation of crop yield. , 2009, Applied optics.

[2]  Andreas Geiger,et al.  Visual odometry based on stereo image sequences with RANSAC-based outlier rejection scheme , 2010, 2010 IEEE Intelligent Vehicles Symposium.

[3]  Salah Sukkarieh,et al.  A Feature Learning Based Approach for Automated Fruit Yield Estimation , 2013, FSR.

[4]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[5]  Johnny Park,et al.  Segmentation of Apple Fruit from Video via Background Modeling , 2006 .

[6]  J. V. Stafford,et al.  A comparison of the spatial variability of vineyard yield in European and Australian production systems. , 2005 .

[7]  G. Dunn,et al.  Yield prediction from digital image analysis: A technique with potential for vineyard assessments prior to harvest , 2008 .

[8]  Sanjiv Singh,et al.  Modeling and Calibrating Visual Yield Estimates in Vineyards , 2012, FSR.

[9]  Benjamin Grocholsky,et al.  Comprehensive Automation for Specialty Crops: Year 1 results and lessons learned , 2010, Intell. Serv. Robotics.

[10]  L. Yang,et al.  A fruit recognition method for automatic harvesting , 2007, 2007 14th International Conference on Mechatronics and Machine Vision in Practice.

[11]  Pierre Vandergheynst,et al.  FREAK: Fast Retina Keypoint , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[12]  E. Vilas,et al.  Estimating Vineyard Yields: Introduction to a Simple, Two-Step Method , 1992, American Journal of Enology and Viticulture.

[13]  Yael Edan,et al.  Grape clusters and foliage detection algorithms for autonomous selective vineyard sprayer , 2010, Intell. Serv. Robotics.

[14]  Christian Germain,et al.  A new approach on Early Estimation of Vineyard Yield: Site specific counting of berries by using a Smartphone , 2011 .

[15]  Sanjiv Singh,et al.  Yield estimation in vineyards by visual grape detection , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[16]  K. Laws Textured Image Segmentation , 1980 .

[17]  Anthony Stentz,et al.  A Multi-Modal System For Yield Prediction in Citrus Trees , 2010 .

[18]  Scarlett Liu,et al.  Towards Automated Yield Estimation in Viticulture , 2013 .

[19]  Paul E. Blom,et al.  Trellis tension monitoring improves yield estimation in vineyards. , 2009 .

[20]  E. Serrano,et al.  Early estimation of vineyard yield: correlation between the volume of a Vitis vinifera bunch during its growth and its weight at harvest. , 2005 .

[21]  Salah Sukkarieh,et al.  Orchard fruit segmentation using multi-spectral feature learning , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[22]  Supreeth Achar,et al.  A Camera and Laser System for Automatic Vine Balance Assessment , 2011 .

[23]  Janice C. Morrison,et al.  The Effects of Sun Exposure on the Compositional Development of Cabernet Sauvignon Berries , 1986, American Journal of Enology and Viticulture.

[24]  J. V. Stafford,et al.  Precision agriculture ’13 , 2013, Wageningen Academic Publishers.

[25]  Vincent Lepetit,et al.  Randomized trees for real-time keypoint recognition , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[26]  Mieke Uyttendaele,et al.  Wageningen Academic Publishers , 2005 .

[27]  Cemagref,et al.  Grape berry calibration by computer vision using elliptical model fitting , 2010 .

[28]  Rahul Sukthankar,et al.  Classification of plant structures from uncalibrated image sequences , 2012, 2012 IEEE Workshop on the Applications of Computer Vision (WACV).

[29]  Alexander Zelinsky,et al.  Fast Radial Symmetry for Detecting Points of Interest , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[30]  María-Paz Diago,et al.  Grapevine Yield and Leaf Area Estimation Using Supervised Classification Methodology on RGB Images Taken under Field Conditions , 2012, Sensors.

[31]  Vincent Lepetit,et al.  BRIEF: Binary Robust Independent Elementary Features , 2010, ECCV.

[32]  R. Zhou,et al.  Using colour features of cv. ‘Gala’ apple fruits in an orchard in image processing to predict yield , 2012, Precision Agriculture.

[33]  Jose L Pons,et al.  A SURVEY OF COMPUTER VISION METHODS FOR LOCATING FRUIT ON TREES , 2000 .

[34]  J. A. Martínez,et al.  Viticultura de precisión: predicción de cosecha a partir de variables de cultivo e índices de vegetación , 2005 .

[35]  Qi Wang,et al.  Automated Crop Yield Estimation for Apple Orchards , 2012, ISER.

[36]  José Antonio Martínez Casasnovas,et al.  Viticultura de precisión: Predicción de cosecha a partir de variables del cultivo e índices de vegetación. , 2005 .