Integration of RGB-based vegetation index, crop surface model and object-based image analysis approach for sugarcane yield estimation using unmanned aerial vehicle

Abstract Estimation of yield is a major challenge in the production of many agricultural crops, including sugarcane. Mapping the spatial variability of plant height (PH) and the stalk density is important for accurate sugarcane yield estimation, and this estimation can aid in the planning of upcoming labor- and cost-intensive actions like harvesting, milling, and forward selling decisions. The objective of this research is to assess the potential of a consumer-grade red-green-blue (RGB) camera mounted on an unmanned aerial vehicle (UAV) for sugarcane yield estimation with minimal field dataset. The study mapped the spatial variability of PH and stalk density at the grid level (4 m × 4 m) on a farm. The average PH was estimated at the grid level by masking the sugarcane area. An object-based image analysis (OBIA) approach was used to extract the sugarcane area by integrating the plant height model (PHM), extracted by subtracting the digital elevation model (DEM) from the crop surface model (CSM). Both CSM and DEM were generated from UAV images, where CSM was produced approximately one month before the harvest and the DEM after the sugarcane was harvested. The PHM improved the overall accuracy of classification from 61.98% to 87.45%. The UAV estimated PH showed a high correlation (r = 0.95) with ground observed PH, with an average overestimation of 0.10 m. An ordinary least square (OLS) linear regression model was developed to estimate millable stalk height (MSH) from PH, weight from estimated MSH, and stalk density from vegetation indices (VIs) at the grid-level. Excess green (ExG) derived from RGB showed R2 of 0.754 with the stalk density. Likewise, R2 of 0.798 and 0.775 were obtained between MSH and PH, and weight and MSH. Eventually, the yield was estimated by integrating the variability of PH and stalk density and weight information. The estimated yield from ExG (200.66 tons) was close to the actual harvest yield (192.1 tons). The very high-resolution RGB-based images from the UAV and OBIA approach demonstrate significant potential for mapping the spatial variability of PH and stalk density and for estimating sugarcane yield. This can aid growers and millers in decision making.

[1]  Thapat Silalertruksa,et al.  An assessment of harvesting practices of sugarcane in the central region of Thailand , 2017 .

[2]  N. Inman-Bamber.  A growth model for sugar-cane based on a simple carbon balance and the CERES· Maize water balance , 1991 .

[3]  R. Ming,et al.  Target enrichment sequencing of 307 germplasm accessions identified ancestry of ancient and modern hybrids and signatures of adaptation and selection in sugarcane (Saccharum spp.), a ‘sweet’ crop with ‘bitter’ genomes , 2018, Plant biotechnology journal.

[4]  F. Baret,et al.  Estimates of plant density of wheat crops at emergence from very low altitude UAV imagery. , 2017 .

[5]  G. O'Leary.  A review of three sugarcane simulation models with respect to their prediction of sucrose yield , 2000 .

[6]  Y. Miao,et al.  Very high resolution crop surface models (CSMs) from UAV-based stereo images for rice growth monitoring In Northeast China , 2013 .

[7]  Chenghai Yang,et al.  Crop Classification and LAI Estimation Using Original and Resolution-Reduced Images from Two Consumer-Grade Cameras , 2017, Remote. Sens..

[8]  Nora Tilly,et al.  Fusion of Plant Height and Vegetation Indices for the Estimation of Barley Biomass , 2015, Remote. Sens..

[9]  Y. Everingham,et al.  Accurate prediction of sugarcane yield using a random forest algorithm , 2016, Agronomy for Sustainable Development.

[10]  Surya Kant,et al.  Estimation of crop plant density at early mixed growth stages using UAV imagery , 2019, Plant Methods.

[11]  N. Ebecken,et al.  Sugarcane yield prediction in Brazil using NDVI time series and neural networks ensemble , 2017 .

[12]  Shabbir H. Gheewala,et al.  Carbon footprint of sugar produced from sugarcane in eastern Thailand , 2011 .

[13]  Felipe Ferreira Bocca,et al.  When do I want to know and why? Different demands on sugarcane yield predictions , 2015 .

[14]  Johanna Link,et al.  Combined Spectral and Spatial Modeling of Corn Yield Based on Aerial Images and Crop Surface Models Acquired with an Unmanned Aircraft System , 2014, Remote. Sens..

[15]  Ramesh P. Singh,et al.  Crop yield estimation model for Iowa using remote sensing and surface parameters , 2006 .

[16]  C. Tucker.  Red and photographic infrared linear combinations for monitoring vegetation , 1979 .

[17]  Weixing Cao,et al.  Predicting grain yield in rice using multi-temporal vegetation indices from UAV-based multispectral and digital imagery , 2017 .

[18]  Graeme L. Hammer,et al.  APSIM: a novel software system for model development, model testing and simulation in agricultural systems research , 1996 .

[19]  U. Sainju,et al.  Spacing Effect on Energy Cane Growth, Physiology, and Biomass Yield , 2018 .

[20]  Farid Kendoul,et al.  Monitoring sugarcane growth response to varying nitrogen application rates: A comparison of UAV SLAM LiDAR and photogrammetry , 2019, Int. J. Appl. Earth Obs. Geoinformation.

[21]  Rubens Augusto Camargo Lamparelli,et al.  Spectral variables, growth analysis and yield of sugarcane , 2005 .

[22]  Luke S. Pruter,et al.  Characterizing canopy height with UAS structure-from-motion photogrammetry—results analysis of a maize field trial with respect to multiple factors , 2018 .

[23]  C. A. van Diepen,et al.  Crop model data assimilation with the Ensemble Kalman filter for improving regional crop yield forecasts , 2007 .

[24]  P. Varma,et al.  Potentiality of Native Pseudomonas spp. in Promoting Sugarcane Seedling Growth and Red Rot (Colletotrichum falcatum went) Management , 2018 .

[25]  Jorge Torres-Sánchez,et al.  An Automatic Random Forest-OBIA Algorithm for Early Weed Mapping between and within Crop Rows Using UAV Imagery , 2018, Remote. Sens..

[26]  Simon Bennertz,et al.  Combining UAV-based plant height from crop surface models, visible, and near infrared vegetation indices for biomass monitoring in barley , 2015, Int. J. Appl. Earth Obs. Geoinformation.

[27]  F. Baret,et al.  Green area index from an unmanned aerial system over wheat and rapeseed crops , 2014 .

[28]  Julien Morel,et al.  Toward a Satellite-Based System of Sugarcane Yield Estimation and Forecasting in Smallholder Farming Conditions: A Case Study on Reunion Island , 2014, Remote. Sens..

[29]  A. J. Huerta,et al.  Leaf growth and canopy development of three sugarcane genotypes under high temperature rainfed conditions in Northeastern Mexico. , 2016 .

[30]  T. Jarmer,et al.  Quantitative analysis of soil chemical properties with diffuse reflectance spectrometry and partial least-square regression: A feasibility study , 2003, Plant and Soil.

[31]  Agnès Bégué,et al.  Forecasting Regional Sugarcane Yield Based on Time Integral and Spatial Aggregation of MODIS NDVI , 2013, Remote. Sens..

[32]  Yufeng Ge,et al.  A multi-sensor system for high throughput field phenotyping in soybean and wheat breeding , 2016, Comput. Electron. Agric..

[33]  Urs Schmidhalter,et al.  Digital Counts of Maize Plants by Unmanned Aerial Vehicles (UAVs) , 2017, Remote. Sens..

[34]  Y. Miao,et al.  Precise plant height monitoring and biomass estimation with Terrestrial Laser Scanning in paddy rice , 2013 .

[35]  G. Meyer,et al.  Color indices for weed identification under various soil, residue, and lighting conditions , 1994 .

[36]  Senthold Asseng,et al.  An overview of APSIM, a model designed for farming systems simulation , 2003 .

[37]  Yidan Bao,et al.  Dynamic monitoring of biomass of rice under different nitrogen treatments using a lightweight UAV with dual image-frame snapshot cameras , 2019, Plant Methods.

[38]  Mingquan Wu,et al.  Evaluation of Orthomosics and Digital Surface Models Derived from Aerial Imagery for Crop Type Mapping , 2017, Remote. Sens..

[39]  Andreas Scheidegger,et al.  Assessing the quality of digital elevation models obtained from mini unmanned aerial vehicles for overland flow modelling in urban areas , 2015 .

[40]  Abdul Bais,et al.  Weed detection in canola fields using maximum likelihood classification and deep convolutional neural network , 2020 .

[41]  C. R. de Souza Filho,et al.  ASTER and Landsat ETM+ images applied to sugarcane yield forecast , 2006 .

[42]  Rubens A. C. Lamparelli,et al.  Mapping skips in sugarcane fields using object-based analysis of unmanned aerial vehicle (UAV) images , 2017, Comput. Electron. Agric..

[43]  A. Ramoelo,et al.  Determining the Best Optimum Time for Predicting Sugarcane Yield Using Hyper-Temporal Satellite Imagery , 2013 .

[44]  Daniel Garbellini Duft,et al.  The potential for RGB images obtained using unmanned aerial vehicle to assess and predict yield in sugarcane fields , 2018 .

[45]  Jackapon Sunthornvarabhas,et al.  The Current Status of Sugar Industry and By-products in Thailand , 2016, Sugar Tech.

[46]  Juliane Bendig,et al.  Toward an automated low-cost three-dimensional crop surface monitoring system using oblique stereo imagery from consumer-grade smart cameras , 2016 .

[47]  J. Goudriaan,et al.  Using the expolinear growth equation for modelling crop growth in year-round cut chrysanthemum. , 2003, Annals of botany.

[48]  Jana Müllerová,et al.  Assessing the Accuracy of Digital Surface Models Derived from Optical Imagery Acquired with Unmanned Aerial Systems , 2019, Drones.

[49]  Pablo J. Zarco-Tejada,et al.  Tree height quantification using very high resolution imagery acquired from an unmanned aerial vehicle (UAV) and automatic 3D photo-reconstruction methods , 2014 .

[50]  Rubens Augusto Camargo Lamparelli,et al.  Height estimation of sugarcane using an unmanned aerial system (UAS) based on structure from motion (SfM) point clouds , 2017 .

[51]  Simon Bennertz,et al.  Estimating Biomass of Barley Using Crop Surface Models (CSMs) Derived from UAV-Based RGB Imaging , 2014, Remote. Sens..

[52]  Sizuo Matsuoka,et al.  SUGARCANE TILLERING AND RATOONING : KEY FACTORS FOR A PROFITABLE CROPPING , 2012 .

[53]  T. Cheng,et al.  Improved estimation of aboveground biomass in wheat from RGB imagery and point cloud data acquired with a low-cost unmanned aerial vehicle system , 2019, Plant Methods.

[54]  Noboru Noguchi,et al.  Monitoring of Wheat Growth Status and Mapping of Wheat Yield's within-Field Spatial Variations Using Color Images Acquired from UAV-camera System , 2017, Remote. Sens..

[55]  Arko Lucieer,et al.  An Automated Technique for Generating Georectified Mosaics from Ultra-High Resolution Unmanned Aerial Vehicle (UAV) Imagery, Based on Structure from Motion (SfM) Point Clouds , 2012, Remote. Sens..

[56]  Jansle Vieira Rocha,et al.  Sugarcane yield estimates using time series analysis of spot vegetation images , 2011 .

[57]  Jon Nielsen,et al.  Are vegetation indices derived from consumer-grade cameras mounted on UAVs sufficiently reliable for assessing experimental plots? , 2016 .

[58]  Agustin Lobo,et al.  Mapping Crop Planting Quality in Sugarcane from UAV Imagery: A Pilot Study in Nicaragua , 2016, Remote. Sens..

[59]  Terje Gobakken,et al.  Biomass Estimation Using 3D Data from Unmanned Aerial Vehicle Imagery in a Tropical Woodland , 2016, Remote. Sens..

[60]  J. F. Ortega,et al.  Estimation of leaf area index in onion (Allium cepa L.) using an unmanned aerial vehicle , 2013 .

[61]  Joseph G. Lauer,et al.  Methods for Calculating Corn Yield , 2002 .

[62]  Sarawut Ninsawat,et al.  Pre-harvest Sugarcane Yield Estimation Using UAV-Based RGB Images and Ground Observation , 2018, Sugar Tech.