Digital surface model applied to unmanned aerial vehicle based photogrammetry to assess potential biotic or abiotic effects on grapevine canopies

Abstract: Accurate data acquisition and analysis to obtain crop canopy information are critical steps to understand plant growth dynamics and to assess the potential impacts of biotic or abiotic stresses on plant development. A versatile and easy to use monitoring system will allow researchers and growers to improve the follow-up management strategies within farms once potential problems have been detected. This study reviewed existing remote sensing platforms and relevant information applied to crops and specifically grapevines to equip a simple Unmanned Aerial Vehicle (UAV) using a visible high definition RGB camera. The objective of the proposed Unmanned Aerial System (UAS) was to implement a Digital Surface Model (DSM) in order to obtain accurate information about the affected or missing grapevines that can be attributed to potential biotic or abiotic stress effects. The analysis process started with a three-dimensional (3D) reconstruction from the RGB images collected from grapevines using the UAS and the Structure from Motion (SfM) technique to obtain the DSM applied on a per-plant basis. Then, the DSM was expressed as greyscale images according to the halftone technique to finally extract the information of affected and missing grapevines using computer vision algorithms based on canopy cover measurement and classification. To validate the automated method proposed, each grapevine row was visually inspected within the study area. The inspection was then compared to the digital assessment using the proposed UAS in order to validate calculations of affected and missing grapevines for the whole studied vineyard. Results showed that the percentage of affected and missing grapevines was 9.5% and 7.3%, respectively from the area studied. Therefore, for this specific study, the abiotic stress that affected the experimental vineyard (frost) impacted a total of 16.8 % of plants. This study provided a new method for automatically surveying affected or missing grapevines in the field and an evaluation tool for plant growth conditions, which can be implemented for other uses such as canopy management, irrigation scheduling and other precision agricultural applications. Keywords: remote sensing, canopy cover, viticultural management, frost damage, digital surface model DOI: 10.3965/j.ijabe.20160906.2908 Citation: Su B F, Xue J R, Xie C Y, Fang Y L, Song Y Y, Fuentes S. Digital surface model applied to unmanned aerial vehicle based photogrammetry to assess potential biotic or abiotic effects on grapevine canopies. Int J Agric & Biol Eng, 2016; 9(6): 119-130.

[1]  S. Poni,et al.  The effect of early leaf removal on whole-canopy gas exchange and vine performance of Vitis vinifera L. ‘Sangiovese’ , 2008 .

[2]  Tan Shan Development and Prospect of Image Multiscale Geometric Analysis , 2003 .

[3]  Samuel Ortega-Farías,et al.  Plant water stress detection based on aerial and terrestrial infrared thermography: a study case from vineyard and olive orchard , 2016 .

[4]  K. Powell A Holistic Approach to Future Management of Grapevine Phylloxera , 2012 .

[5]  Pablo J. Zarco-Tejada,et al.  Estimating evaporation with thermal UAV data and two-source energy balance models , 2016 .

[6]  Sigfredo Fuentes,et al.  An automated procedure for estimating the leaf area index (LAI) of woodland ecosystems using digital imagery, MATLAB programming and its application to an examination of the relationship between remotely sensed and field measurements of LAI. , 2008, Functional plant biology : FPB.

[7]  Adam J. Mathews,et al.  Visualizing and Quantifying Vineyard Canopy LAI Using an Unmanned Aerial Vehicle (UAV) Collected High Density Structure from Motion Point Cloud , 2013, Remote. Sens..

[8]  Martha C. Anderson,et al.  Mapping evapotranspiration with high-resolution aircraft imagery over vineyards using one- and two-source modeling schemes , 2015 .

[9]  D. Hadjimitsis,et al.  Atmospheric correction for satellite remotely sensed data intended for agricultural applications: Impact on vegetation indices , 2010 .

[10]  Samuel Ortega-Farías,et al.  Estimation of Energy Balance Components over a Drip-Irrigated Olive Orchard Using Thermal and Multispectral Cameras Placed on a Helicopter-Based Unmanned Aerial Vehicle (UAV) , 2016, Remote. Sens..

[11]  K. N. Reddy,et al.  Development and evaluation of low-altitude remote sensing systems for crop production management , 2016 .

[12]  R. De Bei,et al.  Automated estimation of leaf area index from grapevine canopies using cover photography, video and computational analysis methods , 2014 .

[13]  C. Watson,et al.  Development of an Unmanned Aerial Vehicle (UAV) for hyper-resolution vineyard mapping based on visible, multispectral and thermal imagery , 2011 .

[14]  J. Cushman,et al.  Water and salinity stress in grapevines: early and late changes in transcript and metabolite profiles , 2007, Functional & Integrative Genomics.

[15]  J. Flexas,et al.  Improving water use efficiency of vineyards in semi-arid regions. A review , 2014, Agronomy for Sustainable Development.

[16]  Feng Peihua,et al.  Generating high spatiotemporal resolution LAI based on MODIS/GF-1 data and combined Kriging-Cressman interpolation , 2016 .

[17]  Stéphane Burgos,et al.  USE OF VERY HIGH-RESOLUTION AIRBORNE IMAGES TO ANALYSE 3D CANOPY ARCHITECTURE OF A VINEYARD , 2015 .

[18]  S. M. Jong,et al.  Mapping landslide displacements using Structure from Motion (SfM) and image correlation of multi-temporal UAV photography , 2014 .

[19]  S. Ortega-Farías,et al.  Crop coefficients and actual evapotranspiration of a drip-irrigated Merlot vineyard using multispectral satellite images , 2012, Irrigation Science.

[20]  R. Nemani,et al.  Mapping vineyard leaf area with multispectral satellite imagery , 2003 .

[21]  D. Lamb,et al.  Optical remote sensing applications in viticulture - a review , 2002 .

[22]  S. Tyerman,et al.  Computational water stress indices obtained from thermal image analysis of grapevine canopies , 2012, Irrigation science.

[23]  Matthijs C. Dorst Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[24]  Jason Smith,et al.  VitiCanopy: A Free Computer App to Estimate Canopy Vigor and Porosity for Grapevine , 2016, Sensors.

[25]  Miguel Ángel Moreno,et al.  Characterization of Vitis vinifera L. Canopy Using Unmanned Aerial Vehicle-Based Remote Sensing and Photogrammetry Techniques , 2015, American Journal of Enology and Viticulture.

[26]  Marco Mora,et al.  Automated computation of leaf area index from fruit trees using improved image processing algorithms applied to canopy cover digital photograpies , 2016, Comput. Electron. Agric..

[27]  J. Baluja,et al.  Assessment of vineyard water status variability by thermal and multispectral imagery using an unmanned aerial vehicle (UAV) , 2012, Irrigation Science.

[28]  Heikki Saari,et al.  Processing and Assessment of Spectrometric, Stereoscopic Imagery Collected Using a Lightweight UAV Spectral Camera for Precision Agriculture , 2013, Remote. Sens..

[29]  Joachim Müller,et al.  Assessing crop water stress of winter wheat by thermography under different irrigation regimes in North China Plain , 2012 .

[30]  Alessandro Matese,et al.  A flexible unmanned aerial vehicle for precision agriculture , 2012, Precision Agriculture.

[31]  M. G. McCarthy,et al.  Regulated deficit irrigation and partial rootzone drying as irrigation management techniques for grapevines , 2002 .

[32]  K. Shinozaki,et al.  Effects of abiotic stress on plants: a systems biology perspective , 2011, BMC Plant Biology.

[33]  Remi Kumagai Open access publishing of scholarly journals , 2004 .

[34]  J. Flexas,et al.  UAVs challenge to assess water stress for sustainable agriculture , 2015 .

[35]  D. Lamb,et al.  Characterising and mapping vineyard canopy using high-spatial-resolution aerial multispectral images , 2003 .

[36]  Samuel Ortega-Farías,et al.  Digital Cover Photography for Estimating Leaf Area Index (LAI) in Apple Trees Using a Variable Light Extinction Coefficient , 2015, Sensors.

[37]  Simon Bennertz,et al.  Estimating Biomass of Barley Using Crop Surface Models (CSMs) Derived from UAV-Based RGB Imaging , 2014, Remote. Sens..

[38]  Andrew W. Fitzgibbon,et al.  Bundle Adjustment - A Modern Synthesis , 1999, Workshop on Vision Algorithms.

[39]  Jean Ponce,et al.  Accurate, Dense, and Robust Multiview Stereopsis , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[40]  M. M. Chaves,et al.  Grapevine under deficit irrigation: hints from physiological and molecular data. , 2010, Annals of botany.

[41]  João Maroco,et al.  Deficit irrigation in grapevine improves water‐use efficiency while controlling vigour and production quality , 2007 .

[42]  He Xiongkui,et al.  Non-invasive water status detection in grapevine (Vitis vinifera L.) by thermography , 2010 .