Estimation of plant height using a high throughput phenotyping platform based on unmanned aerial vehicle and self-calibration: Example for sorghum breeding

Abstract Plant height is an essential trait to evaluate in grain sorghum, being positively associated with potential grain yield. Standard manual measures of plant height for large breeding trials are labour-intensive and time-consuming. Due to potential field access issue and the remote nature of breeding trials, Unmanned Aerial vehicles (UAVs) are well-suited to measure plant height if the ground surface can be referenced. In this study, we compared existing algorithms with a new method for estimating plant height for a sorghum breeding trial. Images were captured by a RGB camera mounted on an UAV before emergence and near maturity to generate digital surface models (DSMs). Two existing methods (‘point cloud’ and ‘reference ground’) and a new method (‘self-calibration’) were used to estimate ground level and plant height at the plot level. The self-calibration method required manual measurements of the actual plant height in a sample of plots (fewer than 30), which could be completed during the 30-min flight time. UAV-derived plant heights from each method were compared to manual measurements. The self-calibration method had the best performance (R2 = 0.63; RMSE = 0.07 m; repeatability = 0.74), with similar repeatability to manual measurement (0.78). The point cloud and reference ground methods had lower repeatabilities (0.34 and 0.38, respectively). For the self-calibration method, we tested different sampling strategies to balance accuracy and the workload of manual measurements, finding that a sample of 30–40 plots from the1440 total could obtain precision similar to manual measurement of the entire trial. The self-calibration method offers a pragmatic, robust and universal approach to high throughput phenotyping of plot plant height with UAV surveys.

[1]  Edzer J. Pebesma,et al.  Multivariable geostatistics in S: the gstat package , 2004, Comput. Geosci..

[2]  Graeme L. Hammer,et al.  Multi-Spectral Imaging from an Unmanned Aerial Vehicle Enables the Assessment of Seasonal Leaf Area Dynamics of Sorghum Breeding Lines , 2017, Front. Plant Sci..

[3]  F. Baret,et al.  High-Throughput Phenotyping of Plant Height: Comparing Unmanned Aerial Vehicles and Ground LiDAR Estimates , 2017, Front. Plant Sci..

[4]  Mingquan Wu,et al.  Evaluation of Orthomosics and Digital Surface Models Derived from Aerial Imagery for Crop Type Mapping , 2017, Remote. Sens..

[5]  Michael R. Dohm,et al.  Repeatability estimates do not always set an upper limit to heritability , 2002 .

[6]  Malia A. Gehan,et al.  Lights, camera, action: high-throughput plant phenotyping is ready for a close-up. , 2015, Current opinion in plant biology.

[7]  Honggang Bu,et al.  Use of corn height measured with an acoustic sensor improves yield estimation with ground based active optical sensors , 2016, Comput. Electron. Agric..

[8]  J. Flexas,et al.  UAVs challenge to assess water stress for sustainable agriculture , 2015 .

[9]  Jose A. Jiménez-Berni,et al.  High-throughput phenotyping technologies allow accurate selection of stay-green , 2016, Journal of Experimental Botany.

[10]  S. Chapman,et al.  A Direct Comparison of Remote Sensing Approaches for High-Throughput Phenotyping in Plant Breeding , 2016, Front. Plant Sci..

[11]  P. Reich,et al.  New handbook for standardised measurement of plant functional traits worldwide , 2013 .

[12]  Pablo Rischbeck,et al.  Data fusion of spectral, thermal and canopy height parameters for improved yield prediction of drought stressed spring barley , 2016 .

[13]  Michael Schirrmann,et al.  Estimating wheat biomass by combining image clustering with crop height , 2016, Comput. Electron. Agric..

[14]  Anne-Katrin Mahlein,et al.  Fusion of sensor data for the detection and differentiation of plant diseases in cucumber , 2014 .

[15]  Lutz Plümer,et al.  A Multi-Resolution Approach for an Automated Fusion of Different Low-Cost 3D Sensors , 2014, Sensors.

[16]  Jose A. Jiménez-Berni,et al.  Proximal Remote Sensing Buggies and Potential Applications for Field-Based Phenotyping , 2014 .

[17]  S. Christensen,et al.  Plant phenomics and the need for physiological phenotyping across scales to narrow the genotype-to-phenotype knowledge gap. , 2015, Journal of experimental botany.

[18]  Toby N. Tonkin,et al.  Ground-Control Networks for Image Based Surface Reconstruction: An Investigation of Optimum Survey Designs Using UAV Derived Imagery and Structure-from-Motion Photogrammetry , 2016, Remote. Sens..

[19]  Francisca López Granados.  Weed detection for site-specific weed management: Mapping and real-time approaches , 2011 .

[20]  S. Sankaran,et al.  Low-altitude, high-resolution aerial imaging systems for row and field crop phenotyping: A review , 2015 .

[21]  Martin J. Wooster,et al.  High Throughput Field Phenotyping of Wheat Plant Height and Growth Rate in Field Plot Trials Using UAV Based Remote Sensing , 2016, Remote. Sens..

[22]  Andreas Burkart,et al.  Generating 3D hyperspectral information with lightweight UAV snapshot cameras for vegetation monitoring: From camera calibration to quality assurance , 2015 .

[23]  Francisca López-Granados,et al.  Weed detection for site-specific weed management: mapping and real-time approaches , 2011 .

[24]  Guilherme N. DeSouza,et al.  Vinobot and Vinoculer: Two Robotic Platforms for High-Throughput Field Phenotyping , 2017, Sensors.

[25]  P. Rathod,et al.  Proximal Spectral Sensing to Monitor Phytoremediation of Metal-Contaminated Soils , 2013, International journal of phytoremediation.

[26]  Arno Ruckelshausen,et al.  BreedVision — A Multi-Sensor Platform for Non-Destructive Field-Based Phenotyping in Plant Breeding , 2013, Sensors.

[27]  M. Tester,et al.  Phenomics--technologies to relieve the phenotyping bottleneck. , 2011, Trends in plant science.

[28]  Z. Niu,et al.  Remote estimation of canopy height and aboveground biomass of maize using high-resolution stereo images from a low-cost unmanned aerial vehicle system , 2016 .

[29]  Kazuyoshi Takahashi,et al.  Method for estimating rice plant height without ground surface detection using laser scanner measurement , 2016 .

[30]  J. Araus,et al.  Field high-throughput phenotyping: the new crop breeding frontier. , 2014, Trends in plant science.

[31]  Frédéric Baret,et al.  Using 3D Point Clouds Derived from UAV RGB Imagery to Describe Vineyard 3D Macro-Structure , 2017, Remote. Sens..

[32]  A. Greenberg,et al.  Next-generation phenotyping: requirements and strategies for enhancing our understanding of genotype–phenotype relationships and its relevance to crop improvement , 2013, Theoretical and Applied Genetics.

[33]  Wei Guo,et al.  High-Throughput Phenotyping of Sorghum Plant Height Using an Unmanned Aerial Vehicle and Its Application to Genomic Prediction Modeling , 2017, Front. Plant Sci..

[34]  José Crossa,et al.  High-throughput phenotyping and genomic selection: the frontiers of crop breeding converge. , 2012, Journal of integrative plant biology.

[35]  Jorge Torres-Sánchez,et al.  Assessing UAV-collected image overlap influence on computation time and digital surface model accuracy in olive orchards , 2018, Precision Agriculture.

[36]  Juliane Bendig,et al.  UAV-based Imaging for Multi-Temporal, very high Resolution Crop Surface Models to monitor Crop Growth Variability , 2013 .

[37]  Seishi Ninomiya,et al.  Comparison of ground cover estimates from experiment plots in cotton, sorghum and sugarcane based on images and ortho-mosaics captured by UAV. , 2016, Functional plant biology : FPB.

[38]  F. van der Heijden,et al.  Weed detection in 3D images , 2011, Precision Agriculture.

[39]  Arko Lucieer,et al.  Assessing the Accuracy of Georeferenced Point Clouds Produced via Multi-View Stereopsis from Unmanned Aerial Vehicle (UAV) Imagery , 2012, Remote. Sens..

[40]  Carolyn J. Lawrence-Dill,et al.  The Quest for Understanding Phenotypic Variation via Integrated Approaches in the Field Environment1[OPEN] , 2016, Plant Physiology.

[41]  Jose A. Jiménez-Berni,et al.  Pheno-Copter: A Low-Altitude, Autonomous Remote-Sensing Robotic Helicopter for High-Throughput Field-Based Phenotyping , 2014 .

[42]  Johanna Link,et al.  Combined Spectral and Spatial Modeling of Corn Yield Based on Aerial Images and Crop Surface Models Acquired with an Unmanned Aircraft System , 2014, Remote. Sens..

[43]  Pablo J. Zarco-Tejada,et al.  Tree height quantification using very high resolution imagery acquired from an unmanned aerial vehicle (UAV) and automatic 3D photo-reconstruction methods , 2014 .

[44]  Genetic control of plant height in European winter wheat cultivars , 2015, Theoretical and Applied Genetics.

[45]  Rubens Augusto Camargo Lamparelli,et al.  Height estimation of sugarcane using an unmanned aerial system (UAS) based on structure from motion (SfM) point clouds , 2017 .

[46]  M. Pérez-Ruiz,et al.  A cost-effective canopy temperature measurement system for precision agriculture: a case study on sugar beet , 2017, Precision Agriculture.

[47]  William R. Raun,et al.  By‐Plant Prediction of Corn Forage Biomass and Nitrogen Uptake at Various Growth Stages Using Remote Sensing and Plant Height , 2007 .