A field-based high-throughput method for acquiring canopy architecture using unmanned aerial vehicle images

Abstract Plant architectural traits are important selection criteria in plant breeding that relate to photosynthetic efficiency and crop productivity. Conventional manual measures of architectural traits for large breeding trials are labour- and time-consuming. In this study, we proposed a new method to reconstruct three-dimensional (3D) canopy architectural models for high-throughput phenotyping of canopy architectural traits using image sequences acquired by an unmanned aerial vehicle (UAV) platform. The accuracy of UAV-derived models is evaluated by comparisons with models from 3D digitizing and measured values. The results indicated that the proposed method could obtain full canopy architecture in the early growth stages and the upper parts of the canopy architecture in the later growth stages. The leaf number, plant height, individual leaf area, and vertical and horizontal distributions of the leaf area estimated from UAV-derived models were in good agreements with the reference values for maize. The derived length and maximum width of individual leaves were close to the field measurements for maize (R2 > 0.92 for both, RMSE 0.85 and RMSE

[1]  B. Bailey,et al.  Rapid measurement of the three-dimensional distribution of leaf orientation and the leaf angle probability density function using terrestrial LiDAR scanning , 2017 .

[2]  Yan Guo,et al.  Comparison of architecture among different cultivars of hybrid rice using a spatial light model based on 3-D digitising. , 2008, Functional plant biology : FPB.

[3]  Joshua S Yuan,et al.  Redesigning photosynthesis to sustainably meet global food and bioenergy demand , 2015, Proceedings of the National Academy of Sciences.

[4]  Jose A. Jiménez-Berni,et al.  High Throughput Determination of Plant Height, Ground Cover, and Above-Ground Biomass in Wheat with LiDAR , 2018, Front. Plant Sci..

[5]  Bangqian Chen,et al.  Simulation of multi-platform LiDAR for assessing total leaf area in tree crowns , 2019, Agricultural and Forest Meteorology.

[6]  Ü. Niinemets A review of light interception in plant stands from leaf to canopy in different plant functional types and in species with varying shade tolerance , 2010, Ecological Research.

[7]  J. Ward,et al.  Bringing New Plant Varieties to Market: Plant Breeding and Selection Practices Advance Beneficial Characteristics while Minimizing Unintended Changes , 2017 .

[8]  Cathy Hawes,et al.  Improving intercropping: a synthesis of research in agronomy, plant physiology and ecology. , 2015, The New phytologist.

[9]  G. Hammer,et al.  Modeling QTL for complex traits: detection and context for plant breeding. , 2009, Current opinion in plant biology.

[10]  Xin-Guang Zhu,et al.  Optimal crop canopy architecture to maximise canopy photosynthetic CO2 uptake under elevated CO2 - a theoretical study using a mechanistic model of canopy photosynthesis. , 2013, Functional plant biology : FPB.

[11]  Marshall W. Bern,et al.  A new Voronoi-based surface reconstruction algorithm , 1998, SIGGRAPH.

[12]  W. Diepenbrock,et al.  A method to extract morphological traits of plant organs from 3D point clouds as a database for an architectural plant model , 2007 .

[13]  Christopher Gomez,et al.  3D modelling of individual trees using a handheld camera: Accuracy of height, diameter and volume estimates , 2015 .

[14]  Matthew J Paul,et al.  Linking fundamental science to crop improvement through understanding source and sink traits and their integration for yield enhancement , 2019, Journal of experimental botany.

[15]  Arko Lucieer,et al.  Poppy Crop Height and Capsule Volume Estimation from a Single UAS Flight , 2017, Remote. Sens..

[16]  P. Benfey,et al.  Advanced imaging techniques for the study of plant growth and development. , 2014, Trends in plant science.

[17]  A. Condon,et al.  Recurrent selection for wider seedling leaves increases early biomass and leaf area in wheat (Triticum aestivum L.) , 2014, Journal of experimental botany.

[18]  H. Sinoquet,et al.  A double-digitising method for building 3D virtual trees with non-planar leaves: application to the morphology and light-capture properties of young beech trees (Fagus sylvatica). , 2008, Functional plant biology : FPB.

[19]  Daryl M. Kempthorne,et al.  Surface reconstruction of wheat leaf morphology from three-dimensional scanned data. , 2015, Functional plant biology : FPB.

[20]  Guilherme N. DeSouza,et al.  Vinobot and Vinoculer: Two Robotic Platforms for High-Throughput Field Phenotyping , 2017, Sensors.

[21]  K. Omasa,et al.  Estimation of vertical plant area density profiles in a rice canopy at different growth stages by high-resolution portable scanning lidar with a lightweight mirror , 2012 .

[22]  J. Fripp,et al.  A novel mesh processing based technique for 3D plant analysis , 2012, BMC Plant Biology.

[23]  C. Klukas,et al.  Advanced phenotyping and phenotype data analysis for the study of plant growth and development , 2015, Front. Plant Sci..

[24]  José Manuel Peñá-Barragán,et al.  Assessing Optimal Flight Parameters for Generating Accurate Multispectral Orthomosaicks by UAV to Support Site-Specific Crop Management , 2015, Remote. Sens..

[25]  Jon Nielsen,et al.  Are vegetation indices derived from consumer-grade cameras mounted on UAVs sufficiently reliable for assessing experimental plots? , 2016 .

[26]  H. Stützel,et al.  Evaluation of a radiosity based light model for greenhouse cucumber canopies , 2011 .

[27]  Huanhuan Liu,et al.  Genetic Mapping of the Leaf Number above the Primary Ear and Its Relationship with Plant Height and Flowering Time in Maize , 2017, Front. Plant Sci..

[28]  R. Dawson How Significant is a Boxplot Outlier? , 2011 .

[29]  C. Fournier,et al.  Changes in the vertical distribution of leaf area enhanced light interception efficiency in maize over generations of selection. , 2019, Plant, cell & environment.

[30]  Xinyu Guo,et al.  A Leaf Modeling and Multi-Scale Remeshing Method for Visual Computation via Hierarchical Parametric Vein and Margin Representation , 2018, Front. Plant Sci..

[31]  Falk Schreiber,et al.  HTPheno: An image analysis pipeline for high-throughput plant phenotyping , 2011, BMC Bioinformatics.

[32]  Ryan F. McCormick,et al.  3D Sorghum Reconstructions from Depth Images Identify QTL Regulating Shoot Architecture1[OPEN] , 2016, Plant Physiology.

[33]  S. Dong,et al.  Optimum leaf removal increases canopy apparent photosynthesis, 13c-photosynthate distribution and grain yield of maize crops grown at high density. , 2015 .

[34]  Jim Hanan,et al.  Towards a model of spray–canopy interactions: Interception, shatter, bounce and retention of droplets on horizontal leaves , 2014 .

[35]  Lei Gao,et al.  Signal Processing: Image Communication , 2022 .

[36]  Christophe Delacourt,et al.  Assessing the Accuracy of High Resolution Digital Surface Models Computed by PhotoScan® and MicMac® in Sub-Optimal Survey Conditions , 2016, Remote. Sens..

[37]  G. Louarn,et al.  A leaf gas exchange model that accounts for intra-canopy variability by considering leaf nitrogen content and local acclimation to radiation in grapevine (Vitis vinifera L.). , 2012, Plant, cell & environment.

[38]  Liang Han,et al.  Effect of Leaf Occlusion on Leaf Area Index Inversion of Maize Using UAV-LiDAR Data , 2019, Remote. Sens..

[39]  Ashok Samal,et al.  Leveraging Image Analysis for High-Throughput Plant Phenotyping , 2019, Front. Plant Sci..

[40]  Min Jiang,et al.  Estimates of rice lodging using indices derived from UAV visible and thermal infrared images , 2018 .

[41]  S. Sankaran,et al.  Low-altitude, high-resolution aerial imaging systems for row and field crop phenotyping: A review , 2015 .

[42]  Erle C. Ellis,et al.  High spatial resolution three-dimensional mapping of vegetation spectral dynamics using computer vision , 2013 .

[43]  Frédéric Baret,et al.  Using 3D Point Clouds Derived from UAV RGB Imagery to Describe Vineyard 3D Macro-Structure , 2017, Remote. Sens..

[44]  J. Araus,et al.  Field high-throughput phenotyping: the new crop breeding frontier. , 2014, Trends in plant science.

[45]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[46]  Yu Jiang,et al.  High throughput phenotyping of cotton plant height using depth images under field conditions , 2016, Comput. Electron. Agric..

[47]  Lutz Plümer,et al.  Low-Cost 3D Systems: Suitable Tools for Plant Phenotyping , 2014, Sensors.

[48]  B. Andrieu,et al.  Use of virtual 3D maize canopies to assess the effect of plot heterogeneity on radiation interception , 2001 .

[49]  Graeme L. Hammer,et al.  Connecting Biochemical Photosynthesis Models with Crop Models to Support Crop Improvement , 2016, Front. Plant Sci..

[50]  A. García-Ferrer,et al.  Reconstruction of extreme topography from UAV structure from motion photogrammetry , 2018, Measurement.

[51]  Changying Li,et al.  Three-dimensional photogrammetric mapping of cotton bolls in situ based on point cloud segmentation and clustering , 2020 .

[52]  M. Tester,et al.  Breeding crops to feed 10 billion , 2019, Nature Biotechnology.

[53]  B. Vanlauwe,et al.  A staggered maize-legume intercrop arrangement robustly increases crop yields and economic returns in the highlands of Central Kenya. , 2010 .

[54]  Wei Guo,et al.  High-Throughput Phenotyping of Sorghum Plant Height Using an Unmanned Aerial Vehicle and Its Application to Genomic Prediction Modeling , 2017, Front. Plant Sci..

[55]  Xin-Guang Zhu,et al.  Improving photosynthetic efficiency for greater yield. , 2010, Annual review of plant biology.

[56]  D. Goodin,et al.  Application of unmanned aerial systems for high throughput phenotyping of large wheat breeding nurseries , 2016, Plant Methods.

[57]  Rubens Augusto Camargo Lamparelli,et al.  Height estimation of sugarcane using an unmanned aerial system (UAS) based on structure from motion (SfM) point clouds , 2017 .

[58]  Tony P. Pridmore,et al.  High-Resolution Three-Dimensional Structural Data Quantify the Impact of Photoinhibition on Long-Term Carbon Gain in Wheat Canopies in the Field1[OPEN] , 2015, Plant Physiology.

[59]  Jose A. Jiménez-Berni,et al.  Proximal Remote Sensing Buggies and Potential Applications for Field-Based Phenotyping , 2014 .

[60]  Yi Lin,et al.  LiDAR: An important tool for next-generation phenotyping technology of high potential for plant phenomics? , 2015, Comput. Electron. Agric..

[61]  Erik H. Murchie,et al.  Exploring Relationships between Canopy Architecture, Light Distribution, and Photosynthesis in Contrasting Rice Genotypes Using 3D Canopy Reconstruction , 2017, Front. Plant Sci..

[62]  S. Chapman,et al.  Dynamic quantification of canopy structure to characterize early plant vigour in wheat genotypes , 2016, Journal of experimental botany.

[63]  B. Andrieu,et al.  Light interception of contrasting azimuth canopies under square and rectangular plant spatial distributions: simulations and crop measurements , 2001 .

[64]  S. Long,et al.  Can improvement in photosynthesis increase crop yields? , 2006, Plant, cell & environment.

[65]  Changying Li,et al.  In-field High Throughput Phenotyping and Cotton Plant Growth Analysis Using LiDAR , 2018, Front. Plant Sci..

[66]  F. Baret,et al.  Estimates of plant density of wheat crops at emergence from very low altitude UAV imagery. , 2017 .

[67]  S. Chapman,et al.  Breeder friendly phenotyping. , 2020, Plant science : an international journal of experimental plant biology.

[68]  Nick Rutter,et al.  Three-dimensional thermal characterization of forest canopies using UAV photogrammetry. , 2018 .

[69]  Fulya Baysal-Gurel,et al.  Unmanned Aircraft System (UAS) Technology and Applications in Agriculture , 2019, Agronomy.

[70]  Ulrich Schurr,et al.  Phenotyping in the fields: dissecting the genetics of quantitative traits and digital farming. , 2015, The New phytologist.

[71]  Jose A. Jiménez-Berni,et al.  Field crop phenomics: enabling breeding for radiation use efficiency and biomass in cereal crops. , 2019, The New phytologist.

[72]  Mark Meyer,et al.  Implicit fairing of irregular meshes using diffusion and curvature flow , 1999, SIGGRAPH.

[73]  Xinyu Guo,et al.  Estimating canopy gap fraction and diffuse light interception in 3D maize canopy using hierarchical hemispheres , 2019, Agricultural and Forest Meteorology.

[74]  Hervé Sinoquet,et al.  Leaf dispersion and light partitioning in three‐dimensionally digitized tall fescue–white clover mixtures , 2002 .

[75]  Radu Bogdan Rusu,et al.  3D is here: Point Cloud Library (PCL) , 2011, 2011 IEEE International Conference on Robotics and Automation.

[76]  Pablo J. Zarco-Tejada,et al.  High-Resolution Airborne UAV Imagery to Assess Olive Tree Crown Parameters Using 3D Photo Reconstruction: Application in Breeding Trials , 2015, Remote. Sens..

[77]  Xu Wang,et al.  Field-based high-throughput phenotyping of plant height in sorghum using different sensing technologies , 2018, Plant Methods.

[78]  R. Bonhomme,et al.  Effect of 3D nitrogen, dry mass per area and local irradiance on canopy photosynthesis within leaves of contrasted heterogeneous maize crops. , 2004, Annals of botany.

[79]  Yan Guo,et al.  Assessment of the influence of global dimming on the photosynthetic production of rice based on three-dimensional modeling , 2011 .

[80]  Q. Zhang,et al.  Sensors and systems for fruit detection and localization: A review , 2015, Comput. Electron. Agric..

[81]  Michael P. Pound,et al.  Approaches to three-dimensional reconstruction of plant shoot topology and geometry. , 2016, Functional plant biology : FPB.

[82]  L. Wallace,et al.  Assessment of Forest Structure Using Two UAV Techniques: A Comparison of Airborne Laser Scanning and Structure from Motion (SfM) Point Clouds , 2016 .

[83]  U. Schmidhalter,et al.  High-Throughput Estimation of Crop Traits: A Review of Ground and Aerial Phenotyping Platforms , 2020, IEEE Geoscience and Remote Sensing Magazine.

[84]  Christian Klukas,et al.  Integrated Analysis Platform: An Open-Source Information System for High-Throughput Plant Phenotyping1[C][W][OPEN] , 2014, Plant Physiology.

[85]  K. Giller,et al.  Maize-grain legume intercropping for enhanced resource use efficiency and crop productivity in the Guinea savanna of northern Ghana , 2017, Field crops research.

[86]  Michael P. Pound,et al.  Automated Recovery of Three-Dimensional Models of Plant Shoots from Multiple Color Images1[C][W][OPEN] , 2014, Plant Physiology.

[87]  Wei Guo,et al.  Pixel size of aerial imagery constrains the applications of unmanned aerial vehicle in crop breeding , 2019, ISPRS Journal of Photogrammetry and Remote Sensing.

[88]  David Reiser,et al.  3-D Imaging Systems for Agricultural Applications—A Review , 2016, Sensors.

[89]  Dong Chen,et al.  LiDAR Point Clouds to 3-D Urban Models$:$ A Review , 2018, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[90]  Wenyu Yang,et al.  Effect of aboveground and belowground interactions on the intercrop yields in maize-soybean relay intercropping systems , 2017 .

[91]  E. Costes,et al.  3D plant model assessed by terrestrial LiDAR and hemispherical photographs: A useful tool for comparing light interception among oil palm progenies , 2018 .

[92]  Fabio Remondino,et al.  Aerial multi-camera systems: Accuracy and block triangulation issues , 2015 .

[93]  Florent Lafarge,et al.  Surface Reconstruction through Point Set Structuring , 2013, Comput. Graph. Forum.

[94]  Mark W. Smith,et al.  Structure from motion photogrammetry in physical geography , 2016 .

[95]  M. Hawkesford,et al.  Field Scanalyzer: An automated robotic field phenotyping platform for detailed crop monitoring. , 2016, Functional plant biology : FPB.

[96]  Kenneth L. McNally,et al.  Field-based high throughput phenotyping rapidly identifies genomic regions controlling yield components in rice , 2017, Scientific Reports.

[97]  Yuntao Ma,et al.  Quantification of light interception within image-based 3D reconstruction of sole and intercropped canopies over the entire growth season. , 2020, Annals of botany.

[98]  M. Zaman-Allah,et al.  Translating High-Throughput Phenotyping into Genetic Gain , 2018, Trends in plant science.

[99]  Jose A. Jiménez-Berni,et al.  Pheno-Copter: A Low-Altitude, Autonomous Remote-Sensing Robotic Helicopter for High-Throughput Field-Based Phenotyping , 2014 .

[100]  Renata Retkute,et al.  Suboptimal Acclimation of Photosynthesis to Light in Wheat Canopies[CC-BY] , 2017, Plant Physiology.

[101]  Wei Su,et al.  Estimation of the vertical leaf area profile of corn (Zea mays) plants using terrestrial laser scanning (TLS) , 2018, Comput. Electron. Agric..

[102]  Yan Guo,et al.  Evaluating a three dimensional model of diffuse photosynthetically active radiation in maize canopies , 2006, International journal of biometeorology.

[103]  Jianbing Yan,et al.  High-Throughput Phenotyping and QTL Mapping Reveals the Genetic Architecture of Maize Plant Growth1[OPEN] , 2017, Plant Physiology.

[104]  H. Sinoquet,et al.  Estimating the three-dimensional geometry of a maize crop as an input of radiation models: comparison between three-dimensional digitizing and plant profiles , 1991 .

[105]  Seishi Ninomiya,et al.  Characterization of peach tree crown by using high-resolution images from an unmanned aerial vehicle , 2018, Horticulture Research.

[106]  Yuntao Ma,et al.  Image-based dynamic quantification and high-accuracy 3D evaluation of canopy structure of plant populations , 2018, Annals of botany.

[107]  Xinguang Zhu,et al.  The impact of modifying photosystem antenna size on canopy photosynthetic efficiency—Development of a new canopy photosynthesis model scaling from metabolism to canopy level processes , 2017, Plant, cell & environment.

[108]  Michael P. Pound,et al.  Image-based 3D canopy reconstruction to determine potential productivity in complex multi-species crop systems , 2017, Annals of botany.

[109]  J. Foley,et al.  Yield Trends Are Insufficient to Double Global Crop Production by 2050 , 2013, PloS one.