Quantifying time-series of leaf morphology using 2D and 3D photogrammetry methods for high-throughput plant phenotyping

Developed novel computer vision algorithms for time-series plant morphology in 2D and 3D.We used 2D leaf area to quantify leaf nastic movements.3D leaf area showed a reliable time-series leaf growth trend.The throughput of the pipeline is very high comparing to previous studies. Conventional phenotyping methods impose a significant bottleneck to the characterization of genotypic and environmental effects on trait expression in plants. In particular, invasive and destructive sampling methods along with manual measurements widely used in conventional studies are labor-intensive, time-consuming, costly, and can lack consistency. These experimental features impede large-scale genetic studies of both crops and wild plant species. Here, we present a high-throughput phenotyping pipeline using photogrammetry and 3D modeling techniques in the model species, Arabidopsis thaliana. We develop novel photogrammetry and computer vision algorithms to quantify 2D and 3D leaf areas for a mapping population of 1050 Arabidopsis thaliana lines, and use 2D areas to analyze plant nastic movements and diurnal cycles. Compared to the 2D leaf areas, 3D leaf areas show an uncorrupted growth trend regardless of plant nastic movement. With optimized algorithms, our pipeline throughput is very computationally efficient for screening a large number of plants. The pipeline not only supports measurement of organ-level growth and development over time, but also enables analysis of whole-plant phenotypes and, thus, identification of genotype-specific performance. Further, the accuracy results evaluating the relationship between physical dimensions and 3D measurements indicate an R2=0.99, and the average 3D area processing time per plant is 0.02s. Our algorithms provide both high accuracy and throughput in plant phenotyping, thereby, enabling progress in plant genotypic modeling.

[1]  K. H. Kjaer,et al.  3D Laser Triangulation for Plant Phenotyping in Challenging Environments , 2015, Sensors.

[2]  M. R. Thorpe,et al.  Non-invasive approaches for phenotyping of enhanced performance traits in bean. , 2011, Functional plant biology : FPB.

[3]  George Azzari,et al.  Rapid Characterization of Vegetation Structure with a Microsoft Kinect Sensor , 2013, Sensors.

[4]  Ladislav Nedbal,et al.  Computer Reconstruction of Plant Growth and Chlorophyll Fluorescence Emission in Three Spatial Dimensions , 2012, Sensors.

[5]  M. Tester,et al.  Phenomics--technologies to relieve the phenotyping bottleneck. , 2011, Trends in plant science.

[6]  B. Andrieu,et al.  Functional-structural plant modelling: a new versatile tool in crop science. , 2010, Journal of experimental botany.

[7]  C. Klukas,et al.  Dissecting the Phenotypic Components of Crop Plant Growth and Drought Responses Based on High-Throughput Image Analysis[W][OPEN] , 2014, Plant Cell.

[8]  K. Keightley,et al.  Original paper: 3D volumetric modeling of grapevine biomass using Tripod LiDAR , 2010 .

[9]  Long Quan,et al.  Image-based plant modeling , 2006, SIGGRAPH 2006.

[10]  José Luis Micol,et al.  Genetic analysis of natural variations in the architecture of Arabidopsis thaliana vegetative leaves. , 2002, Genetics.

[11]  Christine M. Palmer,et al.  LeafJ: an ImageJ plugin for semi-automated leaf shape measurement. , 2013, Journal of visualized experiments : JoVE.

[12]  Thiago T. Santos,et al.  Image-based 3 D digitizing for plant architecture analysis and phenotyping , 2012 .

[13]  Ioannis Xenarios,et al.  Differentially Phased Leaf Growth and Movements in Arabidopsis Depend on Coordinated Circadian and Light Regulation[W] , 2014, Plant Cell.

[14]  Sara E Remsen,et al.  TRiP: Tracking Rhythms in Plants, an automated leaf movement analysis program for circadian period estimation , 2015, Plant Methods.

[15]  Anne-Katrin Mahlein,et al.  Recent advances in sensing plant diseases for precision crop protection , 2012, European Journal of Plant Pathology.

[16]  Cynthia Weinig,et al.  Shade avoidance and the regulation of leaf inclination in Arabidopsis. , 2006, Plant, cell & environment.

[17]  J L Micol,et al.  Venation pattern formation in Arabidopsis thaliana vegetative leaves. , 1999, Developmental biology.

[18]  Lutz Plümer,et al.  Low-Cost 3D Systems: Suitable Tools for Plant Phenotyping , 2014, Sensors.

[19]  Alexandre Escolà,et al.  Real-Time Tree-Foliage Surface Estimation Using a Ground Laser Scanner , 2007, IEEE Transactions on Instrumentation and Measurement.

[20]  K. Omasa,et al.  Estimating vertical plant area density profile and growth parameters of a wheat canopy at different growth stages using three-dimensional portable lidar imaging , 2009 .

[21]  Daniel K. Y. Tan,et al.  A New Image-Processing-Based Technique for Measuring Leaf Dimensions , 2012 .

[22]  Daniel Parnham,et al.  TECHNICAL ADVANCE: LeafAnalyser: a computational method for rapid and large-scale analyses of leaf shape variation: Computational analysis of leaf shape variation , 2007 .

[23]  J. Trygg,et al.  LAMINA: a tool for rapid quantification of leaf size and shape parameters , 2008, BMC Plant Biology.

[24]  C. Robertson McClung,et al.  Reciprocal Interaction of the Circadian Clock with the Iron Homeostasis Network in Arabidopsis1[W][OA] , 2012, Plant Physiology.

[25]  Philippe Lucidarme,et al.  On the use of depth camera for 3D phenotyping of entire plants , 2012 .

[26]  K. Chenu,et al.  PHENOPSIS, an automated platform for reproducible phenotyping of plant responses to soil water deficit in Arabidopsis thaliana permitted the identification of an accession with low sensitivity to soil water deficit. , 2006, The New phytologist.

[27]  James K. M. Brown,et al.  QTL analysis of flowering time inArabidopsis thaliana , 1995, Molecular and General Genetics MGG.

[28]  Long Quan,et al.  Image-based tree modeling , 2007, SIGGRAPH 2007.

[29]  A. Boronat,et al.  Precursor uptake assays and metabolic analyses in isolated tomato fruit chromoplasts , 2012, Plant Methods.

[30]  Arnold J. Bloom,et al.  Easy Leaf Area: Automated digital image analysis for rapid and accurate measurement of leaf area1 , 2014, Applications in plant sciences.

[31]  H. Scharr,et al.  A stereo imaging system for measuring structural parameters of plant canopies. , 2007, Plant, cell & environment.

[32]  Osama Moselhi,et al.  Integrating Automated Data Acquisition Technologies for Progress Reporting of Construction Projects , 2009 .

[33]  M. Tester,et al.  High-throughput shoot imaging to study drought responses. , 2010, Journal of experimental botany.

[34]  Chi-Ren Shyu,et al.  PhenoPhyte: a flexible affordable method to quantify 2D phenotypes from imagery , 2012, Plant Methods.

[35]  Ulrich Schurr,et al.  Future scenarios for plant phenotyping. , 2013, Annual review of plant biology.

[36]  Falk Schreiber,et al.  HTPheno: An image analysis pipeline for high-throughput plant phenotyping , 2011, BMC Bioinformatics.

[37]  Stephen M. Welch,et al.  Plant high-throughput phenotyping using photogrammetry and imaging techniques to measure leaf length and rosette area , 2016, Comput. Electron. Agric..

[38]  Kirk A. Stowe,et al.  Identification and characterization of QTL underlying whole‐plant physiology in Arabidopsis thaliana: δ13C, stomatal conductance and transpiration efficiency , 2005 .

[39]  Guido Sanguinetti,et al.  LEAFPROCESSOR: a new leaf phenotyping tool using contour bending energy and shape cluster analysis. , 2010, The New phytologist.

[40]  C. Daughtry,et al.  Evaluation of Digital Photography from Model Aircraft for Remote Sensing of Crop Biomass and Nitrogen Status , 2005, Precision Agriculture.

[41]  Joy Bergelson,et al.  Linkage and Association Mapping of Arabidopsis thaliana Flowering Time in Nature , 2010, PLoS genetics.