A novel mesh processing based technique for 3D plant analysis

BackgroundIn recent years, imaging based, automated, non-invasive, and non-destructive high-throughput plant phenotyping platforms have become popular tools for plant biology, underpinning the field of plant phenomics. Such platforms acquire and record large amounts of raw data that must be accurately and robustly calibrated, reconstructed, and analysed, requiring the development of sophisticated image understanding and quantification algorithms. The raw data can be processed in different ways, and the past few years have seen the emergence of two main approaches: 2D image processing and 3D mesh processing algorithms. Direct image quantification methods (usually 2D) dominate the current literature due to comparative simplicity. However, 3D mesh analysis provides the tremendous potential to accurately estimate specific morphological features cross-sectionally and monitor them over-time.ResultIn this paper, we present a novel 3D mesh based technique developed for temporal high-throughput plant phenomics and perform initial tests for the analysis of Gossypium hirsutum vegetative growth. Based on plant meshes previously reconstructed from multi-view images, the methodology involves several stages, including morphological mesh segmentation, phenotypic parameters estimation, and plant organs tracking over time. The initial study focuses on presenting and validating the accuracy of the methodology on dicotyledons such as cotton but we believe the approach will be more broadly applicable. This study involved applying our technique to a set of six Gossypium hirsutum (cotton) plants studied over four time-points. Manual measurements, performed for each plant at every time-point, were used to assess the accuracy of our pipeline and quantify the error on the morphological parameters estimated.ConclusionBy directly comparing our automated mesh based quantitative data with manual measurements of individual stem height, leaf width and leaf length, we obtained the mean absolute errors of 9.34%, 5.75%, 8.78%, and correlation coefficients 0.88, 0.96, and 0.95 respectively. The temporal matching of leaves was accurate in 95% of the cases and the average execution time required to analyse a plant over four time-points was 4.9 minutes. The mesh processing based methodology is thus considered suitable for quantitative 4D monitoring of plant phenotypic features.

[1]  J. Bartko Corrective Note to: “The Intraclass Correlation Coefficient as a Measure of Reliability” , 1974 .

[2]  J. Fleiss,et al.  Intraclass correlations: uses in assessing rater reliability. , 1979, Psychological bulletin.

[3]  J. Rodgers,et al.  Thirteen ways to look at the correlation coefficient , 1988 .

[4]  Anil K. Jain,et al.  Automatic image analysis of plant root structures , 1992, Proceedings., 11th IAPR International Conference on Pattern Recognition. Vol.II. Conference B: Pattern Recognition Methodology and Systems.

[5]  Qian Huang,et al.  Generalized tube model: recognizing 3D elongated objects from 2D intensity images , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Jochen Wingbermühle,et al.  Automatic reconstruction of 3D objects using a mobile monoscopic camera , 1997, Proceedings. International Conference on Recent Advances in 3-D Digital Imaging and Modeling (Cat. No.97TB100134).

[7]  U. Schurr,et al.  Leaf development in Ricinus communis during drought stress: dynamics of growth processes, of cellular structure and of sink-source transition. , 2000, Journal of experimental botany.

[8]  P. Reich,et al.  A handbook of protocols for standardised and easy measurement of plant functional traits worldwide , 2003 .

[9]  J. Rossignac,et al.  Plumber: a method for a multi-scale decomposition of 3D shapes into tubular primitives and bodies , 2004, SM '04.

[10]  Gershon Elber,et al.  Proceedings of the Ninth ACM Symposium on Solid Modeling and Applications, Genova, Italy, June 09-11, 2004 , 2004, Symposium on Solid Modeling and Applications.

[11]  Edmond Boyer,et al.  Fusion of multiview silhouette cues using a space occupancy grid , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[12]  Kenji Shimada,et al.  Surface mesh segmentation and smooth surface extraction through region growing , 2005, Comput. Aided Geom. Des..

[13]  Richard Taylor,et al.  3D S.O.M. - A commercial software solution to 3D scanning , 2005, Graph. Model..

[14]  Kenji Omasa,et al.  Voxel-Based 3-D Modeling of Individual Trees for Estimating Leaf Area Density Using High-Resolution Portable Scanning Lidar , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[15]  K. Chenu,et al.  PHENOPSIS, an automated platform for reproducible phenotyping of plant responses to soil water deficit in Arabidopsis thaliana permitted the identification of an accession with low sensitivity to soil water deficit. , 2006, The New phytologist.

[16]  Marco Attene,et al.  Hierarchical mesh segmentation based on fitting primitives , 2006, The Visual Computer.

[17]  Bert Reubens,et al.  Assessing and analyzing 3D architecture of woody root systems, a review of methods and applications in tree and soil stability, resource acquisition and allocation , 2008, Plant and Soil.

[18]  M. M. Christ,et al.  Dynamics of seedling growth acclimation towards altered light conditions can be quantified via GROWSCREEN: a setup and procedure designed for rapid optical phenotyping of different plant species. , 2007, The New phytologist.

[19]  Ariel Shamir,et al.  A survey on Mesh Segmentation Techniques , 2008, Comput. Graph. Forum.

[20]  J. Trygg,et al.  LAMINA: a tool for rapid quantification of leaf size and shape parameters , 2008, BMC Plant Biology.

[21]  C. Fournier,et al.  OpenAlea: a visual programming and component-based software platform for plant modelling. , 2008, Functional plant biology : FPB.

[22]  Guangjian Yan,et al.  Image-based 3D corn reconstruction for retrieval of geometrical structural parameters , 2009 .

[23]  H. Scharr,et al.  Simultaneous phenotyping of leaf growth and chlorophyll fluorescence via GROWSCREEN FLUORO allows detection of stress tolerance in Arabidopsis thaliana and other rosette plants. , 2009, Functional plant biology : FPB.

[24]  Thomas A. Funkhouser,et al.  Consistent segmentation of 3D models , 2009, Comput. Graph..

[25]  Daniel Cremers,et al.  Continuous Global Optimization in Multiview 3D Reconstruction , 2007, International Journal of Computer Vision.

[26]  F. Tardieu,et al.  Multi-scale phenotyping of leaf expansion in response to environmental changes: the whole is more than the sum of parts. , 2009, Plant, cell & environment.

[27]  N. Yazdanbakhsh,et al.  High throughput phenotyping of root growth dynamics, lateral root formation, root architecture and root hair development enabled by PlaRoM. , 2009, Functional plant biology : FPB.

[28]  Hanno Scharr,et al.  Diel Growth Cycle of Isolated Leaf Discs Analyzed with a Novel, High-Throughput Three-Dimensional Imaging Method Is Identical to That of Intact Leaves1[W] , 2009, Plant Physiology.

[29]  Matthias Eberius,et al.  High-Throughput Plant Phenotyping – Data Acquisition, Transformation, and Analysis , 2009 .

[30]  P. Benfey,et al.  Imaging and Analysis Platform for Automatic Phenotyping and Trait Ranking of Plant Root Systems1[W][OA] , 2010, Plant Physiology.

[31]  J. Verdeil,et al.  High-contrast three-dimensional imaging of the Arabidopsis leaf enables the analysis of cell dimensions in the epidermis and mesophyll , 2010, Plant Methods.

[32]  Falk Schreiber,et al.  HTPheno: An image analysis pipeline for high-throughput plant phenotyping , 2011, BMC Bioinformatics.

[33]  W. Broekaert,et al.  TraitMill: a Discovery Engine for Identifying Yield-enhancement Genes in Cereals , 2010 .

[34]  Harold W. Kuhn,et al.  The Hungarian method for the assignment problem , 1955, 50 Years of Integer Programming.

[35]  B. Andrieu,et al.  Functional-structural plant modelling: a new versatile tool in crop science. , 2010, Journal of experimental botany.

[36]  Gary G. Koch,et al.  Intraclass Correlation Coefficient , 2011, International Encyclopedia of Statistical Science.

[37]  R. MacCurdy,et al.  Three-Dimensional Root Phenotyping with a Novel Imaging and Software Platform1[C][W][OA] , 2011, Plant Physiology.

[38]  Q. Luo,et al.  High-throughput measurement of rice tillers using a conveyor equipped with x-ray computed tomography. , 2011, The Review of scientific instruments.

[39]  Lingfeng Duan,et al.  A novel machine-vision-based facility for the automatic evaluation of yield-related traits in rice , 2011, Plant Methods.

[40]  M. Tester,et al.  Phenomics--technologies to relieve the phenotyping bottleneck. , 2011, Trends in plant science.

[41]  Tony P. Pridmore,et al.  Bioinformatics Applications Note Systems Biology High-throughput Feature Counting and Measurement of Roots , 2022 .