Validation of plant part measurements using a 3D reconstruction method suitable for high-throughput seedling phenotyping

In plant phenotyping, there is a demand for high-throughput, non-destructive systems that can accurately analyse various plant traits by measuring features such as plant volume, leaf area, and stem length. Existing vision-based systems either focus on speed using 2D imaging, which is consequently inaccurate, or on accuracy using time-consuming 3D methods. In this paper, we present a computer-vision system for seedling phenotyping that combines best of both approaches by utilizing a fast three-dimensional (3D) reconstruction method. We developed image processing methods for the identification and segmentation of plant organs (stem and leaf) from the 3D plant model. Various measurements of plant features such as plant volume, leaf area, and stem length are estimated based on these plant segments. We evaluate the accuracy of our system by comparing the measurements of our methods with ground truth measurements obtained destructively by hand. The results indicate that the proposed system is very promising.

[1]  R. Klose,et al.  Usability study of 3 D Time-of-Flight cameras for automatic plant phenotyping , 2009 .

[2]  H. Scharr,et al.  A stereo imaging system for measuring structural parameters of plant canopies. , 2007, Plant, cell & environment.

[3]  Ulrich Schurr,et al.  Future scenarios for plant phenotyping. , 2013, Annual review of plant biology.

[4]  Carme Torras,et al.  3D modelling of leaves from color and ToF data for robotized plant measuring , 2011, 2011 IEEE International Conference on Robotics and Automation.

[5]  Jean Ponce,et al.  Accurate, Dense, and Robust Multiview Stereopsis , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  I. Xenarios,et al.  Measuring the diurnal pattern of leaf hyponasty and growth in Arabidopsis - a novel phenotyping approach using laser scanning. , 2012, Functional plant biology : FPB.

[7]  Jake K. Aggarwal,et al.  TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE , 2008 .

[8]  H. Scharr,et al.  Simultaneous phenotyping of leaf growth and chlorophyll fluorescence via GROWSCREEN FLUORO allows detection of stress tolerance in Arabidopsis thaliana and other rosette plants. , 2009, Functional plant biology : FPB.

[9]  M.L.I. Wigham,et al.  MARVIN : high speed 3D imaging for seedling classification , 2009 .

[10]  H. Scharr,et al.  HyperART: non-invasive quantification of leaf traits using hyperspectral absorption-reflectance-transmittance imaging , 2015, Plant Methods.

[11]  Falk Schreiber,et al.  HTPheno: An image analysis pipeline for high-throughput plant phenotyping , 2011, BMC Bioinformatics.

[12]  Richard Taylor,et al.  3D S.O.M. - A commercial software solution to 3D scanning , 2005, Graph. Model..

[13]  Aldo Laurentini,et al.  The visual hull: a new tool for contour-based image understanding , 1991 .

[14]  M. M. Christ,et al.  Dynamics of seedling growth acclimation towards altered light conditions can be quantified via GROWSCREEN: a setup and procedure designed for rapid optical phenotyping of different plant species. , 2007, The New phytologist.

[15]  Zeyu Li,et al.  Wide-area external multi-camera calibration using vision graphs and virtual calibration object , 2008, 2008 Second ACM/IEEE International Conference on Distributed Smart Cameras.

[16]  Michael P. Pound,et al.  Automated Recovery of Three-Dimensional Models of Plant Shoots from Multiple Color Images1[C][W][OPEN] , 2014, Plant Physiology.

[17]  C. Glasbey,et al.  SPICY: towards automated phenotyping of large pepper plants in the greenhouse. , 2012, Functional plant biology : FPB.

[18]  Long Quan,et al.  Image-based plant modeling , 2006, SIGGRAPH 2006.

[19]  Qin Zhang,et al.  A Review of Imaging Techniques for Plant Phenotyping , 2014, Sensors.

[20]  Gustavo A. Pereyra-Irujo,et al.  GlyPh: a low-cost platform for phenotyping plant growth and water use. , 2012, Functional plant biology : FPB.

[21]  Ross A Frick,et al.  Accurate inference of shoot biomass from high-throughput images of cereal plants , 2011, Plant Methods.

[22]  Richard Szeliski,et al.  Rapid octree construction from image sequences , 1993 .

[23]  Hanno Scharr,et al.  Diel Growth Cycle of Isolated Leaf Discs Analyzed with a Novel, High-Throughput Three-Dimensional Imaging Method Is Identical to That of Intact Leaves1[W] , 2009, Plant Physiology.

[24]  Bruce G. Baumgart,et al.  Geometric modeling for computer vision. , 1974 .

[25]  Philippe Lucidarme,et al.  On the use of depth camera for 3D phenotyping of entire plants , 2012 .

[26]  K. Chenu,et al.  PHENOPSIS, an automated platform for reproducible phenotyping of plant responses to soil water deficit in Arabidopsis thaliana permitted the identification of an accession with low sensitivity to soil water deficit. , 2006, The New phytologist.

[27]  Sotirios A. Tsaftaris,et al.  Image-based plant phenotyping with incremental learning and active contours , 2014, Ecol. Informatics.

[28]  A. Laurentini,et al.  The Visual Hull Concept for Silhouette-Based Image Understanding , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[29]  Matthias Eberius,et al.  High-Throughput Plant Phenotyping – Data Acquisition, Transformation, and Analysis , 2009 .

[30]  Jake K. Aggarwal,et al.  Rectangular parallelepiped coding: A volumetric representation of three-dimensional objects , 1986, IEEE J. Robotics Autom..

[31]  K. Thurow,et al.  Future and frontiers of automated screening in plant sciences , 2010 .

[32]  Etienne Belin,et al.  Multiscale imaging of plants: current approaches and challenges , 2015, Plant Methods.

[33]  Hans Jørgen Andersen,et al.  Geometric plant properties by relaxed stereo vision using simulated annealing , 2005 .

[34]  Lutz Plümer,et al.  Low-Cost 3D Systems: Suitable Tools for Plant Phenotyping , 2014, Sensors.

[35]  O. Loudet,et al.  Phenoscope: an automated large-scale phenotyping platform offering high spatial homogeneity. , 2013, The Plant journal : for cell and molecular biology.

[36]  M. Tester,et al.  Phenomics--technologies to relieve the phenotyping bottleneck. , 2011, Trends in plant science.

[37]  J. Fripp,et al.  A novel mesh processing based technique for 3D plant analysis , 2012, BMC Plant Biology.

[38]  Nicola J. Ferrier,et al.  A high throughput robot system for machine vision based plant phenotype studies , 2012, Machine Vision and Applications.