3D Surface Reconstruction of Plant Seeds by Volume Carving: Performance and Accuracies

We describe a method for 3D reconstruction of plant seed surfaces, focusing on small seeds with diameters as small as 200 μm. The method considers robotized systems allowing single seed handling in order to rotate a single seed in front of a camera. Even though such systems feature high position repeatability, at sub-millimeter object scales, camera pose variations have to be compensated. We do this by robustly estimating the tool center point from each acquired image. 3D reconstruction can then be performed by a simple shape-from-silhouette approach. In experiments we investigate runtimes, theoretically achievable accuracy, experimentally achieved accuracy, and show as a proof of principle that the proposed method is well sufficient for 3D seed phenotyping purposes.

[1]  Richard Szeliski,et al.  Rapid octree construction from image sequences , 1993 .

[2]  Ioan Vlad Uilecan,et al.  HYPOTrace: Image Analysis Software for Measuring Hypocotyl Growth and Shape Demonstrated on Arabidopsis Seedlings Undergoing Photomorphogenesis1[OA] , 2009, Plant Physiology.

[3]  Tony P. Pridmore,et al.  A patch-based approach to 3D plant shoot phenotyping , 2016, Machine Vision and Applications.

[4]  Markus Rüggeberg,et al.  A zoom into the nanoscale texture of secondary cell walls , 2014, Plant Methods.

[5]  Sotirios A. Tsaftaris,et al.  Image-based plant phenotyping with incremental learning and active contours , 2014, Ecol. Informatics.

[6]  H. Scharr,et al.  The leaf angle distribution of natural plant populations: assessing the canopy with a novel software tool , 2015, Plant Methods.

[7]  Thiago T. Santos,et al.  Flexible three-dimensional modeling of plants using low- resolution cameras and visual odometry , 2015, Machine Vision and Applications.

[8]  Takeshi Hayashi,et al.  Genome-wide association study of grain shape variation among Oryza sativa L. germplasms based on elliptic Fourier analysis , 2010, Molecular Breeding.

[9]  Hanno Scharr,et al.  Growth Signatures of Rosette Plants from Time-Lapse Video , 2015, IEEE/ACM Transactions on Computational Biology and Bioinformatics.

[10]  C. Glasbey,et al.  SPICY: towards automated phenotyping of large pepper plants in the greenhouse. , 2012, Functional plant biology : FPB.

[11]  Kikuo Fujimura,et al.  Development of a Controlled Vocabulary and Software Application to Analyze Fruit Shape Variation in Tomato and Other Plant Species1[W] , 2006, Plant Physiology.

[12]  J. Fripp,et al.  A novel mesh processing based technique for 3D plant analysis , 2012, BMC Plant Biology.

[13]  Xiaolong Yan,et al.  3D reconstruction and dynamic modeling of root architecture in situ and its application to crop phosphorus research. , 2009, The Plant journal : for cell and molecular biology.

[14]  Alison B. Smith,et al.  GrainScan: a low cost, fast method for grain size and colour measurements , 2014, Plant Methods.

[15]  Lutz Plümer,et al.  Low-Cost 3D Systems: Suitable Tools for Plant Phenotyping , 2014, Sensors.

[16]  T. Sørensen,et al.  A method of establishing group of equal amplitude in plant sociobiology based on similarity of species content and its application to analyses of the vegetation on Danish commons , 1948 .

[17]  Wilfried Philips,et al.  Leaf Segmentation and Tracking Using Probabilistic Parametric Active Contours , 2011, MIRAGE.

[18]  Michael Felsberg,et al.  Leaf Segmentation using the Kinect , 2011 .

[19]  Andreas Fischbach,et al.  3D Surface Reconstruction of Plant Seeds by Volume Carving , 2015 .

[20]  Herbert Edelsbrunner,et al.  Detailed reconstruction of 3D plant root shape , 2011, 2011 International Conference on Computer Vision.

[21]  Xavier Draye,et al.  An online database for plant image analysis software tools , 2013, Plant Methods.

[22]  Carme Torras,et al.  3D modelling of leaves from color and ToF data for robotized plant measuring , 2011, 2011 IEEE International Conference on Robotics and Automation.

[23]  Michael Potmesil.  Generating octree models of 3D objects from their silhouettes in a sequence of images , 1987, Comput. Vis. Graph. Image Process..

[24]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[25]  Michael P. Pound,et al.  Automated Recovery of Three-Dimensional Models of Plant Shoots from Multiple Color Images1[C][W][OPEN] , 2014, Plant Physiology.

[26]  P. Perona,et al.  Visual methods for three-dimensional modeling , 1999 .

[27]  Stefano Soatto,et al.  Structure from motion for scenes without features , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[28]  Long Quan,et al.  Image-based plant modeling , 2006, ACM Trans. Graph..

[29]  A. Laurentini,et al.  The Visual Hull Concept for Silhouette-Based Image Understanding , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[30]  Hanno Scharr,et al.  Image Analysis: The New Bottleneck in Plant Phenotyping [Applications Corner] , 2015, IEEE Signal Processing Magazine.

[31]  J. Trygg,et al.  LAMINA: a tool for rapid quantification of leaf size and shape parameters , 2008, BMC Plant Biology.

[32]  R. Macknight,et al.  Rapid analysis of seed size in Arabidopsis for mutant and QTL discovery , 2011, Plant Methods.

[33]  Nathan D. Miller,et al.  Mapping Quantitative Trait Loci Affecting Arabidopsis thaliana Seed Morphology Features Extracted Computationally From Images , 2013, G3: Genes | Genomes | Genetics.

[34]  R. MacCurdy,et al.  Three-Dimensional Root Phenotyping with a Novel Imaging and Software Platform1[C][W][OA] , 2011, Plant Physiology.

[35]  Christian Klukas,et al.  3-D Histogram-Based Segmentation and Leaf Detection for Rosette Plants , 2014, ECCV Workshops.

[36]  Jake K. Aggarwal,et al.  TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE , 2008 .

[37]  M.L.I. Wigham,et al.  MARVIN : high speed 3D imaging for seedling classification , 2009 .

[38]  Falk Schreiber,et al.  HTPheno: An image analysis pipeline for high-throughput plant phenotyping , 2011, BMC Bioinformatics.

[39]  Gert Kootstra,et al.  Validation of plant part measurements using a 3D reconstruction method suitable for high-throughput seedling phenotyping , 2015, Machine Vision and Applications.

[40]  Sotirios A. Tsaftaris,et al.  Plant phenotyping with low cost digital cameras and image analytics , 2009, ITEE.

[41]  K. Chenu,et al.  PHENOPSIS, an automated platform for reproducible phenotyping of plant responses to soil water deficit in Arabidopsis thaliana permitted the identification of an accession with low sensitivity to soil water deficit. , 2006, The New phytologist.

[42]  宁北芳,et al.  疟原虫var基因转换速率变化导致抗原变异[英]／Paul H, Robert P, Christodoulou Z, et al//Proc Natl Acad Sci U S A , 2005 .

[43]  H. Iwata,et al.  SHAPE: a computer program package for quantitative evaluation of biological shapes based on elliptic Fourier descriptors. , 2002, The Journal of heredity.

[44]  Anna Helena Reali Costa,et al.  Comparative assessment of feature selection and classification techniques for visual inspection of pot plant seedlings , 2013 .

[45]  B. Mueller‐Roeber,et al.  A growth phenotyping pipeline for Arabidopsis thaliana integrating image analysis and rosette area modeling for robust quantification of genotype effects. , 2011, The New phytologist.

[46]  Hanno Scharr,et al.  Modeling leaf growth of rosette plants using infrared stereo image sequences , 2015, Comput. Electron. Agric..

[47]  M. Yano,et al.  SmartGrain: High-Throughput Phenotyping Software for Measuring Seed Shape through Image Analysis1[C][W][OA] , 2012, Plant Physiology.

[48]  L M Christensen,et al.  A MODIFIED KJELDAHL METHOD FOR THE DETERMINATION OF THE NITROGEN CONTENT OF YEAST. , 1927, Plant physiology.

[49]  Nathan D. Miller,et al.  Image analysis is driving a renaissance in growth measurement. , 2013, Current opinion in plant biology.

[50]  H. Scharr,et al.  Simultaneous phenotyping of leaf growth and chlorophyll fluorescence via GROWSCREEN FLUORO allows detection of stress tolerance in Arabidopsis thaliana and other rosette plants. , 2009, Functional plant biology : FPB.

[51]  Malia A. Gehan,et al.  Lights, camera, action: high-throughput plant phenotyping is ready for a close-up. , 2015, Current opinion in plant biology.

[52]  Daniel Cremers,et al.  High-Resolution Plant Shape Measurements from Multi-view Stereo Reconstruction , 2014, ECCV Workshops.

[53]  L. R. Dice.  Measures of the Amount of Ecologic Association Between Species , 1945 .

[54]  Yll Haxhimusa,et al.  Image-Based Phenotyping of the Mature Arabidopsis Shoot System , 2014, ECCV Workshops.

[55]  Luciano Gualberto,et al.  Comparative assessment of feature selection and classification techniques for visual inspection of pot plant seedlings , 2013 .

[56]  Paul R Zurek,et al.  3D phenotyping and quantitative trait locus mapping identify core regions of the rice genome controlling root architecture , 2013, Proceedings of the National Academy of Sciences.

[57]  Marc Pollefeys,et al.  Multiple view geometry , 2005 .

[58]  H. Scharr,et al.  GROWSCREEN-Rhizo is a novel phenotyping robot enabling simultaneous measurements of root and shoot growth for plants grown in soil-filled rhizotrons. , 2012, Functional plant biology : FPB.

[59]  Luc Van Gool,et al.  The Pascal Visual Object Classes (VOC) Challenge , 2010, International Journal of Computer Vision.

[60]  Daniel Parnham,et al.  LeafAnalyser: a computational method for rapid and large-scale analyses of leaf shape variation. , 2008, The Plant journal : for cell and molecular biology.