3D Reconstruction of Plant Leaves for High-Throughput Phenotyping

Generating 3D digital representations of plants is indispensable for researchers to gain a detailed understanding of plant dynamics. Emerging high-throughput plant phenotyping techniques can capture plant point clouds that, however, often contain imperfections and make it a changeling task to generate accurate 3D reconstructions. We present an end-to-end pipeline to reconstruct surfaces from point clouds of maize and rice plants. In particular, we propose a two-step clustering approach to accurately segment the points of each individual plant component according to maize and rice properties. We further employ surface fitting and edge fitting to ensure the smoothness of resulting surfaces. Realistic visualization results are obtained through post-processing, including texturing and lighting. Our experimental study has explored the parameter space and demonstrated the effectiveness of our pipeline for high-throughput plant phenotyping.

[1]  Hans-Peter Kriegel,et al.  A Density-Based Algorithm for Discovering Clusters in Large Spatial Databases with Noise , 1996, KDD.

[2]  Takeo Igarashi,et al.  Flower modeling via X-ray computed tomography , 2014, ACM Trans. Graph..

[3]  Markus H. Gross,et al.  Feature Preserving Point Set Surfaces based on Non‐Linear Kernel Regression , 2009, Comput. Graph. Forum.

[4]  José Dorado,et al.  Matching the Best Viewing Angle in Depth Cameras for Biomass Estimation Based on Poplar Seedling Geometry , 2015, Sensors.

[5]  Long Quan,et al.  Image-based plant modeling , 2006, SIGGRAPH 2006.

[6]  Hans-Jürgen Zimmermann,et al.  Fuzzy Set Theory - and Its Applications , 1985 .

[7]  Michael P. Pound,et al.  Plant Phenotyping: An Active Vision Cell for Three-Dimensional Plant Shoot Reconstruction1[OPEN] , 2018, Plant Physiology.

[8]  D. A. Field.  Laplacian smoothing and Delaunay triangulations , 1988 .

[9]  Reinhard Klein,et al.  Efficient RANSAC for Point‐Cloud Shape Detection , 2007, Comput. Graph. Forum.

[10]  Daniel Cohen-Or,et al.  Analyzing growing plants from 4D point cloud data , 2013, ACM Trans. Graph..

[11]  S. Reutebuch,et al.  Light detection and ranging (LIDAR): an emerging tool for multiple resource inventory. , 2005 .

[12]  Philippe Lucidarme,et al.  On the use of depth camera for 3D phenotyping of entire plants , 2012 .

[13]  Reinhard Koch,et al.  Self-Calibration and Metric Reconstruction Inspite of Varying and Unknown Intrinsic Camera Parameters , 1999, International Journal of Computer Vision.

[14]  P. Cochat,et al.  Et al , 2008, Archives de pediatrie : organe officiel de la Societe francaise de pediatrie.

[15]  W. Cleveland,et al.  Locally Weighted Regression: An Approach to Regression Analysis by Local Fitting , 1988 .

[16]  Fabio Remondino,et al.  Image‐based 3D Modelling: A Review , 2006 .

[17]  Yufeng Ge,et al.  A Novel LiDAR-Based Instrument for High-Throughput, 3D Measurement of Morphological Traits in Maize and Sorghum , 2018, Sensors.

[18]  Yin Hoon Chew,et al.  Mathematical Models Light Up Plant Signaling , 2014, Plant Cell.

[19]  Daniel Cohen-Or,et al.  Texture-lobes for tree modelling , 2011, SIGGRAPH 2011.

[20]  Andrey Dimitrov,et al.  Non‐Uniform B‐Spline Surface Fitting from Unordered 3D Point Clouds for As‐Built Modeling , 2016, Comput. Aided Civ. Infrastructure Eng..

[21]  D. Cohen-Or,et al.  Robust moving least-squares fitting with sharp features , 2005, ACM Trans. Graph..

[22]  William E. Lorensen,et al.  Marching cubes: A high resolution 3D surface construction algorithm , 1987, SIGGRAPH.

[23]  Michael M. Kazhdan,et al.  Screened poisson surface reconstruction , 2013, TOGS.

[24]  Herbert Lank.  Lights , 2000 .

[25]  Steven M. Seitz,et al.  Photo tourism: exploring photo collections in 3D , 2006, ACM Trans. Graph..

[26]  E. Cook,et al.  THE SMOOTHING SPLINE: A NEW APPROACH TO STANDARDIZING FOREST INTERIOR TREE -RING WIDTH SERIES FOR DENDROCLIMATIC STUDIES , 1981 .

[27]  Bernhard Höfle,et al.  Radiometric Correction of Terrestrial LiDAR Point Cloud Data for Individual Maize Plant Detection , 2014, IEEE Geoscience and Remote Sensing Letters.

[28]  Jangmyung Lee,et al.  In Situ 3D Segmentation of Individual Plant Leaves Using a RGB-D Camera for Agricultural Automation , 2015, Sensors.

[29]  Pierre Alliez,et al.  A Survey of Surface Reconstruction from Point Clouds , 2017, Comput. Graph. Forum.

[30]  Yong-Jin Liu,et al.  Cylinder Detection in Large-Scale Point Cloud of Pipeline Plant , 2013, IEEE Transactions on Visualization and Computer Graphics.

[31]  Pankaj Kumar,et al.  High-throughput 3D reconstruction of plant shoots for phenotyping , 2014, 2014 13th International Conference on Control Automation Robotics & Vision (ICARCV).