The 3-dimensional Plant Organs Point Clouds Classification for the Phenotyping Application based on CNNs.

The rice breeding produces the high-throughput via a genotyping technology. It can rapidly test and analyze on a large number of samples while the performance of phenotypic evaluation is still very low because of the manually evaluation. Therefore, this is the main barrier retarding the new rice varieties development. This research is aimed to develop a method for classifying plant organs from 3D point cloud in order to analyze plant morphology or architecture automatically. The rice plant was scanned with a 3D laser scan machine. The points in the cloud were reduced by the skeleton skimming method because the number of points in each cloud group is too large. Thus, it is necessary to preprocess before importing into neural networks for classification. The PointNet was selected as the 3D classifier in this research. The first experiment was conducted in order to evaluate the proposed method. The result showed that the proposed method can classify rice organs, regardless of rice varieties, with accuracy of 87.04%. Then, the second experiment was conducted in order to obtain the accuracy of the network for each rice variety to demonstrate the influence of rice cultivars in the classification due to their different shapes. The results showed that the SPRLR, which had large numbers of leaves and yield, has the lowest accuracy of 51.61% while the other varieties with the greater leaf and panicle distribution have a much better accuracy. The Nieow dum had 91.16% accuracy while Jae hwa, Kaow lueng and Kam had 89.06%, 86.52% and 75.22% accuracy respectively.

[1]  Junjie Cao,et al.  Point Cloud Skeletons via Laplacian Based Contraction , 2010, 2010 Shape Modeling International Conference.

[2]  Olivier Salvado,et al.  Automated 3D Segmentation and Analysis of Cotton Plants , 2011, 2011 International Conference on Digital Image Computing: Techniques and Applications.

[3]  T. Setter Analysis of Constituents for Phenotyping Drought Tolerance in Crop Improvement , 2012, Front. Physio..

[4]  Heiner Kuhlmann,et al.  Surface feature based classification of plant organs from 3D laserscanned point clouds for plant phenotyping , 2013, BMC Bioinformatics.

[5]  Leonidas J. Guibas,et al.  PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Space , 2017, NIPS.

[6]  U. Schurr,et al.  Leaf development in Ricinus communis during drought stress: dynamics of growth processes, of cellular structure and of sink-source transition. , 2000, Journal of experimental botany.

[7]  Mohammed Bennamoun,et al.  NormalNet: A voxel-based CNN for 3D object classification and retrieval , 2019, Neurocomputing.

[8]  Junsong Yuan,et al.  Hand PointNet: 3D Hand Pose Estimation Using Point Sets , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[9]  Leonidas J. Guibas,et al.  PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[10]  Jiajun Wu,et al.  Synthesizing 3D Shapes via Modeling Multi-view Depth Maps and Silhouettes with Deep Generative Networks , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[11]  Zygmunt Pizlo,et al.  Skeleton Extraction from 3D Point Clouds by Decomposing the Object into Parts , 2019, ArXiv.

[12]  Xinyu Guo,et al.  An Accurate Skeleton Extraction Approach From 3D Point Clouds of Maize Plants , 2019, Front. Plant Sci..