Automatic Traits Extraction and Fitting for Field High-throughput Phenotyping Systems

High-throughput phenotyping is a modern technology to measure plant traits efficiently and in large scale by imaging systems over the whole growth season. Those images provide rich data for statistical analysis of plant phenotypes. We propose a pipeline to extract and analyze the plant traits for field phenotyping systems. The proposed pipeline include the following main steps: plant segmentation from field images, automatic calculation of plant traits from the segmented images, and functional curve fitting for the extracted traits. To deal with the challenging problem of plant segmentation for field images, we propose a novel approach on image pixel classification by transform domain neural network models, which utilizes plant pixels from greenhouse images to train a segmentation model for field images. Our results show the proposed procedure is able to accurately extract plant heights and is more stable than results from Amazon Turks, who manually measure plant heights from original images.

[1]  Ronghao Wang,et al.  A High-Throughput Phenotyping Pipeline for Image Processing and Functional Growth Curve Analysis , 2020, Plant phenomics.

[2]  E. R. Davies.  Computer and Machine Vision: Theory, Algorithms, Practicalities , 2012 .

[3]  Yumou Qiu,et al.  Functional Modeling of Plant Growth Dynamics , 2017, bioRxiv.

[4]  M. Liu,et al.  A high-throughput stereo-imaging system for quantifying rape leaf traits during the seedling stage , 2017, Plant Methods.

[5]  Yi Lin,et al.  LiDAR: An important tool for next-generation phenotyping technology of high potential for plant phenomics? , 2015, Comput. Electron. Agric..

[6]  Anup Vibhute,et al.  Applications of Image Processing in Agriculture: A Survey , 2012 .

[7]  Chenyong Miao,et al.  Optimising the identification of causal variants across varying genetic architectures in crops , 2018, bioRxiv.

[8]  M. Tester,et al.  Image-based phenotyping for non-destructive screening of different salinity tolerance traits in rice , 2014, Rice.

[9]  Charles E. Heckler,et al.  Applied Multivariate Statistical Analysis , 2005, Technometrics.

[10]  James C. Schnable,et al.  Plant segmentation by supervised machine learning methods , 2020, The Plant Phenome Journal.

[11]  Andy Lin,et al.  PlantCV v2: Image analysis software for high-throughput plant phenotyping , 2017, PeerJ.

[12]  Malia A. Gehan,et al.  Lights, camera, action: high-throughput plant phenotyping is ready for a close-up. , 2015, Current opinion in plant biology.

[13]  Falk Schreiber,et al.  HTPheno: An image analysis pipeline for high-throughput plant phenotyping , 2011, BMC Bioinformatics.

[14]  Ryan F. McCormick,et al.  3D Sorghum Reconstructions from Depth Images Identify QTL Regulating Shoot Architecture1[OPEN] , 2016, Plant Physiology.

[15]  Zheng Xu,et al.  Simulated Plant Images Improve Maize Leaf Counting Accuracy , 2019, bioRxiv.

[16]  Karen A. F. Copeland.  Local Polynomial Modelling and its Applications , 1997 .

[17]  Zhiguo Cao,et al.  TasselNet: counting maize tassels in the wild via local counts regression network , 2017, Plant Methods.

[18]  H. Dette,et al.  A simple nonparametric estimator of a strictly monotone regression function , 2006 .

[19]  Philippe Lucidarme,et al.  On the use of depth camera for 3D phenotyping of entire plants , 2012 .

[20]  HamudaEsmael,et al.  A survey of image processing techniques for plant extraction and segmentation in the field , 2016 .

[21]  Christian Klukas,et al.  Integrated Analysis Platform: An Open-Source Information System for High-Throughput Plant Phenotyping1[C][W][OPEN] , 2014, Plant Physiology.

[22]  Ashok Samal,et al.  Holistic and component plant phenotyping using temporal image sequence , 2018, Plant Methods.

[23]  Jianqing Fan.  Local Polynomial Modelling and Its Applications: Monographs on Statistics and Applied Probability 66 , 1996 .

[24]  G. Wahba.  Spline models for observational data , 1990 .

[25]  Yufeng Ge,et al.  Temporal dynamics of maize plant growth, water use, and leaf water content using automated high throughput RGB and hyperspectral imaging , 2016, Comput. Electron. Agric..

[26]  Shubhra Aich,et al.  DeepWheat: Estimating Phenotypic Traits from Crop Images with Deep Learning , 2017, 2018 IEEE Winter Conference on Applications of Computer Vision (WACV).