An automated, high-throughput plant phenotyping system using machine learning-based plant segmentation and image analysis

A high-throughput plant phenotyping system automatically observes and grows many plant samples. Many plant sample images are acquired by the system to determine the characteristics of the plants (populations). Stable image acquisition and processing is very important to accurately determine the characteristics. However, hardware for acquiring plant images rapidly and stably, while minimizing plant stress, is lacking. Moreover, most software cannot adequately handle large-scale plant imaging. To address these problems, we developed a new, automated, high-throughput plant phenotyping system using simple and robust hardware, and an automated plant-imaging-analysis pipeline consisting of machine-learning-based plant segmentation. Our hardware acquires images reliably and quickly and minimizes plant stress. Furthermore, the images are processed automatically. In particular, large-scale plant-image datasets can be segmented precisely using a classifier developed using a superpixel-based machine-learning algorithm (Random Forest), and variations in plant parameters (such as area) over time can be assessed using the segmented images. We performed comparative evaluations to identify an appropriate learning algorithm for our proposed system, and tested three robust learning algorithms. We developed not only an automatic analysis pipeline but also a convenient means of plant-growth analysis that provides a learning data interface and visualization of plant growth trends. Thus, our system allows end-users such as plant biologists to analyze plant growth via large-scale plant image data easily.

[1]  S. N. Geethalakshmi,et al.  A Novel Approach for Plant Leaf Image Segmentation using Fuzzy Clustering , 2012 .

[2]  C. Klukas,et al.  Dissecting the Phenotypic Components of Crop Plant Growth and Drought Responses Based on High-Throughput Image Analysis[W][OPEN] , 2014, Plant Cell.

[3]  M. Tester,et al.  High-throughput phenotyping of plant shoots. , 2012, Methods in molecular biology.

[4]  Jan F. Humplík,et al.  Automated phenotyping of plant shoots using imaging methods for analysis of plant stress responses – a review , 2015, Plant Methods.

[5]  Mark A. Friedl,et al.  Digital repeat photography for phenological research in forest ecosystems , 2012 .

[6]  Jinhai Cai,et al.  Novel Image Segmentation Based on Machine Learning and Its Application to Plant Analysis , 2011 .

[7]  Wolfgang Woelker Image segmentation based on an adaptive 3D analysis of the CIE-L*a*b* color space , 1996, Other Conferences.

[8]  Xu Wang,et al.  Development of a field-based high-throughput mobile phenotyping platform , 2016, Comput. Electron. Agric..

[9]  Li Minzan,et al.  Measurement of Tomato Leaf Area Using Computer Image Processing Technology , 2010 .

[10]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[11]  Martín Abadi,et al.  TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems , 2016, ArXiv.

[12]  Ashutosh Kumar Singh,et al.  Machine Learning for High-Throughput Stress Phenotyping in Plants. , 2016, Trends in plant science.

[13]  O. Loudet,et al.  Phenoscope: an automated large-scale phenotyping platform offering high spatial homogeneity. , 2013, The Plant journal : for cell and molecular biology.

[14]  Yufeng Ge,et al.  A multi-sensor system for high throughput field phenotyping in soybean and wheat breeding , 2016, Comput. Electron. Agric..

[15]  J. Araus,et al.  Field high-throughput phenotyping: the new crop breeding frontier. , 2014, Trends in plant science.

[16]  Samuel Madden,et al.  From Databases to Big Data , 2012, IEEE Internet Comput..

[17]  Pedro J. Navarro,et al.  Machine Learning and Computer Vision System for Phenotype Data Acquisition and Analysis in Plants , 2016, Sensors.

[18]  Stephen M. Welch,et al.  Plant high-throughput phenotyping using photogrammetry and imaging techniques to measure leaf length and rosette area , 2016, Comput. Electron. Agric..

[19]  Falk Schreiber,et al.  HTPheno: An image analysis pipeline for high-throughput plant phenotyping , 2011, BMC Bioinformatics.

[20]  Andrea Pitzschke,et al.  Emerging MAP kinase pathways in plant stress signalling. , 2005, Trends in plant science.

[21]  D. Leister,et al.  Large-scale evaluation of plant growth in Arabidopsis thaliana by non-invasive image analysis , 1999 .

[22]  M. Tester,et al.  Phenomics--technologies to relieve the phenotyping bottleneck. , 2011, Trends in plant science.

[23]  Rich Caruana,et al.  An empirical comparison of supervised learning algorithms , 2006, ICML.

[24]  C. Robertson McClung,et al.  Plant Circadian Rhythms , 2006, The Plant Cell Online.

[25]  Igor Grigoriev,et al.  A segmentation procedure using colour features applied to images of Arabidopsis thaliana. , 2013, Functional plant biology : FPB.

[26]  Philippe Lucidarme,et al.  On the use of depth camera for 3D phenotyping of entire plants , 2012 .

[27]  Yu Jiang,et al.  High throughput phenotyping of cotton plant height using depth images under field conditions , 2016, Comput. Electron. Agric..

[28]  Pascal Fua,et al.  SLIC Superpixels Compared to State-of-the-Art Superpixel Methods , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[29]  M. W Gardner,et al.  Artificial neural networks (the multilayer perceptron)—a review of applications in the atmospheric sciences , 1998 .

[30]  Michael A. Crimmins,et al.  Monitoring Plant Phenology Using Digital Repeat Photography , 2008, Environmental management.

[31]  Ulrich Schurr,et al.  Future scenarios for plant phenotyping. , 2013, Annual review of plant biology.

[32]  Licheng Jiao,et al.  The image segmentation based on optimized spatial feature of superpixel , 2015, J. Vis. Commun. Image Represent..

[33]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[34]  N. Yazdanbakhsh,et al.  High throughput phenotyping of root growth dynamics, lateral root formation, root architecture and root hair development enabled by PlaRoM. , 2009, Functional plant biology : FPB.

[35]  Mark Goadrich,et al.  The relationship between Precision-Recall and ROC curves , 2006, ICML.

[36]  B. Mueller‐Roeber,et al.  A growth phenotyping pipeline for Arabidopsis thaliana integrating image analysis and rosette area modeling for robust quantification of genotype effects. , 2011, The New phytologist.