A robot-assisted imaging pipeline for tracking the growths of maize ear and silks in a high-throughput phenotyping platform

AbstractBackgroundIn maize, silks are hundreds of filaments that simultaneously emerge from the ear for collecting pollen over a period of 1–7 days, which largely determines grain number especially under water deficit. Silk growth is a major trait for drought tolerance in maize, but its phenotyping is difficult at throughputs needed for genetic analyses.ResultsWe have developed a reproducible pipeline that follows ear and silk growths every day for hundreds of plants, based on an ear detection algorithm that drives a robotized camera for obtaining detailed images of ears and silks. We first select, among 12 whole-plant side views, those best suited for detecting ear position. Images are segmented, the stem pixels are labelled and the ear position is identified based on changes in width along the stem. A mobile camera is then automatically positioned in real time at 30 cm from the ear, for a detailed picture in which silks are identified based on texture and colour. This allows analysis of the time course of ear and silk growths of thousands of plants. The pipeline was tested on a panel of 60 maize hybrids in the PHENOARCH phenotyping platform. Over 360 plants, ear position was correctly estimated in 86% of cases, before it could be visually assessed. Silk growth rate, estimated on all plants, decreased with time consistent with literature. The pipeline allowed clear identification of the effects of genotypes and water deficit on the rate and duration of silk growth.ConclusionsThe pipeline presented here, which combines computer vision, machine learning and robotics, provides a powerful tool for large-scale genetic analyses of the control of reproductive growth to changes in environmental conditions in a non-invasive and automatized way. It is available as Open Source software in the OpenAlea platform.

[1]  Christian Klukas,et al.  Integrated Analysis Platform: An Open-Source Information System for High-Throughput Plant Phenotyping1[C][W][OPEN] , 2014, Plant Physiology.

[2]  Fiona Corke,et al.  Image-based estimation of oat panicle development using local texture patterns. , 2015, Functional plant biology : FPB.

[3]  Gregory O. Edmeades,et al.  Eight cycles of selection for drought tolerance in lowland tropical maize. III. Responses in drought-adaptive physiological and morphological traits , 1993 .

[4]  Bruno Andrieu,et al.  Maize Leaves Turn Away from Neighbors1 , 2002, Plant Physiology.

[5]  L. Xiong,et al.  Determination of rice panicle numbers during heading by multi-angle imaging , 2015 .

[6]  François Tardieu,et al.  Ovary Apical Abortion under Water Deficit Is Caused by Changes in Sequential Development of Ovaries and in Silk Growth Rate in Maize1[OPEN] , 2015, Plant Physiology.

[7]  Michael P. Pound,et al.  Approaches to three-dimensional reconstruction of plant shoot topology and geometry. , 2016, Functional plant biology : FPB.

[8]  G. Bernier,et al.  Effect of environment on the early steps of ear initiation in maize (Zea mays L.) , 1996 .

[9]  Edsger W. Dijkstra,et al.  A note on two problems in connexion with graphs , 1959, Numerische Mathematik.

[10]  P. Bassetti,et al.  Floral asynchrony and kernel set in maize quantified by image analysis , 1994 .

[11]  Mark E. Westgate,et al.  Emergence, Elongation, and Senescence of Maize Silks , 1993 .

[12]  Xavier Sirault,et al.  Phenomenal: a software framework for model-assisted analysis of high throughput plant phenotyping data , 2015 .

[13]  Ross A Frick,et al.  Accurate inference of shoot biomass from high-throughput images of cereal plants , 2011, Plant Methods.

[14]  Joseph L. Gage,et al.  TIPS: a system for automated image-based phenotyping of maize tassels , 2017, Plant Methods.

[15]  Minzan Li,et al.  Corn tassel detection based on image processing , 2011, International Workshop on Image Processing and Optical Engineering.

[16]  Jean-Marcel Ribaut,et al.  Drought phenotyping in crops: From theory to practice. , 2014 .

[17]  Heiner Kuhlmann,et al.  Surface feature based classification of plant organs from 3D laserscanned point clouds for plant phenotyping , 2013, BMC Bioinformatics.

[18]  B. Andrieu,et al.  Silk Elongation in Maize , 2003 .

[19]  Eric Lebon,et al.  Abscisic Acid Down-Regulates Hydraulic Conductance of Grapevine Leaves in Isohydric Genotypes Only1[OPEN] , 2017, Plant Physiology.

[20]  C. Fournier,et al.  High-throughput estimation of incident light, light interception and radiation-use efficiency of thousands of plants in a phenotyping platform. , 2015, The New phytologist.

[21]  T. Pridmore,et al.  Plant Phenomics, From Sensors to Knowledge , 2017, Current Biology.

[22]  Falk Schreiber,et al.  HTPheno: An image analysis pipeline for high-throughput plant phenotyping , 2011, BMC Bioinformatics.

[23]  Samuel B. Williams,et al.  ASSOCIATION FOR COMPUTING MACHINERY , 2000 .

[24]  Patrick Valduriez,et al.  OpenAlea: scientific workflows combining data analysis and simulation , 2015, SSDBM.

[25]  Ryan F. McCormick,et al.  3D Sorghum Reconstructions from Depth Images Identify QTL Regulating Shoot Architecture1[OPEN] , 2016, Plant Physiology.

[26]  S. Chapman,et al.  Dynamic quantification of canopy structure to characterize early plant vigour in wheat genotypes , 2016, Journal of experimental botany.

[27]  C. Fournier,et al.  OpenAlea: a visual programming and component-based software platform for plant modelling. , 2008, Functional plant biology : FPB.

[28]  J. Léon,et al.  High-precision laser scanning system for capturing 3D plant architecture and analysing growth of cereal plants , 2014 .

[29]  Xavier Armangué,et al.  A comparative review of camera calibrating methods with accuracy evaluation , 2002, Pattern Recognit..

[30]  David R. Swanson,et al.  Image Harvest: an open-source platform for high-throughput plant image processing and analysis , 2016, Journal of experimental botany.

[31]  François Tardieu,et al.  Drought-induced changes in anthesis-silking interval are related to silk expansion: a spatio-temporal growth analysis in maize plants subjected to soil water deficit. , 2008, Plant, cell & environment.

[32]  Michael P. Pound,et al.  Image-based 3D canopy reconstruction to determine potential productivity in complex multi-species crop systems , 2017, Annals of botany.

[33]  Evelyne Costes,et al.  Genetic Variation of Morphological Traits and Transpiration in an Apple Core Collection under Well-Watered Conditions: Towards the Identification of Morphotypes with High Water Use Efficiency , 2015, PloS one.

[34]  G. Edmeades,et al.  Causes for Silk Delay in a Lowland Tropical Maize Population , 1993 .

[35]  Jean-Marcel Ribaut,et al.  The Role and Regulation of the Anthesis‐Silking Interval in Maize , 2000 .

[36]  Calvin R. Maurer,et al.  A Linear Time Algorithm for Computing Exact Euclidean Distance Transforms of Binary Images in Arbitrary Dimensions , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[37]  Ullrich Köthe,et al.  Ilastik: Interactive learning and segmentation toolkit , 2011, 2011 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[38]  Alexander G. Fletcher,et al.  Morphological Plant Modeling: Unleashing Geometric and Topological Potential within the Plant Sciences , 2017, bioRxiv.

[39]  M. Hinich,et al.  A Simple Method for Robust Regression , 1975 .

[40]  François Tardieu,et al.  The growth of vegetative and reproductive structures (leaves and silks) respond similarly to hydraulic cues in maize. , 2016, The New phytologist.

[41]  R Core Team,et al.  R: A language and environment for statistical computing. , 2014 .

[42]  Wei-Yin Loh,et al.  Classification and regression trees , 2011, WIREs Data Mining Knowl. Discov..

[43]  Fred L. Drake,et al.  The Python Language Reference Manual , 1999 .

[44]  Emmanuelle Gouillart,et al.  scikit-image: image processing in Python , 2014, PeerJ.

[45]  Matthijs Tollenaar,et al.  Effects of intraspecific interference on maize leaf azimuth , 1994 .

[46]  Eric Lebon,et al.  Reduced nighttime transpiration is a relevant breeding target for high water-use efficiency in grapevine , 2016, Proceedings of the National Academy of Sciences.

[47]  Mark E. Westgate,et al.  Synchronous pollination within and between ears improves kernel set in maize , 2000 .

[48]  Grégoire M. Hummel,et al.  LeasyScan: a novel concept combining 3D imaging and lysimetry for high-throughput phenotyping of traits controlling plant water budget , 2015, Journal of experimental botany.

[49]  José Crossa,et al.  High-throughput phenotyping and genomic selection: the frontiers of crop breeding converge. , 2012, Journal of integrative plant biology.

[50]  Llorenç Cabrera-Bosquet,et al.  Genetic variation in a grapevine progeny (Vitis vinifera L. cvs Grenache×Syrah) reveals inconsistencies between maintenance of daytime leaf water potential and response of transpiration rate under drought , 2014, Journal of experimental botany.

[51]  H. Scharr,et al.  phenoSeeder - A Robot System for Automated Handling and Phenotyping of Individual Seeds1[OPEN] , 2016, Plant Physiology.

[52]  Shamik Sural,et al.  Segmentation and histogram generation using the HSV color space for image retrieval , 2002, Proceedings. International Conference on Image Processing.

[53]  David W. Bacon,et al.  Estimating the transition between two intersecting straight lines , 1971 .

[54]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[55]  Hai Guo,et al.  2012 International Workshop on Image Processing and Optical Engineering , 2012 .

[56]  史蒂文·R·安德森,et al.  Methods for counting corn silks or other plural elongated strands and use of the count for characterizing the strands or their origin , 2009 .