Latent Space Phenotyping: Automatic Image-Based Phenotyping for Treatment Studies

Association mapping studies have enabled researchers to identify candidate loci for many important environmental resistance factors, including agronomically relevant resistance traits in plants. However, traditional genome-by-environment studies such as these require a phenotyping pipeline which is capable of accurately measuring stress responses, typically in an automated high-throughput context using image processing. In this work, we present Latent Space Phenotyping (LSP), a novel phenotyping method which is able to automatically detect and quantify response-to-treatment directly from images. We demonstrate example applications using data from an interspecific cross of the model C4 grass Setaria, a diversity panel of Sorghum (S. bicolor), and the founder panel for a nested association mapping population of Canola (Brassica napus L.). Using two synthetically generated image datasets, we then show that LSP is able to successfully recover the simulated resistance QTL in both simple and complex synthetic imagery. We propose LSP as an alternative to traditional image analysis methods for phenotyping, enabling the phenotyping of arbitrary and potentially complex response traits without the need for engineering complicated image processing pipelines.

[1]  Tony P. Pridmore,et al.  RootNav 2.0: Deep learning for automatic navigation of complex plant root architectures , 2019, bioRxiv.

[2]  S. S. Wilks.  CERTAIN GENERALIZATIONS IN THE ANALYSIS OF VARIANCE , 1932 .

[3]  Avi C. Knecht,et al.  Integrating Image-Based Phenomics and Association Analysis to Dissect the Genetic Architecture of Temporal Salinity Responses in Rice1[OPEN] , 2015, Plant Physiology.

[4]  Max Welling,et al.  Auto-Encoding Variational Bayes , 2013, ICLR.

[5]  A. M. Edwards,et al.  Utilization of a high-throughput shoot imaging system to examine the dynamic phenotypic responses of a C4 cereal crop plant to nitrogen and water deficiency over time , 2015, Journal of experimental botany.

[6]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[7]  Przemyslaw Prusinkiewicz,et al.  The use of plant models in deep learning: an application to leaf counting in rosette plants , 2018, Plant Methods.

[8]  Thomas Brox,et al.  Striving for Simplicity: The All Convolutional Net , 2014, ICLR.

[9]  Malia A. Gehan,et al.  Lights, camera, action: high-throughput plant phenotyping is ready for a close-up. , 2015, Current opinion in plant biology.

[10]  Ian Stavness,et al.  Deep Plant Phenomics: A Deep Learning Platform for Complex Plant Phenotyping Tasks , 2017, Front. Plant Sci..

[11]  Zhiguo Cao,et al.  TasselNet: counting maize tassels in the wild via local counts regression network , 2017, Plant Methods.

[12]  Samuli Laine,et al.  Feature-Based Metrics for Exploring the Latent Space of Generative Models , 2018, ICLR.

[13]  Mao Li,et al.  The Persistent Homology Mathematical Framework Provides Enhanced Genotype-to-Phenotype Associations for Plant Morphology1[OPEN] , 2018, Plant Physiology.

[14]  Marcel Salathé,et al.  Using Deep Learning for Image-Based Plant Disease Detection , 2016, Front. Plant Sci..

[15]  J. Borevitz,et al.  Deep Phenotyping: Deep Learning for Temporal Phenotype/Genotype Classification , 2017, bioRxiv.

[16]  M. Tester,et al.  Phenomics--technologies to relieve the phenotyping bottleneck. , 2011, Trends in plant science.

[17]  Jeffrey C. Berry,et al.  High‐throughput profiling and analysis of plant responses over time to abiotic stress , 2017, bioRxiv.

[18]  Andreas Kamilaris,et al.  Deep learning in agriculture: A survey , 2018, Comput. Electron. Agric..

[19]  Malia A. Gehan,et al.  Components of Water Use Efficiency Have Unique Genetic Signatures in the Model C4 Grass Setaria1[OPEN] , 2018, Plant Physiology.

[20]  D. Leister,et al.  Large-scale evaluation of plant growth in Arabidopsis thaliana by non-invasive image analysis , 1999 .

[21]  A. Auton,et al.  Genome-wide patterns of genetic variation in worldwide Arabidopsis thaliana accessions from the RegMap panel , 2011, Nature Genetics.

[22]  Loïc Pagès,et al.  Using a structural root system model to evaluate and improve the accuracy of root image analysis pipelines , 2016, bioRxiv.

[23]  R. Richards,et al.  Variation between and within Species of Rapeseed (Brassica campestris and B. napus) in Response to Drought Stress. I Sensitivity at Different Stages of Development , 1978 .

[24]  Ashutosh Kumar Singh,et al.  Deep Learning for Plant Stress Phenotyping: Trends and Future Perspectives. , 2018, Trends in plant science.

[25]  Mohammad Najafi,et al.  Deep phenotyping: deep learning for temporal phenotype/genotype classification , 2017, Plant Methods.

[26]  S. Oliver,et al.  Estimating the total number of phosphoproteins and phosphorylation sites in eukaryotic proteomes , 2017, GigaScience.

[27]  Hui Jiang,et al.  Time dependent genetic analysis links field and controlled environment phenotypes in the model C4 grass Setaria , 2016, bioRxiv.

[28]  M. Bahrani,et al.  Yield and yield components of rapeseed as influenced by water stress at different growth stages and nitrogen levels. , 2009 .

[29]  L. Champolivier,et al.  Effects of water stress applied at different growth stages to Brassica napus L. var. oleifera on yield, yield components and seed quality , 1996 .

[30]  Ying Liu,et al.  FaST linear mixed models for genome-wide association studies , 2011, Nature Methods.

[31]  Philip H. S. Torr,et al.  Recurrent Instance Segmentation , 2015, ECCV.

[32]  Justin O Borevitz,et al.  Genome-wide association studies in plants: the missing heritability is in the field , 2011, Genome Biology.

[33]  James C. Schnable,et al.  Mapping of Quantitative Trait Locus (QTLs) that Contribute to Germination and Early Seedling Drought Tolerance in the Interspecific Cross Setaria italica×Setaria viridis , 2014, PloS one.

[34]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[35]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[36]  V. Kshirsagar,et al.  Face recognition using Eigenfaces , 2011, 2011 3rd International Conference on Computer Research and Development.

[37]  Lars Kai Hansen,et al.  Latent Space Oddity: on the Curvature of Deep Generative Models , 2017, ICLR.

[38]  J. Din,et al.  Physiological and agronomic response of canola varieties to drought stress. , 2011 .

[39]  H. Scharr,et al.  A stereo imaging system for measuring structural parameters of plant canopies. , 2007, Plant, cell & environment.

[40]  Tony P. Pridmore,et al.  Deep machine learning provides state-of-the-art performance in image-based plant phenotyping , 2016, bioRxiv.

[41]  I. Xenarios,et al.  Measuring the diurnal pattern of leaf hyponasty and growth in Arabidopsis - a novel phenotyping approach using laser scanning. , 2012, Functional plant biology : FPB.