Roadmap to High Throughput Phenotyping for Plant Breeding

Background Population growth and climate uncertainty increase the demand for more food to feed the world. Finding a new variety and discovering novel genetic traits that confer stress tolerance will be a game changer in future crop production for sustainable agriculture. Developing and implementing high throughput phenotyping (HTP) technologies and skills become increasingly important to those involved with applying genomics in breeding and biotechnology research. Many institutes and private companies are initiating HTP programs to improve the quality and speed of plant breeding and biotechnology. Breeders and plant scientists need to secure solid data pipelines of phenotypes throughout years-long breeding programs, but they lack an engineering background on sensors, image processing, data management, and cloud-running architecture. Purpose There are a series of components and steps that must be considered for HTP programs to meet their needs and goals. Those components include sensors, platforms, analytics, and data management. The aim of this paper is to address key information of what plant breeding is, why HTP is important, and how the HTP system is designed. Review The paper describes background of plant science to engineering to enlighten the need of HTP and provides a review of the current HTP systems and future strategies. Discussion includes specifics of each HTP component to consider and a roadmap to HTP for plant breeding throughout genetics, phenotypic metrics, algorithm development, data standardization, and scale-up.

[1]  Christian Klukas,et al.  Integrated Analysis Platform: An Open-Source Information System for High-Throughput Plant Phenotyping1[C][W][OPEN] , 2014, Plant Physiology.

[2]  K Aljarallah,et al.  The Design of Cognitive-based Navigation Aids for better Online Interaction , 2016 .

[3]  Korbinian Schneeberger,et al.  The impact of third generation genomic technologies on plant genome assembly. , 2017, Current opinion in plant biology.

[4]  Jeffrey W. White,et al.  Development and evaluation of a field-based high-throughput phenotyping platform. , 2013, Functional plant biology : FPB.

[5]  Ronald L. Phillips,et al.  Mobilizing Science to Break Yield Barriers , 2010 .

[6]  William R. Raun,et al.  By‐Plant Prediction of Corn Forage Biomass and Nitrogen Uptake at Various Growth Stages Using Remote Sensing and Plant Height , 2007 .

[7]  F. Baret,et al.  A semi-automatic system for high throughput phenotyping wheat cultivars in-field conditions: description and first results. , 2012, Functional plant biology : FPB.

[8]  B. N. Chatterji,et al.  An FFT-based technique for translation, rotation, and scale-invariant image registration , 1996, IEEE Trans. Image Process..

[9]  D. Laurie,et al.  The production of haploid wheat plants from wheat x maize crosses , 1988, Theoretical and Applied Genetics.

[10]  Phenotyping of Low-Temperature Stressed Pepper Seedlings Using Infrared Thermography , 2017 .

[11]  Kelly R. Thorp,et al.  High-Throughput Phenotyping of Crop Water Use Efficiency via Multispectral Drone Imagery and a Daily Soil Water Balance Model , 2018, Remote. Sens..

[12]  W. Philips,et al.  Rosette Tracker: An Open Source Image Analysis Tool for Automatic Quantification of Genotype Effects1[C][W] , 2012, Plant Physiology.

[13]  Rob Kooper,et al.  Data Flow for the TERRA-REF project , 2017 .

[14]  Arno Ruckelshausen,et al.  BreedVision — A Multi-Sensor Platform for Non-Destructive Field-Based Phenotyping in Plant Breeding , 2013, Sensors.

[15]  M. Tester,et al.  Breeding crops to feed 10 billion , 2019, Nature Biotechnology.

[16]  Albrecht E. Melchinger,et al.  High-throughput non-destructive biomass determination during early plant development in maize under field conditions , 2011 .

[17]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[18]  S. Govindarajulu,et al.  A Comparison of SIFT, PCA-SIFT and SURF , 2012 .

[19]  Samuel Thomas,et al.  Management and Characterization of Abiotic Stress via PhénoField®, a High-Throughput Field Phenotyping Platform , 2019, Front. Plant Sci..

[20]  Junho Yeom,et al.  Automated Open Cotton Boll Detection for Yield Estimation Using Unmanned Aircraft Vehicle (UAV) Data , 2018, Remote. Sens..

[21]  Chenghai Yang,et al.  Low-cost single-camera imaging system for aerial applicators , 2015 .

[22]  M. Tester,et al.  High-throughput shoot imaging to study drought responses. , 2010, Journal of experimental botany.

[23]  A. Walter,et al.  Plant phenotyping: from bean weighing to image analysis , 2015, Plant Methods.

[24]  FattalRaanan,et al.  Gradient domain high dynamic range compression , 2002 .

[25]  Svend Christensen,et al.  Development of a Mobile Multispectral Imaging Platform for Precise Field Phenotyping , 2014 .

[26]  Pedro Andrade-Sanchez,et al.  Comparing Nadir and Multi-Angle View Sensor Technologies for Measuring in-Field Plant Height of Upland Cotton , 2019, Remote. Sens..

[27]  Craig Willis,et al.  TERRA-REF Data Processing Infrastructure , 2018, PEARC.

[28]  U. Schurr,et al.  Plant Phenotyping: Past, Present, and Future , 2019, Plant phenomics.

[29]  Szymon Rusinkiewicz,et al.  Estimating the Laplace‐Beltrami Operator by Restricting 3D Functions , 2009, Comput. Graph. Forum.

[30]  Jeffrey W. White,et al.  A Flexible, Low‐Cost Cart for Proximal Sensing , 2013 .

[31]  Jinling Wang,et al.  A NEW APPROACH TO FAST MOSAIC UAV IMAGES , 2012 .

[32]  M. Zaman-Allah,et al.  Translating High-Throughput Phenotyping into Genetic Gain , 2018, Trends in plant science.

[33]  Chunxiao Gao,et al.  A Real-time Stitching Algorithm for UAV Aerial Images , 2013 .

[34]  M. Tester,et al.  High-Throughput Phenotyping to Detect Drought Tolerance QTL in Wild Barley Introgression Lines , 2014, PloS one.

[35]  Jorge Torres-Sánchez,et al.  High-Throughput Phenotyping of Bioethanol Potential in Cereals Using UAV-Based Multi-Spectral Imagery , 2019, Front. Plant Sci..

[36]  F. Baret,et al.  A High-Throughput Model-Assisted Method for Phenotyping Maize Green Leaf Area Index Dynamics Using Unmanned Aerial Vehicle Imagery , 2019, Front. Plant Sci..

[37]  Shmuel Peleg,et al.  Seamless Image Stitching in the Gradient Domain , 2004, ECCV.

[38]  Quan Xu,et al.  A Robust Method for Automatic Panoramic UAV Image Mosaic , 2019, Sensors.

[39]  Malia A. Gehan,et al.  A Versatile Phenotyping System and Analytics Platform Reveals Diverse Temporal Responses to Water Availability in Setaria. , 2015, Molecular plant.

[40]  Pedro Andrade-Sanchez,et al.  Deploying a Proximal Sensing Cart to Identify Drought-Adaptive Traits in Upland Cotton for High-Throughput Phenotyping , 2018, Front. Plant Sci..

[41]  Don C. Jones,et al.  Improving the Precision of NDVI Estimates in Upland Cotton Field Trials , 2018 .

[42]  Robert Pless,et al.  High-throughput phenotyping with deep learning gives insight into the genetic architecture of flowering time in wheat , 2019, bioRxiv.

[43]  Zhenlong Li,et al.  Big Data and cloud computing: innovation opportunities and challenges , 2017, Int. J. Digit. Earth.

[44]  Marcel Salathé,et al.  Using Deep Learning for Image-Based Plant Disease Detection , 2016, Front. Plant Sci..

[45]  T Nasser,et al.  Big Data Challenges , 2016 .

[46]  Yan Ke,et al.  PCA-SIFT: a more distinctive representation for local image descriptors , 2004, CVPR 2004.

[47]  Boyan Peshlov,et al.  Scaling up high throughput field phenotyping of corn and soy research plots using ground rovers , 2017, Commercial + Scientific Sensing and Imaging.

[48]  D. Leister,et al.  Large-scale evaluation of plant growth in Arabidopsis thaliana by non-invasive image analysis , 1999 .

[49]  Ross A Frick,et al.  Accurate inference of shoot biomass from high-throughput images of cereal plants , 2011, Plant Methods.

[50]  J. Nieh,et al.  A common neonicotinoid pesticide, thiamethoxam, impairs honey bee flight ability , 2017, Scientific Reports.

[51]  Xu Wang,et al.  Development of a field-based high-throughput mobile phenotyping platform , 2016, Comput. Electron. Agric..

[52]  Kenneth A. Sudduth,et al.  Development of a multi-band sensor for crop temperature measurement , 2019, Comput. Electron. Agric..

[53]  A. Blakeslee,et al.  METHODS OF INDUCING DOUBLING OF CHROMOSOMES IN PLANTS By Treatment With Colchicine , 1937 .

[54]  M. S. Moran,et al.  Remote Sensing for Crop Management , 2003 .

[55]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[56]  Avi C. Knecht,et al.  Integrating Image-Based Phenomics and Association Analysis to Dissect the Genetic Architecture of Temporal Salinity Responses in Rice1[OPEN] , 2015, Plant Physiology.

[57]  Qian Du,et al.  Using High-Resolution Airborne and Satellite Imagery to Assess Crop Growth and Yield Variability for Precision Agriculture , 2013, Proceedings of the IEEE.

[58]  David Michael Glenn,et al.  Characteristics of Active Spectral Sensor for Plant Sensing , 2012 .

[59]  Jochen C Reif,et al.  Novel throughput phenotyping platforms in plant genetic studies. , 2007, Trends in plant science.

[60]  Hanno Scharr,et al.  Machine Learning for Plant Phenotyping Needs Image Processing. , 2016, Trends in plant science.

[61]  M. Hawkesford,et al.  Field Scanalyzer: An automated robotic field phenotyping platform for detailed crop monitoring. , 2016, Functional plant biology : FPB.

[62]  Qin Zhang,et al.  A Review of Imaging Techniques for Plant Phenotyping , 2014, Sensors.

[63]  Ian Stavness,et al.  ProTractor: A Lightweight Ground Imaging and Analysis System for Early-Season Field Phenotyping , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[64]  Flavio Esposito,et al.  UAV-Based High Resolution Thermal Imaging for Vegetation Monitoring, and Plant Phenotyping Using ICI 8640 P, FLIR Vue Pro R 640, and thermoMap Cameras , 2019, Remote. Sens..

[65]  Naiqian Zhang,et al.  Development and Deployment of a Portable Field Phenotyping Platform , 2016 .

[66]  Luc Van Gool,et al.  SURF: Speeded Up Robust Features , 2006, ECCV.

[67]  Dani Lischinski,et al.  Gradient Domain High Dynamic Range Compression , 2023 .

[68]  Yan Zhu,et al.  Rapid Mosaicking of Unmanned Aerial Vehicle (UAV) Images for Crop Growth Monitoring Using the SIFT Algorithm , 2019, Remote. Sens..

[69]  Falk Schreiber,et al.  HTPheno: An image analysis pipeline for high-throughput plant phenotyping , 2011, BMC Bioinformatics.

[70]  Yufeng Ge,et al.  NU-Spidercam: A large-scale, cable-driven, integrated sensing and robotic system for advanced phenotyping, remote sensing, and agronomic research , 2019, Comput. Electron. Agric..

[71]  Alison L. Thompson,et al.  Professor: A motorized field-based phenotyping cart , 2018, HardwareX.

[72]  Bao-Long Guo,et al.  Image Mosaic Based on SIFT , 2008, 2008 International Conference on Intelligent Information Hiding and Multimedia Signal Processing.

[73]  Nadia Shakoor,et al.  Big Data Driven Agriculture: Big Data Analytics in Plant Breeding, Genomics, and the Use of Remote Sensing Technologies to Advance Crop Productivity , 2019, The Plant Phenome Journal.

[74]  M. Tester,et al.  Mechanisms of salinity tolerance. , 2008, Annual review of plant biology.

[75]  Olarik Surinta,et al.  Comparing Local Descriptors and Bags of Visual Words to Deep Convolutional Neural Networks for Plant Recognition , 2017, ICPRAM.

[76]  Sheng Wu,et al.  Maize Plant Phenotyping: Comparing 3D Laser Scanning, Multi-View Stereo Reconstruction, and 3D Digitizing Estimates , 2018, Remote. Sens..

[77]  Jeffrey W. White,et al.  APPROACHES FOR GEOSPATIAL PROCESSING OF FIELD-BASED HIGH-THROUGHPUT PLANT PHENOMICS DATA FROM GROUND VEHICLE PLATFORMS , 2016 .

[78]  Yubin Lan,et al.  Multispectral imaging systems for airborne remote sensing to support agricultural production management , 2010 .

[79]  Deren Li,et al.  A STUDY ON AUTOMATIC UAV IMAGE MOSAIC METHOD FOR PAROXYSMAL DISASTER , 2012 .

[80]  Ian Stavness,et al.  Deep Plant Phenomics: A Deep Learning Platform for Complex Plant Phenotyping Tasks , 2017, Front. Plant Sci..