Image-Based Phenotyping of Flowering Intensity in Cool-Season Crops

The timing and duration of flowering are key agronomic traits that are often associated with the ability of a variety to escape abiotic stress such as heat and drought. Flowering information is valuable in both plant breeding and agricultural production management. Visual assessment, the standard protocol used for phenotyping flowering, is a low-throughput and subjective method. In this study, we evaluated multiple imaging sensors (RGB and multiple multispectral cameras), image resolution (proximal/remote sensing at 1.6 to 30 m above ground level/AGL), and image processing (standard and unsupervised learning) techniques in monitoring flowering intensity of four cool-season crops (canola, camelina, chickpea, and pea) to enhance the accuracy and efficiency in quantifying flowering traits. The features (flower area, percentage of flower area with respect to canopy area) extracted from proximal (1.6–2.2 m AGL) RGB and multispectral (with near infrared, green and blue band) image data were strongly correlated (r up to 0.89) with visual rating scores, especially in pea and canola. The features extracted from unmanned aerial vehicle integrated RGB image data (15–30 m AGL) could also accurately detect and quantify large flowers of winter canola (r up to 0.84), spring canola (r up to 0.72), and pea (r up to 0.72), but not camelina or chickpea flowers. When standard image processing using thresholds and unsupervised machine learning such as k-means clustering were utilized for flower detection and feature extraction, the results were comparable. In general, for applicability of imaging for flower detection, it is recommended that the image data resolution (i.e., ground sampling distance) is at least 2–3 times smaller than that of the flower size. Overall, this study demonstrates the feasibility of utilizing imaging for monitoring flowering intensity in multiple varieties of evaluated crops.

[1]  Sebastian Kipp,et al.  High-throughput phenotyping early plant vigour of winter wheat , 2014 .

[2]  S. Ninomiya,et al.  Automated characterization of flowering dynamics in rice using field-acquired time-series RGB images , 2015, Plant Methods.

[3]  Martin J. Wooster,et al.  High Throughput Field Phenotyping of Wheat Plant Height and Growth Rate in Field Plot Trials Using UAV Based Remote Sensing , 2016, Remote. Sens..

[4]  T. Eisner,et al.  Flavonols: Pigments Responsible for Ultraviolet Absorption in Nectar Guide of Flower , 1972, Science.

[5]  Bruce Forgan,et al.  Estimating ultraviolet radiation at the earth's surface , 1994 .

[6]  D. Tan,et al.  High temperature tolerance in chickpea and its implications for plant improvement , 2012, Crop and Pasture Science.

[7]  N. Troje,et al.  Ultraviolet as a component of flower reflections, and the colour perception of hymenoptera , 1994, Vision Research.

[8]  D. Kahrizi,et al.  Title: Effects of end-season drought stress on yield and yield components of rapeseed (Brassica napus L.) in warm regions of Kermanshah Province , 2015 .

[9]  J. Passioura,et al.  Increasing crop productivity when water is scarce--from breeding to field management , 2006 .

[10]  Zhiguo Cao,et al.  In-field automatic observation of wheat heading stage using computer vision , 2016 .

[11]  R. Sharma Early generation selection for grain-filling period in wheat , 1994 .

[12]  Argelia Lorence,et al.  Engineering plants for tomorrow: how high-throughput phenotyping is contributing to the development of better crops , 2018, Phytochemistry Reviews.

[13]  M. Grusak,et al.  Mineral concentrations of chickpea and lentil cultivars and breeding lines grown in the U.S. Pacific Northwest , 2018, The Crop Journal.

[14]  Yu Jiang,et al.  Aerial Images and Convolutional Neural Network for Cotton Bloom Detection , 2018, Front. Plant Sci..

[15]  Sergei Vassilvitskii,et al.  k-means++: the advantages of careful seeding , 2007, SODA '07.

[16]  Ismail Kavdir,et al.  Detecting corn tassels using computer vision and support vector machines , 2014, Expert Syst. Appl..

[17]  T. Eisner,et al.  Attractive and defensive functions of the ultraviolet pigments of a flower (Hypericum calycinum) , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[18]  Yoel Cohen,et al.  ULTRAVIOLET REFLECTANCE CHARACTERISTICS IN FLOWERS OF CRUCIFERS , 1972 .

[19]  Christian Jung,et al.  Flowering time control and applications in plant breeding. , 2009, Trends in plant science.

[20]  Christian Klukas,et al.  Integrated Analysis Platform: An Open-Source Information System for High-Throughput Plant Phenotyping1[C][W][OPEN] , 2014, Plant Physiology.

[21]  T. B. Daynard,et al.  RELATIONSHIPS BETWEEN LENGTH OF THE ACTUAL AND EFFECTIVE GRAIN FILLING PERIODS AND THE GRAIN YIELD OF CORN , 1976 .

[22]  Meng Joo Er,et al.  Illumination compensation and normalization for robust face recognition using discrete cosine transform in logarithm domain , 2006, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[23]  M. Sedgley,et al.  Development Anatomy in Wheat of Male Sterility Induced by Heat Stress, Water Deficit or Abscisic Acid , 1984 .

[24]  Fantaye Belay,et al.  Agronomic performance evaluation of cowpea [Vigna unguiculata (L.) Walp] varieties in Abergelle District, Northern Ethiopia , 2017 .

[25]  Brane Širok,et al.  Flowering estimation in apple orchards by image analysis , 2013, Precision Agriculture.

[26]  J. Board Physiology of Crop Production , 2007 .

[27]  Alison B. Smith,et al.  GrainScan: a low cost, fast method for grain size and colour measurements , 2014, Plant Methods.

[28]  M. J. Nigam,et al.  Shadow Detection and Removal from Remote Sensing Images using NDI and Morphological Operators , 2012 .

[29]  John J. Sulik,et al.  Spectral considerations for modeling yield of canola , 2016 .

[30]  K. Mclaren XIII—The Development of the CIE 1976 (L* a* b*) Uniform Colour Space and Colour‐difference Formula , 2008 .

[31]  L. Chittka,et al.  The evolution of color vision in insects. , 2001, Annual review of entomology.

[32]  M. Romani,et al.  Farmer-participatory vs. conventional market-oriented breeding of inbred crops using phenotypic and genome-enabled approaches: A pea case study , 2019, Field Crops Research.

[33]  Kelly R. Thorp,et al.  Color image segmentation approach to monitor flowering in lesquerella , 2011 .

[34]  Lav R. Khot,et al.  Detection of canola flowering using proximal and aerial remote sensing techniques , 2018, Commercial + Scientific Sensing and Imaging.

[35]  Rupinder Kaur,et al.  An Optimized Computer Vision Approach to Precise Well-Bloomed Flower Yielding Prediction using Image Segmentation , 2015 .

[36]  Abhiram Das,et al.  Image-Based High-Throughput Field Phenotyping of Crop Roots1[W][OPEN] , 2014, Plant Physiology.

[37]  G. Acquaah Principles of plant genetics and breeding , 2006 .

[38]  R. Richards,et al.  Defining selection criteria to improve yield under drought , 1996, Plant Growth Regulation.

[39]  Duke M. Bulanon,et al.  Peach Flower Monitoring Using Aerial Multispectral Imaging , 2017, J. Imaging.

[40]  K. Sasaki,et al.  A flavonoid from Brassica rapa flower as the UV-absorbing nectar guide. , 2002, Phytochemistry.

[41]  Hiroyuki Tsuji,et al.  A hybrid machine learning approach to automatic plant phenotyping for smart agriculture , 2017, 2017 International Joint Conference on Neural Networks (IJCNN).

[42]  Malrey Lee,et al.  A Novel Technique for tangerine Yield Prediction using Flower Detection Algorithm , 2013, Int. J. Pattern Recognit. Artif. Intell..

[43]  Victor J. D. Tsai,et al.  A comparative study on shadow compensation of color aerial images in invariant color models , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[44]  Hong Sun,et al.  Sensors for measuring plant phenotyping: A review , 2018 .

[45]  Bodo Mistele,et al.  High throughput phenotyping of canopy water mass and canopy temperature in well-watered and drought stressed tropical maize hybrids in the vegetative stage , 2011 .

[46]  Daryl J. Mares,et al.  Pre-harvest sprouting in wheat. I. Influence of cultivar, rainfall and temperature during grain ripening , 1993 .

[47]  Pouria Sadeghi-Tehran,et al.  Automated Method to Determine Two Critical Growth Stages of Wheat: Heading and Flowering , 2017, Front. Plant Sci..