Robotic Detection and Grasp of Maize and Sorghum: Stem Measurement with Contact

Frequent measurements of the plant phenotypes make it possible to monitor plant status during the growing season. Stem diameter is an important proxy for overall plant biomass and health. However, the manual measurement of stem diameter in plants is time consuming, error prone, and laborious. The use of agricultural robots to automatically collect plant phenotypic data for trait measurements can overcome many of the drawbacks of manual phenotyping. The objective of this research was to develop a robotic system that can automatically detect and grasp the stem, and measure its diameter of maize and sorghum plants. The robotic system comprises of a four degree of freedom robotic manipulator, a time-of-flight camera for vision system, and a linear potentiometer sensor to measure the stem diameter. Deep learning and conventional image processing were used to detect stem in images and find grasping point of stem, respectively. An experiment was conducted in a greenhouse using maize and sorghum plants to evaluate the performance of the robotic system. The system demonstrated successful grasping of stem and a high correlation between manual and robotic measurements of diameter depicting its ability to be used as a prototype to integrate other sensors to measure different physiological and chemical attributes of the stem.

[1]  Hanno Scharr,et al.  Machine Learning for Plant Phenotyping Needs Image Processing. , 2016, Trends in plant science.

[2]  Sierra N. Young,et al.  Design and field evaluation of a ground robot for high-throughput phenotyping of energy sorghum , 2018, Precision Agriculture.

[3]  P. Schnable,et al.  Field-based architectural traits characterisation of maize plant using time-of-flight 3D imaging , 2019, Biosystems Engineering.

[4]  James S. Schepers,et al.  Automated Measurement of Maize Stalk Diameter and Plant Spacing , 2017 .

[5]  Jin Liu,et al.  Stem–Leaf Segmentation and Phenotypic Trait Extraction of Individual Maize Using Terrestrial LiDAR Data , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[6]  Jeffrey W. White,et al.  Development and evaluation of a field-based high-throughput phenotyping platform. , 2013, Functional plant biology : FPB.

[7]  Yufeng Ge,et al.  High-throughput analysis of leaf physiological and chemical traits with VIS–NIR–SWIR spectroscopy: a case study with a maize diversity panel , 2019, Plant Methods.

[8]  Ning Wang,et al.  Development of a Ground-Based Peanut Canopy Phenotyping System , 2018 .

[9]  Yufeng Ge,et al.  In vivo human-like robotic phenotyping of leaf traits in maize and sorghum in greenhouse , 2019, Comput. Electron. Agric..

[10]  Yu Mei,et al.  A Robotic Platform for Corn Seedling Morphological Traits Characterization , 2017, Sensors.

[11]  Nader Sadegh,et al.  Autonomous Leaf Picking Using Deep Learning and Visual-Servoing , 2016 .

[12]  George Kantor,et al.  The Robotanist: A ground-based agricultural robot for high-throughput crop phenotyping , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[13]  David Reiser,et al.  Determination of stem position and height of reconstructed maize plants using a time-of-flight camera , 2018, Comput. Electron. Agric..

[14]  Rui Xu,et al.  Development of an Autonomous Ground Robot for Field High Throughput Phenotyping , 2018 .

[15]  Yufeng Ge,et al.  High Throughput In vivo Analysis of Plant Leaf Chemical Properties Using Hyperspectral Imaging , 2017, Front. Plant Sci..

[16]  Matthew N. Dailey,et al.  Automatic morphological trait characterization for corn plants via 3D holographic reconstruction , 2014 .