Field-Based High-Throughput Phenotyping for Maize Plant Using 3D LiDAR Point Cloud Generated With a “Phenomobile”

With the rapid rising of global population, the demand for improving breeding techniques to greatly increase the worldwide crop production has become more and more urgent. Most researchers believe that the key to new breeding techniques lies in genetic improvement of crops, which leads to a large quantity of phenotyping spots. Unfortunately, current phenotyping solutions are not powerful enough to handle so many spots with satisfying speed and accuracy. As a result, high-throughput phenotyping is drawing more and more attention. In this paper, we propose a new field-based sensing solution to high-throughput phenotyping. We mount a LiDAR (Velodyne HDL64-S3) on a mobile robot, making the robot a “phenomobile.” We develop software for data collection and analysis under Robotic Operating System using open source components and algorithm libraries. Different from conducting phenotyping observations with an in-row and one-by-one manner, our new solution allows the robot to move around the parcel to collect data. Thus, the 3D and 360° view laser scanner can collect phenotyping data for a large plant group at the same time, instead of one by one. Furthermore, no touching interference from the robot would be imposed onto the crops. We conduct experiments for maize plant on two parcels. We implement point cloud merging with landmarks and Iterative Closest Points to cut down the time consumption. We then recognize and compute the morphological phenotyping parameters (row spacing and plant height) of maize plant using depth-band histograms and horizontal point density. We analyze the cloud registration and merging performances, the row spacing detection accuracy, and the single plant height computation accuracy. Experimental results verify the feasibility of the proposed solution.

[1]  Jeffrey W. White,et al.  Development and evaluation of a field-based high-throughput phenotyping platform. , 2013, Functional plant biology : FPB.

[2]  Martin Trtílek,et al.  High-Throughput Non-destructive Phenotyping of Traits that Contribute to Salinity Tolerance in Arabidopsis thaliana , 2016, Front. Plant Sci..

[3]  N. Ramankutty,et al.  Recent patterns of crop yield growth and stagnation , 2012, Nature Communications.

[4]  David Reiser,et al.  3D Maize Plant Reconstruction Based on Georeferenced Overlapping LiDAR Point Clouds , 2015, Remote. Sens..

[5]  Barnabás Póczos,et al.  High-Throughput Robotic Phenotyping of Energy Sorghum Crops , 2017, FSR.

[6]  Karine Chenu,et al.  High-throughput phenotyping of seminal root traits in wheat , 2015, Plant Methods.

[7]  Yuan Yan Tang,et al.  Maximum Likelihood Estimation-Based Joint Sparse Representation for the Classification of Hyperspectral Remote Sensing Images , 2019, IEEE Transactions on Neural Networks and Learning Systems.

[8]  Radu Bogdan Rusu,et al.  3D is here: Point Cloud Library (PCL) , 2011, 2011 IEEE International Conference on Robotics and Automation.

[9]  Gary Stacey,et al.  Phenotypic and Genomic Analyses of a Fast Neutron Mutant Population Resource in Soybean1[W][OA] , 2011, Plant Physiology.

[10]  Koushik Banerjee,et al.  Application of thermal imaging of wheat crop canopy to estimate leaf area index under different moisture stress conditions , 2018 .

[11]  Patrick S Schnable,et al.  A high-throughput , field-based phenotyping technology for tall biomass crops , 2018 .

[12]  Chenghai Yang,et al.  Rapeseed Seedling Stand Counting and Seeding Performance Evaluation at Two Early Growth Stages Based on Unmanned Aerial Vehicle Imagery , 2018, Front. Plant Sci..

[13]  K. H. Kjaer,et al.  3D Laser Triangulation for Plant Phenotyping in Challenging Environments , 2015, Sensors.

[14]  Richard O. Duda,et al.  Use of the Hough transformation to detect lines and curves in pictures , 1972, CACM.

[15]  K. Moffett,et al.  Remote Sens , 2015 .

[16]  L. Xiong,et al.  Combining high-throughput phenotyping and genome-wide association studies to reveal natural genetic variation in rice , 2014, Nature Communications.

[17]  Xicheng Tan,et al.  Research on the Parallelization of the DBSCAN Clustering Algorithm for Spatial Data Mining Based on the Spark Platform , 2017, Remote. Sens..

[18]  Ashutosh Kumar Singh,et al.  Machine Learning for High-Throughput Stress Phenotyping in Plants. , 2016, Trends in plant science.

[19]  Jose A. Jiménez-Berni,et al.  Pheno-Copter: A Low-Altitude, Autonomous Remote-Sensing Robotic Helicopter for High-Throughput Field-Based Phenotyping , 2014 .

[20]  D. Tilman,et al.  Global food demand and the sustainable intensification of agriculture , 2011, Proceedings of the National Academy of Sciences.

[21]  Changying Li,et al.  In-field High Throughput Phenotyping and Cotton Plant Growth Analysis Using LiDAR , 2018, Front. Plant Sci..

[22]  Zhenghe Song,et al.  Multi-crop-row detection algorithm based on binocular vision , 2016 .

[23]  Alexandre Escolà,et al.  Application of light detection and ranging and ultrasonic sensors to high-throughput phenotyping and precision horticulture: current status and challenges , 2018, Horticulture Research.

[24]  Patrick S. Schnable,et al.  Field‐based robotic phenotyping of sorghum plant architecture using stereo vision , 2018, J. Field Robotics.

[25]  M. Hawkesford,et al.  Field Scanalyzer: An automated robotic field phenotyping platform for detailed crop monitoring. , 2016, Functional plant biology : FPB.

[26]  Nico Blodow,et al.  Fast Point Feature Histograms (FPFH) for 3D registration , 2009, 2009 IEEE International Conference on Robotics and Automation.

[27]  Sebastian Riedel,et al.  Automated Analysis of Barley Organs Using 3D Laser Scanning: An Approach for High Throughput Phenotyping , 2014, Sensors.

[28]  Qian Du,et al.  Self-Paced Joint Sparse Representation for the Classification of Hyperspectral Images , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[29]  Bin Li,et al.  Extended Ackerman Steering Principle for the coordinated movement control of a four wheel drive agricultural mobile robot , 2018, Comput. Electron. Agric..

[30]  M. Tester,et al.  Phenomics--technologies to relieve the phenotyping bottleneck. , 2011, Trends in plant science.

[31]  A. G. Cirilo,et al.  Yield Responses to Narrow Rows Depend on Increased Radiation Interception , 2002 .

[32]  Yin Zhou,et al.  VoxelNet: End-to-End Learning for Point Cloud Based 3D Object Detection , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[33]  Yi Lin,et al.  LiDAR: An important tool for next-generation phenotyping technology of high potential for plant phenomics? , 2015, Comput. Electron. Agric..

[34]  Maria Manuela Chaves,et al.  Thermal imaging to phenotype traditional maize landraces for drought tolerance , 2015 .

[35]  Rajnikant V. Patel,et al.  Computer Vision Based Autonomous Robotic System for 3D Plant Growth Measurement , 2015, 2015 12th Conference on Computer and Robot Vision.

[36]  J. Foley,et al.  Yield Trends Are Insufficient to Double Global Crop Production by 2050 , 2013, PloS one.

[37]  Yu Jiang,et al.  High throughput phenotyping of cotton plant height using depth images under field conditions , 2016, Comput. Electron. Agric..

[38]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[39]  F. Andrade,et al.  Row Spacing Effects at Different Levels of Nitrogen Availability in Maize , 2000 .

[40]  Yufeng Ge,et al.  High Throughput In vivo Analysis of Plant Leaf Chemical Properties Using Hyperspectral Imaging , 2017, Front. Plant Sci..

[41]  Mitsuru Tsubo,et al.  A MODEL OF RADIATION INTERCEPTION AND USE BY A MAIZE–BEAN INTERCROP CANOPY , 2002 .

[42]  Qian Du,et al.  Graph-Regularized Fast and Robust Principal Component Analysis for Hyperspectral Band Selection , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[43]  Paul Scheunders,et al.  Close-range hyperspectral image analysis for the early detection of stress responses in individual plants in a high-throughput phenotyping platform , 2018 .

[44]  D. Goodin,et al.  Application of unmanned aerial systems for high throughput phenotyping of large wheat breeding nurseries , 2016, Plant Methods.

[45]  Scott C. Chapman,et al.  Estimation of plant height using a high throughput phenotyping platform based on unmanned aerial vehicle and self-calibration: Example for sorghum breeding , 2018 .

[46]  J. Araus,et al.  Field high-throughput phenotyping: the new crop breeding frontier. , 2014, Trends in plant science.

[47]  Gonzalo Pajares,et al.  Automatic detection of curved and straight crop rows from images in maize fields , 2017 .

[48]  Hans-Peter Kriegel,et al.  A Density-Based Algorithm for Discovering Clusters in Large Spatial Databases with Noise , 1996, KDD.

[49]  Achim Walter,et al.  Remote, aerial phenotyping of maize traits with a mobile multi-sensor approach , 2015, Plant Methods.

[50]  Lie Tang,et al.  Within-row spacing sensing of maize plants using 3D computer vision , 2014 .

[51]  George Kantor,et al.  The Robotanist: A ground-based agricultural robot for high-throughput crop phenotyping , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[52]  Liu Jin,et al.  Crop 3D: a platform based on LiDAR for 3D high-throughputcrop phenotyping , 2016 .

[53]  C. Klukas,et al.  Dissecting the Phenotypic Components of Crop Plant Growth and Drought Responses Based on High-Throughput Image Analysis[W][OPEN] , 2014, Plant Cell.

[54]  Wang Yushun,et al.  Monitoring lettuce growth using K-means color image segmentation and principal component analysis method , 2016 .

[55]  Wolfram Burgard,et al.  OctoMap : A Probabilistic , Flexible , and Compact 3 D Map Representation for Robotic Systems , 2010 .

[56]  Heiner Kuhlmann,et al.  Surface feature based classification of plant organs from 3D laserscanned point clouds for plant phenotyping , 2013, BMC Bioinformatics.

[57]  F. Baret,et al.  High-Throughput Phenotyping of Plant Height: Comparing Unmanned Aerial Vehicles and Ground LiDAR Estimates , 2017, Front. Plant Sci..

[58]  José Dorado,et al.  Using depth cameras to extract structural parameters to assess the growth state and yield of cauliflower crops , 2016, Comput. Electron. Agric..

[59]  Diego Alonso,et al.  A Machine Learning Approach to Pedestrian Detection for Autonomous Vehicles Using High-Definition 3D Range Data , 2016, Sensors.

[60]  Malia A. Gehan,et al.  Lights, camera, action: high-throughput plant phenotyping is ready for a close-up. , 2015, Current opinion in plant biology.

[61]  Didier Demilly,et al.  QTL analysis of seed germination and pre-emergence growth at extreme temperatures in Medicago truncatula , 2010, Theoretical and Applied Genetics.

[62]  M. Otegui,et al.  Plant population density, row spacing and hybrid effects on maize canopy architecture and light attenuation , 2001 .