Direct derivation of maize plant and crop height from low-cost time-of-flight camera measurements

BackgroundIn agriculture, information about the spatial distribution of crop height is valuable for applications such as biomass and yield estimation, or increasing field work efficiency in terms of fertilizing, applying pesticides, irrigation, etc. Established methods for capturing crop height often comprise restrictions in terms of cost and time efficiency, flexibility, and temporal and spatial resolution of measurements. Furthermore, crop height is mostly derived from a measurement of the bare terrain prior to plant growth and measurements of the crop surface when plants are growing, resulting in the need of multiple field campaigns. In our study, we examine a method to derive crop heights directly from data of a plot of full grown maize plants captured in a single field campaign. We assess continuous raster crop height models (CHMs) and individual plant heights derived from data collected with the low-cost 3D camera Microsoft® Kinect® for Xbox One™ based on a comprehensive comparison to terrestrial laser scanning (TLS) reference data.ResultsWe examine single measurements captured with the 3D camera and a combination of the single measurements, i.e. a combination of multiple perspectives. The quality of both CHMs, and individual plant heights is improved by combining the measurements. R2 of CHMs derived from single measurements range from 0.48 to 0.88, combining all measurements leads to an R2 of 0.89. In case of individual plant heights, an R2 of 0.98 is achieved for the combined measures (with R2 = 0.44 for the single measurements). The crop heights derived from the 3D camera measurements comprise an average underestimation of 0.06 m compared to TLS reference values.ConclusionWe recommend the combination of multiple low-cost 3D camera measurements, removal of measurement artefacts, and the inclusion of correction functions to improve the quality of crop height measurements. Operating low-cost 3D cameras under field conditions on agricultural machines or on autonomous platforms can offer time and cost efficient tools for capturing the spatial distribution of crop heights directly in the field and subsequently to advance agricultural efficiency and productivity. More general, all processes which include the 3D geometry of natural objects can profit from low-cost methods producing 3D geodata.

[1]  Gérard G. Medioni,et al.  Object modeling by registration of multiple range images , 1991, Proceedings. 1991 IEEE International Conference on Robotics and Automation.

[2]  Gérard G. Medioni,et al.  Object modelling by registration of multiple range images , 1992, Image Vis. Comput..

[3]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Hermann Auernhammer,et al.  Precision farming — the environmental challenge , 2001 .

[5]  N. Zhang,et al.  Precision agriculture—a worldwide overview , 2002 .

[6]  William R. Raun,et al.  By‐Plant Prediction of Corn Forage Biomass and Nitrogen Uptake at Various Growth Stages Using Remote Sensing and Plant Height , 2007 .

[7]  Matthias Rothmund,et al.  Precision agriculture on grassland : Applications, perspectives and constraints , 2008 .

[8]  Detlef Ehlert,et al.  Vehicle Based Laser Range Finding in Crops , 2009, Sensors.

[9]  Michael Höhle,et al.  Accuracy assessment of digital elevation models by means of robust statistical methods , 2009 .

[10]  D. Ehlert,et al.  Suitability of a laser rangefinder to characterize winter wheat , 2010, Precision Agriculture.

[11]  Steven R. Raine,et al.  Applied machine vision of plants – a review with implications for field deployment in automated farming operations 1 , 2010 .

[12]  De Li Liu,et al.  Adapting agriculture to climate change: a review , 2013, Theoretical and Applied Climatology.

[13]  Xinhua Yin,et al.  Assessment of plant biomass and nitrogen nutrition with plant height in early-to mid-season corn. , 2012, Journal of the science of food and agriculture.

[14]  David Ball,et al.  Robotics for Sustainable Broad-Acre Agriculture , 2013, FSR.

[15]  J. Eitel,et al.  LiDAR based biomass and crop nitrogen estimates for rapid, non-destructive assessment of wheat nitrogen status , 2014 .

[16]  Bernhard Höfle,et al.  Radiometric Correction of Terrestrial LiDAR Point Cloud Data for Individual Maize Plant Detection , 2014, IEEE Geoscience and Remote Sensing Letters.

[17]  G. Grenzdörffer.  Crop height determination with UAS point clouds , 2014 .

[18]  Norbert Pfeifer,et al.  OPALS - A framework for Airborne Laser Scanning data analysis , 2014, Comput. Environ. Urban Syst..

[19]  Glen L. Ritchie,et al.  Inter-relationships of cotton plant height, canopy width, ground cover and plant nitrogen status indicators , 2014 .

[20]  Jan Boehm.  Accuracy Investigation for Structured-light Based Consumer 3D Sensors , 2014 .

[21]  H. Macher,et al.  FIRST EXPERIENCES WITH KINECT V2 SENSOR FOR CLOSE RANGE 3D MODELLING , 2015 .

[22]  Y. Miao,et al.  Transferability of Models for Estimating Paddy Rice Biomass from Spatial Plant Height Data , 2015 .

[23]  Simon Bennertz,et al.  Combining UAV-based plant height from crop surface models, visible, and near infrared vegetation indices for biomass monitoring in barley , 2015, Int. J. Appl. Earth Obs. Geoinformation.

[24]  Chaoyang Wu,et al.  Airborne LiDAR technique for estimating biomass components of maize: A case study in Zhangye City, Northwest China , 2015 .

[25]  F. Marinello,et al.  Application of the Kinect sensor for dynamic soil surface characterization , 2015, Precision Agriculture.

[26]  G. Waldhoff,et al.  Crop height variability detection in a single field by multi-temporal terrestrial laser scanning , 2016, Precision Agriculture.

[27]  Nora Tilly,et al.  Correction: Tilly, N. et al. Fusion of Plant Height and Vegetation Indices for the Estimation of Barley Biomass. Remote Sens. 2015, 7, 11449-11480 , 2015, Remote. Sens..

[28]  Pedro Arias,et al.  Metrological comparison between Kinect I and Kinect II sensors , 2015 .

[29]  Nora Tilly,et al.  Fusion of Plant Height and Vegetation Indices for the Estimation of Barley Biomass , 2015, Remote. Sens..

[30]  Stefan May,et al.  A MAN-PORTABLE, IMU-FREE MOBILE MAPPING SYSTEM , 2015 .

[31]  Andreas Kolb,et al.  Kinect range sensing: Structured-light versus Time-of-Flight Kinect , 2015, Comput. Vis. Image Underst..

[32]  J. R. Rosell-Polo,et al.  Advances in Structured Light Sensors Applications in Precision Agriculture and Livestock Farming , 2015 .

[33]  J. Chen,et al.  Effects of LiDAR point density, sampling size and height threshold on estimation accuracy of crop biophysical parameters. , 2016, Optics express.

[34]  M. Heinrichs,et al.  The German Version of the Gaze Anxiety Rating Scale (GARS): Reliability and Validity , 2016, PloS one.

[35]  Bernhard Höfle,et al.  Simulating an Autonomously Operating Low-Cost Static Terrestrial LiDAR for Multitemporal Maize Crop Height Measurements , 2016, Remote. Sens..

[36]  Z. Niu,et al.  Remote estimation of canopy height and aboveground biomass of maize using high-resolution stereo images from a low-cost unmanned aerial vehicle system , 2016 .

[37]  Dirk Hoffmeister,et al.  A Comparison of UAV- and TLS-derived Plant Height for Crop Monitoring: Using Polygon Grids for the Analysis of Crop Surface Models (CSMs) , 2016 .

[38]  Honggang Bu,et al.  Use of corn height measured with an acoustic sensor improves yield estimation with ground based active optical sensors , 2016, Comput. Electron. Agric..

[39]  A. Walter,et al.  Terrestrial 3D laser scanning to track the increase in canopy height of both monocot and dicot crop species under field conditions , 2016, Plant Methods.

[40]  Bernhard Höfle,et al.  3D Participatory Sensing with Low-Cost Mobile Devices for Crop Height Assessment – A Comparison with Terrestrial Laser Scanning Data , 2016, PloS one.

[41]  O. E. Krips,et al.  Automated video tracking of thrips behavior to assess host-plant resistance in multiple parallel two-choice setups , 2016, Plant Methods.

[42]  Dirk Hoffmeister,et al.  4D Near Real-Time Environmental Monitoring Using Highly Temporal LiDAR , 2016 .