Low-Cost Three-Dimensional Modeling of Crop Plants

Plant modeling can provide a more detailed overview regarding the basis of plant development throughout the life cycle. Three-dimensional processing algorithms are rapidly expanding in plant phenotyping programmes and in decision-making for agronomic management. Several methods have already been tested, but for practical implementations the trade-off between equipment cost, computational resources needed and the fidelity and accuracy in the reconstruction of the end-details needs to be assessed and quantified. This study examined the suitability of two low-cost systems for plant reconstruction. A low-cost Structure from Motion (SfM) technique was used to create 3D models for plant crop reconstruction. In the second method, an acquisition and reconstruction algorithm using an RGB-Depth Kinect v2 sensor was tested following a similar image acquisition procedure. The information was processed to create a dense point cloud, which allowed the creation of a 3D-polygon mesh representing every scanned plant. The selected crop plants corresponded to three different crops (maize, sugar beet and sunflower) that have structural and biological differences. The parameters measured from the model were validated with ground truth data of plant height, leaf area index and plant dry biomass using regression methods. The results showed strong consistency with good correlations between the calculated values in the models and the ground truth information. Although, the values obtained were always accurately estimated, differences between the methods and among the crops were found. The SfM method showed a slightly better result with regard to the reconstruction the end-details and the accuracy of the height estimation. Although the use of the processing algorithm is relatively fast, the use of RGB-D information is faster during the creation of the 3D models. Thus, both methods demonstrated robust results and provided great potential for use in both for indoor and outdoor scenarios. Consequently, these low-cost systems for 3D modeling are suitable for several situations where there is a need for model generation and also provide a favourable time-cost relationship.

[1]  Tao Zheng,et al.  Smartphone based hemispherical photography for canopy structure measurement , 2018, International Conference on Optical Instruments and Technology.

[2]  P. Lancashire,et al.  A uniform decimal code for growth stages of crops and weeds , 1991 .

[3]  B. Mueller‐Roeber,et al.  A growth phenotyping pipeline for Arabidopsis thaliana integrating image analysis and rosette area modeling for robust quantification of genotype effects. , 2011, The New phytologist.

[4]  Alberto Tellaeche,et al.  Analysis of natural images processing for the extraction of agricultural elements , 2010, Image Vis. Comput..

[5]  J. Fripp,et al.  A novel mesh processing based technique for 3D plant analysis , 2012, BMC Plant Biology.

[6]  Long Quan,et al.  Image-based plant modeling , 2006, ACM Trans. Graph..

[7]  Lucas R. Amaral,et al.  Comparison of crop canopy reflectance sensors used to identify sugarcane biomass and nitrogen status , 2014, Precision Agriculture.

[8]  Thiago T. Santos,et al.  Image-based 3 D digitizing for plant architecture analysis and phenotyping , 2012 .

[9]  Long Quan,et al.  Match Propagation for Image-Based Modeling and Rendering , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  José Dorado,et al.  Three-Dimensional Modeling of Weed Plants Using Low-Cost Photogrammetry , 2018, Sensors.

[11]  Xinlian Liang,et al.  Evaluation of Close-Range Photogrammetry Image Collection Methods for Estimating Tree Diameters , 2018, ISPRS Int. J. Geo Inf..

[12]  B. Höfle,et al.  Direct derivation of maize plant and crop height from low-cost time-of-flight camera measurements , 2016, Plant Methods.

[13]  Jordi Llop,et al.  Advanced Technologies for the Improvement of Spray Application Techniques in Spanish Viticulture: An Overview , 2014, Sensors.

[14]  Hector Nieto,et al.  Evapotranspiration estimates derived using thermal-based satellite remote sensing and data fusion for irrigation management in California vineyards , 2018, Irrigation Science.

[15]  J. R. Rosell-Polo,et al.  Advances in Structured Light Sensors Applications in Precision Agriculture and Livestock Farming , 2015 .

[16]  J. Kromdijk,et al.  Chlorophyll a fluorescence induction: Can just a one-second measurement be used to quantify abiotic stress responses? , 2018, Photosynthetica.

[17]  G. Meyer,et al.  Color indices for weed identification under various soil, residue, and lighting conditions , 1994 .

[18]  Rémy Guyonneau,et al.  An Image Processing Method Based on Features Selection for Crop Plants and Weeds Discrimination Using RGB Images , 2018, ICISP.

[19]  José Dorado,et al.  Influence of Wind Speed on RGB-D Images in Tree Plantations , 2017, Sensors.

[20]  Murtaza Taj,et al.  Evaluation of Microsoft Kinect Sensor for Plant Health Monitoring , 2016 .

[21]  M. Liu,et al.  A high-throughput stereo-imaging system for quantifying rape leaf traits during the seedling stage , 2017, Plant Methods.

[22]  Francisco José Krug,et al.  In situ Determination of K, Ca, S and Si in Fresh Sugar Cane Leaves by Handheld Energy Dispersive X-Ray Fluorescence Spectrometry , 2017 .

[23]  Matthew N. Dailey,et al.  Automatic morphological trait characterization for corn plants via 3D holographic reconstruction , 2014 .

[24]  Nobuo Ezaki,et al.  Plant Recognition by Integrating Color and Range Data Obtained Through Stereo Vision , 2005, J. Adv. Comput. Intell. Intell. Informatics.

[25]  N. Otsu.  A threshold selection method from gray level histograms , 1979 .

[26]  Michael P. Pound,et al.  Approaches to three-dimensional reconstruction of plant shoot topology and geometry. , 2016, Functional plant biology : FPB.

[27]  Rafael Rieder,et al.  Computer vision and artificial intelligence in precision agriculture for grain crops: A systematic review , 2018, Comput. Electron. Agric..

[28]  A. Walter,et al.  Plant phenotyping: from bean weighing to image analysis , 2015, Plant Methods.

[29]  Lutz Plümer,et al.  Low-Cost 3D Systems: Suitable Tools for Plant Phenotyping , 2014, Sensors.

[30]  Roland Gerhards,et al.  Potential use of ground-based sensor technologies for weed detection. , 2014, Pest management science.

[31]  Alexandre Escolà,et al.  Weed discrimination using ultrasonic sensors , 2011 .

[32]  B. Andrieu,et al.  Computer stereo plotting for 3-D reconstruction of a maize canopy , 1995 .

[33]  Changying Li,et al.  Size estimation of sweet onions using consumer-grade RGB-depth sensor , 2014 .

[34]  Philippe Lucidarme,et al.  On the use of depth camera for 3D phenotyping of entire plants , 2012 .

[35]  H. Scharr,et al.  A stereo imaging system for measuring structural parameters of plant canopies. , 2007, Plant, cell & environment.

[36]  V. Rueda-Ayala,et al.  A LiDAR-Based System to Assess Poplar Biomass , 2016, Gesunde Pflanzen.

[37]  Anamika Mishra,et al.  Plant phenotyping: a perspective , 2016, Indian Journal of Plant Physiology.

[38]  Heiner Kuhlmann,et al.  Accuracy Analysis of a Multi-View Stereo Approach for Phenotyping of Tomato Plants at the Organ Level , 2015, Sensors.

[39]  Stefan May,et al.  A MAN-PORTABLE, IMU-FREE MOBILE MAPPING SYSTEM , 2015 .

[40]  Qian Wu,et al.  Automatic Non-Destructive Growth Measurement of Leafy Vegetables Based on Kinect , 2018, Sensors.

[41]  M. Dobson,et al.  The use of Imaging radars for ecological applications : A review , 1997 .

[42]  C. Fernández-Quintanilla,et al.  An assessment of the accuracy and consistency of human perception of weed cover , 2010 .

[43]  Matthias Nießner,et al.  Real-time 3D reconstruction at scale using voxel hashing , 2013, ACM Trans. Graph..

[44]  Urs Schmidhalter,et al.  Evaluating RGB Imaging and Multispectral Active and Hyperspectral Passive Sensing for Assessing Early Plant Vigor in Winter Wheat , 2018, Sensors.