Semantic interpretation and complexity reduction of 3D point clouds of vineyards

In precision agriculture, autonomous ground and aerial vehicles can lead to favourable improvements in field operations, extending crop scouting to large fields and performing field tasks in a timely and effective way. However, automated navigation and operations within a complex scenarios require specific and robust path planning and navigation control. Thus, in addition to proper knowledge of their instantaneous position, robotic vehicles and machines require an accurate spatial description of their environment. An innovative modelling framework is presented to semantically interpret 3D point clouds of vineyards and to generate low complexity 3D mesh models of vine rows. The proposed methodology, based on a combination of convex hull filtration and minimum area c-gon design, reduces the amount of instances required to describe the spatial layout and shape of vine canopies allowing the amount of data to be reduced without losing relevant crop shape information. The algorithm is not hindered by complex scenarios, such as non-linear vine rows, as it is able to automatically process non uniform vineyards. Results demonstrated a data reduction of about 98%; from the 500 Mb ha−1 required to store the original dataset to 7.6 Mb ha−1 for the low complexity 3D mesh. Reducing the amount of data is crucial to reducing computational times for large original datasets, thus enabling the exploitation of 3D point cloud information in real-time during field operations. When considering scenarios involving cooperating machines and robots, data reduction will allow rapid communication and data exchange between in field actors.

[1]  Giulio Reina,et al.  Terrain assessment for precision agriculture using vehicle dynamic modelling , 2017, ArXiv.

[2]  S. Wolfert,et al.  Big Data in Smart Farming – A review , 2017 .

[3]  Peter Biber,et al.  Plant detection and mapping for agricultural robots using a 3D LIDAR sensor , 2011, Robotics Auton. Syst..

[4]  Robin Gebbers,et al.  Precision Agriculture and Food Security , 2010, Science.

[6]  Mustafa Zeybek,et al.  Point cloud filtering on UAV based point cloud , 2019, Measurement.

[7]  J. Bailey,et al.  Improving productivity and increasing the efficiency of soil nutrient management on grassland farms in the UK and Ireland using precision agriculture technology , 2019, European Journal of Agronomy.

[8]  Lorenzo Comba,et al.  Robot ensembles for grafting herbaceous crops , 2016 .

[9]  Marco Bietresato,et al.  Evaluation and stability comparison of different vehicle configurations for robotic agricultural operations on side-slopes , 2015 .

[10]  Aldo Calcante,et al.  Selective spraying of grapevines for disease control using a modular agricultural robot , 2016 .

[11]  Cristina Tortia,et al.  2D and 3D data fusion for crop monitoring in precision agriculture , 2019, 2019 IEEE International Workshop on Metrology for Agriculture and Forestry (MetroAgriFor).

[12]  Tapio Pahikkala,et al.  Automatic detection of cereal rows by means of pattern recognition techniques , 2019, Comput. Electron. Agric..

[13]  Avital Bechar,et al.  Agricultural robots for field operations. Part 2: Operations and systems , 2017 .

[14]  Anders la Cour-Harbo,et al.  Side-to-side 3D coverage path planning approach for agricultural robots to minimize skip/overlap areas between swaths , 2016, Robotics Auton. Syst..

[15]  Lars Grimstad,et al.  Thorvald II - a Modular and Re-configurable Agricultural Robot , 2017 .

[16]  Michael Kassler,et al.  Agricultural Automation in the new Millennium , 2001 .

[17]  Emilio Gil,et al.  Development of canopy vigour maps using UAV for site-specific management during vineyard spraying process , 2019, Precision Agriculture.

[18]  Petr Císar,et al.  Automated multiple fish tracking in three-Dimension using a Structured Light Sensor , 2016, Comput. Electron. Agric..

[19]  Volker Steinhage,et al.  High-precision 3D detection and reconstruction of grapes from laser range data for efficient phenotyping based on supervised learning , 2017, Comput. Electron. Agric..

[20]  Mark de Berg,et al.  Computational geometry: algorithms and applications , 1997 .

[21]  P. Schnable,et al.  Field-based architectural traits characterisation of maize plant using time-of-flight 3D imaging , 2019, Biosystems Engineering.

[22]  J. A. López-Riquelme,et al.  New trends in precision agriculture: a novel cloud-based system for enabling data storage and agricultural task planning and automation , 2017, Precision Agriculture.

[23]  Jordi Llorens,et al.  Kinect v2 Sensor-Based Mobile Terrestrial Laser Scanner for Agricultural Outdoor Applications , 2017, IEEE/ASME Transactions on Mechatronics.

[24]  W. Maes,et al.  Perspectives for Remote Sensing with Unmanned Aerial Vehicles in Precision Agriculture. , 2019, Trends in plant science.

[25]  Xinxing Li,et al.  Precision irrigation perspectives on the sustainable water-saving of field crop production in China: Water demand prediction and irrigation scheme optimization , 2019, Journal of Cleaner Production.

[26]  Asher Bender,et al.  Segmentation of lettuce in coloured 3D point clouds for fresh weight estimation , 2018, Comput. Electron. Agric..

[27]  Jan Tommy Gravdahl,et al.  Robotic in-row weed control in vegetables , 2018, Comput. Electron. Agric..

[28]  Marcello Chiaberge,et al.  Comparison of Satellite and UAV-Based Multispectral Imagery for Vineyard Variability Assessment , 2019, Remote. Sens..

[29]  Spyros Fountas,et al.  Big Data for weed control and crop protection , 2017 .

[30]  K. Sudduth,et al.  Yield estimation in cotton using UAV-based multi-sensor imagery , 2020 .

[31]  C. Tortia,et al.  Leaf Area Index evaluation in vineyards using 3D point clouds from UAV imagery , 2019, Precision Agriculture.

[32]  Xiangjun Zou,et al.  Vision-based extraction of spatial information in grape clusters for harvesting robots , 2016 .

[33]  Emilio Gil,et al.  Ground Deposition and Airborne Spray Drift Assessment in Vineyard and Orchard: The Influence of Environmental Variables and Sprayer Settings , 2017 .

[34]  Alessandro Matese,et al.  NDVI-based vigour maps production using automatic detection of vine rows in ultra-high resolution aerial images , 2015 .

[35]  Lorenzo Comba,et al.  Individual plant definition and missing plant characterization in vineyards from high-resolution UAV imagery , 2017 .

[36]  Jesús A. Gil-Ribes,et al.  Towards an Optimized Method of Olive Tree Crown Volume Measurement , 2015, Sensors.

[37]  Lorenzo Comba,et al.  Cost-effective visual odometry system for vehicle motion control in agricultural environments , 2019, Comput. Electron. Agric..

[38]  M. Collison,et al.  How should we turn data into decisions in AgriFood? , 2019, Journal of the science of food and agriculture.

[39]  Frank Hensgen,et al.  Evaluation of 3D point cloud-based models for the prediction of grassland biomass , 2019, Int. J. Appl. Earth Obs. Geoinformation.

[40]  Lorenzo Comba,et al.  Unsupervised detection of vineyards by 3D point-cloud UAV photogrammetry for precision agriculture , 2018, Comput. Electron. Agric..

[41]  Santosh K. Pitla,et al.  Evaluation of low-cost depth cameras for agricultural applications , 2020, Comput. Electron. Agric..

[42]  Jihee Han,et al.  An efficient approach to 3D path planning , 2019, Inf. Sci..

[43]  Avital Bechar,et al.  Agricultural robots for field operations: Concepts and components , 2016 .

[44]  Yael Edan,et al.  Robotics in protected cultivation , 2013 .

[45]  Marcello Chiaberge,et al.  UAV and Machine Learning Based Refinement of a Satellite-Driven Vegetation Index for Precision Agriculture † , 2020, Sensors.

[46]  In Seop Na,et al.  Rice yield estimation based on K-means clustering with graph-cut segmentation using low-altitude UAV images , 2019, Biosystems Engineering.

[47]  Li Li,et al.  Monitoring maize growth conditions by training a BP neural network with remotely sensed vegetation temperature condition index and leaf area index , 2019, Comput. Electron. Agric..