Multimodal Data Collection System for UAV-based Precision Agriculture Applications

Unmanned Aerial Vehicles (UAVs) consist of emerging technologies that have the potential to be used gradually in various sectors providing a wide range of applications. In agricultural tasks, the UAV-based solutions are supplanting the labor and time-intensive traditional crop management practices. In this direction, this work proposes an automated framework for efficient data collection in crops employing autonomous path planning operational modes. The first method assures an optimal and collision-free path route for scanning the under examination area. The collected data from the oversight perspective are used for orthomocaic creation and subsequently, vegetation indices are extracted to assess the health levels of crops. The second operational mode is considered as an inspection extension for further on-site enriched information collection, performing fixed radius cycles around the central points of interest. A real-world weed detection application is performed verifying the acquired information using both operational modes. The weed detection performance has been evaluated utilizing a well-known Convolutional Neural Network (CNN), named Feature Pyramid Network (FPN), providing sufficient results in terms of Intersection over Union (IoU).

[1]  Olivier Simonin,et al.  Inspection of Ship Hulls with Multiple UAVs: Exploiting Prior Information for Online Path Planning , 2022, 2022 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[2]  Athanasios Ch. Kapoutsis,et al.  CoFly-WeedDB: A UAV image dataset for weed detection and species identification , 2022, Data in brief.

[3]  D. Scaramuzza,et al.  Agilicious: Open-source and open-hardware agile quadrotor for vision-based flight , 2022, Science Robotics.

[4]  S. F. D. Gennaro,et al.  Vineyard classification using OBIA on UAV-based RGB and multispectral data: A case study in different wine regions , 2022, Comput. Electron. Agric..

[5]  Elias B. Kosmatopoulos,et al.  Cooperative multi-UAV coverage mission planning platform for remote sensing applications , 2022, Autonomous Robots.

[6]  Donglin Fan,et al.  Comparison of optimized object-based RF-DT algorithm and SegNet algorithm for classifying Karst wetland vegetation communities using ultra-high spatial resolution UAV data , 2021, Int. J. Appl. Earth Obs. Geoinformation.

[7]  C. Premebida,et al.  Multispectral vineyard segmentation: A deep learning comparison study , 2021, Comput. Electron. Agric..

[8]  George Pavlidis,et al.  Multispectral aerial imagery-based 3D digitisation, segmentation and annotation of large scale urban areas of significant cultural value , 2021 .

[9]  D. Scaramuzza,et al.  AutoTune: Controller Tuning for High-Speed Flight , 2021, IEEE Robotics and Automation Letters.

[10]  Ce Yang,et al.  A review on plant high-throughput phenotyping traits using UAV-based sensors , 2020, Comput. Electron. Agric..

[11]  Ram L. Ray,et al.  Applications of Remote Sensing in Precision Agriculture: A Review , 2020, Remote. Sens..

[12]  Elias B. Kosmatopoulos,et al.  Towards an Integrated Low-Cost Agricultural Monitoring System with Unmanned Aircraft System , 2020, 2020 International Conference on Unmanned Aircraft Systems (ICUAS).

[13]  Elias B. Kosmatopoulos,et al.  Autonomous and Cooperative Design of the Monitor Positions for a Team of UAVs to Maximize the Quantity and Quality of Detected Objects , 2020, IEEE Robotics and Automation Letters.

[14]  Panagiotis G. Sarigiannidis,et al.  A Review on UAV-Based Applications for Precision Agriculture , 2019, Inf..

[15]  Jayme Garcia Arnal Barbedo,et al.  A Review on the Use of Unmanned Aerial Vehicles and Imaging Sensors for Monitoring and Assessing Plant Stresses , 2019, Drones.

[16]  W. Maes,et al.  Perspectives for Remote Sensing with Unmanned Aerial Vehicles in Precision Agriculture. , 2019, Trends in plant science.

[17]  Adel Hafiane,et al.  Deep leaning approach with colorimetric spaces and vegetation indices for vine diseases detection in UAV images , 2018, Comput. Electron. Agric..

[18]  Hyoung Il Son,et al.  Multiple UAV Systems for Agricultural Applications: Control, Implementation, and Evaluation , 2018, Electronics.

[19]  Ola Hall,et al.  Remote Sensing of Yields: Application of UAV Imagery-Derived NDVI for Estimating Maize Vigor and Yields in Complex Farming Systems in Sub-Saharan Africa , 2018, Drones.

[20]  Robert S. Freeland,et al.  Effective and efficient agricultural drainage pipe mapping with UAS thermal infrared imagery: A case study , 2018 .

[21]  Hemerson Pistori,et al.  Weed detection in soybean crops using ConvNets , 2017, Comput. Electron. Agric..

[22]  Morten Stigaard Laursen,et al.  Designing and Testing a UAV Mapping System for Agricultural Field Surveying , 2017, Sensors.

[23]  Elias B. Kosmatopoulos,et al.  DARP: Divide Areas Algorithm for Optimal Multi-Robot Coverage Path Planning , 2017, J. Intell. Robotic Syst..

[24]  Carmelo Di Franco,et al.  Coverage Path Planning for UAVs Photogrammetry with Energy and Resolution Constraints , 2016, J. Intell. Robotic Syst..

[25]  Marc Carreras,et al.  A survey on coverage path planning for robotics , 2013, Robotics Auton. Syst..

[26]  Alberto Tellaeche,et al.  A new vision-based approach to differential spraying in precision agriculture , 2008 .

[27]  William J. Cook,et al.  The Traveling Salesman Problem: A Computational Study , 2007 .

[28]  Elon Rimon,et al.  Spanning-tree based coverage of continuous areas by a mobile robot , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[29]  J. P. Jarvis,et al.  Computational experience with minimum spanning tree algorithms , 1983 .

[30]  L. Quebrajo,et al.  Linking thermal imaging and soil remote sensing to enhance irrigation management of sugar beet , 2018 .

[31]  A. Ollero,et al.  Multiple UAV cooperative searching operation using polygon area decomposition and efficient coverage algorithms , 2004, DARS.