UAV-Based High Throughput Phenotyping in Citrus Utilizing Multispectral Imaging and Artificial Intelligence

Traditional plant breeding evaluation methods are time-consuming, labor-intensive, and costly. Accurate and rapid phenotypic trait data acquisition and analysis can improve genomic selection and accelerate cultivar development. In this work, a technique for data acquisition and image processing was developed utilizing small unmanned aerial vehicles (UAVs), multispectral imaging, and deep learning convolutional neural networks to evaluate phenotypic characteristics on citrus crops. This low-cost and automated high-throughput phenotyping technique utilizes artificial intelligence (AI) and machine learning (ML) to: (i) detect, count, and geolocate trees and tree gaps; (ii) categorize trees based on their canopy size; (iii) develop individual tree health indices; and (iv) evaluate citrus varieties and rootstocks. The proposed remote sensing technique was able to detect and count citrus trees in a grove of 4,931 trees, with precision and recall of 99.9% and 99.7%, respectively, estimate their canopy size with overall accuracy of 85.5%, and detect, count, and geolocate tree gaps with a precision and recall of 100% and 94.6%, respectively. This UAV-based technique provides a consistent, more direct, cost-effective, and rapid method to evaluate phenotypic characteristics of citrus varieties and rootstocks.

[1]  Ashutosh Kumar Singh,et al.  Machine Learning for High-Throughput Stress Phenotyping in Plants. , 2016, Trends in plant science.

[2]  Joe Mari Maja,et al.  Huanglongbing (Citrus Greening) Detection Using Visible, Near Infrared and Thermal Imaging Techniques , 2013, Sensors.

[3]  Juha Hyyppä,et al.  Individual Tree Detection and Classification with UAV-Based Photogrammetric Point Clouds and Hyperspectral Imaging , 2017, Remote. Sens..

[4]  C. Silva,et al.  Individual tree detection from Unmanned Aerial Vehicle (UAV) derived canopy height model in an open canopy mixed conifer forest , 2017 .

[5]  Arko Lucieer,et al.  Evaluating Tree Detection and Segmentation Routines on Very High Resolution UAV LiDAR Data , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[6]  Oliver Fiehn,et al.  Metabolic variations in different citrus rootstock cultivars associated with different responses to Huanglongbing. , 2016, Plant physiology and biochemistry : PPB.

[7]  Antonio Granell,et al.  Fruit volatile profiles of two citrus hybrids are dramatically different from those of their parents. , 2014, Journal of agricultural and food chemistry.

[8]  Lei Tian,et al.  Development of a low-cost agricultural remote sensing system based on an autonomous unmanned aerial vehicle (UAV) , 2011 .

[9]  Y. Ampatzidis,et al.  The adoption of precision agriculture technologies by Florida growers: a comparison of 2005 and 2018 survey data , 2020, Acta Horticulturae.

[10]  H. S. Abdullahi,et al.  Technology Impact on Agricultural Productivity: A Review of Precision Agriculture Using Unmanned Aerial Vehicles , 2015, WISATS.

[11]  Yiannis Ampatzidis,et al.  Development and evaluation of a low-cost and smart technology for precision weed management utilizing artificial intelligence , 2019, Comput. Electron. Agric..

[12]  Andrea Luvisi,et al.  Detection of grapevine yellows symptoms in Vitis vinifera L. with artificial intelligence , 2019, Comput. Electron. Agric..

[13]  T. Mockler,et al.  High throughput phenotyping to accelerate crop breeding and monitoring of diseases in the field. , 2017, Current opinion in plant biology.

[14]  Andrea Luvisi,et al.  Plant Pathology and Information Technology: Opportunity for Management of Disease Outbreak and Applications in Regulation Frameworks , 2016 .

[15]  Reza Ehsani,et al.  Evaluating the performance of spectral features and multivariate analysis tools to detect laurel wilt disease and nutritional deficiency in avocado , 2018, Comput. Electron. Agric..

[16]  P. Aleza,et al.  Implementation of extensive citrus triploid breeding programs based on 4x × 2x sexual hybridisations , 2012, Tree Genetics & Genomes.

[17]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[18]  Andrea Luvisi,et al.  X-FIDO: An Effective Application for Detecting Olive Quick Decline Syndrome with Deep Learning and Data Fusion , 2017, Front. Plant Sci..

[19]  Mehtap Şahin-Çevik,et al.  Quantitative trait loci analysis of morphological traits in Citrus , 2011, Plant Biotechnology Reports.

[20]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[21]  Maggi Kelly,et al.  Identification of Citrus Trees from Unmanned Aerial Vehicle Imagery Using Convolutional Neural Networks , 2018, Drones.

[22]  Naif Alajlan,et al.  Efficient Framework for Palm Tree Detection in UAV Images , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[23]  Gonzalo Pajares,et al.  Overview and Current Status of Remote Sensing Applications Based on Unmanned Aerial Vehicles (UAVs) , 2015 .

[24]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[25]  Peter Droogers,et al.  Effects of saline reclaimed waters and deficit irrigation on Citrus physiology assessed by UAV remote sensing , 2017 .

[26]  Dominique Brunel,et al.  Genetically Based Location from Triploid Populations and Gene Ontology of a 3.3-Mb Genome Region Linked to Alternaria Brown Spot Resistance in Citrus Reveal Clusters of Resistance Genes , 2013, PloS one.

[27]  Andrea Luvisi,et al.  iPathology: Robotic Applications and Management of Plants and Plant Diseases , 2017 .

[28]  Stephan Nebiker,et al.  A LIGHT-WEIGHT MULTISPECTRAL SENSOR FOR MICRO UAV – OPPORTUNITIES FOR VERY HIGH RESOLUTION AIRBORNE REMOTE SENSING , 2008 .

[29]  Alessandro Matese,et al.  Mapping of vine vigor by UAV and anthocyanin content by a non-destructive fluorescence technique , 2013 .

[30]  Ali Farhadi,et al.  YOLOv3: An Incremental Improvement , 2018, ArXiv.

[31]  Nataliia Kussul,et al.  Deep Learning Classification of Land Cover and Crop Types Using Remote Sensing Data , 2017, IEEE Geoscience and Remote Sensing Letters.

[32]  Won Suk Lee,et al.  Comparison of two aerial imaging platforms for identification of Huanglongbing-infected citrus trees , 2013 .

[33]  Anne-Katrin Mahlein Plant Disease Detection by Imaging Sensors - Parallels and Specific Demands for Precision Agriculture and Plant Phenotyping. , 2016, Plant disease.

[34]  Amr H. Abd-Elrahman,et al.  A remote sensing technique for detecting laurel wilt disease in avocado in presence of other biotic and abiotic stresses , 2019, Comput. Electron. Agric..

[35]  I. Levin,et al.  Induction of Seedlessness in Citrus: From Classical Techniques to Emerging Biotechnological Approaches , 2008 .

[36]  Qiang Xu,et al.  Isolation, phylogenetic relationship and expression profiling of sugar transporter genes in sweet orange (Citrus sinensis) , 2014, Plant Cell, Tissue and Organ Culture (PCTOC).

[37]  Craig S. T. Daughtry,et al.  Acquisition of NIR-Green-Blue Digital Photographs from Unmanned Aircraft for Crop Monitoring , 2010, Remote. Sens..