Efficient Maize Tassel-Detection Method using UAV based remote sensing

Abstract Regular monitoring is worthwhile to maintain a healthy crop. Historically, the manual observation was used to monitor crops, which is time-consuming and often costly. The recent boom in the development of Unmanned Aerial Vehicles (UAVs) has established a quick and easy way to monitor crops. UAVs can cover a wide area in a few minutes and obtain useful crop information with different sensors such as RGB, multispectral, hyperspectral cameras. Simultaneously, Convolutional Neural Networks (CNNs) have been effectively used for various vision-based agricultural monitoring activities, such as flower detection, fruit counting, and yield estimation. However, Convolutional Neural Network (CNN) requires a massive amount of labeled data for training, which is not always easy to obtain. Especially in agriculture, generating labeled datasets is time-consuming and exhaustive since interest objects are typically small in size and large in number. This paper proposes a novel method using k-means clustering with adaptive thresholding for detecting maize crop tassels to address these issues. The qualitative and quantitative analysis of the proposed method reveals that our method performs close to reference approaches and has an advantage over computational complexity. The proposed method detected and counted tassels with precision: 0.97438, recall: 0.88132, and F1 Score: 0.92412. In addition, using maize tassel detection from UAV images as the task in this paper, we propose a semi-automatic image annotation method to create labeled datasets of the maize crop easily. Based on the proposed method, the developed tool can be used in conjunction with a machine learning model to provide initial annotations for a given image, modified further by the user. Our tool's performance analysis reveals promising savings in annotation time, enabling the rapid production of maize crop labeled datasets.

[1]  M. Weiss,et al.  Remote sensing for agricultural applications: A meta-review , 2020 .

[2]  Mohsen Guizani,et al.  Unmanned Aerial Vehicles (UAVs): A Survey on Civil Applications and Key Research Challenges , 2018, IEEE Access.

[3]  Tianzhu Xiang,et al.  Mini-Unmanned Aerial Vehicle-Based Remote Sensing: Techniques, applications, and prospects , 2019, IEEE Geoscience and Remote Sensing Magazine.

[4]  Zhiguo Cao,et al.  Region-based colour modelling for joint crop and maize tassel segmentation , 2016 .

[5]  A. Toreti,et al.  When Will Current Climate Extremes Affecting Maize Production Become the Norm? , 2019, Earth's Future.

[6]  Patrick Wspanialy,et al.  An Image Labeling Tool and Agricultural Dataset for Deep Learning , 2020, ArXiv.

[7]  Yiannis Ampatzidis,et al.  Agroview: Cloud-based application to process, analyze and visualize UAV-collected data for precision agriculture applications utilizing artificial intelligence , 2020, Comput. Electron. Agric..

[8]  Gregory Joy,et al.  Color image quantization by agglomerative clustering , 1994, IEEE Computer Graphics and Applications.

[9]  Konstantinos G. Nikolakopoulos,et al.  Emergency response to landslide using GNSS measurements and UAV , 2017, Remote Sensing.

[10]  Yuntao Ma,et al.  Detection of Maize Tassels from UAV RGB Imagery with Faster R-CNN , 2020, Remote. Sens..

[11]  David A. Wood,et al.  Automated Labelling using an Attention model for Radiology reports of MRI scans (ALARM) , 2020, MIDL.

[12]  Paolo Valigi,et al.  Combining Domain Adaptation and Spatial Consistency for Unseen Fruits Counting: A Quasi-Unsupervised Approach , 2020, IEEE Robotics and Automation Letters.

[13]  K. Nikolakopoulos,et al.  Post-seismic monitoring of cliff mass wasting using an unmanned aerial vehicle and field data at Egremni, Lefkada Island, Greece , 2020 .

[14]  Éric Gaussier,et al.  A Probabilistic Interpretation of Precision, Recall and F-Score, with Implication for Evaluation , 2005, ECIR.

[15]  J. MacQueen Some methods for classification and analysis of multivariate observations , 1967 .

[16]  A. Smaal,et al.  Oyster breakwater reefs promote adjacent mudflat stability and salt marsh growth in a monsoon dominated subtropical coast , 2019, Scientific Reports.

[17]  Ian Stavness,et al.  Deep Plant Phenomics: A Deep Learning Platform for Complex Plant Phenotyping Tasks , 2017, Front. Plant Sci..

[18]  Yadong Liu,et al.  Computer vision technology in agricultural automation —A review , 2020 .

[19]  Morten Bisgaard,et al.  Adaptive Surveying and Early Treatment of Crops with a Team of Autonomous Vehicles , 2011, ECMR.

[20]  S. Sankaran,et al.  High-throughput field phenotyping of Ascochyta blight disease severity in chickpea , 2019, Crop Protection.

[21]  A. Ghulam,et al.  Unmanned Aerial System (UAS)-Based Phenotyping of Soybean using Multi-sensor Data Fusion and Extreme Learning Machine , 2017 .

[22]  C. Lingard,et al.  Book Review: The Challenge of Red China , 1946 .

[23]  José Manuel Amigo,et al.  Hyperspectral imaging in crop fields: precision agriculture , 2020 .

[24]  Ismail Kavdir,et al.  Detecting corn tassels using computer vision and support vector machines , 2014, Expert Syst. Appl..

[25]  Trupti M. Kodinariya,et al.  Review on determining number of Cluster in K-Means Clustering , 2013 .

[26]  Seth C. Murray,et al.  Temporal Estimates of Crop Growth in Sorghum and Maize Breeding Enabled by Unmanned Aerial Systems , 2018 .

[27]  Derya Birant,et al.  ST-DBSCAN: An algorithm for clustering spatial-temporal data , 2007, Data Knowl. Eng..

[28]  Luc Van Gool,et al.  Efficient Non-Maximum Suppression , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[29]  Won Suk Lee,et al.  Comparison of two aerial imaging platforms for identification of Huanglongbing-infected citrus trees , 2013 .

[30]  Girish Chowdhary,et al.  Detecting In-Season Crop Nitrogen Stress of Corn for Field Trials Using UAV- and CubeSat-Based Multispectral Sensing , 2019, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[31]  Aalap Doshi,et al.  A comprehensive review on automation in agriculture using artificial intelligence , 2019, Artificial Intelligence in Agriculture.

[32]  Mahsa Asnafi,et al.  A Review on Potential Applications of Unmanned Aerial Vehicle for Construction Industry , 2018 .

[33]  Claire Marais-Sicre,et al.  Contribution of multispectral (optical and radar) satellite images to the classification of agricultural surfaces , 2020, Int. J. Appl. Earth Obs. Geoinformation.

[34]  S. Hussain,et al.  Interactive effects of drought and heat stresses on morpho-physiological attributes, yield, nutrient uptake and oxidative status in maize hybrids , 2019, Scientific Reports.

[35]  Zhiguo Cao,et al.  TasselNet: counting maize tassels in the wild via local counts regression network , 2017, Plant Methods.

[36]  Flavio Esposito,et al.  Soybean yield prediction from UAV using multimodal data fusion and deep learning , 2020 .

[37]  Jie Liang,et al.  Saliency Analysis and Gaussian Mixture Model-Based Detail Extraction Algorithm for Hyperspectral Pansharpening , 2020, IEEE Transactions on Geoscience and Remote Sensing.