A semi-supervised system for weed mapping in sunflower crops using unmanned aerial vehicles and a crop row detection method

Graphical abstractDisplay Omitted HighlightsThe problem of constructing a weed mapping model via machine learning techniques is assessed.The combination of spectral properties with vegetation indexes and crop rows helps the prediction.A semi-supervised classifier has been proved to perform well for the classification problem assessed with very few information provided by the user.An extended experimental design for weed mapping could be performed considering other crops. This paper presents a system for weed mapping, using imagery provided by unmanned aerial vehicles (UAVs). Weed control in precision agriculture is based on the design of site-specific control treatments according to weed coverage. A key component is precise and timely weed maps, and one of the crucial steps is weed monitoring, by ground sampling or remote detection. Traditional remote platforms, such as piloted planes and satellites, are not suitable for early weed mapping, given their low spatial and temporal resolutions. Nonetheless, the ultra-high spatial resolution provided by UAVs can be an efficient alternative. The proposed method for weed mapping partitions the image and complements the spectral information with other sources of information. Apart from the well-known vegetation indexes, which are commonly used in precision agriculture, a method for crop row detection is proposed. Given that crops are always organised in rows, this kind of information simplifies the separation between weeds and crops. Finally, the system incorporates classification techniques for the characterisation of pixels as crop, soil and weed. Different machine learning paradigms are compared to identify the best performing strategies, including unsupervised, semi-supervised and supervised techniques. The experiments study the effect of the flight altitude and the sensor used. Our results show that an excellent performance is obtained using very few labelled data complemented with unlabelled data (semi-supervised approach), which motivates the use of weed maps to design site-specific weed control strategies just when farmers implement the early post-emergence weed control.

[1]  Francisca López Granados Weed detection for site-specific weed management: Mapping and real-time approaches , 2011 .

[2]  Sharon A. Robinson,et al.  Using an Unmanned Aerial Vehicle (UAV) to capture micro-topography of Antarctic moss beds , 2014, Int. J. Appl. Earth Obs. Geoinformation.

[3]  Qin Song,et al.  Multiobjective fireworks optimization for variable-rate fertilization in oil crop production , 2013, Appl. Soft Comput..

[4]  G. Meyer,et al.  Color indices for weed identification under various soil, residue, and lighting conditions , 1994 .

[5]  Jan Verbesselt,et al.  Magnitude- and Shape-Related Feature Integration in Hyperspectral Mixture Analysis to Monitor Weeds in Citrus Orchards , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[6]  M. Jurado-Expósito,et al.  Spectral discrimination of wild oat and canary grass in wheat fields for less herbicide application , 2010, Agronomy for Sustainable Development.

[7]  Janez Demsar,et al.  Statistical Comparisons of Classifiers over Multiple Data Sets , 2006, J. Mach. Learn. Res..

[8]  Anil K. Jain Data clustering: 50 years beyond K-means , 2010, Pattern Recognit. Lett..

[9]  A. Gitelson,et al.  Novel algorithms for remote estimation of vegetation fraction , 2002 .

[10]  Francisca López-Granados,et al.  Broad-scale cruciferous weed patch classification in winter wheat using QuickBird imagery for in-season site-specific control , 2013, Precision Agriculture.

[11]  L. Tian,et al.  A Review on Remote Sensing of Weeds in Agriculture , 2004, Precision Agriculture.

[12]  Richard O. Duda,et al.  Use of the Hough transformation to detect lines and curves in pictures , 1972, CACM.

[13]  Francisca López-Granados,et al.  Multi-species weed spatial variability and site-specific management maps in cultivated sunflower , 2003, Weed Science.

[14]  Gonzalo Pajares,et al.  Overview and Current Status of Remote Sensing Applications Based on Unmanned Aerial Vehicles (UAVs) , 2015 .

[15]  Chunhua Zhang,et al.  The application of small unmanned aerial systems for precision agriculture: a review , 2012, Precision Agriculture.

[16]  Francisca López-Granados,et al.  Airborne multi-spectral imagery for mapping cruciferous weeds in cereal and legume crops , 2011, Precision Agriculture.

[17]  Jorge Torres-Sánchez,et al.  An automatic object-based method for optimal thresholding in UAV images: Application for vegetation detection in herbaceous crops , 2015, Comput. Electron. Agric..

[18]  Pedro Antonio Gutiérrez,et al.  Mapping sunflower yield as affected by Ridolfia segetum patches and elevation by applying evolutionary product unit neural networks to remote sensed data , 2008 .

[19]  Francisca López-Granados,et al.  Mapping Ridolfia segetum patches in sunflower crop using remote sensing , 2007 .

[20]  Alberto Tellaeche,et al.  A computer vision approach for weeds identification through Support Vector Machines , 2011, Appl. Soft Comput..

[21]  Francisca López-Granados,et al.  Weed detection for site-specific weed management: mapping and real-time approaches , 2011 .

[22]  Ribana Roscher,et al.  Incremental Import Vector Machines for Classifying Hyperspectral Data , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[23]  Alexander Zien,et al.  Semi-Supervised Learning , 2006 .

[24]  S. Sathiya Keerthi,et al.  Large scale semi-supervised linear SVMs , 2006, SIGIR.

[25]  Angela Ribeiro,et al.  Highlights and preliminary results for autonomous crop protection , 2015, Comput. Electron. Agric..

[26]  F. López-Granados,et al.  Multi-temporal mapping of the vegetation fraction in early-season wheat fields using images from UAV , 2014 .

[27]  Arko Lucieer,et al.  Sensor Correction of a 6-Band Multispectral Imaging Sensor for UAV Remote Sensing , 2012, Remote. Sens..

[28]  F. López-Granados,et al.  Configuration and Specifications of an Unmanned Aerial Vehicle (UAV) for Early Site Specific Weed Management , 2013, PloS one.

[29]  Lorenzo Comba,et al.  Vineyard detection from unmanned aerial systems images , 2015, Comput. Electron. Agric..

[30]  E. Oerke Crop losses to pests , 2005, The Journal of Agricultural Science.

[31]  Chih-Jen Lin,et al.  A comparison of methods for multiclass support vector machines , 2002, IEEE Trans. Neural Networks.

[32]  Jungho Im,et al.  Support vector machines in remote sensing: A review , 2011 .

[33]  F. López-Granados,et al.  Weed Mapping in Early-Season Maize Fields Using Object-Based Analysis of Unmanned Aerial Vehicle (UAV) Images , 2013, PloS one.

[34]  F. López-Granados,et al.  Assessing the accuracy of mosaics from unmanned aerial vehicle (UAV) imagery for precision agriculture purposes in wheat , 2013, Precision Agriculture.

[35]  Elpiniki I. Papageorgiou,et al.  Fuzzy cognitive map based approach for predicting yield in cotton crop production as a basis for decision support system in precision agriculture application , 2011, Appl. Soft Comput..

[36]  Xavier P. Burgos-Artizzu,et al.  Real-time image processing for crop / weed discrimination in maize fields , 2012 .

[37]  Farid Melgani,et al.  Automatic Car Counting Method for Unmanned Aerial Vehicle Images , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[38]  Zhe Xu,et al.  Feature Learning Based Approach for Weed Classification Using High Resolution Aerial Images from a Digital Camera Mounted on a UAV , 2014, Remote. Sens..

[39]  M. Jurado-Expósito,et al.  Multispectral classification of grass weeds and wheat (Triticum durum) using linear and nonparametric functional discriminant analysis and neural networks , 2008 .

[40]  A. Rango,et al.  Acquisition, orthorectification, and object-based classification of unmanned aerial vehicle (UAV) imagery for rangeland monitoring. , 2010 .

[41]  N. Otsu A threshold selection method from gray level histograms , 1979 .