Early season detection of rice plants using RGB, NIR-G-B and multispectral images from unmanned aerial vehicle (UAV)

Abstract Crop plant detection is vital for mapping crop planting area and extracting pure crop canopy information. In this study, three cameras (RGB, color infrared (NIR-G-B) and multispectral (MS) camera) were mounted on a multi-rotor unmanned aerial vehicle (UAV) to obtain images of rice canopy at the early growth stages (tillering, jointing and initial booting stages). We proposed a new decision tree (DT) combining texture features (mean and variance (C.V)) and spectral features (TS-DT) for rice plants detection within UAV images. First, the image was classified into the pure class and the mixed class based on the C.V value. Then the pure class was classified into rice plants and road by the DN or reflectance value in red band. The mixed class was classified into rice plants and background (soil, water and duckweed) through comparing each pixel value to the mean value within the moving window. The results showed that TS-DT exhibited an averaged high classification accuracy with overall accuracy (OA) and kappa coefficient (KC) of 91.25%, 0.86, 92.88%, 0.86 and 93.53%, 0.88 for RGB, NIR and MS image among the early three growth stages, respectively. The highest estimation accuracy was obtained at booting stage and the lowest was at tillering stage. Compared with the traditional classification methods, the TS-DT method achieved an improved estimation accuracy of 5.2–26.71% in OA and 0.06–0.40 in KC. Therefore, this TS-DT method is a reliable approach for crop plants detection using UAV imagery.

[1]  Caiyun Zhang,et al.  Combining object-based texture measures with a neural network for vegetation mapping in the Everglades from hyperspectral imagery , 2012 .

[2]  F. López-Granados,et al.  Multi-temporal mapping of the vegetation fraction in early-season wheat fields using images from UAV , 2014 .

[3]  Yun Zhang,et al.  Optimisation of building detection in satellite images by combining multispectral classification and texture filtering , 1999 .

[4]  Mingjie Tang,et al.  Detection of Hidden Bruise on Kiwi fruit Using Hyperspectral Imaging and Parallelepiped Classification , 2012 .

[5]  G. Meyer,et al.  Verification of color vegetation indices for automated crop imaging applications , 2008 .

[6]  Xiang Zhou,et al.  Evaluation of RGB, Color-Infrared and Multispectral Images Acquired from Unmanned Aerial Systems for the Estimation of Nitrogen Accumulation in Rice , 2018, Remote. Sens..

[7]  Anne Puissant,et al.  The utility of texture analysis to improve per‐pixel classification for high to very high spatial resolution imagery , 2005 .

[8]  Peijun Li,et al.  Land cover classification using CHRIS/PROBA images and multi-temporal texture , 2012 .

[9]  C. Tucker.  Red and photographic infrared linear combinations for monitoring vegetation , 1979 .

[10]  Jorge Torres-Sánchez,et al.  An automatic object-based method for optimal thresholding in UAV images: Application for vegetation detection in herbaceous crops , 2015, Comput. Electron. Agric..

[11]  M. C. Kiran,et al.  Quantifying and mapping biodiversity and ecosystem services : Utility of a multi-season NDVI based Mahalanobis distance surrogate , 2009 .

[12]  Jinwei Dong,et al.  Mapping paddy rice planting areas through time series analysis of MODIS land surface temperature and vegetation index data. , 2015, ISPRS journal of photogrammetry and remote sensing : official publication of the International Society for Photogrammetry and Remote Sensing.

[13]  Zhiguo Cao,et al.  Crop segmentation from images by morphology modeling in the CIE L*a*b* color space , 2013 .

[14]  Peter M. Atkinson,et al.  Texture classification of Mediterranean land cover , 2007, Int. J. Appl. Earth Obs. Geoinformation.

[15]  A. Gitelson,et al.  Novel algorithms for remote estimation of vegetation fraction , 2002 .

[16]  Dongmei Chen,et al.  Examining the effect of spatial resolution and texture window size on classification accuracy: an urban environment case , 2004 .

[17]  Michael Pflanz,et al.  Monitoring Agronomic Parameters of Winter Wheat Crops with Low-Cost UAV Imagery , 2016, Remote. Sens..

[18]  Simon Bennertz,et al.  Estimating Biomass of Barley Using Crop Surface Models (CSMs) Derived from UAV-Based RGB Imaging , 2014, Remote. Sens..

[19]  Yudong Zhang,et al.  Polarimetric synthetic aperture radar image segmentation by convolutional neural network using graphical processing units , 2017, Journal of Real-Time Image Processing.

[20]  Qiang Cao,et al.  Evaluation of One-Class Support Vector Classification for Mapping the Paddy Rice Planting Area in Jiangsu Province of China from Landsat 8 OLI Imagery , 2018, Remote. Sens..

[21]  A. Huete.  A soil-adjusted vegetation index (SAVI) , 1988 .

[22]  P. V. Raju,et al.  Classification of wheat crop with multi-temporal images: performance of maximum likelihood and artificial neural networks , 2003 .

[23]  Arko Lucieer,et al.  Texture-based classification of sub-Antarctic vegetation communities on Heard Island , 2010, Int. J. Appl. Earth Obs. Geoinformation.

[24]  Chunhua Zhang,et al.  The application of small unmanned aerial systems for precision agriculture: a review , 2012, Precision Agriculture.

[25]  Ming-Der Yang,et al.  Spatial and Spectral Hybrid Image Classification for Rice Lodging Assessment through UAV Imagery , 2017, Remote. Sens..

[26]  Craig A. Coburn,et al.  A multiscale texture analysis procedure for improved forest stand classification , 2004 .

[27]  Mariana Belgiu,et al.  Sentinel-2 cropland mapping using pixel-based and object-based time-weighted dynamic time warping analysis , 2018 .

[28]  Won Suk Lee,et al.  Comparison of two aerial imaging platforms for identification of Huanglongbing-infected citrus trees , 2013 .

[29]  Robert A. Schowengerdt,et al.  A review and analysis of backpropagation neural networks for classification of remotely-sensed multi-spectral imagery , 1995 .

[30]  Weixing Cao,et al.  Predicting grain yield in rice using multi-temporal vegetation indices from UAV-based multispectral and digital imagery , 2017 .

[31]  Robert M. Haralick,et al.  Textural Features for Image Classification , 1973, IEEE Trans. Syst. Man Cybern..

[32]  Michal Strzelecki,et al.  Texture Analysis Methods - A Review , 1998 .

[33]  María Flor Álvarez-Taboada,et al.  Mapping of the Invasive Species Hakea sericea Using Unmanned Aerial Vehicle (UAV) and WorldView-2 Imagery and an Object-Oriented Approach , 2017, Remote. Sens..

[34]  Peter M. Atkinson,et al.  A comparison of texture measures for the per-field classification of Mediterranean land cover , 2004 .

[35]  O. Mutanga,et al.  Spectral discrimination of papyrus vegetation (Cyperus papyrus L.) in swamp wetlands using field spectrometry , 2009 .

[36]  Lei Tian,et al.  Development of a low-cost agricultural remote sensing system based on an autonomous unmanned aerial vehicle (UAV) , 2011 .

[37]  Jinwei Dong,et al.  Mapping paddy rice planting area in cold temperate climate region through analysis of time series Landsat 8 (OLI), Landsat 7 (ETM+) and MODIS imagery. , 2015, ISPRS journal of photogrammetry and remote sensing : official publication of the International Society for Photogrammetry and Remote Sensing.

[38]  A. Gitelson,et al.  Use of a green channel in remote sensing of global vegetation from EOS- MODIS , 1996 .

[39]  Alan H. Strahler,et al.  The Use of Prior Probabilities in Maximum Likelihood Classification , 1980 .

[40]  Luis Samaniego,et al.  Supervised Classification of Agricultural Land Cover Using a Modified k-NN Technique (MNN) and Landsat Remote Sensing Imagery , 2009, Remote. Sens..

[41]  G. Meyer,et al.  Color indices for weed identification under various soil, residue, and lighting conditions , 1994 .

[42]  Y. Zhu,et al.  Detecting leaf nitrogen content in wheat with canopy hyperspectrum under different soil backgrounds , 2014, Int. J. Appl. Earth Obs. Geoinformation.

[43]  Yudong Zhang,et al.  Remote-Sensing Image Classification Based on an Improved Probabilistic Neural Network , 2009, Sensors.

[44]  Jie Wang,et al.  Comparison of Classification Algorithms and Training Sample Sizes in Urban Land Classification with Landsat Thematic Mapper Imagery , 2014, Remote. Sens..

[45]  Peter M. Atkinson,et al.  The integration of spectral and textural information using neural networks for land cover mapping in the Mediterranean , 2000 .

[46]  Lei Tian,et al.  Environmentally adaptive segmentation algorithm for outdoor image segmentation , 1998 .

[47]  Weixing Cao,et al.  Assessing the Impact of Spatial Resolution on the Estimation of Leaf Nitrogen Concentration Over the Full Season of Paddy Rice Using Near-Surface Imaging Spectroscopy Data , 2018, Front. Plant Sci..

[48]  D. Stow,et al.  THE EFFECT OF TRAINING STRATEGIES ON SUPERVISED CLASSIFICATION AT DIFFERENT SPATIAL RESOLUTIONS , 2002 .

[49]  Giles M. Foody,et al.  A relative evaluation of multiclass image classification by support vector machines , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[50]  Minzan Li,et al.  Spectral difference analysis and airborne imaging classification for citrus greening infected trees , 2012 .

[51]  Arko Lucieer,et al.  apping invasive Fallopia japonica by combined spectral , spatial , and temporal nalysis of digital orthophotos , 2012 .

[52]  I. El-Magd,et al.  Improvements in land use mapping for irrigated agriculture from satellite sensor data using a multi-stage maximum likelihood classification , 2003 .

[53]  Giles M. Foody,et al.  An evaluation of some factors affecting the accuracy of classification by an artificial neural network , 1997 .

[54]  Weixing Cao,et al.  Combining Unmanned Aerial Vehicle (UAV)-Based Multispectral Imagery and Ground-Based Hyperspectral Data for Plant Nitrogen Concentration Estimation in Rice , 2018, Front. Plant Sci..

[55]  Marijke F. Augusteijn,et al.  Performance evaluation of texture measures for ground cover identification in satellite images by means of a neural network classifier , 1995, IEEE Trans. Geosci. Remote. Sens..

[56]  Tao Liu,et al.  Evaluation of Seed Emergence Uniformity of Mechanically Sown Wheat with UAV RGB Imagery , 2017, Remote. Sens..

[57]  Haiyan Wang,et al.  Classification of image pixels based on minimum distance and hypothesis testing , 2012, Comput. Stat. Data Anal..