Modified Red Blue Vegetation Index for Chlorophyll Estimation and Yield Prediction of Maize from Visible Images Captured by UAV

The vegetation index (VI) has been successfully used to monitor the growth and to predict the yield of agricultural crops. In this paper, a long-term observation was conducted for the yield prediction of maize using an unmanned aerial vehicle (UAV) and estimations of chlorophyll contents using SPAD-502. A new vegetation index termed as modified red blue VI (MRBVI) was developed to monitor the growth and to predict the yields of maize by establishing relationships between MRBVI- and SPAD-502-based chlorophyll contents. The coefficients of determination (R2s) were 0.462 and 0.570 in chlorophyll contents’ estimations and yield predictions using MRBVI, and the results were relatively better than the results from the seven other commonly used VI approaches. All VIs during the different growth stages of maize were calculated and compared with the measured values of chlorophyll contents directly, and the relative error (RE) of MRBVI is the lowest at 0.355. Further, machine learning (ML) methods such as the backpropagation neural network model (BP), support vector machine (SVM), random forest (RF), and extreme learning machine (ELM) were adopted for predicting the yields of maize. All VIs calculated for each image captured during important phenological stages of maize were set as independent variables and the corresponding yields of each plot were defined as dependent variables. The ML models used the leave one out method (LOO), where the root mean square errors (RMSEs) were 2.157, 1.099, 1.146, and 1.698 (g/hundred grain weight) for BP, SVM, RF, and ELM. The mean absolute errors (MAEs) were 1.739, 0.886, 0.925, and 1.356 (g/hundred grain weight) for BP, SVM, RF, and ELM, respectively. Thus, the SVM method performed better in predicting the yields of maize than the other ML methods. Therefore, it is strongly suggested that the MRBVI calculated from images acquired at different growth stages integrated with advanced ML methods should be used for agricultural- and ecological-related chlorophyll estimation and yield predictions.

[1]  Jiaguo Qi,et al.  Improved population mapping for China using remotely sensed and points-of-interest data within a random forests model. , 2019, The Science of the total environment.

[2]  Kun Tan,et al.  Wavelet SVM in Reproducing Kernel Hilbert Space for hyperspectral remote sensing image classification , 2010 .

[3]  M. Mccabe,et al.  A Calibration Procedure for Field and UAV-Based Uncooled Thermal Infrared Instruments , 2020, Sensors.

[4]  F. Baret,et al.  Estimation of Wheat Plant Density at Early Stages Using High Resolution Imagery , 2017, Front. Plant Sci..

[5]  Xueliang Zhang,et al.  Deep learning in remote sensing applications: A meta-analysis and review , 2019, ISPRS Journal of Photogrammetry and Remote Sensing.

[6]  J. Senthilnath,et al.  Multitemporal time series analysis using machine learning models for ground deformation in the Erhai region, China , 2020, Environmental Monitoring and Assessment.

[7]  Liangliang Zhang,et al.  Prediction of Winter Wheat Yield Based on Multi-Source Data and Machine Learning in China , 2020, Remote. Sens..

[8]  Joydeep Ghosh,et al.  Investigation of the random forest framework for classification of hyperspectral data , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[9]  Zhao Zhang,et al.  Identifying the Contributions of Multi-Source Data for Winter Wheat Yield Prediction in China , 2020, Remote. Sens..

[10]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[11]  Ning Li,et al.  A Hierarchical Airport Detection Method Using Spatial Analysis and Deep Learning , 2019, Remote. Sens..

[12]  N. Wang,et al.  Modelling maize phenology, biomass growth and yield under contrasting temperature conditions , 2018 .

[13]  Marco Dubbini,et al.  Evaluating Multispectral Images and Vegetation Indices for Precision Farming Applications from UAV Images , 2015, Remote. Sens..

[14]  Mahesh Pal,et al.  Random forest classifier for remote sensing classification , 2005 .

[15]  J. Senthilnath,et al.  Application of UAV imaging platform for vegetation analysis based on spectral-spatial methods , 2017, Comput. Electron. Agric..

[16]  Kuo-Wei Chang,et al.  Effects of nitrogen status on leaf anatomy, chlorophyll content and canopy reflectance of paddy rice , 2011 .

[17]  Emanuele Santi,et al.  Comparison of Machine Learning Methods Applied to SAR Images for Forest Classification in Mediterranean Areas , 2020, Remote. Sens..

[18]  Wenzhong Shi,et al.  Remote Sensing Image Fusion Using Multiscale Mapped LS-SVM , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[19]  F. A. P. Avalos,et al.  Determination of vegetation cover index under different soil management systems of cover plants by using an unmanned aerial vehicle with an onboard digital photographic camera , 2019, Semina: Ciências Agrárias.

[20]  Xiaomao Lin,et al.  Maize potential yields and yield gaps in the changing climate of northeast China , 2012 .

[21]  Lei Yan,et al.  Agricultural drought monitoring using European Space Agency Sentinel 3A land surface temperature and normalized difference vegetation index imageries , 2019 .

[22]  I. Lorite,et al.  Impact of high temperatures in maize: Phenology and yield components , 2018 .

[23]  Fan Yang,et al.  Estimating grassland LAI using the Random Forests approach and Landsat imagery in the meadow steppe of Hulunber, China , 2017 .

[24]  Lorenzo Bruzzone,et al.  A Novel SOM-SVM-Based Active Learning Technique for Remote Sensing Image Classification , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[25]  Junho Yeom,et al.  Comparison of Vegetation Indices Derived from UAV Data for Differentiation of Tillage Effects in Agriculture , 2019, Remote. Sens..

[26]  Rich Caruana,et al.  Overfitting in Neural Nets: Backpropagation, Conjugate Gradient, and Early Stopping , 2000, NIPS.

[27]  H. Pleijel,et al.  Evaluating the relationship between leaf chlorophyll concentration and SPAD-502 chlorophyll meter readings , 2007, Photosynthesis Research.

[28]  P. Gentine,et al.  Reconstructed Solar‐Induced Fluorescence: A Machine Learning Vegetation Product Based on MODIS Surface Reflectance to Reproduce GOME‐2 Solar‐Induced Fluorescence , 2018, Geophysical research letters.

[29]  Marcello Chiaberge,et al.  UAV and Machine Learning Based Refinement of a Satellite-Driven Vegetation Index for Precision Agriculture † , 2020, Sensors.

[30]  Yuan Zhou,et al.  A Simple Method for Detecting Phenological Change From Time Series of Vegetation Index , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[31]  Ran Meng,et al.  A UAS Platform for Assessing Spectral, Structural, and Thermal Patterns of Arctic Tundra Vegetation , 2019, IGARSS 2019 - 2019 IEEE International Geoscience and Remote Sensing Symposium.

[32]  Ma. Rebecca C. Laza,et al.  Chlorophyll meter estimates leaf area‐based nitrogen concentration of rice , 1995 .

[33]  K. Cassman,et al.  Closing yield gaps for rice self-sufficiency in China , 2019, Nature Communications.

[34]  A. Kai Qin,et al.  Evolutionary extreme learning machine , 2005, Pattern Recognit..

[35]  N. Raghuwanshi,et al.  Spatial variability of climate change impacts on yield of rice and wheat in the Indian Ganga Basin. , 2013, The Science of the total environment.

[36]  Ujjwal Maulik,et al.  Learning with transductive SVM for semisupervised pixel classification of remote sensing imagery , 2013 .

[37]  Patrizia Busato,et al.  Machine Learning in Agriculture: A Review , 2018, Sensors.

[38]  F. Tao,et al.  Temporal and spatial changes of maize yield potentials and yield gaps in the past three decades in China , 2015 .

[39]  M. Urynowicz,et al.  Enhanced bioremediation of diesel range hydrocarbons in soil using biochar made from organic wastes , 2020, Environmental Monitoring and Assessment.

[40]  D. Giordan,et al.  ESTIMATING CROP DENSITY FROM MULTI-SPECTRAL UAV IMAGERY IN MAIZE CROP , 2019, The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences.

[41]  B. Rabiei,et al.  Improvement of nitrogen management in rice paddy fields using chlorophyll meter (SPAD) , 2008, Paddy and Water Environment.

[42]  N. D. Tillett,et al.  Automated Crop and Weed Monitoring in Widely Spaced Cereals , 2006, Precision Agriculture.

[43]  A. Crane-Droesch Machine learning methods for crop yield prediction and climate change impact assessment in agriculture , 2018, Environmental Research Letters.

[44]  C. Field,et al.  Global scale climate–crop yield relationships and the impacts of recent warming , 2007, Environmental Research Letters.

[45]  Z. Wan,et al.  Using MODIS Land Surface Temperature and Normalized Difference Vegetation Index products for monitoring drought in the southern Great Plains, USA , 2004 .

[46]  Zunfu Lv,et al.  Adjusting sowing date and cultivar shift improve maize adaption to climate change in China , 2019, Mitigation and Adaptation Strategies for Global Change.

[47]  M. Bauer,et al.  Comparison of petiole nitrate concentrations, SPAD chlorophyll readings, and QuickBird satellite imagery in detecting nitrogen status of potato canopies , 2007 .

[48]  T. Sakamoto,et al.  Estimating Rice Leaf Greenness (SPAD) Using Fixed-Point Continuous Observations of Visible Red and Near Infrared Narrow-Band Digital Images , 2012 .

[49]  A. Ruane,et al.  Uncertainties in predicting rice yield by current crop models under a wide range of climatic conditions , 2015, Global change biology.

[50]  Navin Ramankutty,et al.  Mind the gap: how do climate and agricultural management explain the ‘yield gap’ of croplands around the world? , 2010 .

[51]  Liangliang Zhang,et al.  Combining Optical, Fluorescence, Thermal Satellite, and Environmental Data to Predict County-Level Maize Yield in China Using Machine Learning Approaches , 2019, Remote. Sens..

[52]  Shufeng Han,et al.  Comparison of Satellite Remote Sensing and Aerial Photography for Ability to Detect In-Season Nitrogen Stress in Corn , 2001 .

[53]  G. Meyer,et al.  Verification of color vegetation indices for automated crop imaging applications , 2008 .

[54]  Dong Liang,et al.  Leaf Area Index Estimation Using Vegetation Indices Derived From Airborne Hyperspectral Images in Winter Wheat , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[55]  A. Viña,et al.  Remote estimation of leaf area index and green leaf biomass in maize canopies , 2003 .

[56]  Chen Li-ping,et al.  Study on diagnosing nitrogen nutrition status of corn using Greenseeker and SPAD meter , 2008 .

[57]  C. Lee Giles,et al.  Overfitting and neural networks: conjugate gradient and backpropagation , 2000, Proceedings of the IEEE-INNS-ENNS International Joint Conference on Neural Networks. IJCNN 2000. Neural Computing: New Challenges and Perspectives for the New Millennium.

[58]  Chee Kheong Siew,et al.  Extreme learning machine: Theory and applications , 2006, Neurocomputing.

[59]  R. Clark,et al.  Spectroscopic Determination of Leaf Biochemistry Using Band-Depth Analysis of Absorption Features and Stepwise Multiple Linear Regression , 1999 .

[60]  G. Mi,et al.  Yield gap simulations using ten maize cultivars commonly planted in Northeast China during the past five decades , 2015 .

[61]  R. P. Singh,et al.  Use of vegetation index and meteorological parameters for the prediction of crop yield in India , 2007 .

[62]  Deren Li,et al.  Multi-scale hierarchical sampling change detection using Random Forest for high-resolution satellite imagery , 2018 .

[63]  J. Senthilnath,et al.  Radiometric Calibration for Multispectral Camera of Different Imaging Conditions Mounted on a UAV Platform , 2019, Sustainability.

[64]  Yahui Guo,et al.  Ground Deformation Analysis Using InSAR and Backpropagation Prediction with Influencing Factors in Erhai Region, China , 2019, Sustainability.

[65]  Nathan D. Miller,et al.  Predicting Zea mays Flowering Time, Yield, and Kernel Dimensions by Analyzing Aerial Images , 2019, Front. Plant Sci..

[66]  M. S. Borhan,et al.  Evaluation of computer imaging technique for predicting the SPAD readings in potato leaves. , 2017 .

[67]  F. Baret,et al.  Estimates of plant density of wheat crops at emergence from very low altitude UAV imagery. , 2017 .

[68]  Yu Jin,et al.  Recognition of Banana Fusarium Wilt Based on UAV Remote Sensing , 2020, Remote. Sens..

[69]  Xiaohang Li,et al.  Combining UAV-based hyperspectral imagery and machine learning algorithms for soil moisture content monitoring , 2019, PeerJ.

[70]  Jon Atli Benediktsson,et al.  Deep TEC: Deep Transfer Learning with Ensemble Classifier for Road Extraction from UAV Imagery , 2020, Remote. Sens..

[71]  A. Gitelson,et al.  Novel algorithms for remote estimation of vegetation fraction , 2002 .

[72]  I. Asano,et al.  The diagnosis of nitrogen nutrition of rice plants (Sasanishiki) using chlorophyll-meter. , 1986 .

[73]  Hod Lipson,et al.  Quantitative Phenotyping of Northern Leaf Blight in UAV Images Using Deep Learning , 2019, Remote. Sens..

[74]  J. Senthilnath,et al.  Detection of tomatoes using spectral-spatial methods in remotely sensed RGB images captured by UAV , 2016 .

[75]  Jing Li,et al.  Estimating Maize Above-Ground Biomass Using 3D Point Clouds of Multi-Source Unmanned Aerial Vehicle Data at Multi-Spatial Scales , 2019, Remote. Sens..

[76]  Xiaodong Yang,et al.  Modeling maize above-ground biomass based on machine learning approaches using UAV remote-sensing data , 2019, Plant Methods.

[77]  Andrew E. Suyker,et al.  A Two-Step Filtering approach for detecting maize and soybean phenology with time-series MODIS data , 2010 .