Corn Yield Prediction With Ensemble CNN-DNN

We investigate the predictive performance of two novel CNN-DNN machine learning ensemble models in predicting county-level corn yields across the US Corn Belt (12 states). The developed data set is a combination of management, environment, and historical corn yields from 1980 to 2019. Two scenarios for ensemble creation are considered: homogenous and heterogenous ensembles. In homogenous ensembles, the base CNN-DNN models are all the same, but they are generated with a bagging procedure to ensure they exhibit a certain level of diversity. Heterogenous ensembles are created from different base CNN-DNN models which share the same architecture but have different hyperparameters. Three types of ensemble creation methods were used to create several ensembles for either of the scenarios: Basic Ensemble Method (BEM), Generalized Ensemble Method (GEM), and stacked generalized ensembles. Results indicated that both designed ensemble types (heterogenous and homogenous) outperform the ensembles created from five individual ML models (linear regression, LASSO, random forest, XGBoost, and LightGBM). Furthermore, by introducing improvements over the heterogenous ensembles, the homogenous ensembles provide the most accurate yield predictions across US Corn Belt states. This model could make 2019 yield predictions with a root mean square error of 866 kg/ha, equivalent to 8.5% relative root mean square and could successfully explain about 77% of the spatio-temporal variation in the corn grain yields. The significant predictive power of this model can be leveraged for designing a reliable tool for corn yield prediction which will in turn assist agronomic decision makers.

[1]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[2]  B. Basso,et al.  Seasonal crop yield forecast: Methods, applications, and accuracies , 2019, Advances in Agronomy.

[3]  Juan Frausto Solís,et al.  Predictive ability of machine learning methods for massive crop yield prediction , 2014 .

[4]  Salah Sukkarieh,et al.  Machine learning approaches for crop yield prediction and nitrogen status estimation in precision agriculture: A review , 2018, Comput. Electron. Agric..

[5]  Mohsen Shahhosseini,et al.  Coupling machine learning and crop modeling improves crop yield prediction in the US Corn Belt , 2020, Scientific Reports.

[6]  Qing. Shi Chapter Seven , 2019, New Kings of the World.

[7]  Sander Bohte,et al.  Conditional Time Series Forecasting with Convolutional Neural Networks , 2017, 1703.04691.

[8]  Roy B. Dodd,et al.  COMPARISON OF DIFFERENT TYPES OF LIGHT SOURCES FOR OPTICAL COTTON MASS MEASUREMENTA NEURAL NETWORK FOR SETTING TARGET CORN YIELDS , 2001 .

[9]  P. Feng,et al.  Incorporating machine learning with biophysical model can improve the evaluation of climate extremes impacts on wheat yield in south-eastern Australia , 2019, Agricultural and Forest Meteorology.

[10]  Leo Breiman,et al.  Bagging Predictors , 1996, Machine Learning.

[11]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[12]  Moncef Gabbouj,et al.  Real-Time Motor Fault Detection by 1-D Convolutional Neural Networks , 2016, IEEE Transactions on Industrial Electronics.

[13]  Jose A. Romagnoli,et al.  Deep Learning Based Soft Sensor and Its Application on a Pyrolysis Reactor for Compositions Predictions of Gas Phase Components , 2018 .

[14]  Jingfeng Huang,et al.  A deep learning approach to conflating heterogeneous geospatial data for corn yield estimation: A case study of the US Corn Belt at the county level , 2019, Global change biology.

[15]  Stien Heremans,et al.  A comparison of machine learning algorithms for regional wheat yield prediction using NDVI time series of SPOT-VGT , 2016, 2016 Fifth International Conference on Agro-Geoinformatics (Agro-Geoinformatics).

[16]  David H. Wolpert,et al.  Stacked generalization , 1992, Neural Networks.

[17]  T. Mavromatis Spatial resolution effects on crop yield forecasts: An application to rainfed wheat yield in north Greece with CERES-Wheat , 2016 .

[18]  A. Crane-Droesch Machine learning methods for crop yield prediction and climate change impact assessment in agriculture , 2018, Environmental Research Letters.

[19]  Stefano Ermon,et al.  Deep Gaussian Process for Crop Yield Prediction Based on Remote Sensing Data , 2017, AAAI.

[20]  Hong-Bin Shen,et al.  Artificial intelligence in bioinformatics , 2020, Biomedical Information Technology.

[21]  I. Nyagumbo,et al.  Evaluating machine learning algorithms for predicting maize yield under conservation agriculture in Eastern and Southern Africa , 2020, SN Applied Sciences.

[22]  Dong Jiang,et al.  An artificial neural network model for estimating crop yields using remotely sensed information , 2004 .

[23]  Mohsen Shahhosseini,et al.  Maize yield and nitrate loss prediction with machine learning algorithms , 2019, Environmental Research Letters.

[24]  Y. Everingham,et al.  Accurate prediction of sugarcane yield using a random forest algorithm , 2016, Agronomy for Sustainable Development.

[25]  Kenneth A. Sudduth,et al.  STATISTICAL AND NEURAL METHODS FOR SITE–SPECIFIC YIELD PREDICTION , 2003 .

[26]  Yang-Won Lee,et al.  A Comparison Between Major Artificial Intelligence Models for Crop Yield Prediction: Case Study of the Midwestern United States, 2006-2015 , 2019, ISPRS Int. J. Geo Inf..

[27]  Xanthoula Eirini Pantazi,et al.  Wheat yield prediction using machine learning and advanced sensing techniques , 2016, Comput. Electron. Agric..

[28]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[29]  R. Confalonieri,et al.  Forecasting sugarcane yields using agro-climatic indicators and Canegro model: A case study in the main production region in Brazil , 2017 .

[30]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[31]  Patrice Simardy,et al.  Learning Long-Term Dependencies with , 2007 .

[32]  Yoshua Bengio,et al.  Learning long-term dependencies with gradient descent is difficult , 1994, IEEE Trans. Neural Networks.

[33]  Stefano Pignatti,et al.  Downstream Services for Rice Crop Monitoring in Europe: From Regional to Local Scale , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[34]  Cha Zhang,et al.  Ensemble Machine Learning , 2012 .

[35]  Prabhat,et al.  Artificial Neural Network , 2018, Encyclopedia of GIS.

[36]  S. Vincenzi,et al.  Application of a Random Forest algorithm to predict spatial distribution of the potential yield of Ruditapes philippinarum in the Venice lagoon, Italy , 2011 .

[37]  Onur Avci,et al.  1-D Convolutional Neural Networks for Signal Processing Applications , 2019, ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[38]  C. Hamel,et al.  Crop Yield , 1999, Springer Berlin Heidelberg.

[39]  Jonathan P. Resop,et al.  Random Forests for Global and Regional Crop Yield Predictions , 2016, PloS one.

[40]  Shinji Fukuda,et al.  Random Forests modelling for the estimation of mango (Mangifera indica L. cv. Chok Anan) fruit yields under different irrigation regimes , 2013 .

[41]  Y. Cai,et al.  Crop Yield Predictions - High Resolution Statistical Model for Intra-season Forecasts Applied to Corn in the US , 2017 .

[42]  Juan Frausto-Solís,et al.  Predictive ability of machine learning methods for massive crop yield prediction , 2014 .

[43]  Qi Yang,et al.  Deep convolutional neural networks for rice grain yield estimation at the ripening stage using UAV-based remotely sensed images , 2019, Field Crops Research.

[44]  Qinghan Dong,et al.  Potential of ensemble tree methods for early-season prediction of winter wheat yield from short time series of remotely sensed normalized difference vegetation index and in situ meteorological data , 2015 .

[45]  Stefano Ermon,et al.  Deep Transfer Learning for Crop Yield Prediction with Remote Sensing Data , 2018, COMPASS.

[46]  Lizhi Wang,et al.  Predicting yield performance of parents in plant breeding: A neural collaborative filtering approach , 2020, PloS one.

[47]  Lizhi Wang,et al.  A CNN-RNN Framework for Crop Yield Prediction , 2019, Frontiers in Plant Science.

[48]  Mohsen Shahhosseini,et al.  Forecasting Corn Yield With Machine Learning Ensembles , 2020, Frontiers in Plant Science.

[49]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[50]  Cha Zhang,et al.  Ensemble Machine Learning: Methods and Applications , 2012 .

[51]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[52]  Lizhi Wang,et al.  Crop Yield Prediction Using Deep Neural Networks , 2019, Front. Plant Sci..

[53]  Gavin Brown,et al.  Ensemble Learning , 2010, Encyclopedia of Machine Learning and Data Mining.

[54]  L. Cooper,et al.  When Networks Disagree: Ensemble Methods for Hybrid Neural Networks , 1992 .