Rice nitrogen nutrition estimation with RGB images and machine learning methods

Abstract Crop red–green–blue (RGB) images are powerful tools in nitrogen (N) nutrition estimation. Various regression models using crop N nutrition parameters and image indices have been suggested, but their accuracy and generalization performance for N estimation have not been thoroughly evaluated. In this study, a commercial digital camera was used to capture rice canopy RGB images in a 2-year field experiment, and three regression methods (simple nonlinear regression, SNR; backpropagation neural network, BPNN; and random forest regression, RF) were used for rice shoot dry matter (DM), N accumulation (NA), and leaf area index (LAI) estimation. A repeated random subsampling validation method was performed 1000 times on all three regression methods for the evaluation of model performance and stability. The RF regression models had the highest accuracy for the validation dataset, with average testing prediction accuracy (ATPA) of 80.17%, 79.44%, and 81.82% for DM, LAI, and NA estimation, respectively, followed by BPNN and SNR models. According to the distribution of ATPA in 1000-time calculations, the highest standard deviation (SD) and interval range (5%–95%) of ATPA was observed in BPNN models, which indicated that the BPNN model was most susceptible to dataset splitting. The lower SD and interval range of ATPA were followed by RF and SNR models, which indicated that the RF and SNR models were less affected by dataset splitting and were able to produce robust regression models consistently. In conclusion, the ensemble algorithm of the RF model effectively prevents overfitting when dealing with different dataset segmentations; thus, the RF model has strong generalization performance. A combination of digital imagery and appropriate machine learning methods facilitates convenient and reliable estimation of crop N nutrition.

[1]  Malia A. Gehan,et al.  Lights, camera, action: high-throughput plant phenotyping is ready for a close-up. , 2015, Current opinion in plant biology.

[2]  Robin Gebbers,et al.  Assessing Nitrogen and water status of winter wheat using a digital camera , 2019, Comput. Electron. Agric..

[3]  Bo Du,et al.  Deep Learning for Remote Sensing Data: A Technical Tutorial on the State of the Art , 2016, IEEE Geoscience and Remote Sensing Magazine.

[4]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[5]  Sudhanshu Sekhar Panda,et al.  Application of Vegetation Indices for Agricultural Crop Yield Prediction Using Neural Network Techniques , 2010, Remote. Sens..

[6]  E. Davidson,et al.  Managing nitrogen for sustainable development , 2015, Nature.

[7]  Charlie Walker,et al.  Estimating the nitrogen status of crops using a digital camera , 2010 .

[8]  Xinkai Zhu,et al.  Estimation of biomass in wheat using random forest regression algorithm and remote sensing data , 2016 .

[9]  Bin Liu,et al.  Active canopy sensing of winter wheat nitrogen status: An evaluation of two sensor systems , 2015, Comput. Electron. Agric..

[10]  Michael I. Jordan,et al.  Machine learning: Trends, perspectives, and prospects , 2015, Science.

[11]  Baskar Ganapathysubramanian,et al.  An explainable deep machine vision framework for plant stress phenotyping , 2018, Proceedings of the National Academy of Sciences.

[12]  Carolyn Hedley,et al.  The role of precision agriculture for improved nutrient management on farms. , 2015, Journal of the science of food and agriculture.

[13]  Byun-Woo Lee,et al.  Estimation of rice growth and nitrogen nutrition status using color digital camera image analysis , 2013 .

[14]  W. Shi,et al.  Development of a model using the nitrogen nutrition index to estimate in-season rice nitrogen requirement , 2020 .

[15]  Jianliang Huang,et al.  Strategies for overcoming low agronomic nitrogen use efficiency in irrigated rice systems in China , 2006 .

[16]  Kenji Omasa,et al.  Estimating rice chlorophyll content and leaf nitrogen concentration with a digital still color camera under natural light , 2014, Plant Methods.

[17]  Yuan Wang,et al.  In-Season Yield Prediction of Cabbage with a Hand-Held Active Canopy Sensor , 2017, Sensors.

[18]  Z. Zhu,et al.  Nitrogen fertilizer use in China – Contributions to food production, impacts on the environment and best management strategies , 2002, Nutrient Cycling in Agroecosystems.

[19]  Mario Chica-Olmo,et al.  An assessment of the effectiveness of a random forest classifier for land-cover classification , 2012 .

[20]  N. Ramankutty,et al.  Closing yield gaps through nutrient and water management , 2012, Nature.

[21]  Weixing Cao,et al.  Optimal Leaf Positions for SPAD Meter Measurement in Rice , 2016, Front. Plant Sci..

[22]  Xiaodong Yang,et al.  Modeling maize above-ground biomass based on machine learning approaches using UAV remote-sensing data , 2019, Plant Methods.

[23]  Jayme Garcia Arnal Barbedo,et al.  Detection of nutrition deficiencies in plants using proximal images and machine learning: A review , 2019, Comput. Electron. Agric..

[24]  Yidan Bao,et al.  Dynamic monitoring of biomass of rice under different nitrogen treatments using a lightweight UAV with dual image-frame snapshot cameras , 2019, Plant Methods.

[25]  Shan He,et al.  Identification of Nitrogen, Phosphorus, and Potassium Deficiencies Based on Temporal Dynamics of Leaf Morphology and Color , 2018 .

[26]  Natan S. Kopeika,et al.  Applicability of digital color imaging for monitoring nitrogen uptake and fertilizer requirements in crops , 2018, Remote Sensing.

[27]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[28]  Ashutosh Kumar Singh,et al.  Machine Learning for High-Throughput Stress Phenotyping in Plants. , 2016, Trends in plant science.

[29]  M. S. Borhan,et al.  Evaluation of computer imaging technique for predicting the SPAD readings in potato leaves. , 2017 .

[30]  Konstantinos P. Ferentinos,et al.  Deep learning models for plant disease detection and diagnosis , 2018, Comput. Electron. Agric..

[31]  Wei Li,et al.  A Comparative Assessment of Different Modeling Algorithms for Estimating Leaf Nitrogen Content in Winter Wheat Using Multispectral Images from an Unmanned Aerial Vehicle , 2018, Remote. Sens..

[32]  Tiantian Wang,et al.  Improving Unmanned Aerial Vehicle Remote Sensing-Based Rice Nitrogen Nutrition Index Prediction with Machine Learning , 2020, Remote. Sens..

[33]  Y. Wang,et al.  Estimating nitrogen status of rice using the image segmentation of G-R thresholding method , 2013 .

[34]  A. B. M. Shawkat Ali,et al.  A Random Forest Machine Learning Approach for the Retrieval of Leaf Chlorophyll Content in Wheat , 2019, Remote. Sens..

[35]  Flavio Esposito,et al.  Soybean yield prediction from UAV using multimodal data fusion and deep learning , 2020 .