Integration of Visible and Thermal Imagery with an Artificial Neural Network Approach for Robust Forecasting of Canopy Water Content in Rice

A total of 120 rice plant samples were scanned by visible and thermal proximal sensing systems under different water stress levels to evaluate the canopy water content (CWC). The oven-drying method was employed for assessing the canopy’s water state. This CWC is of great importance for irrigation management decisions. The proposed framework is to integrate visible and thermal imaging data using an artificial neural network as a valuable promising implement for accurately estimating the water content of the plant. The RGB-based features included 20 color vegetation indices (VI) and 6 gray level co-occurrence matrix-based texture features (GLCMF). The thermal imaging features were two thermal indicators (T), namely normalized relative canopy temperature (NRCT) and the crop water stress index (CWSI), that were deliberated by plant temperatures. These features were applied with a back-propagation neural network (BPNN) for training the samples with minimal loss on a cross-validation set. Model behavior was affected by filtering high-level features and optimizing hyperparameters of the model. The results indicated that feature-based modeling from both visible and thermal images achieved better performance than features from the individual visible or thermal image. The supreme prediction variables were 21 features: 14VI, 5GLCMF, and 2T. The fusion of color–texture–thermal features greatly improved the precision of water content evaluation (99.40%). Its determination coefficient (R2 = 0.983) was the most satisfied with an RMSE of 0.599. Overall, the methodology of this work can support decision makers and water managers to take effective and timely actions and achieve agricultural water sustainability.

[1]  Mohammadmehdi Saberioon,et al.  Assessment of rice leaf chlorophyll content using visible bands at different growth stages at both the leaf and canopy scale , 2014, Int. J. Appl. Earth Obs. Geoinformation.

[2]  M. Schaepman,et al.  Angular sensitivity analysis of vegetation indices derived from CHRIS/PROBA data , 2008 .

[3]  Jorge Nocedal,et al.  A Limited Memory Algorithm for Bound Constrained Optimization , 1995, SIAM J. Sci. Comput..

[4]  Yufeng Ge,et al.  High Throughput In vivo Analysis of Plant Leaf Chemical Properties Using Hyperspectral Imaging , 2017, Front. Plant Sci..

[5]  Hang Lei,et al.  Hyperparameter Optimization for Machine Learning Models Based on Bayesian Optimization , 2019 .

[6]  Qin Zhang,et al.  A Review of Imaging Techniques for Plant Phenotyping , 2014, Sensors.

[7]  Hua Sun,et al.  Mapping Forest Ecosystem Biomass Density for Xiangjiang River Basin by Combining Plot and Remote Sensing Data and Comparing Spatial Extrapolation Methods , 2017, Remote. Sens..

[8]  Chris Dyer,et al.  On the State of the Art of Evaluation in Neural Language Models , 2017, ICLR.

[9]  J. Casal,et al.  Cryptochrome as a Sensor of the Blue/Green Ratio of Natural Radiation in Arabidopsis1[C][W][OA] , 2010, Plant Physiology.

[10]  M. Louhaichi,et al.  Spatially Located Platform and Aerial Photography for Documentation of Grazing Impacts on Wheat , 2001 .

[11]  Xavier P. Burgos-Artizzu,et al.  utomatic segmentation of relevant textures in agricultural images , 2010 .

[12]  Urs Schmidhalter,et al.  Evaluating RGB Imaging and Multispectral Active and Hyperspectral Passive Sensing for Assessing Early Plant Vigor in Winter Wheat , 2018, Sensors.

[13]  Michael J. Delwiche,et al.  Development of a Continuous Leaf Monitoring System to Predict Plant Water Status , 2017 .

[14]  F H Schulze,et al.  Applications of Artificial Neural Networks in integrated water management: fiction or future? , 2005, Water science and technology : a journal of the International Association on Water Pollution Research.

[15]  Su Ki Ooi,et al.  Detecting maize leaf water status by using digital RGB images , 2014 .

[16]  Wolfram Mauser,et al.  Spaceborne Imaging Spectroscopy for Sustainable Agriculture: Contributions and Challenges , 2018, Surveys in Geophysics.

[17]  David Enke,et al.  The adaptive selection of financial and economic variables for use with artificial neural networks , 2004, Neurocomputing.

[18]  Pan Wen-chao.  Diagnosis of Cotton Water Status Based on Image Recognition , 2007 .

[19]  Makoto Nakatani,et al.  An Algorithm for Estimating Chlorophyll Content in Leaves Using a Video Camera , 1998 .

[20]  Y. Cohen,et al.  Use of thermal and visible imagery for estimating crop water status of irrigated grapevine. , 2006, Journal of experimental botany.

[21]  J. Macgregor,et al.  Image texture analysis: methods and comparisons , 2004 .

[22]  S. Idso,et al.  Normalizing the stress-degree-day parameter for environmental variability☆ , 1981 .

[23]  Wossenu Abtew,et al.  Evaporation and Evapotranspiration: Measurements and Estimations , 2012 .

[24]  U. Schmidhalter,et al.  Spectral reflectance indices as a rapid and nondestructive phenotyping tool for estimating different morphophysiological traits of contrasting spring wheat germplasms under arid conditions , 2015 .

[25]  M. M. Chaves,et al.  Thermography to explore plant-environment interactions. , 2013, Journal of experimental botany.

[26]  P. F. Scholander,et al.  Sap Pressure in Vascular Plants , 1965, Science.

[27]  J. Peñuelas,et al.  Estimation of plant water concentration by the reflectance Water Index WI (R900/R970) , 1997 .

[28]  Uri Yermiyahu,et al.  An insight to the performance of crop water stress index for olive trees , 2013 .

[29]  C. Rosen,et al.  Crop water stress index derived from multi-year ground and aerial thermal images as an indicator of potato water status , 2014, Precision Agriculture.

[30]  R. E. Yoder,et al.  Simulation of nitrate distribution under drip irrigation using artificial neural networks , 2003, Irrigation Science.

[31]  Ozgur Kisi,et al.  Evapotranspiration Estimation using Six Different Multi-layer PerceptronAlgorithms , 2016 .

[32]  Pau Martí,et al.  An artificial neural network approach to the estimation of stem water potential from frequency domain reflectometry soil moisture measurements and meteorological data , 2013 .

[33]  Y. Ge,et al.  Field-Based Scoring of Soybean Iron Deficiency Chlorosis Using RGB Imaging and Statistical Learning , 2018, Front. Plant Sci..

[34]  Dimitrios I. Fotiadis,et al.  Plaque Characterization Methods Using Intravascular Ultrasound Imaging , 2017 .

[35]  G. Meyer,et al.  Color indices for weed identification under various soil, residue, and lighting conditions , 1994 .

[36]  S. Elsayed,et al.  Hyperspectral remote sensing to assess the water status, biomass, and yield of maize cultivars under salinity and water stress , 2017 .

[37]  Hirokazu Fukuda,et al.  Non-destructive sensing and its inverse model for canopy parameters using texture analysis and artificial neural network , 2007 .

[38]  H. Jones,et al.  Combining thermal and visible imagery for estimating canopy temperature and identifying plant stress. , 2004, Journal of experimental botany.

[39]  C. Tucker.  Red and photographic infrared linear combinations for monitoring vegetation , 1979 .

[40]  Sushma Jain,et al.  Reference evapotranspiration estimation and modeling of the Punjab Northern India using deep learning , 2019, Comput. Electron. Agric..

[41]  M. Feng,et al.  Assessment of plant water status in winter wheat (Triticum aestivum L.) based on canopy spectral indices , 2019, PloS one.

[42]  R. Ranjan.  Predicting the leaf water potential of potato plants using RGB reflectance , 2008 .

[43]  Louis W. Glorfeld.  A Methodology for simplification and interpretation of backpropagation-based neural network models , 1996 .

[44]  Yufeng Ge,et al.  Temporal dynamics of maize plant growth, water use, and leaf water content using automated high throughput RGB and hyperspectral imaging , 2016, Comput. Electron. Agric..

[45]  P. Zarco-Tejada,et al.  Fluorescence, temperature and narrow-band indices acquired from a UAV platform for water stress detection using a micro-hyperspectral imager and a thermal camera , 2012 .

[46]  Pablo J. Zarco-Tejada,et al.  Airborne Thermal Imagery to Detect the Seasonal Evolution of Crop Water Status in Peach, Nectarine and Saturn Peach Orchards , 2016, Remote. Sens..

[48]  Jon Nielsen,et al.  Are vegetation indices derived from consumer-grade cameras mounted on UAVs sufficiently reliable for assessing experimental plots? , 2016 .

[49]  Widodo Budiharto,et al.  Mango Fruit Sortation System using Neural Network and Computer Vision , 2017, International Conference on Computer Science and Computational Intelligence.

[50]  Li Fu-sheng.  Effects of irrigation method and ratio of organic to inorganic nitrogen on yield and water use of rice , 2012 .

[51]  Josep Peñuelas,et al.  Cell wall elasticity and Water Index (R970 nm/R900 nm) in wheat under different nitrogen availabilities , 1996 .

[52]  Natasha Gilbert,et al.  Water under pressure , 2012, Nature.

[53]  B. Das,et al.  Evaluation of regression algorithms for estimating leaf area index and canopy water content from water stressed rice canopy reflectance , 2020 .

[54]  Haruhiko Murase,et al.  Growth Monitoring of Green Vegetables Cultured in a Centrifuge Phytotron , 1997 .

[55]  Michael E. Schaepman,et al.  Estimating canopy water content using hyperspectral remote sensing data , 2010, Int. J. Appl. Earth Obs. Geoinformation.

[56]  Zhengjun Qiu,et al.  Fusion of Feature Selection Methods and Regression Algorithms for Predicting the Canopy Water Content of Rice Based on Hyperspectral Data , 2021, Agriculture.

[57]  M. A. Jiménez-Bello,et al.  Usefulness of thermography for plant water stress detection in citrus and persimmon trees , 2013 .

[58]  J. Mayer,et al.  Infrared thermal sensing of plant canopies as a screening technique for dehydration avoidance in wheat , 1982 .

[59]  Anand Singh Jalal,et al.  Fusing Color and Texture Cues to Identify the Fruit Diseases Using Images , 2014, Int. J. Comput. Vis. Image Process..