Attention Mechanisms in Convolutional Neural Networks for Nitrogen Treatment Detection in Tomato Leaves Using Hyperspectral Images

Nitrogen is an essential macronutrient for the growth and development of tomatoes. However, excess nitrogen fertilization can affect the quality of tomato fruit, making it unattractive to consumers. Consequently, the aim of this study is to develop a method for the early detection of excessive nitrogen fertilizer use in Royal tomato by visible and near-infrared spectroscopy. Spectral reflectance values of tomato leaves were captured at wavelengths between 400 and 1100 nm, collected from several treatments after application of normal nitrogen and on the first, second, and third days after application of excess nitrogen. A new method based on convolutional neural networks (CNN) with an attention mechanism was proposed to perform the estimation of nitrogen overdose in tomato leaves. To verify the effectiveness of this method, the proposed attention mechanism-based CNN classifier was compared with an alternative CNN having the same architecture without integrating the attention mechanism, and with other CNN models, AlexNet and VGGNet. Experimental results showed that the CNN with an attention mechanism outperformed the alternative CNN, achieving a correct classification rate (CCR) of 97.33% for the treatment, compared with a CCR of 94.94% for the CNN alone. These findings will help in the development of a new tool for rapid and accurate detection of nitrogen fertilizer overuse in large areas.

[1]  Linsong Zhang,et al.  3DAGNet: 3D Deep Attention and Global Search Network for Pulmonary Nodule Detection , 2023, Electronics.

[2]  S. Sheykhivand,et al.  Customized 2D CNN Model for the Automatic Emotion Recognition Based on EEG Signals , 2023, Electronics.

[3]  M. Kim,et al.  Hyperspectral reflectance imaging for nondestructive evaluation of root rot in Korean ginseng (Panax ginseng Meyer) , 2023, Frontiers in Plant Science.

[4]  M. Dong,et al.  Attention Mechanism Trained with Small Datasets for Biomedical Image Segmentation , 2023, Electronics.

[5]  G. García-Mateos,et al.  Comparison of Classic Classifiers, Metaheuristic Algorithms and Convolutional Neural Networks in Hyperspectral Classification of Nitrogen Treatment in Tomato Leaves , 2022, Remote. Sens..

[6]  Ngo Minh Thang Nguyen,et al.  Ripeness Evaluation of Achacha Fruit Using Hyperspectral Image Data , 2022, Agriculture.

[7]  Yingying Wang,et al.  Corn Disease Recognition Based on Attention Mechanism Network , 2022, Axioms.

[8]  G. García-Mateos,et al.  Convolutional Neural Networks for Estimating the Ripening State of Fuji Apples Using Visible and Near-Infrared Spectroscopy , 2022, Food and Bioprocess Technology.

[9]  Yueming Zhu,et al.  Improving rice nitrogen stress diagnosis by denoising strips in hyperspectral images via deep learning , 2022, Biosystems Engineering.

[10]  Yuan Cheng,et al.  Deep Learning and Hyperspectral Images Based Tomato Soluble Solids Content and Firmness Estimation , 2022, Frontiers in Plant Science.

[11]  Chengqiang Zhang,et al.  Deep Learning-Based Identification of Maize Leaf Diseases Is Improved by an Attention Mechanism: Self-Attention , 2022, Frontiers in Plant Science.

[12]  J. L. Hernández-Hernández,et al.  One-Dimensional Convolutional Neural Networks for Hyperspectral Analysis of Nitrogen in Plant Leaves , 2021, Applied Sciences.

[13]  Guantao Xuan,et al.  Maturity determination at harvest and spatial assessment of moisture content in okra using Vis-NIR hyperspectral imaging , 2021 .

[14]  Kevin Tansey,et al.  A deep learning framework under attention mechanism for wheat yield estimation using remotely sensed indices in the Guanzhong Plain, PR China , 2021, Int. J. Appl. Earth Obs. Geoinformation.

[15]  J. I. Arribas,et al.  Nondestructive estimation of three apple fruit properties at various ripening levels with optimal Vis-NIR spectral wavelength regression data , 2021, Heliyon.

[16]  Hui Yu,et al.  A review on the attention mechanism of deep learning , 2021, Neurocomputing.

[17]  Yan Zhu,et al.  Estimation of Leaf Nitrogen Content in Wheat Based on Fusion of Spectral Features and Deep Features from Near Infrared Hyperspectral Imagery , 2021, Sensors.

[18]  Xiaodong Yang,et al.  Estimation of Crop Growth Parameters Using UAV-Based Hyperspectral Remote Sensing Data , 2020, Sensors.

[19]  Yuening Jia,et al.  Attention Mechanism in Machine Translation , 2019, Journal of Physics: Conference Series.

[20]  Asheesh K. Singh,et al.  Plant disease identification using explainable 3D deep learning on hyperspectral images , 2019, Plant Methods.

[21]  Hao Yang,et al.  Hyperspectral-Based Estimation of Leaf Nitrogen Content in Corn Using Optimal Selection of Multiple Spectral Variables , 2019, Sensors.

[22]  Jun Huang,et al.  Spectral-Spatial Attention Networks for Hyperspectral Image Classification , 2019, Remote. Sens..

[23]  Gang Liu,et al.  Bidirectional LSTM with attention mechanism and convolutional layer for text classification , 2019, Neurocomputing.

[24]  Bo Ren,et al.  Image captioning by incorporating affective concepts learned from both visual and textual components , 2019, Neurocomputing.

[25]  Li Lin,et al.  Estimation of Leaf Nitrogen Content in Wheat Using New Hyperspectral Indices and a Random Forest Regression Algorithm , 2018, Remote. Sens..

[26]  Tao Mei,et al.  Boosting image sentiment analysis with visual attention , 2018, Neurocomputing.

[27]  Xuelong Li,et al.  Video Summarization With Attention-Based Encoder–Decoder Networks , 2017, IEEE Transactions on Circuits and Systems for Video Technology.

[28]  Bo Zhu,et al.  Estimation of rice leaf nitrogen contents based on hyperspectral LIDAR , 2016, Int. J. Appl. Earth Obs. Geoinformation.

[29]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[30]  Raphael A. Viscarra Rossel,et al.  ParLeS: Software for chemometric analysis of spectroscopic data , 2008 .

[31]  T. Zhang,et al.  Effects of nitrogen fertilization on fruit yield and quality of processing tomatoes , 2004 .

[32]  Bedir Tekinerdogan,et al.  Effect of Attention Mechanism in Deep Learning-Based Remote Sensing Image Processing: A Systematic Literature Review , 2021, Remote. Sens..