BMAE-Net: A Data-Driven Weather Prediction Network for Smart Agriculture

Weather is an essential component of natural resources that affects agricultural production and plays a decisive role in deciding the type of agricultural production, planting structure, crop quality, etc. In field agriculture, medium- and long-term predictions of temperature and humidity are vital for guiding agricultural activities and improving crop yield and quality. However, existing intelligent models still have difficulties dealing with big weather data in predicting applications, such as striking a balance between prediction accuracy and learning efficiency. Therefore, a multi-head attention encoder-decoder neural network optimized via Bayesian inference strategy (BMAE-Net) is proposed herein to predict weather time series changes accurately. Firstly, we incorporate Bayesian inference into the gated recurrent unit to construct a Bayesian-gated recurrent units (Bayesian-GRU) module. Then, a multi-head attention mechanism is introduced to design the network structure of each Bayesian layer, improving the prediction applicability to time-length changes. Subsequently, an encoder-decoder framework with Bayesian hyperparameter optimization is designed to infer intrinsic relationships among big time-series data for high prediction accuracy. For example, the R-evaluation metrics for temperature prediction in the three locations are 0.9, 0.804, and 0.892, respectively, while the RMSE is reduced to 2.899, 3.011, and 1.476, as seen in Case 1 of the temperature data. Extensive experiments subsequently demonstrated that the proposed BMAE-Net has overperformed on three location weather datasets, which provides an effective solution for prediction applications in the smart agriculture system.

[1]  P. Chakrabarti,et al.  Variational Bayesian Network with Information Interpretability Filtering for Air Quality Forecasting , 2023, Mathematics.

[2]  P. Chakrabarti,et al.  Deep Spatio-Temporal Graph Network with Self-Optimization for Air Quality Prediction , 2023, Entropy.

[3]  Hongwei Gong,et al.  Attention-LSTM architecture combined with Bayesian hyperparameter optimization for indoor temperature prediction , 2022, Building and Environment.

[4]  Asif Iqbal Middya,et al.  Attention based long-term air temperature forecasting network: ALTF Net , 2022, Knowl. Based Syst..

[5]  Yanghua Xiao,et al.  A Graph-Related High-Order Neural Network Architecture via Feature Aggregation Enhancement for Identification Application of Diseases and Pests , 2022, Computational intelligence and neuroscience.

[6]  Xue-bo Jin,et al.  A Spatial Feature-Enhanced Attention Neural Network with High-Order Pooling Representation for Application in Pest and Disease Recognition , 2022, Agriculture.

[7]  W. Shangguan,et al.  An attention-aware LSTM model for soil moisture and soil temperature prediction , 2022, Geoderma.

[8]  Tingli Su,et al.  A Reversible Automatic Selection Normalization (RASN) Deep Network for Predicting in the Smart Agriculture System , 2022, Agronomy.

[9]  Xuewen Jin,et al.  PFVAE: A Planar Flow-Based Variational Auto-Encoder Prediction Model for Time Series Data , 2022, Mathematics.

[10]  Lianyong Qi,et al.  A long short‐term memory‐based model for greenhouse climate prediction , 2021, Int. J. Intell. Syst..

[11]  Xue-bo Jin,et al.  Deep-Stacking Network Approach by Multisource Data Mining for Hazardous Risk Identification in IoT-Based Intelligent Food Management Systems , 2021, Comput. Intell. Neurosci..

[12]  Xue-bo Jin,et al.  Deep-Learning Temporal Predictor via Bidirectional Self-Attentive Encoder–Decoder Framework for IOT-Based Environmental Sensing in Intelligent Greenhouse , 2021, Agriculture.

[13]  Xiaoyi Wang,et al.  Multi-stream hybrid architecture based on cross-level fusion strategy for fine-grained crop species recognition in precision agriculture , 2021, Comput. Electron. Agric..

[14]  Dragutin Lisjak,et al.  Intelligent Fault Diagnosis of Rotary Machinery by Convolutional Neural Network with Automatic Hyper-Parameters Tuning Using Bayesian Optimization , 2021, Sensors.

[15]  Ching-Hsien Hsu,et al.  ISOF: Information Scheduling and Optimization Framework for Improving the Performance of Agriculture Systems Aided by Industry 4.0 , 2021, IEEE Internet of Things Journal.

[16]  M. G. Schultz,et al.  Can deep learning beat numerical weather prediction? , 2021, Philosophical Transactions of the Royal Society A.

[17]  Hui Xiong,et al.  Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecasting , 2020, AAAI.

[18]  Raman Pall,et al.  Understanding the temporal evolution of COVID-19 research through machine learning and natural language processing , 2020, Scientometrics.

[19]  Yong-Sik Cho,et al.  Modeling Maximum Tsunami Heights Using Bayesian Neural Networks , 2020, Atmosphere.

[20]  Jürgen Pilz,et al.  Measuring the Uncertainty of Predictions in Deep Neural Networks with Variational Inference , 2020, Sensors.

[21]  Christos Katris,et al.  A time series-based statistical approach for outbreak spread forecasting: Application of COVID-19 in Greece , 2020, Expert Systems with Applications.

[22]  Si Chen,et al.  Improved Hidden Markov Model Incorporated with Copula for Probabilistic Seasonal Drought Forecasting , 2020 .

[23]  Clinton Fookes,et al.  Bayesian Neural Networks: An Introduction and Survey , 2020, Case Studies in Applied Bayesian Data Science.

[24]  Tianrui Li,et al.  Multivariate time series forecasting via attention-based encoder-decoder framework , 2020, Neurocomputing.

[25]  Yongjae Lee,et al.  Basic Enhancement Strategies When Using Bayesian Optimization for Hyperparameter Tuning of Deep Neural Networks , 2020, IEEE Access.

[26]  Ting-Li Su,et al.  Hybrid Deep Learning Predictor for Smart Agriculture Sensing Based on Empirical Mode Decomposition and Gated Recurrent Unit Group Model , 2020, Sensors.

[27]  Katarina Grolinger,et al.  Deep Learning for Load Forecasting: Sequence to Sequence Recurrent Neural Networks With Attention , 2020, IEEE Access.

[28]  Tingli Su,et al.  Deep Learning Predictor for Sustainable Precision Agriculture Based on Internet of Things System , 2020, Sustainability.

[29]  Li-Chiu Chang,et al.  Exploring a Long Short-Term Memory based Encoder-Decoder framework for multi-step-ahead flood forecasting , 2020 .

[30]  Richard E. Turner,et al.  Practical Deep Learning with Bayesian Principles , 2019, NeurIPS.

[31]  Lingfeng Wang,et al.  Deep Hierarchical Encoder–Decoder Network for Image Captioning , 2019, IEEE Transactions on Multimedia.

[32]  L. Magnusson,et al.  Advancements in Hurricane Prediction With NOAA's Next‐Generation Forecast System , 2019, Geophysical Research Letters.

[33]  Min Zuo,et al.  CropDeep: The Crop Vision Dataset for Deep-Learning-Based Classification and Detection in Precision Agriculture , 2019, Sensors.

[34]  Laith H. Baniata,et al.  A Neural Machine Translation Model for Arabic Dialects That Utilises Multitask Learning (MTL) , 2018, Comput. Intell. Neurosci..

[35]  Eenjun Hwang,et al.  Hybrid Short-Term Load Forecasting Scheme Using Random Forest and Multilayer Perceptron , 2018, Energies.

[36]  Yoon Sanghoo,et al.  A Missing Value Replacement Method for Agricultural Meteorological Data Using Bayesian Spatio–Temporal Model , 2018 .

[37]  Baihua Xiao,et al.  Short-term cloud coverage prediction using the ARIMA time series model , 2018 .

[38]  J. Hajšlová,et al.  A neural network model for prediction of deoxynivalenol content in wheat grain based on weather data and preceding crop , 2018 .

[39]  Witawas Srisa-an,et al.  Significant Permission Identification for Machine-Learning-Based Android Malware Detection , 2018, IEEE Transactions on Industrial Informatics.

[40]  Alneu de Andrade Lopes,et al.  A survey of the applications of Bayesian networks in agriculture , 2017, Eng. Appl. Artif. Intell..

[41]  Shahbaz Gul Hassan,et al.  Prediction of the temperature in a Chinese solar greenhouse based on LSSVM optimized by improved PSO , 2016, Comput. Electron. Agric..

[42]  Zili Zhang,et al.  A distributed spatial-temporal weighted model on MapReduce for short-term traffic flow forecasting , 2016, Neurocomputing.

[43]  Wang Rui-chun,et al.  Wind Power Prediction Model Based on the Combined Optimization Algorithm of ARMA Model and BP Neural Networks , 2013 .

[44]  Tak-Chung Fu,et al.  A review on time series data mining , 2011, Eng. Appl. Artif. Intell..

[45]  Bo Zhong,et al.  BP neural network with rough set for short term load forecasting , 2009, Expert Syst. Appl..

[46]  Fathi Fourati,et al.  A greenhouse control with feed-forward and recurrent neural networks , 2007, Simul. Model. Pract. Theory.

[47]  António E. Ruano,et al.  Neural network models in greenhouse air temperature prediction , 2002, Neurocomputing.