Hybrid LSTM Self-Attention Mechanism Model for Forecasting the Reform of Scientific Research in Morocco

Education is the cultivation of people to promote and guarantee the development of society. Education reforms can play a vital role in the development of a country. However, it is crucial to continually monitor the educational model's performance by forecasting the outcome's progress. Machine learning-based models are currently a hot topic in improving the forecasting research area. Forecasting models can help to analyse the impact of future outcomes by showing yearly trends. For this study, we developed a hybrid, forecasting time-series model by long short-term memory (LSTM) network and self-attention mechanism (SAM) to monitor Morocco's educational reform. We analysed six universities' performance and provided a prediction model to evaluate the best-performing university's performance after implementing the latest reform, i.e., from 2015–2030. We forecasted the six universities' research outcomes and tested our proposed methodology's accuracy against other time-series models. Results show that our model performs better for predicting research outcomes. The percentage increase in university performance after nine years is discussed to help predict the best-performing university. Our proposed algorithm accuracy and performance are better than other algorithms like LSTM and RNN.

[1]  Kenli Li,et al.  Automatic Fetal Ultrasound Standard Plane Recognition Based on Deep Learning and IIoT , 2021, IEEE Transactions on Industrial Informatics.

[2]  George Xydis,et al.  Electricity Price Forecasting in the Danish Day-Ahead Market Using the TBATS, ANN and ARIMA Methods , 2019, Energies.

[3]  Abderrahim Amghar School-based leadership in the education reform agenda in Morocco: an analysis of policy and context , 2018, International Journal of Leadership in Education.

[4]  Ahmed Smirkou A Critical Discourse Analysis of the Moroccan Supreme Education Council ’ s Report ‘ Strategic Vision : 2015-2030 ’ , 2018 .

[5]  Kenli Li,et al.  Fetal cardiac cycle detection in multi-resource echocardiograms using hybrid classification framework , 2021, Future Gener. Comput. Syst..

[6]  P. Adeline Higher Education Institution (HEI) Enrollment Forecasting Using Data Mining Technique , 2020, International Journal of Advanced Trends in Computer Science and Engineering.

[7]  Fernando Luiz Cyrino Oliveira,et al.  Forecasting mid-long term electric energy consumption through bagging ARIMA and exponential smoothing methods , 2018 .

[8]  S. Borin,et al.  Integrated technological and management solutions for wastewater treatment and efficient agricultural reuse in Egypt, Morocco, and Tunisia , 2018, Integrated environmental assessment and management.

[9]  Yan Kang,et al.  A Novel Mutual Fractional Grey Bernoulli Model With Differential Evolution Algorithm and Its Application in Education Investment Forecasting in China , 2020, IEEE Access.

[10]  I. I. Berchin,et al.  Strategies to Promote Sustainability in Higher Education Institutions. , 2017 .

[11]  Héctor Pomares,et al.  Soft-computing techniques and ARMA model for time series prediction , 2008, Neurocomputing.

[12]  Yoshua Bengio,et al.  End-to-end attention-based large vocabulary speech recognition , 2015, 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[13]  Alexander Griffiths,et al.  Forecasting failure : assessing risks to quality assurance in higher education using machine learning , 2017 .

[14]  Yu Zhang,et al.  Recommendation system for immunization coverage and monitoring , 2018, Human vaccines & immunotherapeutics.

[15]  Qiang Wang,et al.  Forecasting energy demand in China and India: Using single-linear, hybrid-linear, and non-linear time series forecast techniques , 2018, Energy.

[16]  Meriame Mohajane,et al.  Land Use/Land Cover (LULC) Using Landsat Data Series (MSS, TM, ETM+ and OLI) in Azrou Forest, in the Central Middle Atlas of Morocco , 2018, Environments.

[17]  Amr Radwan,et al.  Science and innovation policies in North African Countries: Exploring challenges and opportunities , 2018, Entrepreneurship and Sustainability Issues.

[18]  Aarhus M. Dela Cruz Forecasting Philippine Household Final Consumption Expenditure on Education Using Discrete Wavelet Transformation on Hybrid ARIMA-ANN Model , 2019, Indian Journal of Science and Technology.

[19]  Lazrak,et al.  Issues in Moroccan Higher Education , 2017 .

[20]  Di Wu,et al.  Recommendation system using feature extraction and pattern recognition in clinical care systems , 2018, Enterp. Inf. Syst..

[21]  Maria Meehan,et al.  Contrasting prediction methods for early warning systems at undergraduate level , 2016, Internet High. Educ..

[22]  Shuai Li,et al.  Independently Recurrent Neural Network (IndRNN): Building A Longer and Deeper RNN , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[23]  Caisheng Wang,et al.  Improving short-term electricity price forecasting using day-ahead LMP with ARIMA models , 2017, 2017 IEEE Power & Energy Society General Meeting.

[24]  Farhan Sarwar,et al.  Applications of Quantum Physics on Resistivity, Dielectricity, Giant Magneto Resistance, Hall Effect and Conductance , 2016 .

[25]  Uzair Aslam Bhatti,et al.  Time Series Analysis and Forecasting of Air Pollution Particulate Matter (PM2.5): An SARIMA and Factor Analysis Approach , 2021, IEEE Access.

[26]  Atin Roy,et al.  Support vector regression based metamodeling for seismic reliability analysis of structures , 2018, Applied Mathematical Modelling.

[27]  V. Suriya,et al.  An empirical study on the effect of technological innovations in improving quality of higher education and forecasting the skilled manpower needs , 2018 .

[28]  Nashirah Abu Bakar,et al.  Autoregressive Integrated Moving Average (ARIMA) Model for Forecasting Cryptocurrency Exchange Rate in High Volatility Environment: A New Insight of Bitcoin Transaction , 2017 .

[29]  Yuan Liu,et al.  ED-ACNN: Novel attention convolutional neural network based on encoder-decoder framework for human traffic prediction , 2020, Appl. Soft Comput..

[30]  Hao Wang,et al.  A Clinical Decision Support Framework for Heterogeneous Data Sources , 2018, IEEE Journal of Biomedical and Health Informatics.

[31]  Mariana-Daniela González-Zamar,et al.  Sustainable Management of Digital Transformation in Higher Education: Global Research Trends , 2020 .

[32]  Yi Yang,et al.  A hybrid application algorithm based on the support vector machine and artificial intelligence: An example of electric load forecasting , 2015 .

[33]  Andrew W. Senior,et al.  Long short-term memory recurrent neural network architectures for large scale acoustic modeling , 2014, INTERSPEECH.

[34]  Kiyoshi Yamaoka,et al.  Application of Akaike's information criterion (AIC) in the evaluation of linear pharmacokinetic equations , 1978, Journal of Pharmacokinetics and Biopharmaceutics.

[35]  W. Murad,et al.  The Impact of Economic Growth, Trade Openness and Technological Progress on Renewable Energy Use in Organization for Economic Co-Operation and Development Countries , 2020, Renewable Energy.

[36]  Yu Zhang,et al.  An Extended-Tag-Induced Matrix Factorization Technique for Recommender Systems , 2018, Inf..

[37]  Clifford M. Hurvich,et al.  Smoothing parameter selection in nonparametric regression using an improved Akaike information criterion , 1998 .

[38]  Yue-Shan Chang,et al.  Air Pollution Forecasting Using RNN with LSTM , 2018, 2018 IEEE 16th Intl Conf on Dependable, Autonomic and Secure Computing, 16th Intl Conf on Pervasive Intelligence and Computing, 4th Intl Conf on Big Data Intelligence and Computing and Cyber Science and Technology Congress(DASC/PiCom/DataCom/CyberSciTech).

[39]  A. Adenle Assessment of solar energy technologies in Africa-opportunities and challenges in meeting the 2030 agenda and sustainable development goals , 2020, Energy Policy.

[40]  Hind Benlhabib A Review about Performance Management in Education Systems: Case of Morocco , 2019 .

[41]  G. Figari,et al.  La place de l'évaluation dans la réforme du système éducatif marocain : questions pour la recherche , 2010 .

[42]  Ritika Singh,et al.  Stock prediction using deep learning , 2016, Multimedia Tools and Applications.

[43]  W. Murad,et al.  The Impact of Economic Growth, Trade Openness and Technological Progress on Renewable Energy Use in Organization for Economic Co-Operation and Development Countries , 2020 .

[44]  Xiaojun Yuan,et al.  The thematic and citation landscape of Data and Knowledge Engineering , 2008, Data Knowl. Eng..

[45]  Mansureh Kebritchi,et al.  Learning Analytics Methods, Benefits, and Challenges in Higher Education: A Systematic Literature Review. , 2016 .