Transfer Learning for Classification and Prediction of Time Series for Next Generation Networks

Transfer learning (TL) is a useful technique that enables the wide spreading of neural networks after re-adaptation of their weights. In ths paper, two methods are introduced for transfer learning of recurrent neural networks: D-LSTM (Long Short Term Memory with deep layers) and CNN-1D (Convolutional Neural Network of One Dimension). The first is used to improve the prediction of time series when datasets are too small to obtain satisfactory results. The second enables personalizing and hence re-adaptation of an already-trained network to a new class of time series. In fact, the CNN-1D classification is applied to those real datasets to classify different behaviors in a large city. We show that our architecture drastically improves prediction when transfer learning is used in the same class of behavior but also on different classes of behaviors.

[1]  Dongpu Cao,et al.  Transfer Learning for Driver Model Adaptation in Lane-Changing Scenarios Using Manifold Alignment , 2020, IEEE Transactions on Intelligent Transportation Systems.

[2]  Richi Nayak,et al.  Regularising LSTM classifier by transfer learning for detecting misogynistic tweets with small training set , 2020, Knowledge and Information Systems.

[3]  Hossam Afifi,et al.  An Artificial Intelligence Approach for Time Series Next Generation Applications , 2020, ICC 2020 - 2020 IEEE International Conference on Communications (ICC).

[4]  Houssam Abbas,et al.  Anytime Computation and Control for Autonomous Systems , 2020, IEEE Transactions on Control Systems Technology.

[5]  Ioannis D. Apostolopoulos,et al.  Covid-19: automatic detection from X-ray images utilizing transfer learning with convolutional neural networks , 2020, Physical and Engineering Sciences in Medicine.

[6]  Muazzam Maqsood,et al.  Transfer Learning Assisted Classification and Detection of Alzheimer’s Disease Stages Using 3D MRI Scans , 2019, Sensors.

[7]  Avi Bleiweiss,et al.  LSTM Neural Networks for Transfer Learning in Online Moderation of Abuse Context , 2019, ICAART.

[8]  Germain Forestier,et al.  Transfer learning for time series classification , 2018, 2018 IEEE International Conference on Big Data (Big Data).

[9]  Seif Eddine Hammami Dynamic network resources optimization based on machine learning and cellular data mining , 2018 .

[10]  Alexis Sultan,et al.  Méthodes et outils d'analyse de données de signalisation mobile pour l'étude de la mobilité humaine , 2016 .

[11]  Hossam Afifi,et al.  Network planning tool based on network classification and load prediction , 2016, 2016 IEEE Wireless Communications and Networking Conference.

[12]  Hossam Afifi,et al.  Studying information dissemination in a d2d network using Call details records , 2014 .

[13]  Hossam Afifi,et al.  Adaptive data collection protocol using reinforcement learning for VANETs , 2013, 2013 9th International Wireless Communications and Mobile Computing Conference (IWCMC).

[14]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.