Self‐adaptive online virtual network migration in network virtualization environments

This is the peer reviewed version of the following article: Zangiabady, M, Garcia‐Robledo, A, Gorricho, J‐L, Serrat‐Fernandez, J, Rubio‐Loyola, J. Self‐adaptive online virtual network migration in network virtualization environments. Trans Emerging Tel Tech. 2019; 30:e3692. https://doi.org/10.1002/ett.3692, which has been published in final form at https://doi.org/10.1002/ett.3692. This article may be used for non-commercial purposes in accordance with Wiley Terms and Conditions for Self-Archiving.

[1]  Guy Pujolle,et al.  VNR Algorithm: A Greedy Approach for Virtual Networks Reconfigurations , 2011, 2011 IEEE Global Telecommunications Conference - GLOBECOM 2011.

[2]  Filip De Turck,et al.  Design and evaluation of learning algorithms for dynamic resource management in virtual networks , 2014, 2014 IEEE Network Operations and Management Symposium (NOMS).

[3]  Xavier Hesselbach,et al.  Virtual Network Embedding: A Survey , 2013, IEEE Communications Surveys & Tutorials.

[4]  Bart De Schutter,et al.  A Comprehensive Survey of Multiagent Reinforcement Learning , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[5]  Michel Tokic.  Adaptive ε-greedy Exploration in Reinforcement Learning Based on Value Differences , 2010 .

[6]  Liu Liu,et al.  Correlation-based virtual machine migration in dynamic cloud environments , 2015, Photonic Network Communications.

[7]  Cong Wang,et al.  VHub: Single-stage virtual network mapping through hub location , 2015, Comput. Networks.

[8]  Joan Serrat,et al.  Enhancing Metaheuristic-Based Online Embedding in Network Virtualization Environments , 2018, IEEE Transactions on Network and Service Management.

[9]  Depei Qian,et al.  A bandwidth adaptive method for estimating end-to-end available bandwidth , 2008, 2008 11th IEEE Singapore International Conference on Communication Systems.

[10]  Sarang Bharadwaj Masti,et al.  Simulated annealing algorithm for virtual network reconfiguration , 2012, Proceedings of the 8th Euro-NF Conference on Next Generation Internet NGI 2012.

[11]  Xu Chen,et al.  A novel reinforcement learning algorithm for virtual network embedding , 2018, Neurocomputing.

[12]  Andrew W. Moore,et al.  Reinforcement Learning: A Survey , 1996, J. Artif. Intell. Res..

[13]  Verena Heidrich-Meisner.  Interview with Richard S. Sutton , 2009, Künstliche Intell..

[14]  Xiang Cheng,et al.  Virtual network embedding through topology-aware node ranking , 2011, CCRV.

[15]  Xiaolin Chang,et al.  Performance evaluation of artificial intelligence algorithms for virtual network embedding , 2013, Eng. Appl. Artif. Intell..

[16]  Takashi Oshiba,et al.  Quick end-to-end available bandwidth estimation for QoS of real-time multimedia communication , 2010, The IEEE symposium on Computers and Communications.

[17]  Ellen W. Zegura,et al.  Virtual network migration on real infrastructure: A PlanetLab case study , 2014, 2014 IFIP Networking Conference.

[18]  Raouf Boutaba,et al.  ViNEYard: Virtual Network Embedding Algorithms With Coordinated Node and Link Mapping , 2012, IEEE/ACM Transactions on Networking.

[19]  Peter Dayan,et al.  Q-learning , 1992, Machine Learning.

[20]  Peter van Beek,et al.  Bandwidth Estimation and Robust Video Streaming Over 802.11E Wireless Lans , 2005, 2005 IEEE International Conference on Multimedia and Expo.

[21]  Javier Rubio-Loyola,et al.  A virtual network migration approach and analysis for enhanced online virtual network embedding , 2016, 2016 12th International Conference on Network and Service Management (CNSM).

[22]  Yong Zhu,et al.  Algorithms for Assigning Substrate Network Resources to Virtual Network Components , 2006, Proceedings IEEE INFOCOM 2006. 25TH IEEE International Conference on Computer Communications.

[23]  Brahmjit Singh,et al.  Network selection based on available link bandwidth in multi-access networks , 2016 .

[24]  Marwan Krunz,et al.  Multi-constrained optimal path selection , 2001, Proceedings IEEE INFOCOM 2001. Conference on Computer Communications. Twentieth Annual Joint Conference of the IEEE Computer and Communications Society (Cat. No.01CH37213).

[25]  Cong Wang,et al.  Discrete Particle Swarm Optimization Algorithm for Virtual Network Reconfiguration , 2013, ICSI.

[26]  Ke Xu,et al.  A neuro-fuzzy approach to self-management of virtual network resources , 2015, Expert Syst. Appl..

[27]  Chun-Shien Lu,et al.  Available bandwidth estimation via one-way delay jitter and queuing delay propagation model , 2006, IEEE Wireless Communications and Networking Conference, 2006. WCNC 2006..

[28]  Shahrokh Valaee,et al.  A System-Theoretic Approach to Bandwidth Estimation , 2008, IEEE/ACM Transactions on Networking.

[29]  Zhiming Wang,et al.  Embedding and reconfiguration algorithms for service aggregation in network virtualization , 2016, Int. J. Commun. Syst..

[30]  Kin K. Leung,et al.  Resource management in distributed SDN using reinforcement learning , 2018, Defense + Security.

[31]  Ashiq Khan,et al.  Survey on Survivable Virtual Network Embedding Problem and Solutions , 2013 .

[32]  Lei Guo,et al.  Virtual Network Embedding in SDN/NFV based Fiber-Wireless Access Network , 2016, 2016 International Conference on Software Networking (ICSN).

[33]  Michel Tokic,et al.  Adaptive epsilon-Greedy Exploration in Reinforcement Learning Based on Value Difference , 2010, KI.

[34]  R. Sutton.  Reinforcement Learning Architectures , 1992 .

[35]  Raouf Boutaba,et al.  Virtual Network Embedding with Coordinated Node and Link Mapping , 2009, IEEE INFOCOM 2009.

[36]  Guy Shani,et al.  Resolving Perceptual Aliasing In The Presence Of Noisy Sensors , 2004, NIPS.

[37]  Muhammad Siraj Rathore,et al.  An Approach towards Resource Efficient Virtual Network Embedding , 2010, 2010 2nd International Conference on Evolving Internet.

[38]  Hiroaki Harai,et al.  Reinforcement learning based dynamic resource migration for virtual networks , 2017, 2017 IFIP/IEEE Symposium on Integrated Network and Service Management (IM).

[39]  Minlan Yu,et al.  Rethinking virtual network embedding: substrate support for path splitting and migration , 2008, CCRV.

[40]  Hui Deng,et al.  A New Method for End-to-End Available Bandwidth Estimation , 2008, IEEE GLOBECOM 2008 - 2008 IEEE Global Telecommunications Conference.

[41]  Andreas Timm-Giel,et al.  Reconfiguration of virtual network mapping considering service disruption , 2013, 2013 IEEE International Conference on Communications (ICC).

[42]  Liu Liu,et al.  ReViNE: Reallocation of Virtual Network Embedding to eliminate substrate bottlenecks , 2017, 2017 IFIP/IEEE Symposium on Integrated Network and Service Management (IM).

[43]  Guy Pujolle,et al.  VNE-AC: Virtual Network Embedding Algorithm Based on Ant Colony Metaheuristic , 2011, 2011 IEEE International Conference on Communications (ICC).

[44]  Emanuele Goldoni,et al.  Assolo, a New Method for Available Bandwidth Estimation , 2009, 2009 Fourth International Conference on Internet Monitoring and Protection.

[45]  Soroush Haeri,et al.  Virtual Network Embedding via Monte Carlo Tree Search , 2018, IEEE Transactions on Cybernetics.

[46]  Filip De Turck,et al.  Neural network-based autonomous allocation of resources in virtual networks , 2014, 2014 European Conference on Networks and Communications (EuCNC).

[47]  Andreas Timm-Giel,et al.  Optimal mapping of virtual networks considering reactive reconfiguration , 2012, 2012 IEEE 1st International Conference on Cloud Networking (CLOUDNET).

[48]  Xiang Cheng,et al.  A unified enhanced particle swarm optimization‐based virtual network embedding algorithm , 2013, Int. J. Commun. Syst..