Resource Management and Security Scheme of ICPSs and IoT Based on VNE Algorithm

The development of intelligent cyber–physical systems (ICPSs) in the virtual network environment is facing severe challenges. On the one hand, the Internet of Things (IoT) based on ICPSs construction needs a large amount of reasonable network resources support. On the other hand, ICPSs are facing severe network security problems. The integration of ICPSs and network virtualization (NV) can provide more efficient network resource support and security guarantees for IoT users. Based on the above two problems faced by ICPSs, we propose a virtual network embedded (VNE) algorithm with computing, storage resources, and security constraints to ensure the rationality and security of resource allocation in ICPSs. In particular, we use the reinforcement learning (RL) method as a means to improve algorithm performance. We extract the important attribute characteristics of the underlying network as the training environment of the RL agent. The agent can derive the optimal node embedding strategy through training, so as to meet the requirements of ICPSs for resource management and security. The embedding of virtual links is based on the breadth first search (BFS) strategy. Therefore, this is a comprehensive two-stage RL-VNE algorithm considering the constraints of computing, storage, and security 3-D resources. Finally, we design a large number of simulation experiments from the perspective of typical indicators of VNE algorithms. The experimental results effectively illustrate the effectiveness of the algorithm in the application of ICPSs.

[1]  Athanasios V. Vasilakos,et al.  Fine-Grained Powercap Allocation for Power-Constrained Systems Based on Multi-Objective Machine Learning , 2021, IEEE Transactions on Parallel and Distributed Systems.

[2]  Athanasios V. Vasilakos,et al.  Designing Secure User Authentication Protocol for Big Data Collection in IoT-Based Intelligent Transportation System , 2021, IEEE Internet of Things Journal.

[3]  Athanasios V. Vasilakos,et al.  Designing Blockchain-Based Access Control Protocol in IoT-Enabled Smart-Grid System , 2021, IEEE Internet of Things Journal.

[4]  Athanasios V. Vasilakos,et al.  A comprehensive survey of load balancing techniques in software-defined network , 2021, J. Netw. Comput. Appl..

[5]  Athanasios V. Vasilakos,et al.  Security and Privacy for Mobile Edge Caching: Challenges and Solutions , 2020, IEEE Wireless Communications.

[6]  Cheng Zhang,et al.  PDAAA: Progressive Defense Against Adversarial Attacks for Deep Learning-as-a-Service in Internet of Things , 2020, 2021 IEEE 20th International Conference on Trust, Security and Privacy in Computing and Communications (TrustCom).

[7]  Mohsen Guizani,et al.  IoV Scenario: Implementation of a Bandwidth Aware Algorithm in Wireless Network Communication Mode , 2020, IEEE Transactions on Vehicular Technology.

[8]  Yonghong Tian,et al.  GAN-Driven Personalized Spatial-Temporal Private Data Sharing in Cyber-Physical Social Systems , 2020, IEEE Transactions on Network Science and Engineering.

[9]  Chunxiao Jiang,et al.  Decreasing Big Data Application Latency in Satellite Link by Caching and Peer Selection , 2020, IEEE Transactions on Network Science and Engineering.

[10]  Athanasios V. Vasilakos,et al.  Energy-Efficient Provisioning for Service Function Chains to Support Delay-Sensitive Applications in Network Function Virtualization , 2020, IEEE Internet of Things Journal.

[11]  Athanasios V. Vasilakos,et al.  Low-Latency and Resource-Efficient Service Function Chaining Orchestration in Network Function Virtualization , 2020, IEEE Internet of Things Journal.

[12]  Athanasios V. Vasilakos,et al.  An effective service-oriented networking management architecture for 5G-enabled internet of things , 2020, Comput. Networks.

[13]  Chunxiao Jiang,et al.  Reinforcement Learning Based Capacity Management in Multi-Layer Satellite Networks , 2020, IEEE Transactions on Wireless Communications.

[14]  Tong Li,et al.  Automatic Virtual Network Embedding: A Deep Reinforcement Learning Approach With Graph Convolutional Networks , 2020, IEEE Journal on Selected Areas in Communications.

[15]  Mohammad Sayad Haghighi,et al.  Artificial Intelligence for Detection, Estimation, and Compensation of Malicious Attacks in Nonlinear Cyber-Physical Systems and Industrial IoT , 2020, IEEE Transactions on Industrial Informatics.

[16]  Haipeng Yao,et al.  The Next Generation Heterogeneous Satellite Communication Networks: Integration of Resource Management and Deep Reinforcement Learning , 2020, IEEE Wireless Communications.

[17]  Chunxiao Jiang,et al.  Distributed Q-Learning Aided Heterogeneous Network Association for Energy-Efficient IIoT , 2020, IEEE Transactions on Industrial Informatics.

[18]  Haipeng Yao,et al.  A Continuous-Decision Virtual Network Embedding Scheme Relying on Reinforcement Learning , 2020, IEEE Transactions on Network and Service Management.

[19]  Chunxiao Jiang,et al.  Thirty Years of Machine Learning: The Road to Pareto-Optimal Wireless Networks , 2019, IEEE Communications Surveys & Tutorials.

[20]  Xuyun Zhang,et al.  A balanced virtual machine scheduling method for energy-performance trade-offs in cyber-physical cloud systems , 2017, Future Gener. Comput. Syst..

[21]  Feng Xia,et al.  Deep Reinforcement Learning for Vehicular Edge Computing , 2019, ACM Trans. Intell. Syst. Technol..

[22]  Jianping Wu,et al.  VNE-TD: A virtual network embedding algorithm based on temporal-difference learning , 2019, Comput. Networks.

[23]  Sancheng Peng,et al.  A Coordinated Two-Stages Virtual Network Embedding Algorithm Based on Reinforcement Learning , 2019, 2019 Seventh International Conference on Advanced Cloud and Big Data (CBD).

[24]  Cong Wang,et al.  A Q-learning-based approach for virtual network embedding in data center , 2019, Neural Computing and Applications.

[25]  Uwe D. Hanebeck,et al.  A Control Approach for Cooperative Sharing of Network Resources in Cyber-Physical Systems , 2019, 2019 IEEE International Conference on Industrial Cyber Physical Systems (ICPS).

[26]  Neeraj Kumar,et al.  SURVIVOR: A blockchain based edge-as-a-service framework for secure energy trading in SDN-enabled vehicle-to-grid environment , 2019, Comput. Networks.

[27]  Jian Chen,et al.  Robust Energy-Efficient Resource Allocation for IoT-Powered Cyber-Physical-Social Smart Systems With Virtualization , 2019, IEEE Internet of Things Journal.

[28]  Athanasios V. Vasilakos,et al.  Biometrics-Based Privacy-Preserving User Authentication Scheme for Cloud-Based Industrial Internet of Things Deployment , 2018, IEEE Internet of Things Journal.

[29]  Haipeng Yao,et al.  Virtual Network Embedding Based on Computing, Network, and Storage Resource Constraints , 2018, IEEE Internet of Things Journal.

[30]  Mohsen Guizani,et al.  Auction Design and Analysis for SDN-Based Traffic Offloading in Hybrid Satellite-Terrestrial Networks , 2018, IEEE Journal on Selected Areas in Communications.

[31]  Manuel Roveri,et al.  Intelligent Cyber-Physical Systems for Industry 4.0 , 2018, 2018 First International Conference on Artificial Intelligence for Industries (AI4I).

[32]  Wanlei Zhou,et al.  A Hybrid Privacy Protection Scheme in Cyber-Physical Social Networks , 2018, IEEE Transactions on Computational Social Systems.

[33]  Sherali Zeadally,et al.  Certificateless Public Key Authenticated Encryption With Keyword Search for Industrial Internet of Things , 2018, IEEE Transactions on Industrial Informatics.

[34]  Laurence T. Yang,et al.  UAV-Empowered Edge Computing Environment for Cyber-Threat Detection in Smart Vehicles , 2018, IEEE Network.

[35]  Soroush Haeri,et al.  Virtual Network Embedding via Monte Carlo Tree Search , 2018, IEEE Transactions on Cybernetics.

[36]  Kim-Kwang Raymond Choo,et al.  Security and Privacy for the Internet of Drones: Challenges and Solutions , 2018, IEEE Communications Magazine.

[37]  Haipeng Yao,et al.  Virtual Network Embedding Using Node Multiple Metrics Based on Simplified ELECTRE Method , 2018, IEEE Access.

[38]  Fatih Ertam,et al.  Data classification with deep learning using Tensorflow , 2017, 2017 International Conference on Computer Science and Engineering (UBMK).

[39]  Athanasios V. Vasilakos,et al.  Software-Defined Networking for Internet of Things: A Survey , 2017, IEEE Internet of Things Journal.

[40]  Ning Ge,et al.  Non-Orthogonal Multiple Access Based Integrated Terrestrial-Satellite Networks , 2017, IEEE Journal on Selected Areas in Communications.

[41]  Athanasios V. Vasilakos,et al.  A security and trust framework for virtualized networks and software-defined networking , 2016, Secur. Commun. Networks.

[42]  Athanasios V. Vasilakos,et al.  Security in Software-Defined Networking: Threats and Countermeasures , 2016, Mobile Networks and Applications.

[43]  Athanasios V. Vasilakos,et al.  CPHR: In-Network Caching for Information-Centric Networking With Partitioning and Hash-Routing , 2016, IEEE/ACM Transactions on Networking.

[44]  Wanlei Zhou,et al.  Modeling malicious activities in cyber space , 2015, IEEE Network.

[45]  Joel J. P. C. Rodrigues,et al.  An intelligent approach for building a secure decentralized public key infrastructure in VANET , 2015, J. Comput. Syst. Sci..

[46]  Song Guo,et al.  An Improved Stochastic Modeling of Opportunistic Routing in Vehicular CPS , 2015, IEEE Transactions on Computers.

[47]  Athanasios V. Vasilakos,et al.  Software-Defined and Virtualized Future Mobile and Wireless Networks: A Survey , 2014, Mobile Networks and Applications.

[48]  K. J. Ray Liu,et al.  Joint Spectrum Sensing and Access Evolutionary Game in Cognitive Radio Networks , 2013, IEEE Transactions on Wireless Communications.

[49]  K. J. Ray Liu,et al.  Renewal-theoretical dynamic spectrum access in cognitive radio network with unknown primary behavior , 2011, IEEE Journal on Selected Areas in Communications.

[50]  Guy Pujolle,et al.  VNE-AC: Virtual Network Embedding Algorithm Based on Ant Colony Metaheuristic , 2011, 2011 IEEE International Conference on Communications (ICC).

[51]  Stefan Hougardy,et al.  The Floyd-Warshall algorithm on graphs with negative cycles , 2010, Inf. Process. Lett..

[52]  Minlan Yu,et al.  Rethinking virtual network embedding: substrate support for path splitting and migration , 2008, CCRV.