Intelligent Network Control

Finding the near-optimal control strategy is the most critical and ubiquitous problem in a network. Examples include routing decision, load balancing, QoS-enable load scheduling, and so on. However, the majority solutions of these problems are largely relying on a manual process. To address this issue, in this chapter, we apply several artificial intelligence approaches for self-learning control strategies in networks. In this chapter, we first present an energy-aware multi-controller placement scheme as well as a latency-aware resource management model for the SDWN. Moreover, the particle swarm optimization (PSO) is invoked for solving the multi-controller placement problem, and a deep reinforcement learning (DRL) algorithm aided resource allocation strategy is conceived. Then, we present a novel controller mind (CM) framework to implement automatic management among multiple controllers and propose a novel Quality of Service (QoS) enabled load scheduling algorithm based on reinforcement learning to solve the problem of complexity and pre-strategy in the networks. In addition, we present a Wireless Local Area Networks (WLAN) interference self-optimization method based on a Self-Organizing Feature Map (SOM) neural network model to suppress the interference in local area networks. Finally, we propose a BC-based consensus protocol in distributed SDIIoT, where BC works as a trusted third party to collect and synchronize network-wide views between different SDN controllers. In addition, we use a novel dueling deep Q-learning approach to solve this joint problem.

[1]  Adão Silva,et al.  Power allocation strategies for distributed precoded multicell based systems , 2011, EURASIP J. Wirel. Commun. Netw..

[2]  Nick McKeown,et al.  OpenFlow: enabling innovation in campus networks , 2008, CCRV.

[3]  Kang G. Shin,et al.  Self-Reconfigurable Wireless Mesh Networks , 2011, IEEE/ACM Transactions on Networking.

[4]  Zhu Han,et al.  Network Association Strategies for an Energy Harvesting Aided Super-WiFi Network Relying on Measured Solar Activity , 2016, IEEE Journal on Selected Areas in Communications.

[5]  Yonggang Wen,et al.  “ A Survey of Software Defined Networking , 2020 .

[6]  F. Richard Yu,et al.  A Survey of Green Information-Centric Networking: Research Issues and Challenges , 2015, IEEE Communications Surveys & Tutorials.

[7]  F. Richard Yu,et al.  A survey of energy-efficient caching in information-centric networking , 2014, IEEE Communications Magazine.

[8]  Haipeng Yao,et al.  A novel QoS-enabled load scheduling algorithm based on reinforcement learning in software-defined energy internet , 2019, Future Gener. Comput. Syst..

[9]  Victor C. M. Leung,et al.  Information-Sharing Outage-Probability Analysis of Vehicular Networks , 2016, IEEE Transactions on Vehicular Technology.

[10]  Jiannong Cao,et al.  Distributed Fault-Tolerant Topology Control in Cooperative Wireless Ad Hoc Networks , 2015, IEEE Transactions on Parallel and Distributed Systems.

[11]  Bin Yu,et al.  PUF-Assisted Group Key Distribution Scheme for Software-Defined Wireless Sensor Networks , 2018, IEEE Communications Letters.

[12]  Yudong Zhang,et al.  On the Construction of Data Aggregation Tree With Maximizing Lifetime in Large-Scale Wireless Sensor Networks , 2016, IEEE Sensors Journal.

[13]  Haipeng Yao,et al.  Multi-objective enhanced particle swarm optimization in virtual network embedding , 2016, EURASIP J. Wirel. Commun. Netw..

[14]  Rob Sherwood,et al.  The controller placement problem , 2012, HotSDN@SIGCOMM.

[15]  Chip-Hong Chang,et al.  New adaptive color quantization method based on self-organizing maps , 2005, IEEE Transactions on Neural Networks.

[16]  Allen B. MacKenzie,et al.  On Stochastic Controller Placement in Software-Defined Wireless Networks , 2017, 2017 IEEE Wireless Communications and Networking Conference (WCNC).

[17]  Haipeng Yao,et al.  Location based spectrum sensing evaluation in cognitive radio networks , 2011, EURASIP J. Wirel. Commun. Netw..

[18]  Ishai Menache,et al.  Network-Aware Scheduling for Data-Parallel Jobs: Plan When You Can , 2015, SIGCOMM.

[19]  Mohsen Guizani,et al.  Edge Computing in the Industrial Internet of Things Environment: Software-Defined-Networks-Based Edge-Cloud Interplay , 2018, IEEE Communications Magazine.

[20]  Peter Dayan,et al.  Technical Note: Q-Learning , 2004, Machine Learning.

[21]  Changchuan Yin,et al.  Throughput Characterization for Cooperative Wireless Information Transmission with RF Energy Harvesting-Based Relay , 2016, Mob. Inf. Syst..

[22]  Alan L. Cox,et al.  Maestro: A System for Scalable OpenFlow Control , 2010 .

[23]  Burak Gorkemli,et al.  A QoS-enabled OpenFlow environment for Scalable Video streaming , 2010, 2010 IEEE Globecom Workshops.

[24]  Lei Shi,et al.  A Multicontroller Load Balancing Approach in Software-Defined Wireless Networks , 2015, Int. J. Distributed Sens. Networks.

[25]  Shengli Xie,et al.  Cognitive machine-to-machine communications: visions and potentials for the smart grid , 2012, IEEE Network.

[26]  Yap Keem Siah,et al.  Improvement of ANN-BP by data pre-segregation using SOM , 2009, 2009 IEEE International Conference on Computational Intelligence for Measurement Systems and Applications.

[27]  F. Richard Yu,et al.  Industrial Internet: A Survey on the Enabling Technologies, Applications, and Challenges , 2017, IEEE Communications Surveys & Tutorials.

[28]  Haipeng Yao,et al.  DaVe: Offloading Delay-Tolerant Data Traffic to Connected Vehicle Networks , 2016, IEEE Transactions on Vehicular Technology.

[29]  Victor C. M. Leung,et al.  Learning-Aided Network Association for Hybrid Indoor LiFi-WiFi Systems , 2018, IEEE Transactions on Vehicular Technology.

[30]  Stefan Schmid,et al.  Exploiting locality in distributed SDN control , 2013, HotSDN '13.

[31]  Chunxiao Jiang,et al.  Device-to-Device-Assisted Communications in Cellular Networks: An Energy Efficient Approach in Downlink Video Sharing Scenario , 2016, IEEE Transactions on Wireless Communications.

[32]  Arjan Durresi,et al.  A survey: Control plane scalability issues and approaches in Software-Defined Networking (SDN) , 2017, Comput. Networks.

[33]  Xu Chen,et al.  A Novel Framework of Data-Driven Networking , 2016, IEEE Access.

[34]  Xinbing Wang,et al.  The Value Strength Aided Information Diffusion in Socially-Aware Mobile Networks , 2016, IEEE Access.

[35]  Haipeng Yao,et al.  Big Data Analytics in Mobile Cellular Networks , 2016, IEEE Access.

[36]  Laizhong Cui,et al.  When big data meets software-defined networking: SDN for big data and big data for SDN , 2016, IEEE Network.

[37]  Haipeng Yao,et al.  Virtual Network Embedding Based on Computing, Network, and Storage Resource Constraints , 2018, IEEE Internet of Things Journal.

[38]  Hsiao-Hwa Chen,et al.  Cooperative Device-to-Device Communications: Social Networking Perspectives , 2017, IEEE Network.

[39]  Shane Legg,et al.  Human-level control through deep reinforcement learning , 2015, Nature.

[40]  Zhang Wei,et al.  Research and Application of a New Artificial Immune Algorithm Which Based on SOM Neural Network , 2006, 2006 IEEE International Conference on Networking, Sensing and Control.

[41]  Debanjan Saha,et al.  Optical Network Control: Architecture, Protocols, and Standards , 2003 .

[42]  Zhu Han,et al.  Information Credibility Modeling in Cooperative Networks: Equilibrium and Mechanism Design , 2017, IEEE Journal on Selected Areas in Communications.

[43]  Matti Latva-aho,et al.  Learning-Based Caching in Cloud-Aided Wireless Networks , 2018, IEEE Communications Letters.

[44]  David West,et al.  A comparison of SOM neural network and hierarchical clustering methods , 1996 .

[45]  Frank Dürr,et al.  Incremental Flow Scheduling and Routing in Time-Sensitive Software-Defined Networks , 2018, IEEE Transactions on Industrial Informatics.

[46]  Raj Yavatkar,et al.  The Phoenix framework: a practical architecture for programmable networks , 2000 .

[47]  Chunxiao Jiang,et al.  Mobile Data Transactions in Device-to-Device Communication Networks: Pricing and Auction , 2016, IEEE Wireless Communications Letters.

[48]  Chunxiao Jiang,et al.  A Framework for Categorizing and Applying Privacy-Preservation Techniques in Big Data Mining , 2016, Computer.

[49]  Trishul M. Chilimbi,et al.  Project Adam: Building an Efficient and Scalable Deep Learning Training System , 2014, OSDI.

[50]  Zhu Han,et al.  User Association in Heterogeneous Networks: A Social Interaction Approach , 2016, IEEE Transactions on Vehicular Technology.

[51]  Yang Xiao,et al.  A survey of communication/networking in Smart Grids , 2012, Future Gener. Comput. Syst..

[52]  Zhu Han,et al.  Energy Efficient D2D Communications: A Perspective of Mechanism Design , 2016, IEEE Transactions on Wireless Communications.

[53]  F. Richard Yu,et al.  A distributed energy-efficient algorithm in green Content-Centric Networks , 2015, 2015 IEEE International Conference on Communications (ICC).

[54]  Michael Dahlin,et al.  Making Byzantine Fault Tolerant Systems Tolerate Byzantine Faults , 2009, NSDI.

[55]  Zhu Han,et al.  Virtual Resource Allocation in Information-Centric Wireless Networks With Virtualization , 2016, IEEE Transactions on Vehicular Technology.

[56]  Yanhua Zhang,et al.  Virtualization for Distributed Ledger Technology (vDLT) , 2018, IEEE Access.

[57]  Haipeng Yao,et al.  An Intrusion Detection Framework Based on Hybrid Multi-Level Data Mining , 2019, International Journal of Parallel Programming.

[58]  Tom Schaul,et al.  Dueling Network Architectures for Deep Reinforcement Learning , 2015, ICML.

[59]  Zhu Han,et al.  Resource Allocation With Video Traffic Prediction in Cloud-Based Space Systems , 2016, IEEE Transactions on Multimedia.

[60]  Athanasios V. Vasilakos,et al.  Software-Defined Industrial Internet of Things in the Context of Industry 4.0 , 2016, IEEE Sensors Journal.

[61]  Hsiao-Hwa Chen,et al.  Interference-Limited Resource Optimization in Cognitive Femtocells With Fairness and Imperfect Spectrum Sensing , 2016, IEEE Transactions on Vehicular Technology.

[62]  Martín Abadi,et al.  TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems , 2016, ArXiv.

[63]  F. Richard Yu,et al.  Energy-efficient distributed in-network caching for Content-Centric Networks , 2014, 2014 IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS).

[64]  Victor C. M. Leung,et al.  Aggressive congestion control mechanism for space systems , 2016, IEEE Aerospace and Electronic Systems Magazine.

[65]  K. J. Ray Liu,et al.  Wireless Network Association Game With Data-Driven Statistical Modeling , 2016, IEEE Transactions on Wireless Communications.

[66]  Rajiv Ranjan,et al.  On construction of heuristic QoS bandwidth management in clouds , 2013, Concurr. Comput. Pract. Exp..

[67]  Tao Xiaofeng,et al.  SDN based next generation Mobile Network with Service Slicing and trials , 2014, China Communications.

[68]  Xiang Li,et al.  CONCURRENCY AND COMPUTATION : PRACTICE AND EXPERIENCE Concurrency Computat , 2007 .

[69]  Dong-Seong Kim,et al.  Efficient load balancing for multi-controller in SDN-based mission-critical networks , 2016, 2016 IEEE 14th International Conference on Industrial Informatics (INDIN).

[70]  Alagan Anpalagan,et al.  Industrial Internet of Things Driven by SDN Platform for Smart Grid Resiliency , 2019, IEEE Internet of Things Journal.

[71]  Joel J. P. C. Rodrigues,et al.  SDN-Enabled Multi-Attribute-Based Secure Communication for Smart Grid in IIoT Environment , 2018, IEEE Transactions on Industrial Informatics.

[72]  Vivien Quéma,et al.  RBFT: Redundant Byzantine Fault Tolerance , 2013, 2013 IEEE 33rd International Conference on Distributed Computing Systems.

[73]  Quanyan Zhu,et al.  Dependable Demand Response Management in the Smart Grid: A Stackelberg Game Approach , 2013, IEEE Transactions on Smart Grid.

[74]  Haipeng Yao,et al.  Dynamic Spectrum Management with Movement Prediction in Vehicular Ad Hoc Networks , 2016, Ad Hoc Sens. Wirel. Networks.

[75]  C. Malsburg Self-organization of orientation sensitive cells in the striate cortex , 2004, Kybernetik.

[76]  Dandan Wu,et al.  Green Energy Management of the Energy Internet Based on Service Composition Quality , 2018, IEEE Access.

[77]  Alberto Leon-Garcia,et al.  OpenAMI: Software-Defined AMI Load Balancing , 2018, IEEE Internet of Things Journal.

[78]  Haipeng Yao,et al.  Random Access and Virtual Resource Allocation in Software-Defined Cellular Networks With Machine-to-Machine Communications , 2017, IEEE Transactions on Vehicular Technology.

[79]  Chunxiao Jiang,et al.  Microblog Dimensionality Reduction—A Deep Learning Approach , 2016, IEEE Transactions on Knowledge and Data Engineering.

[80]  Wei Sun,et al.  Workload-aware load balancing for clustered Web servers , 2005, IEEE Transactions on Parallel and Distributed Systems.

[81]  Xiaodong Wang,et al.  Optimal state feedback control for wireless networked control systems with decentralised controllers , 2015 .

[82]  K. J. Ray Liu,et al.  Dynamic Chinese Restaurant Game: Theory and Application to Cognitive Radio Networks , 2014, IEEE Transactions on Wireless Communications.

[83]  Srikanth Kandula,et al.  Resource Management with Deep Reinforcement Learning , 2016, HotNets.

[84]  K. J. Ray Liu,et al.  Indian Buffet Game With Negative Network Externality and Non-Bayesian Social Learning , 2013, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[85]  Haipeng Yao,et al.  A novel energy efficiency algorithm in green mobile networks with cache , 2015, EURASIP Journal on Wireless Communications and Networking.

[86]  B. J. Wilson,et al.  A management and visualization framework for reconfigurable WDM optical networks , 2000 .

[87]  Zhu Han,et al.  Resource Allocation in Space Multiaccess Systems , 2017, IEEE Transactions on Aerospace and Electronic Systems.

[88]  Petr Kuznetsov,et al.  A distributed and robust SDN control plane for transactional network updates , 2015, 2015 IEEE Conference on Computer Communications (INFOCOM).

[89]  Haipeng Yao,et al.  Permissioned Blockchain-Based Distributed Software-Defined Industrial Internet of Things , 2018, 2018 IEEE Globecom Workshops (GC Wkshps).

[90]  Rose Qingyang Hu,et al.  Self-organization in disaster-resilient heterogeneous small cell networks , 2015, IEEE Network.

[91]  Chao Qiu,et al.  Sleeping mode of multi-controller in green software-defined networking , 2016, EURASIP J. Wirel. Commun. Netw..

[92]  Thomas Nolte,et al.  A Cost Efficient Design of a Multi-sink Multi-controller WSN in a Smart Factory , 2017, 2017 IEEE 19th International Conference on High Performance Computing and Communications; IEEE 15th International Conference on Smart City; IEEE 3rd International Conference on Data Science and Systems (HPCC/SmartCity/DSS).

[93]  Haipeng Yao,et al.  A Novel Kernel for Text Classification Based on Semantic and Statistical Information , 2018, Comput. Informatics.

[94]  Lane M. D. Owsley,et al.  Self-organizing feature maps with perfect organization , 1996, 1996 IEEE International Conference on Acoustics, Speech, and Signal Processing Conference Proceedings.

[95]  Haipeng Yao,et al.  WLAN interference self‐optimization using som neural networks , 2017, Concurr. Comput. Pract. Exp..

[96]  Haipeng Yao,et al.  Modeling Energy-Delay Tradeoffs in Single Base Station with Cache , 2015, Int. J. Distributed Sens. Networks.

[97]  Srikanth Kandula,et al.  Multi-resource packing for cluster schedulers , 2015, SIGCOMM.

[98]  Mohsen Guizani,et al.  Cooperative earth observation through complex space information networks , 2016, IEEE Wireless Communications.

[99]  C. Senabre,et al.  Comparative analysis of self organizing maps vs. multilayer perceptron neural networks for short-term load forecasting , 2010, 2010 Modern Electric Power Systems.

[100]  Tao Huang,et al.  Optimal power allocation in cognitive radio based machine-to-machine network , 2014, EURASIP Journal on Wireless Communications and Networking.

[101]  Mohsen Guizani,et al.  Home M2M networks: Architectures, standards, and QoS improvement , 2011, IEEE Communications Magazine.

[102]  Matthew Roughan,et al.  The Internet Topology Zoo , 2011, IEEE Journal on Selected Areas in Communications.

[103]  Meng Chang Chen,et al.  Proportional delay differentiation service based on weighted fair queuing , 2000, Proceedings Ninth International Conference on Computer Communications and Networks (Cat.No.00EX440).

[104]  Miguel Castro,et al.  Practical byzantine fault tolerance and proactive recovery , 2002, TOCS.

[105]  Dong In Kim,et al.  HetNets with cognitive small cells: user offloading and distributed channel access techniques , 2013, IEEE Communications Magazine.

[106]  Joris Jaguemont,et al.  Characterization and Modeling of a Hybrid-Electric-Vehicle Lithium-Ion Battery Pack at Low Temperatures , 2016, IEEE Transactions on Vehicular Technology.

[107]  Chunxiao Jiang,et al.  Location-aware device communication design: exploration and exploitation on energy , 2016, IEEE Wireless Communications.

[108]  José Ferreira de Rezende,et al.  TDCS: A new mechanism for automatic channel assignment for independent IEEE 802.11 networks , 2009 .

[109]  Jianhua Li,et al.  Dynamic Privacy Pricing: A Multi-Armed Bandit Approach With Time-Variant Rewards , 2017, IEEE Transactions on Information Forensics and Security.

[110]  Haipeng Yao,et al.  Towards next generation software-defined radio access network–architecture, deployment, and use case , 2016, EURASIP J. Wirel. Commun. Netw..