How to Mislead AI-Assisted Network Automation in SD-IPoEONs: A Comparison Study of DRL- and GAN-Based Approaches

Recently, the combination of artificial intelligence (AI) and software-defined networking (SDN) has attracted intensive research interests because it realizes and promotes AI-assisted network automation (AIaNA). Despite the initial successes of AIaNA, its vulnerabilities, i.e., the downside of the reduction of human involvement achieved by it, have not been carefully explored. In this work, we use software-defined IP over elastic optical networks (SD-IPoEONs) as the background, and study how to mislead the AIaNA system in them. Specifically, we target our attack on the deep neural network (DNN) based traffic predictor in the AIaNA system, and design an adversarial module (ADVM) that can craft and inject adversarial traffic samples adaptively to disturb its operation. We consider two approaches to design the ADVM, i.e., the deep reinforcement learning (DRL) based on deep deterministic policy gradient (DDPG), and the generative adversarial network (GAN) model. Our proposed ADVM can monitor and interact with a dynamic SD-IPoEON to train itself on-the-fly. This enables it to generate and inject adversarial samples in the most disturbing and hard-to-detect way and to severely affect the AIaNA's performance on multilayer service provisioning. Specifically, IP flows will be served incorrectly to result in unnecessary congestions/under-utilizations on lightpaths, and erroneous network reconfigurations will be invoked frequently. Simulation results confirm the effectiveness of our ADVM designs, and show that the GAN-based ADVM achieves better attack effects with smaller perturbation strength.

[1]  Biswanath Mukherjee,et al.  Evolving Traffic Grooming in Multi-Layer Flexible-Grid Optical Networks With Software-Defined Elasticity , 2014, Journal of Lightwave Technology.

[2]  Zuqing Zhu,et al.  When Deep Learning Meets Inter-Datacenter Optical Network Management: Advantages and Vulnerabilities , 2018, Journal of Lightwave Technology.

[3]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[4]  Changsheng You,et al.  Dynamic and Adaptive Bandwidth Defragmentation in Spectrum-Sliced Elastic Optical Networks With Time-Varying Traffic , 2014, Journal of Lightwave Technology.

[5]  Min Wang,et al.  Can You Trust AI-assisted Network Automationƒ A DRL-based Approach to Mislead the Automation in SD-IPoEONs , 2020, 2020 Optical Fiber Communications Conference and Exhibition (OFC).

[6]  Pan He,et al.  Adversarial Examples: Attacks and Defenses for Deep Learning , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[7]  Fan Ji,et al.  Service availability oriented p-cycle protection design in elastic optical networks , 2014, IEEE/OSA Journal of Optical Communications and Networking.

[8]  Wei Lu,et al.  Efficient resource allocation for all-optical multicasting over spectrum-sliced elastic optical networks , 2013, IEEE/OSA Journal of Optical Communications and Networking.

[9]  Zhong Pan,et al.  Jitter and Amplitude Noise Accumulations in Cascaded All-Optical Regenerators , 2008, Journal of Lightwave Technology.

[10]  Daoyun Hu,et al.  Demonstration of OpenFlow-Controlled Network Orchestration for Adaptive SVC Video Manycast , 2015, IEEE Transactions on Multimedia.

[11]  Wei Lu,et al.  Dynamic Service Provisioning in Elastic Optical Networks With Hybrid Single-/Multi-Path Routing , 2013, Journal of Lightwave Technology.

[12]  Shoujiang Ma,et al.  Demonstrations of Efficient Online Spectrum Defragmentation in Software-Defined Elastic Optical Networks , 2014, Journal of Lightwave Technology.

[13]  Ananthram Swami,et al.  Distillation as a Defense to Adversarial Perturbations Against Deep Neural Networks , 2015, 2016 IEEE Symposium on Security and Privacy (SP).

[14]  S. J. B. Yoo,et al.  Spectral and spatial 2D fragmentation-aware routing and spectrum assignment algorithms in elastic optical networks [invited] , 2013, IEEE/OSA Journal of Optical Communications and Networking.

[15]  Masahiko Jinno,et al.  Elastic optical networking: a new dawn for the optical layer? , 2012, IEEE Communications Magazine.

[16]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[17]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[18]  Victor Lopez,et al.  Virtual network topology adaptability based on data analytics for traffic prediction , 2017, IEEE/OSA Journal of Optical Communications and Networking.

[19]  Zuqing Zhu,et al.  Virtual Optical Network Embedding (VONE) Over Elastic Optical Networks , 2014, Journal of Lightwave Technology.

[20]  Danish Rafique,et al.  Machine learning for network automation: overview, architecture, and applications [Invited Tutorial] , 2018, IEEE/OSA Journal of Optical Communications and Networking.

[21]  Baojia Li,et al.  Realizing AI-AssistedMulti-Layer Restoration in a Software-Defined IP-over-EON with Deep Learning: An Experimental Study , 2018, 2018 Optical Fiber Communications Conference and Exposition (OFC).

[22]  Dong-Chul Park,et al.  Structure optimization of BiLinear Recurrent Neural Networks and its application to Ethernet network traffic prediction , 2013, Inf. Sci..

[23]  Wei Lu,et al.  Predictive Analytics Based Knowledge-Defined Orchestration in a Hybrid Optical/Electrical Datacenter Network Testbed , 2019, Journal of Lightwave Technology.

[24]  Marija Furdek,et al.  Machine Learning for Optical Network Security Monitoring: A Practical Perspective , 2020, Journal of Lightwave Technology.

[25]  S. J. B. Yoo,et al.  Demonstration of Cooperative Resource Allocation in an OpenFlow-Controlled Multidomain and Multinational SD-EON Testbed , 2015, Journal of Lightwave Technology.

[26]  Víctor López,et al.  Multi-layer capacity planning for IP-optical networks , 2014, IEEE Communications Magazine.

[27]  Roberto Proietti,et al.  Self-Taught Anomaly Detection With Hybrid Unsupervised/Supervised Machine Learning in Optical Networks , 2019, Journal of Lightwave Technology.

[28]  Zuqing Zhu,et al.  Scalable knowledge-defined orchestration for hybrid optical–electrical datacenter networks [Invited] , 2020, IEEE/OSA Journal of Optical Communications and Networking.

[29]  Massimo Tornatore,et al.  Routing and Spectrum Assignment Integrating Machine-Learning-Based QoT Estimation in Elastic Optical Networks , 2019, IEEE INFOCOM 2019 - IEEE Conference on Computer Communications.

[30]  Zuqing Zhu,et al.  On the cross-layer orchestration to address IP router outages with cost-efficient multilayer restoration in IP-over-EONs , 2018, IEEE/OSA Journal of Optical Communications and Networking.

[31]  Achim Autenrieth,et al.  First demonstration of SDN-controlled Multi-Layer Restoration and its advantage over Optical Restoration , 2016 .

[32]  Ajmal Mian,et al.  Threat of Adversarial Attacks on Deep Learning in Computer Vision: A Survey , 2018, IEEE Access.

[33]  Baojia Li,et al.  Deep-NFVOrch: leveraging deep reinforcement learning to achieve adaptive vNF service chaining in DCI-EONs , 2019, IEEE/OSA Journal of Optical Communications and Networking.

[34]  Cisco Visual Networking Index: Forecast and Methodology 2016-2021.(2017) http://www.cisco.com/c/en/us/solutions/collateral/service-provider/visual- networking-index-vni/complete-white-paper-c11-481360.html. High Efficiency Video Coding (HEVC) Algorithms and Architectures https://jvet.hhi.fraunhofer. , 2017 .

[35]  Ananthram Swami,et al.  The Limitations of Deep Learning in Adversarial Settings , 2015, 2016 IEEE European Symposium on Security and Privacy (EuroS&P).

[36]  Zuqing Zhu,et al.  Spectrum-efficient anycast in elastic optical inter-datacenter networks , 2014, Opt. Switch. Netw..

[37]  Christophe Diot,et al.  Pop-level and access-link-level traffic dynamics in a tier-1 POP , 2001, IMW '01.

[38]  Lu Peng,et al.  Fooling AI with AI: An Accelerator for Adversarial Attacks on Deep Learning Visual Classification , 2019, 2019 IEEE 30th International Conference on Application-specific Systems, Architectures and Processors (ASAP).

[39]  Zuqing Zhu,et al.  On Cost-Efficient Integrated Multilayer Protection Planning in IP-Over-EONs , 2018, Journal of Lightwave Technology.

[40]  Shashank Srivastava,et al.  Research Trends in Security and DDoS in SDN , 2016, Secur. Commun. Networks.

[41]  L. Velasco,et al.  Survivable IP/MPLS-Over-WSON Multilayer Network Optimization , 2011, IEEE/OSA Journal of Optical Communications and Networking.

[42]  Xiang Zhou,et al.  A Two-Population Based Evolutionary Approach for Optimizing Routing, Modulation and Spectrum Assignments (RMSA) in O-OFDM Networks , 2012, IEEE Communications Letters.

[43]  Keith W. Ross,et al.  Topology Mapping and Geolocating for China's Internet , 2013, IEEE Transactions on Parallel and Distributed Systems.

[44]  Baojia Li,et al.  DL-Assisted Cross-Layer Orchestration in Software-Defined IP-Over-EONs: From Algorithm Design to System Prototype , 2019, Journal of Lightwave Technology.

[45]  Achim Autenrieth,et al.  Cognitive Assurance Architecture for Optical Network Fault Management , 2018, Journal of Lightwave Technology.

[46]  Shengru Li,et al.  Protocol Oblivious Forwarding (POF): Software-Defined Networking with Enhanced Programmability , 2017, IEEE Network.

[47]  Baojia Li,et al.  Deep-learning-assisted network orchestration for on-demand and cost-effective VNF service chaining in inter-DC elastic optical networks , 2018, IEEE/OSA Journal of Optical Communications and Networking.

[48]  Junaid Qadir,et al.  Black-box Adversarial Machine Learning Attack on Network Traffic Classification , 2019, 2019 15th International Wireless Communications & Mobile Computing Conference (IWCMC).

[49]  Zuqing Zhu,et al.  Data-Oriented Task Scheduling in Fixed- and Flexible-Grid Multilayer Inter-DC Optical Networks: A Comparison Study , 2017, Journal of Lightwave Technology.

[50]  Yuval Tassa,et al.  Continuous control with deep reinforcement learning , 2015, ICLR.

[51]  Zuqing Zhu,et al.  Cost-efficient multi-layer restoration to address IP router outages in IP-over-EONs , 2017, 2017 Optical Fiber Communications Conference and Exhibition (OFC).

[52]  Jingjing Yao,et al.  Highly efficient data migration and backup for big data applications in elastic optical inter-data-center networks , 2015, IEEE Network.