Deep learning based adaptive sequential data augmentation technique for the optical network traffic synthesis.

The lack of the sufficient and diverse training data is one of the main challenges limiting performances of the machine learning enabled applications in optical networks. Here, we propose a deep learning based sequential data augmentation technique for the aggregate traffic data augmentation for diverse optical network scenarios. A generative adversarial network (GAN) model is trained with the experimental traffic data to automatically extract the substantial characteristics of the experimental traffic data through the zero-sum game theory and then augment the traffic data adaptively. The statistical evaluation parameters of the augmented traffic are mean, variance and Hurst exponent. To add comparisons, two other classical generative models including the statistical parameter configuration (SPC) model and the variational autoencoder (VAE) model are also adopted to generate the traffic data that are similar to the actual traffic data. The comprehensive comparisons among the proposed GAN, the SPC and VAE show that the performances of the GAN exceed those of the SPC and the VAE obviously. The mean and the variance of the augmented traffic data from the GAN are almost equal to those of the experimental traffic data, where the average deviations are both within 2%. The Hurst exponent of the augmented traffic data from the GAN is respectively near 90% and 96% of those of the experimental traffic data in the access network and the core network. To estimate the similarity intuitively, the well-known k-mean algorithm is used to cluster the augmented traffic data according to the centroids determined by the corresponding experimental traffic data and the clustering accuracies are all higher than 95% for 6 kinds of typical traffic types in the optical networks. These results demonstrate that the proposed GAN is able to effectively generate the traffic data that is very close to the experimental traffic data and is difficult to be distinguished for diverse traffic types. Moreover, a relatively small dataset with a few hundred pieces of experimental traffic data is required and the amount of the augmented traffic data from the GAN is unlimited in theory, which can be augmented as much as we need. The proposed traffic data augmentation technique also has the potential to be utilized in other sequential data augmentation applications for the optical networks.

[1]  Chih-Fong Tsai,et al.  CANN: An intrusion detection system based on combining cluster centers and nearest neighbors , 2015, Knowl. Based Syst..

[2]  Min Zhang,et al.  Failure prediction using machine learning and time series in optical network. , 2017, Optics express.

[3]  Marco Ruffini,et al.  An Overview on Application of Machine Learning Techniques in Optical Networks , 2018, IEEE Communications Surveys & Tutorials.

[4]  P. Castoldi,et al.  Dynamic core VNT adaptability based on predictive metro-flow traffic models , 2017, IEEE/OSA Journal of Optical Communications and Networking.

[5]  Victor Lopez,et al.  Virtual network topology adaptability based on data analytics for traffic prediction , 2017, IEEE/OSA Journal of Optical Communications and Networking.

[6]  Marc Ruiz,et al.  CURSA-SQ: A methodology for service-centric traffic flow analysis , 2018, IEEE/OSA Journal of Optical Communications and Networking.

[7]  Michalis Faloutsos,et al.  Long-range dependence ten years of Internet traffic modeling , 2004, IEEE Internet Computing.

[8]  Xin Wang,et al.  Machine Learning for Networking: Workflow, Advances and Opportunities , 2017, IEEE Network.

[9]  Walter Willinger,et al.  Self-similarity through high-variability: statistical analysis of Ethernet LAN traffic at the source level , 1997, TNET.

[10]  Elio Salvadori,et al.  Cognitive optical network testbed: EU project CHRON [Invited] , 2015 .

[11]  Min Zhang,et al.  Intelligent constellation diagram analyzer using convolutional neural network-based deep learning. , 2017, Optics express.

[12]  Matthias Grossglauser,et al.  On the relevance of long-range dependence in network traffic , 1999, TNET.

[13]  Min Zhang,et al.  Adaptive Demodulator Using Machine Learning for Orbital Angular Momentum Shift Keying , 2017, IEEE Photonics Technology Letters.

[14]  Chao Lu,et al.  An Optical Communication's Perspective on Machine Learning and Its Applications , 2019, Journal of Lightwave Technology.

[15]  Min Zhang,et al.  System impairment compensation in coherent optical communications by using a bio-inspired detector based on artificial neural network and genetic algorithm , 2017 .

[16]  Yongli Zhao,et al.  SOON: self-optimizing optical networks with machine learning. , 2018, Optics express.

[17]  Fernando Morales,et al.  On-demand incremental capacity planning in optical transport networks , 2016, IEEE/OSA Journal of Optical Communications and Networking.

[18]  Wolfgang Kellerer,et al.  Software Defined Optical Networks (SDONs): A Comprehensive Survey , 2015, IEEE Communications Surveys & Tutorials.

[19]  Xue Chen,et al.  Modulation Format Recognition and OSNR Estimation Using CNN-Based Deep Learning , 2017, IEEE Photonics Technology Letters.

[20]  Gil Zussman,et al.  Dynamic mitigation of EDFA power excursions with machine learning. , 2017, Optics express.

[21]  Danish Rafique,et al.  Machine learning for network automation: overview, architecture, and applications [Invited Tutorial] , 2018, IEEE/OSA Journal of Optical Communications and Networking.

[22]  Luis Velasco,et al.  In-operation network planning , 2014, IEEE Commun. Mag..

[23]  Min Zhang,et al.  Joint atmospheric turbulence detection and adaptive demodulation technique using the CNN for the OAM-FSO communication. , 2018, Optics express.

[24]  Chao Lu,et al.  Optical Performance Monitoring: A Review of Current and Future Technologies , 2016, Journal of Lightwave Technology.