Dirty-data-based alarm prediction in self-optimizing large-scale optical networks.

Machine-learning-based solutions are showing promising results for several critical issues in large-scale optical networks. Alarm (caused by failure, disaster, etc.) prediction is an important use-case, where machine learning can assist in predicting events, ahead of time. Accurate prediction enables network administrators to undertake preventive measures. For such alarm prediction applications, high-quality data sets for training and testing are crucial. However, the collected performance and alarm data from large-scale optical networks are often dirty, i.e., these data are incomplete, inconsistent, and lack certain behaviors or trends. Such data are likely to contain several errors, when collected from old-fashioned optical equipment, in particular. Even after appropriate data preprocessing, feature distribution can be extremely unbalanced, limiting the performance of machine learning algorithms. This paper demonstrates a Dirty-data-based Alarm Prediction (DAP) method for Self-Optimizing Optical Networks (SOONs). Experimental results on a commercial large-scale field topology with 274 nodes and 487 links demonstrate that the proposed DAP method can achieve high accuracy for different types of alarms.

[1]  Nitesh V. Chawla,et al.  SMOTE: Synthetic Minority Over-sampling Technique , 2002, J. Artif. Intell. Res..

[2]  Doheon Lee,et al.  A Taxonomy of Dirty Data , 2004, Data Mining and Knowledge Discovery.

[3]  Nitesh V. Chawla,et al.  Editorial: special issue on learning from imbalanced data sets , 2004, SKDD.

[4]  Haibo He,et al.  Learning from Imbalanced Data , 2009, IEEE Transactions on Knowledge and Data Engineering.

[5]  Joao Pedro,et al.  Machine learning models for estimating quality of transmission in DWDM networks , 2018, IEEE/OSA Journal of Optical Communications and Networking.

[6]  Min Zhang,et al.  Failure prediction using machine learning and time series in optical network. , 2017, Optics express.

[7]  Yongli Zhao,et al.  SOON: self-optimizing optical networks with machine learning. , 2018, Optics express.

[8]  H. Robbins A Stochastic Approximation Method , 1951 .

[9]  Ying Mi,et al.  Imbalanced Classification Based on Active Learning SMOTE , 2013 .

[10]  Mikael Mazur,et al.  10 Tb/s PM-64QAM Self-Homodyne Comb-Based Superchannel Transmission With 4% Shared Pilot Tone Overhead , 2018, Journal of Lightwave Technology.

[11]  G. Ellinas,et al.  Leveraging statistical machine learning to address failure localization in optical networks , 2018, IEEE/OSA Journal of Optical Communications and Networking.