An Optical Communication's Perspective on Machine Learning and Its Applications

Machine learning (ML) has disrupted a wide range of science and engineering disciplines in recent years. ML applications in optical communications and networking are also gaining more attention, particularly in the areas of nonlinear transmission systems, optical performance monitoring, and cross-layer network optimizations for software-defined networks. However, the extent to which ML techniques can benefit optical communications and networking is not clear and this is partly due to an insufficient understanding of the nature of ML concepts. This paper aims to describe the mathematical foundations of basic ML techniques from communication theory and signal processing perspectives, which in turn will shed light on the types of problems in optical communications and networking that naturally warrant ML use. This will be followed by an overview of ongoing ML research in optical communications and networking with a focus on physical layer issues.

[1]  Changyuan Yu,et al.  Joint OSNR monitoring and modulation format identification in digital coherent receivers using deep neural networks. , 2017, Optics express.

[2]  Milton S. Boyd,et al.  Designing a neural network for forecasting financial and economic time series , 1996, Neurocomputing.

[3]  Yoshua Bengio,et al.  On the Expressive Power of Deep Architectures , 2011, ALT.

[4]  David G. Stork,et al.  Pattern Classification (2nd ed.) , 1999 .

[5]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[6]  M. O'Sullivan,et al.  Fiber Nonlinear Noise-to-Signal Ratio Monitoring Using Artificial Neural Networks , 2017, 2017 European Conference on Optical Communication (ECOC).

[7]  Sofien Mhatli,et al.  Reduction of Nonlinear Intersubcarrier Intermixing in Coherent Optical OFDM by a Fast Newton-Based Support Vector Machine Nonlinear Equalizer , 2017, Journal of Lightwave Technology.

[8]  Danish Rafique,et al.  Machine learning for network automation: overview, architecture, and applications [Invited Tutorial] , 2018, IEEE/OSA Journal of Optical Communications and Networking.

[9]  Yoshua. Bengio,et al.  Learning Deep Architectures for AI , 2007, Found. Trends Mach. Learn..

[10]  E. Ip,et al.  Nonlinear Compensation Using Backpropagation for Polarization-Multiplexed Transmission , 2010, Journal of Lightwave Technology.

[11]  Reza Nejabati,et al.  Field trial of Machine-Learning-assisted and SDN-based Optical Network Planning with Network-Scale Monitoring Database , 2017, 2017 European Conference on Optical Communication (ECOC).

[12]  J. Edward Jackson,et al.  A User's Guide to Principal Components. , 1991 .

[13]  Lijuan Cao,et al.  A comparison of PCA, KPCA and ICA for dimensionality reduction in support vector machine , 2003, Neurocomputing.

[14]  Metodi P. Yankov,et al.  Time-Domain Neural Network Receiver for Nonlinear Frequency Division Multiplexed Systems , 2018, IEEE Photonics Technology Letters.

[15]  Razvan Pascanu,et al.  On the difficulty of training recurrent neural networks , 2012, ICML.

[16]  Stephen E. Ralph,et al.  Robust architecture for autonomous coherent optical receivers , 2015, IEEE/OSA Journal of Optical Communications and Networking.

[17]  Ian T. Jolliffe,et al.  Principal Component Analysis , 2002, International Encyclopedia of Statistical Science.

[18]  Faisal Nadeem Khan,et al.  Simultaneous optical performance monitoring and modulation format/bit-rate identification using principal component analysis , 2014, IEEE/OSA Journal of Optical Communications and Networking.

[19]  Stephen R. Marsland,et al.  Machine Learning - An Algorithmic Perspective , 2009, Chapman and Hall / CRC machine learning and pattern recognition series.

[20]  Yoshua Bengio,et al.  Exploring Strategies for Training Deep Neural Networks , 2009, J. Mach. Learn. Res..

[21]  Chao Lu,et al.  Optical Performance Monitoring in Fiber-Optic Networks Enabled by Machine Learning Techniques , 2018, 2018 Optical Fiber Communications Conference and Exposition (OFC).

[22]  Razvan Pascanu,et al.  How to Construct Deep Recurrent Neural Networks , 2013, ICLR.

[23]  Idelfonso Tafur Monroy,et al.  Cognitive digital receiver for burst mode phase modulated radio over fiber links , 2010, 36th European Conference and Exhibition on Optical Communication.

[24]  Wanyi Gu,et al.  Nonparameter Nonlinear Phase Noise Mitigation by Using M-ary Support Vector Machine for Coherent Optical Systems , 2013, IEEE Photonics Journal.

[25]  Chao Lu,et al.  Modulation Format Identification in Coherent Receivers Using Deep Machine Learning , 2016, IEEE Photonics Technology Letters.

[26]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[27]  Victor Lopez,et al.  Virtual network topology adaptability based on data analytics for traffic prediction , 2017, IEEE/OSA Journal of Optical Communications and Networking.

[28]  Andrew R. Webb,et al.  Statistical Pattern Recognition , 1999 .

[29]  Marc Wuilpart,et al.  Fiber Nonlinearity Equalizer Based on Support Vector Classification for Coherent Optical OFDM , 2016, IEEE Photonics Journal.

[30]  C. Siva Ram Murthy,et al.  A Reinforcement Learning Framework for Path Selection and Wavelength Selection in Optical Burst Switched Networks , 2007, IEEE Journal on Selected Areas in Communications.

[31]  Guido Maier,et al.  Matheuristic with machine-learning-based prediction for software-defined mobile metro-core networks , 2017, IEEE/OSA Journal of Optical Communications and Networking.

[32]  I. Jolliffe.  Principal Component Analysis , 2002 .

[33]  Peter J. Winzer,et al.  Nonlinear Interference Mitigation: Methods and Potential Gain , 2017, Journal of Lightwave Technology.

[34]  Min Zhang,et al.  Failure prediction using machine learning and time series in optical network. , 2017, Optics express.

[35]  Gabriella Bosco,et al.  EGN model of non-linear fiber propagation. , 2014, Optics express.

[36]  Idelfonso Tafur Monroy,et al.  Nonlinear impairment compensation using expectation maximization for dispersion managed and unmanaged PDM 16-QAM transmission. , 2012, Optics express.

[37]  Danilo P. Mandic,et al.  Recurrent Neural Networks for Prediction: Learning Algorithms, Architectures and Stability , 2001 .

[38]  Chao Lu,et al.  Optical Performance Monitoring Using Artificial Neural Networks Trained With Empirical Moments of Asynchronously Sampled Signal Amplitudes , 2012, IEEE Photonics Technology Letters.

[39]  Xiaoxia Wu,et al.  Applications of Artificial Neural Networks in Optical Performance Monitoring , 2009, Journal of Lightwave Technology.

[40]  Y. Jiang,et al.  Recent Advances in the Modeling of the Impact of Nonlinear Fiber Propagation Effects on Uncompensated Coherent Transmission Systems , 2017, Journal of Lightwave Technology.

[41]  Chee Kheong Siew,et al.  Extreme learning machine: Theory and applications , 2006, Neurocomputing.

[42]  A. Lau,et al.  OSNR Monitoring for PM-QPSK Systems With Large Inline Chromatic Dispersion Using Artificial Neural Network Technique , 2012, IEEE Photonics Technology Letters.

[43]  Chao Lu,et al.  Modulation format identification in heterogeneous fiber-optic networks using artificial neural networks. , 2012, Optics express.

[44]  Mohit Chamania,et al.  Artificial Intelligence (AI) Methods in Optical Networks: A Comprehensive Survey , 2018, Opt. Switch. Netw..

[45]  Polina Bayvel,et al.  End-to-End Deep Learning of Optical Fiber Communications , 2018, Journal of Lightwave Technology.

[46]  S. Bigo,et al.  Proactive Fiber Damage Detection in Real-time Coherent Receiver , 2017, 2017 European Conference on Optical Communication (ECOC).

[47]  Alan Pak Tao Lau,et al.  Fiber nonlinearity compensation using extreme learning machine for DSP-based coherent communication systems , 2011, 16th Opto-Electronics and Communications Conference.

[48]  Wolfgang Kellerer,et al.  Software Defined Optical Networks (SDONs): A Comprehensive Survey , 2015, IEEE Communications Surveys & Tutorials.

[49]  B. Eggleton,et al.  Fiber nonlinearity-induced penalty reduction in CO-OFDM by ANN-based nonlinear equalization. , 2015, Optics letters.

[50]  Yoshua Bengio,et al.  Understanding the difficulty of training deep feedforward neural networks , 2010, AISTATS.

[51]  Roberto Proietti,et al.  Deep-RMSA: A Deep-Reinforcement-Learning Routing, Modulation and Spectrum Assignment Agent for Elastic Optical Networks , 2018, 2018 Optical Fiber Communications Conference and Exposition (OFC).

[52]  Takeshi Hoshida,et al.  Deep Neural Network Based Optical Monitor Providing Self-Confidence as Auxiliary Output , 2018, 2018 European Conference on Optical Communication (ECOC).

[53]  Rich Caruana,et al.  Do Deep Nets Really Need to be Deep? , 2013, NIPS.

[54]  Chao Lu,et al.  Optical Performance Monitoring: A Review of Current and Future Technologies , 2016, Journal of Lightwave Technology.

[55]  Jian Sun,et al.  Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[56]  Yoshua Bengio,et al.  Deep Sparse Rectifier Neural Networks , 2011, AISTATS.

[57]  Constantin F. Aliferis,et al.  A Gentle Introduction to Support Vector Machines in Biomedicine: Case Studies , 2011 .

[58]  Achim Autenrieth,et al.  Analytics-Driven Fault Discovery and Diagnosis for Cognitive Root Cause Analysis , 2018, 2018 Optical Fiber Communications Conference and Exposition (OFC).

[59]  Henry D. Pfister,et al.  Wideband Time-Domain Digital Backpropagation via Subband Processing and Deep Learning , 2018, 2018 European Conference on Optical Communication (ECOC).

[60]  Frank R. Kschischang,et al.  Optical Nonlinear Phase Noise Compensation for $9\times 32$ -Gbaud PolDM-16 QAM Transmission Using a Code-Aided Expectation-Maximization Algorithm , 2015, Journal of Lightwave Technology.

[61]  Henry D. Pfister,et al.  Nonlinear Interference Mitigation via Deep Neural Networks , 2017, 2018 Optical Fiber Communications Conference and Exposition (OFC).

[62]  Xue Chen,et al.  Modulation Format Recognition and OSNR Estimation Using CNN-Based Deep Learning , 2017, IEEE Photonics Technology Letters.

[63]  Min Zhang,et al.  Nonlinear decision boundary created by a machine learning-based classifier to mitigate nonlinear phase noise , 2015, 2015 European Conference on Optical Communication (ECOC).

[64]  Alan Pak Tao Lau,et al.  Non-data-aided joint bit-rate and modulation format identification for next-generation heterogeneous optical networks , 2014 .

[65]  Pascal Vincent,et al.  Representation Learning: A Review and New Perspectives , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[66]  J.C. Li,et al.  Multi Impairment Monitoring for Optical Networks , 2009, Journal of Lightwave Technology.

[67]  Takeshi Hoshida,et al.  OSNR monitoring by deep neural networks trained with asynchronously sampled data , 2016, 2016 21st OptoElectronics and Communications Conference (OECC) held jointly with 2016 International Conference on Photonics in Switching (PS).

[68]  Marco Ruffini,et al.  An Overview on Application of Machine Learning Techniques in Optical Networks , 2018, IEEE Communications Surveys & Tutorials.

[69]  Chao Lu,et al.  Optical Performance Monitoring For Fiber‐Optic Communication Networks , 2016 .

[70]  Vijay Vusirikala,et al.  Evolution from 8QAM live traffic to PS 64-QAM with Neural-Network Based Nonlinearity Compensation on 11000 km Open Subsea Cable , 2018, 2018 Optical Fiber Communications Conference and Exposition (OFC).

[71]  Radford M. Neal.  Pattern Recognition and Machine Learning , 2007, Technometrics.

[72]  Robert Dunne,et al.  A Statistical Approach to Neural Networks for Pattern Recognition , 2007 .

[73]  A. Caballero,et al.  Optical modulation format recognition in stokes space for digital coherent receivers , 2013, 2013 Optical Fiber Communication Conference and Exposition and the National Fiber Optic Engineers Conference (OFC/NFOEC).

[74]  Ethem Alpaydin,et al.  Introduction to machine learning , 2004, Adaptive computation and machine learning.

[75]  Zhenning Tao,et al.  Multiplier-Free Intrachannel Nonlinearity Compensating Algorithm Operating at Symbol Rate , 2011, Journal of Lightwave Technology.

[76]  Achim Autenrieth,et al.  Cognitive Assurance Architecture for Optical Network Fault Management , 2018, Journal of Lightwave Technology.

[77]  M. O'Sullivan,et al.  Machine learning based linear and nonlinear noise estimation , 2018, IEEE/OSA Journal of Optical Communications and Networking.