The Novel Applications of Deep Reservoir Computing in Cyber-Security and Wireless Communication

This chapter introduces the novel applications of deep reservoir computing (RC) systems in cyber-security and wireless communication. The RC systems are a new class of recurrent neural networks (RNNs). Traditional RNNs are very challenging to train due to vanishing/exploding gradients. However, the RC systems are easier to train and have shown similar or even better performances compared with traditional RNNs. It is very essential to study the spatio-temporal correlations in cyber-security and wireless communication domains. Therefore, RC models are good choices to explore the spatio-temporal correlations. In this chapter, we explore the applications and performance of delayed feedback reservoirs (DFRs), and echo state networks (ESNs) in the cyber-security of smart grids and symbol detection in MIMO-OFDM systems, respectively. DFRs and ESNs are two different types of RC models. We also introduce the spiking structure of DFRs as spiking artificial neural networks are more energy efficient and biologically plausible as well.

[1]  Lingjia Liu,et al.  Modeling and Analysis of Energy Consumption for MIMO Systems , 2017, 2017 IEEE Wireless Communications and Networking Conference (WCNC).

[2]  Shaodan Ma,et al.  Channel estimation in full-dimensional massive MIMO system using one training symbol , 2017, 2017 IEEE 18th International Workshop on Signal Processing Advances in Wireless Communications (SPAWC).

[3]  Yang Yi,et al.  Analog Spike-Timing-Dependent Resistive Crossbar Design for Brain Inspired Computing , 2018, IEEE Journal on Emerging and Selected Topics in Circuits and Systems.

[4]  Yang Yi,et al.  Spike-Time-Dependent Encoding for Neuromorphic Processors , 2015, ACM J. Emerg. Technol. Comput. Syst..

[5]  Yang Yi,et al.  An energy efficient decoding scheme for nonlinear MIMO-OFDM network using reservoir computing , 2016, 2016 International Joint Conference on Neural Networks (IJCNN).

[6]  Xin Fu,et al.  Interspike-Interval-Based Analog Spike-Time-Dependent Encoder for Neuromorphic Processors , 2017, IEEE Transactions on Very Large Scale Integration (VLSI) Systems.

[7]  Lingjia Liu,et al.  Multi-Cell Multi-User Massive FD-MIMO: Downlink Precoding and Throughput Analysis , 2018, IEEE Transactions on Wireless Communications.

[8]  Zhou Zhou,et al.  Learn to Demodulate: MIMO-OFDM Symbol Detection through Downlink Pilots , 2019, ArXiv.

[9]  Hao Chen,et al.  Self-Tuning Sectorization: Deep Reinforcement Learning Meets Broadcast Beam Optimization , 2019, IEEE Transactions on Wireless Communications.

[10]  Lingjia Liu,et al.  DoA Estimation and RMSE Characterization for 3D Massive-MIMO/FD-MIMO OFDM System , 2014, GLOBECOM 2014.

[11]  Yang Yi,et al.  Reservoir Computing Meets Smart Grids: Attack Detection Using Delayed Feedback Networks , 2018, IEEE Transactions on Industrial Informatics.

[12]  Yang Yi,et al.  Deep-DFR: A Memristive Deep Delayed Feedback Reservoir Computing System with Hybrid Neural Network Topology , 2019, 2019 56th ACM/IEEE Design Automation Conference (DAC).

[13]  Yan Li,et al.  Angle and Delay Estimation for 3-D Massive MIMO/FD-MIMO Systems Based on Parametric Channel Modeling , 2017, IEEE Transactions on Wireless Communications.

[14]  Hao Chen,et al.  Artificial Intelligence-Enabled Cellular Networks: A Critical Path to Beyond-5G and 6G , 2019, IEEE Wireless Communications.

[15]  David Tse,et al.  Fundamentals of Wireless Communication , 2005 .

[16]  Robert Hecht-Nielsen,et al.  Theory of the backpropagation neural network , 1989, International 1989 Joint Conference on Neural Networks.

[17]  Jian Liu,et al.  Novel Spike based Reservoir Node Design with High Performance Spike Delay Loop , 2016, NANOCOM.

[18]  Lingjia Liu,et al.  Energy Consumption vs. Bit Rate Analysis Toward Massive MIMO Systems , 2018, 2018 IEEE International Smart Cities Conference (ISC2).

[19]  Lingjia Liu,et al.  Downlink Channel Estimation with Limited Feedback for FDD Multi-User Massive MIMO with Spatial Channel Correlation , 2018, 2018 IEEE International Conference on Communications (ICC).

[20]  Holger Kantz,et al.  Identifying and Modeling Delay Feedback Systems. , 1998, chao-dyn/9907019.

[21]  Robert Hecht-Nielsen.  III.3 – Theory of the Backpropagation Neural Network* , 1992 .

[22]  Yang Yi,et al.  Channel estimation in wireless OFDM systems using reservoir computing , 2015, 2015 IEEE Symposium on Computational Intelligence for Security and Defense Applications (CISDA).

[23]  Jianzhong Zhang,et al.  On the Channel Estimation of Multi-Cell Massive FD-MIMO Systems , 2018, 2018 IEEE International Conference on Communications (ICC).

[24]  Cai Hua,et al.  MIMO-OFDM channel estimation based on Neural Network , 2011 .

[25]  Yang Yi,et al.  Privacy Protection Scheme for eHealth Systems: A Stochastic Geometry Approach , 2016, 2016 IEEE Global Communications Conference (GLOBECOM).

[26]  Yang Yi,et al.  Enabling An New Era of Brain-inspired Computing: Energy-efficient Spiking Neural Network with Ring Topology , 2018, 2018 55th ACM/ESDA/IEEE Design Automation Conference (DAC).

[27]  Kandarpa Kumar Sarma,et al.  Modeling MIMO channels using a class of complex recurrent neural network architectures , 2012 .

[28]  Yang Yi,et al.  Realizing Green Symbol Detection via Reservoir Computing: An Energy-Efficiency Perspective , 2018, 2018 IEEE International Conference on Communications (ICC).

[29]  Huajin Tang,et al.  Precise-Spike-Driven Synaptic Plasticity: Learning Hetero-Association of Spatiotemporal Spike Patterns , 2013, PloS one.

[30]  Yi Yang,et al.  Big Data Meet Cyber-Physical Systems: A Panoramic Survey , 2018, IEEE Access.

[31]  Krishna Sayana,et al.  Downlink MIMO in LTE-advanced: SU-MIMO vs. MU-MIMO , 2012, IEEE Communications Magazine.

[32]  G. Liodakis,et al.  Neural Network – based Digital Receiver for Radio Communications , 2004 .

[33]  Li Zhu,et al.  Joint Security and QoS Provisioning in Train-Centric CBTC Systems Under Sybil Attacks , 2019, IEEE Access.

[34]  Haibo He,et al.  Distributive Dynamic Spectrum Access Through Deep Reinforcement Learning: A Reservoir Computing-Based Approach , 2018, IEEE Internet of Things Journal.

[35]  Hao Chen,et al.  Enabling cyber-physical communication in 5G cellular networks: challenges, spatial spectrum sensing, and cyber-security , 2017, IET Cyper-Phys. Syst.: Theory & Appl..

[36]  Yahong Rosa Zheng,et al.  Brain-Inspired Wireless Communications: Where Reservoir Computing Meets MIMO-OFDM , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[37]  Ying Li,et al.  Automated Residential Demand Response: Algorithmic Implications of Pricing Models , 2012, IEEE Transactions on Smart Grid.

[38]  Andrew S. Cassidy,et al.  Convolutional networks for fast, energy-efficient neuromorphic computing , 2016, Proceedings of the National Academy of Sciences.

[39]  Lingjia Liu,et al.  Energy-Efficient Wireless Communications: From Energy Modeling to Performance Evaluation , 2019, IEEE Transactions on Vehicular Technology.

[40]  Yik-Chung Wu,et al.  DoA Estimation and Capacity Analysis for 3-D Millimeter Wave Massive-MIMO/FD-MIMO OFDM Systems , 2016, IEEE Transactions on Wireless Communications.

[41]  P. Kanungo,et al.  Rayleigh Fading MIMO Channel Prediction Using RNN with Genetic Algorithm , 2011 .

[42]  Chenyang Yang,et al.  Energy-Efficient Resource Allocation for MIMO-OFDM Systems Serving Random Sources With Statistical QoS Requirement , 2015, IEEE Transactions on Communications.

[43]  Yang Yi,et al.  Energy efficient analog spiking temporal encoder with verification and recovery scheme for neuromorphic computing systems , 2017, 2017 18th International Symposium on Quality Electronic Design (ISQED).

[44]  Lingjia Liu,et al.  Content-Based User Association and MIMO Operation over Cached Cloud-RAN Networks , 2019, ArXiv.

[45]  Lingjia Liu,et al.  Joint Parametric Channel Estimation and Performance Characterization for 3D Massive MIMO OFDM Systems , 2018, 2018 IEEE International Conference on Communications (ICC).

[46]  Yang Yi,et al.  Neuromorphic encoding system design with chaos based CMOS analog neuron , 2015, 2015 IEEE Symposium on Computational Intelligence for Security and Defense Applications (CISDA).

[47]  Yang Yi,et al.  A Physical Layer Security Scheme for Mobile Health Cyber-Physical Systems , 2018, IEEE Internet of Things Journal.

[48]  R D Zimmerman,et al.  MATPOWER: Steady-State Operations, Planning, and Analysis Tools for Power Systems Research and Education , 2011, IEEE Transactions on Power Systems.

[49]  Rahul Porwal,et al.  MIMO OFDM Space Time Coding - Spatial Multiplexing Increasing Performance and Spectral Efficiency in Wireless Systems , 2014 .

[50]  Yang Yi,et al.  A deep learning based approach for analog hardware implementation of delayed feedback reservoir computing system , 2018, 2018 19th International Symposium on Quality Electronic Design (ISQED).

[51]  Ulysses Lee,et al.  Cognitive relay networks with energy and mutual-information accumulation , 2018, IEEE INFOCOM 2018 - IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS).

[52]  Lingjia Liu,et al.  Learning for Detection: MIMO-OFDM Symbol Detection Through Downlink Pilots , 2019, IEEE Transactions on Wireless Communications.

[53]  Yang Yi,et al.  Energy Efficient Spiking Temporal Encoder Design for Neuromorphic Computing Systems , 2016, IEEE Transactions on Multi-Scale Computing Systems.

[54]  Yang Yi,et al.  Enabling Sustainable Cyber Physical Security Systems through Neuromorphic Computing , 2018, IEEE Transactions on Sustainable Computing.

[55]  Jinsong Wu,et al.  Green Massive Traffic Offloading for Cyber-Physical Systems over Heterogeneous Cellular Networks , 2019, Mob. Networks Appl..

[56]  Lingjia Liu,et al.  DoA Estimation and Performance Analysis for Multi-Cell Multi-User 3D mmWave Massive-MIMO OFDM System , 2017, 2017 IEEE Wireless Communications and Networking Conference (WCNC).

[57]  Yang Yi,et al.  Analog hardware implementation of spike-based delayed feedback reservoir computing system , 2017, 2017 International Joint Conference on Neural Networks (IJCNN).

[58]  Lang Tong,et al.  Dynamic attacks on power systems economic dispatch , 2014, 2014 48th Asilomar Conference on Signals, Systems and Computers.

[59]  V. K. Jones,et al.  Channel estimation for wireless OFDM systems , 1998, IEEE GLOBECOM 1998 (Cat. NO. 98CH36250).

[60]  Haizhou Li,et al.  A Spike-Timing-Based Integrated Model for Pattern Recognition , 2013, Neural Computation.

[61]  Herbert Jaeger,et al.  Adaptive Nonlinear System Identification with Echo State Networks , 2002, NIPS.