Long Short-Term Memory for Radio Frequency Spectral Prediction and its Real-Time FPGA Implementation

Reactive communication waveforms hosted in current generation tactical radios often fail to achieve good performance and resilience in highly dynamic and complex environments. Arguably, novel waveforms that can proactively adapt to anticipated channel conditions may better meet the challenges of the tactical environment. This motivates the ability to accurately predict spectral behaviour in real-time. A Long Short- Term Memory (LSTM) network is a type of recurrent neural network which has been extremely successful in dealing with time-dependent signal processing problems such as speech recognition and machine translation. In this paper, we apply it to the task of spectral prediction and present a module generator for a latency-optimised Field-Programmable Gate Array (FPGA) implementation. We show that our implementation obtains superior results to other time series prediction techniques including a naïve predictor, moving average and ARIMA for the problem of radio frequency spectral prediction. For a single LSTM layer plus a fully- connected output layer with 32 inputs and 32 outputs, we demonstrate that a prediction latency of 4.3 μ $s$ on a Xilinx XC7K410T Kintex-7 FPGA is achievable.

[1]  Berin Martini,et al.  Recurrent Neural Networks Hardware Implementation on FPGA , 2015, ArXiv.

[2]  Martin Braun,et al.  RFNoC: RF Network-on-Chip , 2016 .

[3]  Philip Heng Wai Leong,et al.  Real-time FPGA-based Anomaly Detection for Radio Frequency Signals , 2018, 2018 IEEE International Symposium on Circuits and Systems (ISCAS).

[4]  Lajos Hanzo,et al.  Spectrum Inference in Cognitive Radio Networks: Algorithms and Applications , 2018, IEEE Communications Surveys & Tutorials.

[5]  Yoshua Bengio,et al.  BinaryNet: Training Deep Neural Networks with Weights and Activations Constrained to +1 or -1 , 2016, ArXiv.

[6]  Young-Joo Suh,et al.  Latency Analysis in GNU Radio/USRP-Based Software Radio Platforms , 2013, MILCOM 2013 - 2013 IEEE Military Communications Conference.

[7]  Geoffrey E. Hinton,et al.  Speech recognition with deep recurrent neural networks , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[8]  Jason Cong,et al.  FPGA-based accelerator for long short-term memory recurrent neural networks , 2017, 2017 22nd Asia and South Pacific Design Automation Conference (ASP-DAC).

[9]  Song Han,et al.  ESE: Efficient Speech Recognition Engine with Sparse LSTM on FPGA , 2016, FPGA.

[10]  Long Xu,et al.  Solar radio spectrum classification with LSTM , 2017, 2017 IEEE International Conference on Multimedia & Expo Workshops (ICMEW).

[11]  J. Tukey,et al.  An algorithm for the machine calculation of complex Fourier series , 1965 .

[12]  Wojciech Zaremba,et al.  Recurrent Neural Network Regularization , 2014, ArXiv.

[13]  Falko Dressler,et al.  Towards an Open Source IEEE 802.11p stack: A full SDR-based transceiver in GNU Radio , 2013, 2013 IEEE Vehicular Networking Conference.

[14]  Eric Blossom,et al.  GNU radio: tools for exploring the radio frequency spectrum , 2004 .

[15]  Timothy J. O'Shea,et al.  Recurrent Neural Radio Anomaly Detection , 2016, ArXiv.

[16]  Hayden Kwok-Hay So,et al.  NnCore: A parameterized non-linear function generator for machine learning applications in FPGAs , 2017, 2017 International Conference on Field Programmable Technology (ICFPT).

[17]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.