Spiking Neural Networks—Part III: Neuromorphic Communications

Synergies between wireless communications and artificial intelligence are increasingly motivating research at the intersection of the two fields. On the one hand, the presence of more and more wirelessly connected devices, each with its own data, is driving efforts to export advances in machine learning (ML) from high performance computing facilities, where information is stored and processed in a single location, to distributed, privacy-minded, processing at the end user. On the other hand, ML can address algorithm and model deficits in the optimization of communication protocols. However, implementing ML models for learning and inference on battery-powered devices that are connected via bandwidth-constrained channels remains challenging. This paper explores two ways in which Spiking Neural Networks (SNNs) can help address these open problems. First, we discuss federated learning for the distributed training of SNNs, and then describe the integration of neuromorphic sensing, SNNs, and impulse radio technologies for low-power remote inference.

[1]  Abu Sebastian,et al.  File Classification Based on Spiking Neural Networks , 2020, ISCAS.

[2]  Deniz Gündüz,et al.  Deep Joint Source-channel Coding for Wireless Image Transmission , 2018, ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[3]  A. Cassidy,et al.  Impulse Radio Address Event Interconnects for body area networks and neural prostheses , 2008, 2008 Argentine School of Micro-Nanoelectronics, Technology and Applications.

[4]  Yuan Xie,et al.  Rethinking the performance comparison between SNNS and ANNS , 2020, Neural Networks.

[5]  Kenji Leibnitz,et al.  Low-Complexity Nanosensor Networking Through Spike-Encoded Signaling , 2016, IEEE Internet of Things Journal.

[6]  Gerhard Kramer,et al.  Directed information for channels with feedback , 1998 .

[7]  Osvaldo Simeone,et al.  Federated Neuromorphic Learning of Spiking Neural Networks for Low-Power Edge Intelligence , 2019, ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[8]  Oriol Vinyals,et al.  Neural Discrete Representation Learning , 2017, NIPS.

[9]  Toshio Morioka,et al.  Towards ultrahigh speed impulse radio THz wireless communications , 2015, 2015 17th International Conference on Transparent Optical Networks (ICTON).

[10]  Kin K. Leung,et al.  Adaptive Federated Learning in Resource Constrained Edge Computing Systems , 2018, IEEE Journal on Selected Areas in Communications.

[11]  Osvaldo Simeone,et al.  A Brief Introduction to Machine Learning for Engineers , 2017, Found. Trends Signal Process..

[12]  Osvaldo Simeone,et al.  An Introduction to Probabilistic Spiking Neural Networks: Probabilistic Models, Learning Rules, and Applications , 2019, IEEE Signal Processing Magazine.

[13]  Jakob Hoydis,et al.  An Introduction to Deep Learning for the Physical Layer , 2017, IEEE Transactions on Cognitive Communications and Networking.

[14]  Osvaldo Simeone,et al.  Spiking Neural Networks—Part II: Detecting Spatio-Temporal Patterns , 2020, IEEE Communications Letters.

[15]  Andrew McCallum,et al.  Energy and Policy Considerations for Deep Learning in NLP , 2019, ACL.

[16]  Stefano Ermon,et al.  Neural Joint Source-Channel Coding , 2018, ICML.

[17]  Tobi Delbrück,et al.  A 128 X 128 120db 30mw asynchronous vision sensor that responds to relative intensity change , 2006, 2006 IEEE International Solid State Circuits Conference - Digest of Technical Papers.

[18]  Osvaldo Simeone,et al.  Spiking Neural Networks - Part I: Detecting Spatial Patterns , 2020, ArXiv.

[19]  Bernabé Linares-Barranco,et al.  Poker-DVS and MNIST-DVS. Their History, How They Were Made, and Other Details , 2015, Front. Neurosci..

[20]  Blaise Agüera y Arcas,et al.  Communication-Efficient Learning of Deep Networks from Decentralized Data , 2016, AISTATS.

[21]  Guido Masera,et al.  An all-digital spike-based ultra-low-power IR-UWB dynamic average threshold crossing scheme for muscle force wireless transmission , 2015, 2015 Design, Automation & Test in Europe Conference & Exhibition (DATE).

[22]  Evangelos Eleftheriou,et al.  Short-term synaptic plasticity optimally models continuous environments , 2020, ArXiv.

[23]  Osvaldo Simeone,et al.  End-to-End Learning of Neuromorphic Wireless Systems for Low-Power Edge Artificial Intelligence , 2020, 2020 54th Asilomar Conference on Signals, Systems, and Computers.

[24]  Sheetal Kalyani,et al.  Design of Communication Systems Using Deep Learning: A Variational Inference Perspective , 2019, IEEE Transactions on Cognitive Communications and Networking.