Address-Event Variable-Length Compression for Time-Encoded Data

Time-encoded signals, such as social network update logs and spiking traces in neuromorphic processors, are defined by multiple traces carrying information in the timing of events, or spikes. When time-encoded data is processed at a remote site with respect to the location it is produced, the occurrence of events needs to be encoded and transmitted in a timely fashion. The standard Address-Event Representation (AER) protocol for neuromorphic chips encodes the indices of the "spiking" traces in the payload of a packet produced at the same time the events are recorded, hence implicitly encoding the events' timing in the timing of the packet. This paper investigates the potential bandwidth saving that can be obtained by carrying out variable-length compression of packets' payloads. Compression leverages both intra-trace and inter-trace correlations over time that are typical in applications such as social networks or neuromorphic computing. The approach is based on discrete-time Hawkes processes and entropy coding with conditional codebooks. Results from an experiment based on a real-world retweet dataset are also provided.

[1]  Christof Koch,et al.  Multi-chip neuromorphic motion processing , 1999, Proceedings 20th Anniversary Conference on Advanced Research in VLSI.

[2]  László Tóth,et al.  Perfect recovery and sensitivity analysis of time encoded bandlimited signals , 2004, IEEE Transactions on Circuits and Systems I: Regular Papers.

[3]  Carlo Blundo,et al.  New bounds on the expected length of one-to-one codes , 1996, IEEE Trans. Inf. Theory.

[4]  Hongyuan Zha,et al.  Learning Granger Causality for Hawkes Processes , 2016, ICML.

[5]  Craig Boutilier,et al.  Context-Specific Independence in Bayesian Networks , 1996, UAI.

[6]  Osvaldo Simeone,et al.  An Introduction to Probabilistic Spiking Neural Networks. , 2019 .

[7]  Takeo Fujii,et al.  Real time information gathering based on frequency and timing assignment for wireless sensor networks , 2012, 2012 IEEE International Conference on Communication Systems (ICCS).

[8]  Hong Wang,et al.  Loihi: A Neuromorphic Manycore Processor with On-Chip Learning , 2018, IEEE Micro.

[9]  W. Wildman,et al.  Theoretical Neuroscience , 2014 .

[10]  Jason Eisner,et al.  The Neural Hawkes Process: A Neurally Self-Modulating Multivariate Point Process , 2016, NIPS.

[11]  Massimo A. Sivilotti,et al.  Wiring considerations in analog VLSI systems, with application to field-programmable networks , 1992 .

[12]  Emine Yilmaz,et al.  Self-Attentive Hawkes Processes , 2019, ArXiv.

[13]  Osvaldo Simeone,et al.  Learning Algorithms and Signal Processing for Brain-Inspired Computing [From the Guest Editors] , 2019, IEEE Signal Process. Mag..

[14]  Sergio Verdú,et al.  Bits through queues , 1994, Proceedings of 1994 IEEE International Symposium on Information Theory.

[15]  E. Musk.  An Integrated Brain-Machine Interface Platform With Thousands of Channels , 2019, bioRxiv.

[16]  Misha A. Mahowald,et al.  An Analog VLSI System for Stereoscopic Vision , 1994 .

[17]  T. Taimre,et al.  Hawkes Processes , 2015, 1507.02822.

[18]  Gert Cauwenberghs,et al.  Dropout and DropConnect for Reliable Neuromorphic Inference Under Communication Constraints in Network Connectivity , 2019, IEEE Journal on Emerging and Selected Topics in Circuits and Systems.

[19]  Youngsoo Seol.  Limit theorems for discrete Hawkes processes , 2015 .

[20]  Todd P. Coleman,et al.  The Rate-Distortion Function of a Poisson Process with a Queueing Distortion Measure , 2008, Data Compression Conference (dcc 2008).

[21]  Amos Lapidoth,et al.  Covering Point Patterns , 2011, IEEE Transactions on Information Theory.

[22]  Jure Leskovec,et al.  SEISMIC: A Self-Exciting Point Process Model for Predicting Tweet Popularity , 2015, KDD.

[23]  Pier Luigi Dragotti,et al.  Time-based Sampling and Reconstruction of Non-bandlimited Signals , 2019, ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[24]  Tobi Delbruck,et al.  Event-Driven Sensing for Efficient Perception: Vision and audition algorithms , 2019, IEEE Signal Processing Magazine.

[25]  Kwabena Boahen,et al.  Point-to-point connectivity between neuromorphic chips using address events , 2000 .

[26]  Daisuke Takahashi,et al.  Retrieving knowledge from auditing log-files for computer and network forensics and accountability , 2008, Secur. Commun. Networks.

[27]  Starr Roxanne Hiltz,et al.  Trust and Privacy Concern Within Social Networking Sites: A Comparison of Facebook and MySpace , 2007, AMCIS.