Multi-periodic neural coding for adaptive information transfer

Information processing in the presence of noise has been a key challenge in multiple disciplines including computer science, communications, and neuroscience. Among such noise-reduction mechanisms, the shift-map code represents an analog variable by its residues with respect to distinct moduli (that are chosen as geometric scalings of an integer). Motivated by the multi-periodic neural code in the entorhinal cortex, i.e., the coding mechanism of grid cells, this work extends the shift-map code by generalizing the choices of moduli. In particular, it is shown that using similarly sized moduli (for instance, evenly and closely spaced integers, which tend to have large co-prime factors) results in a code whose codewords are separated in an interleaving way such that when the decoder has side information regarding the source, then error control is significantly improved (compared to the original shift map code). This novel structure allows the system to dynamically adapt to the side information at the decoder, even if the encoder is not privy to the side information. A geometrical interpretation of the proposed coding scheme and a method to find such codes are detailed. As an extension, it is shown that this novel code also adapts to scenarios when only a fraction of codeword symbols is available at the decoder.

[1]  May-Britt Moser,et al.  The entorhinal grid map is discretized , 2012, Nature.

[2]  Amir K. Khandani,et al.  Single-Sample Robust Joint Source–Channel Coding: Achieving Asymptotically Optimum Scaling of SDR Versus SNR , 2012, IEEE Transactions on Information Theory.

[3]  C. Stevens,et al.  Changes in reliability of synaptic function as a mechanism for plasticity , 1994, Nature.

[4]  I. Fiete,et al.  A Model of Grid Cell Development through Spatial Exploration and Spike Time-Dependent Plasticity , 2014, Neuron.

[5]  Aaron D. Wyner,et al.  The rate-distortion function for source coding with side information at the decoder , 1976, IEEE Trans. Inf. Theory.

[6]  J. Wolfowitz.  The rate distortion function for source coding with side information at the decoder , 1979 .

[7]  Gregory W. Wornell,et al.  Analog error-correcting codes based on chaotic dynamical systems , 1998, IEEE Trans. Commun..

[8]  D. Schumacher,et al.  On the temperature dependence of vacancy activation energies in f.c.c. metals , 1968 .

[9]  Aaron D. Wyner,et al.  On source coding with side information at the decoder , 1975, IEEE Trans. Inf. Theory.

[10]  Ila R Fiete,et al.  What Grid Cells Convey about Rat Location , 2008, The Journal of Neuroscience.

[11]  N. J. A. Sloane,et al.  Sphere Packings, Lattices and Groups , 1987, Grundlehren der mathematischen Wissenschaften.

[12]  Sueli I. Rodrigues Costa,et al.  Curves on a sphere, shift-map dynamics, and error control for continuous alphabet sources , 2003, IEEE Transactions on Information Theory.

[13]  Ila Fiete,et al.  Grid cells generate an analog error-correcting code for singularly precise neural computation , 2011, Nature Neuroscience.

[14]  P. Dudchenko.  The hippocampus as a cognitive map , 2010 .

[15]  Sriram Vishwanath,et al.  On Resolving Simultaneous Congruences Using Belief Propagation , 2015, Neural Computation.

[16]  R. W. Watson,et al.  Self-checked computation using residue arithmetic , 1966 .

[17]  W. Newsome,et al.  The Variable Discharge of Cortical Neurons: Implications for Connectivity, Computation, and Information Coding , 1998, The Journal of Neuroscience.

[18]  G. David Forney,et al.  Modulation and Coding for Linear Gaussian Channels , 1998, IEEE Trans. Inf. Theory.

[19]  William R. Softky,et al.  The highly irregular firing of cortical cells is inconsistent with temporal integration of random EPSPs , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[20]  Peter Dayan,et al.  Theoretical Neuroscience: Computational and Mathematical Modeling of Neural Systems , 2001 .

[21]  L. Nadel,et al.  Précis of O'Keefe & Nadel's The hippocampus as a cognitive map , 1979, Behavioral and Brain Sciences.

[22]  Michael A. Soderstrand,et al.  Residue number system arithmetic: modern applications in digital signal processing , 1986 .

[23]  C.E. Shannon,et al.  Communication in the Presence of Noise , 1949, Proceedings of the IRE.

[24]  Michael Baake,et al.  Some remarks on the visible points of a lattice , 1994 .

[25]  H Sompolinsky,et al.  Simple models for reading neuronal population codes. , 1993, Proceedings of the National Academy of Sciences of the United States of America.

[26]  R. Passingham.  The hippocampus as a cognitive map J. O'Keefe & L. Nadel, Oxford University Press, Oxford (1978). 570 pp., £25.00 , 1979, Neuroscience.

[27]  M. Paradiso,et al.  A theory for the use of visual orientation information which exploits the columnar structure of striate cortex , 2004, Biological Cybernetics.

[28]  Stephen S. Yau,et al.  Error Correction in Redundant Residue Number Systems , 1973, IEEE Trans. Computers.

[29]  T. Hafting,et al.  Microstructure of a spatial map in the entorhinal cortex , 2005, Nature.

[30]  Thomas C. Hales.  Sphere packings, I , 1997, Discret. Comput. Geom..

[31]  David P. Dobkin,et al.  The quickhull algorithm for convex hulls , 1996, TOMS.

[32]  H. Krishna,et al.  A coding theory approach to error control in redundant residue number systems. I. Theory and single error correction , 1992 .

[33]  A. P. Georgopoulos,et al.  Neuronal population coding of movement direction. , 1986, Science.

[34]  H. Krishna,et al.  A coding theory approach to error control in redundant residue number systems. II. Multiple error detection and correction , 1992 .

[35]  Richard H. Sherman,et al.  Chaotic communications in the presence of noise , 1993, Optics & Photonics.