A Perfectly Invertible Rank Order Coder

Our goal is to revisit rank order coding by proposing an original exact decoding procedure for it. Rank order coding was proposed by Simon Thorpe et al. to explain the impressive performance of the human visual system in recognizing objects. It is based on the hypothesis that the retina represents the visual stimulus by the order in which its cells are activated. A classical rank order coder/decoder was then designed (Van Rullen and Thorpe, 2001) involving three stages: (i) A model of the stimulus transform in the retina consisting in a redundant filter bank analysis; (ii) A sorting stage of the filters according to their activation degree; (iii) A straightforward decoding procedure that consists in a weighted sum of the most activated filters. Focusing on this last stage, it appears that the decoding procedure employed yields reconstruction errors that limit the model Rate/Quality performances when used as an image codec. Attempts made in the literature to overcome this issue are time consuming and alter the coding procedure or are infeasible for standard size images and lacking mathematical support. Here we solve this problem in an original fashion by using the frames theory, where a frame of a vector space designates an extension for the notion of basis. Our contribution is threefold. First we add an adequate scaling function to the filter bank under study that has both a mathematical and a biological justification. Second, we prove that the analyzing filter bank considered is a frame, and then we define the corresponding dual frame that is necessary for the exact image reconstruction. Finally, to deal with the problem of memory overhead, we design an original recursive out-of-core blockwise algorithm for the computation of this dual frame. Our work provides a mathematical formalism for the retinal model under study and specifies a simple and exact reverse transform for it. Furthermore, the framework presented here can be extended to several models of the visual cortical areas using redundant representations.

[1]  David J. Field,et al.  What Is the Goal of Sensory Coding? , 1994, Neural Computation.

[2]  Stephen B. Furber,et al.  Biologically Inspired Means for Rank-Order Encoding Images: A Quantitative Analysis , 2010, IEEE Transactions on Neural Networks.

[3]  Simon J. Thorpe,et al.  Ultra-Rapid Scene Categorization with a Wave of Spikes , 2002, Biologically Motivated Computer Vision.

[4]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[5]  Edward H. Adelson,et al.  The Laplacian Pyramid as a Compact Image Code , 1983, IEEE Trans. Commun..

[6]  Minh N. Do,et al.  Framing pyramids , 2003, IEEE Trans. Signal Process..

[7]  William Bialek,et al.  Spikes: Exploring the Neural Code , 1996 .

[8]  R. Duffin,et al.  A class of nonharmonic Fourier series , 1952 .

[9]  Pierre Kornprobst,et al.  A Bio-Inspired Image Coder with Temporal Scalability , 2011, ACIVS.

[10]  Jelena Kovacevic,et al.  An Introduction to Frames , 2008, Found. Trends Signal Process..

[11]  Simon J. Thorpe,et al.  Spike arrival times: A highly efficient coding scheme for neural networks , 1990 .

[12]  S. Thorpe,et al.  Speed of processing in the human visual system , 1996, Nature.

[13]  Stephen B. Furber,et al.  Maximising information recovery from rank-order codes , 2007, SPIE Defense + Commercial Sensing.

[14]  Tim Gollisch,et al.  Rapid Neural Coding in the Retina with Relative Spike Latencies , 2008, Science.

[15]  Rufin van Rullen,et al.  Rate Coding Versus Temporal Order Coding: What the Retinal Ganglion Cells Tell the Visual Cortex , 2001, Neural Computation.

[16]  R. W. Rodieck Quantitative analysis of cat retinal ganglion cell response to visual stimuli. , 1965, Vision research.

[17]  Pierre Kornprobst,et al.  A novel bio-inspired static image compression scheme for noisy data transmission over low-bandwidth channels , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[18]  Michael J. Berry,et al.  The Neural Code of the Retina , 1999, Neuron.

[19]  Simon J. Thorpe,et al.  Coding static natural images using spiking event times: do neurons Cooperate? , 2004, IEEE Transactions on Neural Networks.

[20]  Subrata Rakshit,et al.  Error correction with frames: the Burt-Laplacian pyramid , 1995, IEEE Trans. Inf. Theory.