Frames for Exact Inversion of the Rank Order Coder

Our goal is to revisit rank order coding by proposing an original exact decoding procedure for it. Rank order coding was proposed by Thorpe . who stated that the order in which the retina cells are activated encodes for the visual stimulus. Based on this idea, the authors proposed in a rank order coder/decoder associated to a retinal model. Though, it appeared that the decoding procedure employed yields reconstruction errors that limit the model bit-cost/quality performances when used as an image codec. The attempts made in the literature to overcome this issue are time consuming and alter the coding procedure, or are lacking mathematical support and feasibility for standard size images. Here we solve this problem in an original fashion by using the frames theory, where a frame of a vector space designates an extension for the notion of basis. Our contribution is twofold. First, we prove that the analyzing filter bank considered is a frame, and then we define the corresponding dual frame that is necessary for the exact image reconstruction. Second, to deal with the problem of memory overhead, we design a recursive out-of-core blockwise algorithm for the computation of this dual frame. Our work provides a mathematical formalism for the retinal model under study and defines a simple and exact reverse transform for it with over than 265 dB of increase in the peak signal-to-noise ratio quality compared to . Furthermore, the framework presented here can be extended to several models of the visual cortical areas using redundant representations.

[1]  Tomaso Poggio,et al.  Cooperative computation of stereo disparity , 1988 .

[2]  Stephen B. Furber,et al.  Maximising information recovery from rank-order codes , 2007, SPIE Defense + Commercial Sensing.

[3]  Tim Gollisch,et al.  Rapid Neural Coding in the Retina with Relative Spike Latencies , 2008, Science.

[4]  Michael J. Berry,et al.  The Neural Code of the Retina , 1999, Neuron.

[5]  Simon J. Thorpe,et al.  Coding static natural images using spiking event times: do neurons Cooperate? , 2004, IEEE Transactions on Neural Networks.

[6]  Rufin van Rullen,et al.  Rate Coding Versus Temporal Order Coding: What the Retinal Ganglion Cells Tell the Visual Cortex , 2001, Neural Computation.

[7]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[8]  Sivan Toledo,et al.  A survey of out-of-core algorithms in numerical linear algebra , 1999, External Memory Algorithms.

[9]  Bertram E. Shi,et al.  A Neuromorphic Multi-chip Model of a Disparity Selective Complex Cell , 2003, NIPS.

[10]  T. Poggio,et al.  A generalized ordering constraint for stereo correspondence , 1984 .

[11]  Simon J. Thorpe,et al.  Spike arrival times: A highly efficient coding scheme for neural networks , 1990 .

[12]  Kwabena Boahen,et al.  Synchrony in Silicon: The Gamma Rhythm , 2007, IEEE Transactions on Neural Networks.

[13]  Subrata Rakshit,et al.  Error correction with frames: the Burt-Laplacian pyramid , 1995, IEEE Trans. Inf. Theory.

[14]  David J. Field,et al.  What Is the Goal of Sensory Coding? , 1994, Neural Computation.

[15]  Stephen B. Furber,et al.  Biologically Inspired Means for Rank-Order Encoding Images: A Quantitative Analysis , 2010, IEEE Transactions on Neural Networks.

[16]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[17]  Tobi Delbrück,et al.  Cooperative Stereo Matching Using Static and Dynamic Image Features , 1989, Analog VLSI Implementation of Neural Systems.

[18]  M. Abeles Role of the cortical neuron: integrator or coincidence detector? , 1982, Israel journal of medical sciences.

[19]  S. Thorpe,et al.  Speed of processing in the human visual system , 1996, Nature.

[20]  Li Zhang,et al.  Spacetime stereo: shape recovery for dynamic scenes , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[21]  Edward H. Adelson,et al.  The Laplacian Pyramid as a Compact Image Code , 1983, IEEE Trans. Commun..

[22]  Minh N. Do,et al.  Framing pyramids , 2003, IEEE Trans. Signal Process..

[23]  Ryad Benosman,et al.  Asynchronous Event-Based Hebbian Epipolar Geometry , 2011, IEEE Transactions on Neural Networks.

[24]  Frederic Devernay,et al.  A Variational Method for Scene Flow Estimation from Stereo Sequences , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[25]  R. Duffin,et al.  A class of nonharmonic Fourier series , 1952 .

[26]  John K. Tsotsos,et al.  Applying temporal constraints to the dynamic stereo problem , 1986, Comput. Vis. Graph. Image Process..

[27]  Christoph Sulzbachner,et al.  Bio-inspired Stereo Vision System with Silicon Retina Imagers , 2009, ICVS.

[28]  Michael Isard,et al.  Estimating disparity and occlusions in stereo video sequences , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[29]  Jelena Kovacevic,et al.  An Introduction to Frames , 2008, Found. Trends Signal Process..

[30]  Minglun Gong Enforcing Temporal Consistency in Real-Time Stereo Estimation , 2006, ECCV.

[31]  Pierre Kornprobst,et al.  A novel bio-inspired static image compression scheme for noisy data transmission over low-bandwidth channels , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[32]  Allen M. Waxman,et al.  Binocular Image Flows: Steps Toward Stereo-Motion Fusion , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.