Event-based coding of still images using a bio-inspired frame

The growing interest of event-based systems has influenced image processing field and is expected to be a groundbreaking architecture for image and video compression. The human visual system is an efficient event-based biological system which is a source of inspiration to design an event-based codec. This paper introduces a bio-inspired encoding architecture for still images. A bio-inspired filter is first applied to the input image and then the retinal-filtered image is fed to an Integrate And Fire (IAF) sampler. The spike train produced by the IAF sampler is decoded in order to reconstruct the still image at the receiver. We prove that the retinal filter has a frame structure, so the reconstruction is almost perfect provided that the IAF sampling is sufficiently fine.

[1]  Pierre Kornprobst,et al.  Streaming an image through the eye: The retina seen as a dithered scalable image coder , 2012, Signal Process. Image Commun..

[2]  Detlev Marpe,et al.  Performance comparison of H.265/MPEG-HEVC, VP9, and H.264/MPEG-AVC encoders , 2013, 2013 Picture Coding Symposium (PCS).

[3]  Edward H. Adelson,et al.  The Laplacian Pyramid as a Compact Image Code , 1983, IEEE Trans. Commun..

[4]  Touradj Ebrahimi,et al.  The JPEG2000 still image coding system: an overview , 2000, IEEE Trans. Consumer Electron..

[5]  David J. Field,et al.  What Is the Goal of Sensory Coding? , 1994, Neural Computation.

[6]  Jelena Kovacevic,et al.  An Introduction to Frames , 2008, Found. Trends Signal Process..

[7]  Pierre Kornprobst,et al.  Virtual Retina: A biological retina model and simulator, with contrast gain control , 2009, Journal of Computational Neuroscience.

[8]  Tim Gollisch,et al.  Eye Smarter than Scientists Believed: Neural Computations in Circuits of the Retina , 2010, Neuron.

[9]  Ajay Luthra,et al.  Overview of the H.264/AVC video coding standard , 2003, IEEE Trans. Circuits Syst. Video Technol..

[10]  R. Masland.  The fundamental plan of the retina , 2001, Nature Neuroscience.

[11]  Pierre Kornprobst,et al.  Frames for Exact Inversion of the Rank Order Coder , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[12]  José Carlos Príncipe,et al.  Approximate reconstruction of bandlimited functions for the integrate and fire sampler , 2009, Advances in Computational Mathematics.

[13]  Anthony N. Burkitt,et al.  A Review of the Integrate-and-fire Neuron Model: I. Homogeneous Synaptic Input , 2006, Biological Cybernetics.

[14]  G. DeAngelis,et al.  Spatiotemporal receptive field organization in the lateral geniculate nucleus of cats and kittens. , 1997, Journal of neurophysiology.

[15]  Wang Xin.  Overview of the H.264 / AVC Video Coding Standard , 2003 .