Simulation of the Retina: a Tool for Visual prostheses

To extract high-level information from natural scenes, the visual system has to cope with a wide variety of ambient lights, reflection properties of objects, spatio-temporal contexts, and geometrical complexity. By pre-processing the visual information, the retina plays a key role in the functioning of the whole visual system. It is crucial to reproduce such a pre-processing in artificial devices aiming at replacing or substituting the damaged vision system by artificial means. In this paper, we present a biologically plausible model of the retina at the cell level and its implementation as a real-time retinal simulation software. It features the non-uniform sampling of the visual information by the photoreceptor cells, the non-separable spatio-temporal properties of the retina, the subsequent generation of the Parvocellular and Magnocellular pathways, and the non-linear equalization of luminance and contrast at the local level. For each of these aspects, a description of the model is provided and illustr...

[1]  Misha Mahowald,et al.  A silicon model of early visual processing , 1993, Neural Networks.

[2]  S. Wu,et al.  Synaptic transmission in the outer retina. , 1994, Annual review of physiology.

[3]  C. Veraart,et al.  Vision rehabilitation in the case of blindness , 2004, Expert review of medical devices.

[4]  K. Horch,et al.  Mobility performance with a pixelized vision system , 1992, Vision Research.

[5]  K. Naka,et al.  S‐potentials from luminosity units in the retina of fish (Cyprinidae) , 1966, The Journal of physiology.

[6]  Gislin Dagnelie,et al.  Real and virtual mobility performance in simulated prosthetic vision , 2007, Journal of neural engineering.

[7]  Gilles Sicard,et al.  An adaptive bio–inspired analog silicon retina , 1999 .

[8]  Stephen A. Baccus,et al.  Image Processing for a High-Resolution Optoelectronic Retinal Prosthesis , 2007, IEEE Transactions on Biomedical Engineering.

[9]  W. Beaudot,et al.  Sensory coding in the vertebrate retina: towards an adaptive control of visual sensitivity. , 1996, Network.

[10]  E. L. Schwartz,et al.  Spatial mapping in the primate sensory projection: Analytic structure and relevance to perception , 1977, Biological Cybernetics.

[11]  Su-Ling Yeh,et al.  Modulation of object-based and space-based attention by cue validity , 2005 .

[12]  G. Baselli,et al.  Simulation and Assessment of Bioinspired Visual Processing System for Epi-retinal Prostheses , 2006, 2006 International Conference of the IEEE Engineering in Medicine and Biology Society.

[13]  Hans van Hateren.  A cellular and molecular model of response kinetics and adaptation in primate cones and horizontal cells. , 2005, Journal of vision.

[14]  S. M. Wu,et al.  A quantitative analysis of interactions between photoreceptors in the salamander (Ambystoma) retina. , 1984, The Journal of physiology.

[15]  Rolf Eckmiller,et al.  Tunable retina encoders for retina implants: why and how , 2005, Journal of neural engineering.

[16]  B. Boycott,et al.  Functional architecture of the mammalian retina. , 1991, Physiological reviews.

[17]  C. Lenay,et al.  SENSORY SUBSTITUTION: LIMITS AND PERSPECTIVES , 2003 .

[18]  Kees C. J. Overbeeke,et al.  Trade-off between resolution and interactivity in spatial task performance , 1995, IEEE Computer Graphics and Applications.

[19]  M. Mladejovsky,et al.  ‘Braille’ reading by a blind volunteer by visual cortex stimulation , 1976, Nature.

[20]  C. Trullemans,et al.  A real-time experimental prototype for enhancement of vision rehabilitation using auditory substitution , 1998, IEEE Transactions on Biomedical Engineering.

[21]  Nigel H. Lovell,et al.  Psychophysics of Prosthetic Vision: I. Visual Scanning and Visual Acuity , 2006, 2006 International Conference of the IEEE Engineering in Medicine and Biology Society.

[22]  Jeanny Hérault,et al.  Realistic Simulation Tool for Early Visual Processing Including Space, Time and Colour Data , 1993, IWANN.

[23]  D. Dacey,et al.  Colour coding in the primate retina: diverse cell types and cone-specific circuitry , 2003, Current Opinion in Neurobiology.

[24]  Nigel H. Lovell,et al.  Image Analysis for Microelectronic Retinal Prosthesis , 2008, IEEE Transactions on Biomedical Engineering.

[25]  Malika Auvray,et al.  Perception With Compensatory Devices: From Sensory Substitution to Sensorimotor Extension , 2009, Cogn. Sci..

[26]  Nigel H. Lovell,et al.  Simulated prosthetic visual fixation, saccade, and smooth pursuit , 2005, Vision Research.

[27]  Gislin Dagnelie,et al.  Facial recognition using simulated prosthetic pixelized vision. , 2003, Investigative ophthalmology & visual science.

[28]  Gislin Dagnelie,et al.  Visually guided performance of simple tasks using simulated prosthetic vision. , 2003, Artificial organs.

[29]  B. Rappaz,et al.  Simulation of artificial vision: II. Eccentric reading of full-page text and the learning of this task , 2004, Vision Research.

[30]  G D Field,et al.  Information processing in the primate retina: circuitry and coding. , 2007, Annual review of neuroscience.

[31]  Philip T. Kortum,et al.  Adaptation mechanisms in spatial vision—ii. Flash thresholds and background adaptation , 1995, Vision Research.

[32]  M. Shimoda,et al.  Electronic circuit model of retina in color vision. , 1999, Biomedical sciences instrumentation.

[33]  W. Beaudot.  Le traitement neuronal de l'information dans la retine des vertebres : un creuset d'idees pour la vision artificielle , 1994 .

[34]  E. Eskandar,et al.  Getting signals into the brain: visual prosthetics through thalamic microstimulation. , 2009, Neurosurgical focus.

[35]  L. Merabet,et al.  Development of a cortical visual neuroprosthesis for the blind: the relevance of neuroplasticity , 2005, Journal of neural engineering.

[36]  Susumu Tachi,et al.  A vision substitution system using forehead electrical stimulation , 2006, SIGGRAPH '06.

[37]  M. Goodale,et al.  Separate visual pathways for perception and action , 1992, Trends in Neurosciences.

[38]  Jason Dowling,et al.  Artificial human vision , 2005, Expert review of medical devices.

[39]  Laurence Meylan,et al.  Model of retinal local adaptation for the tone mapping of color filter array images. , 2007, Journal of the Optical Society of America. A, Optics, image science, and vision.

[40]  W. H. Dobelle.  Artificial vision for the blind by connecting a television camera to the visual cortex. , 2000, ASAIO journal.

[41]  D. Hood,et al.  Lower-level visual processing and models of light adaptation. , 1998, Annual review of psychology.

[42]  G.J. Suaning,et al.  Effect on prosthetic vision visual acuity by filtering schemes, filter cut-off frequency and phosphene matrix: a virtual reality simulation , 2004, The 26th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[43]  C. Enroth-Cugell,et al.  Chapter 9 Visual adaptation and retinal gain controls , 1984 .

[44]  Benjamin Rappaz,et al.  Simulation of artificial vision, III: do the spatial or temporal characteristics of stimulus pixelization really matter? , 2005, Investigative ophthalmology & visual science.

[45]  Joseph J. Atick,et al.  What Does the Retina Know about Natural Scenes? , 1992, Neural Computation.

[46]  D. Dacey,et al.  Synergistic center-surround receptive field model of monkey H1 horizontal cells. , 2005, Journal of vision.

[47]  Kwabena Boahen,et al.  A silicon retina that reproduces signals in the optic nerve , 2006, Journal of neural engineering.

[48]  K W Horch,et al.  Reading speed with a pixelized vision system. , 1992, Journal of the Optical Society of America. A, Optics and image science.

[49]  A. Hendrickson,et al.  Human photoreceptor topography , 1990, The Journal of comparative neurology.

[50]  A. Cowey,et al.  Retinal ganglion cells that project to the superior colliculus and pretectum in the macaque monkey , 1984, Neuroscience.

[51]  John B. Shoven,et al.  I , Edinburgh Medical and Surgical Journal.

[52]  L. Merabet,et al.  What blindness can tell us about seeing again: merging neuroplasticity and neuroprostheses , 2005, Nature Reviews Neuroscience.