Spike-triggered average electrical stimuli as input filters for bionic vision—a perspective

Bionic retinal implants are gaining acceptance in the treatment of blindness from degenerative diseases including retinitis pigmentosa and macular degeneration. OBJECTIVE A current obstacle to the improved performance of such implants is the difficulty of comparing the results of disparate experiments. Another obstacle is the current difficulty in selectively activating the many different retinal ganglion cell types that are used as separate pathways for visual information to the brain. APPROACH To address these obstacles, we propose a modelling framework based on white noise stimulation and reverse correlation. In this perspective, we first outline early developments in visual retinal physiology leading up to the implementation of white noise stimuli and spike-triggered averaging. We then review recent efforts to adapt the white noise method for electrical stimulation of the retina and some of the nuances of this approach. MAIN RESULTS Based on such white noise methods, we describe a modelling framework whereby the effect of any arbitrary electrical stimulus on a ganglion cell's neural code can be better understood. SIGNIFICANCE This framework should additionally disentangle the effects of stimulation on photoreceptor, bipolar cell and retinal ganglion cell-ultimately supporting selective stimulation of specific ganglion cell types for a more nuanced bionic retinal implant. Finally, we point to upcoming considerations in this rapidly developing domain of research.

[1]  S. Fried,et al.  The sodium channel band shapes the response to electric stimulation in retinal ganglion cells , 2011, Journal of neural engineering.

[2]  S. Fried,et al.  Axonal sodium-channel bands shape the response to electric stimulation in retinal ganglion cells. , 2009, Journal of neurophysiology.

[3]  D. Baylor,et al.  Mosaic arrangement of ganglion cell receptive fields in rabbit retina. , 1997, Journal of neurophysiology.

[4]  Nigel H. Lovell,et al.  Responses of starburst amacrine cells to prosthetic stimulation of the retina , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[5]  S Sekhar,et al.  Tickling the retina: integration of subthreshold electrical pulses can activate retinal neurons , 2016, Journal of neural engineering.

[6]  K. Naka,et al.  White-Noise Analysis of a Neuron Chain: An Application of the Wiener Theory , 1972, Science.

[7]  Sang Baek Ryu,et al.  Functional connectivity map of retinal ganglion cells for retinal prosthesis. , 2008, The Korean journal of physiology & pharmacology : official journal of the Korean Physiological Society and the Korean Society of Pharmacology.

[8]  James B Fallon,et al.  Creating virtual electrodes with 2D current steering , 2018, Journal of neural engineering.

[9]  G. Suaning,et al.  Progress in artificial vision through suprachoroidal retinal implants , 2017, Journal of neural engineering.

[10]  Max Eickenscheidt,et al.  Action potentials in retinal ganglion cells are initiated at the site of maximal curvature of the extracellular potential , 2014, Journal of neural engineering.

[11]  David B. Grayden,et al.  Can electric current steering be used to control perception of a retinal prosthesis patient , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[12]  Pengjia Cao,et al.  Electrically Evoked Responses in the Rabbit Cortex Induced by Current Steering With Penetrating Optic Nerve Electrodes. , 2016, Investigative ophthalmology & visual science.

[13]  Alex E. Hadjinicolaou,et al.  Single-compartment models of retinal ganglion cells with different electrophysiologies , 2017, Network.

[14]  Eberhart Zrenner,et al.  Fighting Blindness with Microelectronics , 2013, Science Translational Medicine.

[15]  Tatyana O Sharpee,et al.  Computational identification of receptive fields. , 2013, Annual review of neuroscience.

[16]  E. Evans,et al.  Enhancement of vowel coding for cochlear implants by addition of noise , 1996, Nature Medicine.

[17]  S. Kelly,et al.  Methods and perceptual thresholds for short-term electrical stimulation of human retina with microelectrode arrays. , 2003, Investigative ophthalmology & visual science.

[18]  Gislin Dagnelie,et al.  Electrically elicited visual evoked potentials in Argus II retinal implant wearers. , 2013, Investigative ophthalmology & visual science.

[19]  R. Granit The distribution of excitation and inhibition in single‐fibre responses from a polarized retina , 1946, The Journal of physiology.

[20]  Maesoon Im,et al.  Indirect activation elicits strong correlations between light and electrical responses in ON but not OFF retinal ganglion cells , 2015, The Journal of physiology.

[21]  A. Sher,et al.  Spatiotemporal characteristics of retinal response to network-mediated photovoltaic stimulation. , 2018, Journal of neurophysiology.

[22]  Daniel L Rathbun,et al.  Optimal voltage stimulation parameters for network-mediated responses in wild type and rd10 mouse retinal ganglion cells , 2017, Journal of neural engineering.

[23]  C. Enroth-Cugell,et al.  The contrast sensitivity of retinal ganglion cells of the cat , 1966, The Journal of physiology.

[24]  T. Velte,et al.  A computational model of electrical stimulation of the retinal ganglion cell , 1999, IEEE Transactions on Biomedical Engineering.

[25]  David Tsai,et al.  Current steering in retinal stimulation via a quasimonopolar stimulation paradigm. , 2013, Investigative ophthalmology & visual science.

[26]  Pierre Kornprobst,et al.  Virtual Retina: A biological retina model and simulator, with contrast gain control , 2009, Journal of Computational Neuroscience.

[27]  Roland Thewes,et al.  Electrical stimulation of retinal neurons in epiretinal and subretinal configuration using a multicapacitor array. , 2012, Journal of neurophysiology.

[28]  R Samba,et al.  PEDOT–CNT coated electrodes stimulate retinal neurons at low voltage amplitudes and low charge densities , 2015, Journal of neural engineering.

[29]  Yan T Wong,et al.  Neural Responses to Multielectrode Stimulation of Healthy and Degenerate Retina. , 2017, Investigative ophthalmology & visual science.

[30]  Gislin Dagnelie,et al.  An update on retinal prostheses , 2019, Clinical Neurophysiology.

[31]  Matthias Bethge,et al.  The functional diversity of retinal ganglion cells in the mouse , 2015, Nature.

[32]  Mark S Humayun,et al.  Predicting visual sensitivity in retinal prosthesis patients. , 2009, Investigative ophthalmology & visual science.

[33]  J. Weiland,et al.  Pattern electrical stimulation of the human retina , 1999, Vision Research.

[34]  P. Lennie,et al.  Spatial frequency analysis in the visual system. , 1985, Annual review of neuroscience.

[35]  D. Hubel,et al.  Integrative action in the cat's lateral geniculate body , 1961, The Journal of physiology.

[36]  F. Ratliff,et al.  The spatiotemporal transfer function of the Limulus lateral eye , 1978, The Journal of general physiology.

[37]  S. Kelly,et al.  Perceptual efficacy of electrical stimulation of human retina with a microelectrode array during short-term surgical trials. , 2003, Investigative ophthalmology & visual science.

[38]  H. Barlow Summation and inhibition in the frog's retina , 1953, The Journal of physiology.

[39]  Maesoon Im,et al.  Electric stimulus duration alters network-mediated responses depending on retinal ganglion cell type , 2018, Journal of neural engineering.

[40]  Alfred Stett,et al.  Subretinal electronic chips allow blind patients to read letters and combine them to words , 2010, Proceedings of the Royal Society B: Biological Sciences.

[41]  Tianruo Guo,et al.  Closed-Loop Efficient Searching of Optimal Electrical Stimulation Parameters for Preferential Excitation of Retinal Ganglion Cells , 2018, Front. Neurosci..

[42]  E. Chichilnisky,et al.  Electrical stimulation of mammalian retinal ganglion cells with multielectrode arrays. , 2006, Journal of neurophysiology.

[43]  Leonid M. Litvak,et al.  Current focusing and steering: Modeling, physiology, and psychophysics , 2008, Hearing Research.

[44]  Liam Paninski,et al.  Statistical models for neural encoding, decoding, and optimal stimulus design. , 2007, Progress in brain research.

[45]  Mark Humayun,et al.  Electrical stimulation of isolated retina with microwire glass electrodes , 2004, Journal of Neuroscience Methods.

[46]  R. W. Rodieck Quantitative analysis of cat retinal ganglion cell response to visual stimuli. , 1965, Vision research.

[47]  S Sekhar,et al.  Correspondence between visual and electrical input filters of ON and OFF mouse retinal ganglion cells , 2017, Journal of neural engineering.

[48]  R. Masland Cell populations of the retina: the Proctor lecture. , 2011, Investigative ophthalmology & visual science.

[49]  Gary Matthews,et al.  Functional Specialization of the Axon Initial Segment by Isoform-Specific Sodium Channel Targeting , 2003, The Journal of Neuroscience.

[50]  Joseph F Rizzo,et al.  Selective activation of neuronal targets with sinusoidal electric stimulation. , 2010, Journal of neurophysiology.

[51]  Shelley Fried,et al.  The Retinal Response to Sinusoidal Electrical Stimulation , 2016, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[52]  David B. Grayden,et al.  A Simple and Accurate Model to Predict Responses to Multi-electrode Stimulation in the Retina , 2016, PLoS Comput. Biol..

[53]  J. Rizzo,et al.  Multi-electrode stimulation and recording in the isolated retina , 2000, Journal of Neuroscience Methods.

[54]  F. Müller,et al.  Correlations between specific patterns of spontaneous activity and stimulation efficiency in degenerated retina , 2017, PloS one.

[55]  A. Sher,et al.  Photovoltaic restoration of sight with high visual acuity , 2015, Nature Medicine.

[56]  R. Freeman,et al.  Spatiotemporal flow of information in the early visual pathway , 2014, The European journal of neuroscience.

[57]  Eero P. Simoncelli,et al.  Spike-triggered neural characterization. , 2006, Journal of vision.

[58]  Michael R Ibbotson,et al.  Intrinsic physiological properties of rat retinal ganglion cells with a comparative analysis. , 2012, Journal of neurophysiology.

[59]  Mark S Humayun,et al.  Frequency and amplitude modulation have different effects on the percepts elicited by retinal stimulation. , 2012, Investigative ophthalmology & visual science.

[60]  F. Werblin,et al.  A method for generating precise temporal patterns of retinal spiking using prosthetic stimulation. , 2006, Journal of neurophysiology.

[61]  Angelika Braun,et al.  Artificial vision with wirelessly powered subretinal electronic implant alpha-IMS , 2013, Proceedings of the Royal Society B: Biological Sciences.

[62]  Donald K Eddington,et al.  Responses to pulsatile subretinal electric stimulation: effects of amplitude and duration. , 2013, Journal of neurophysiology.

[63]  Joseph F. Rizzo,et al.  Electric Stimulation with Sinusoids and White Noise for Neural Prostheses , 2010, Front. Neuropro..

[64]  C. Kim,et al.  Electrically-evoked Neural Activities of rd1 Mice Retinal Ganglion Cells by Repetitive Pulse Stimulation. , 2009, The Korean journal of physiology & pharmacology : official journal of the Korean Physiological Society and the Korean Society of Pharmacology.

[65]  Kyung Hwan Kim,et al.  Amplitude Modulation-based Electrical Stimulation for Encoding Multipixel Spatiotemporal Visual Information in Retinal Neural Activities , 2017, Journal of Korean medical science.

[66]  E. Chichilnisky,et al.  Spatially Patterned Electrical Stimulation to Enhance Resolution of Retinal Prostheses , 2014, The Journal of Neuroscience.

[67]  Sang Baek Ryu,et al.  Decoding of temporal visual information from electrically evoked retinal ganglion cell activities in photoreceptor-degenerated retinas. , 2011, Investigative ophthalmology & visual science.

[68]  K. Naka,et al.  Nonlinear analysis and synthesis of receptive-field responses in the catfish retina. 3. Two-input white-noise analysis. , 1973, Journal of neurophysiology.

[69]  E. Margalit,et al.  Simultaneous recording of mouse retinal ganglion cells during epiretinal or subretinal stimulation , 2014, Vision Research.

[70]  Chris E. Williams,et al.  Virtual electrodes by current steering in retinal prostheses. , 2014, Investigative ophthalmology & visual science.

[71]  S. W. Kuffler Discharge patterns and functional organization of mammalian retina. , 1953, Journal of neurophysiology.

[72]  M. Mcmahon,et al.  Retinal prosthesis phosphene shape analysis , 2008, 2008 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[73]  P Z Marmarelis,et al.  Nonlinear analysis and synthesis of receptive-field responses in the catfish retina. I. Horizontal cell leads to ganglion cell chain. , 1973, Journal of neurophysiology.

[74]  D. Palanker,et al.  Selectivity of direct and network-mediated stimulation of the retinal ganglion cells with epi-, sub- and intraretinal electrodes , 2014, Journal of neural engineering.

[75]  H. K. Hartline,et al.  THE RESPONSE OF SINGLE OPTIC NERVE FIBERS OF THE VERTEBRATE EYE TO ILLUMINATION OF THE RETINA , 1938 .

[76]  E J Chichilnisky,et al.  Prediction and Decoding of Retinal Ganglion Cell Responses with a Probabilistic Spiking Model , 2005, The Journal of Neuroscience.

[77]  R. Jensen,et al.  Responses of ganglion cells to repetitive electrical stimulation of the retina , 2007, Journal of neural engineering.

[78]  Hamish Meffin,et al.  Biophysical basis of the linear electrical receptive fields of retinal ganglion cells , 2018, Journal of neural engineering.

[79]  Philipp Berens,et al.  Die Retina im Rausch der Kanäle , 2017, Klinische Monatsblätter für Augenheilkunde.

[80]  I. Aviram,et al.  The Weiss–Lapicque and the Lapicque–Blair strength—duration curves revisited , 2016 .

[81]  Mark S Humayun,et al.  Electrical Stimulation of the Retina to Produce Artificial Vision. , 2016, Annual review of vision science.

[82]  David B. Grayden,et al.  Electrical receptive fields of retinal ganglion cells: Influence of presynaptic neurons , 2018, PLoS Comput. Biol..

[83]  F. Rattay,et al.  A study of the application of the Hodgkin-Huxley and the Frankenhaeuser-Huxley model for electrostimulation of the acoustic nerve , 1986, Neuroscience.

[84]  M. Bethge,et al.  Inhibition decorrelates visual feature representations in the inner retina , 2017, Nature.

[85]  M. J. Korenberg,et al.  The identification of nonlinear biological systems: LNL cascade models , 1986, Biological Cybernetics.

[86]  Spencer C. Chen,et al.  Simulating prosthetic vision: I. Visual models of phosphenes , 2009, Vision Research.

[87]  J. Weiland,et al.  Improving the spatial resolution of epiretinal implants by increasing stimulus pulse duration , 2015, Science Translational Medicine.

[88]  Daniel Palanker,et al.  Strength-duration relationship for extracellular neural stimulation: numerical and analytical models. , 2010, Journal of neurophysiology.

[89]  W. Catterall,et al.  Localization of sodium channels in axon hillocks and initial segments of retinal ganglion cells. , 1986, Proceedings of the National Academy of Sciences of the United States of America.

[90]  F. Rattay,et al.  Influence of the sodium channel band on retinal ganglion cell excitation during electric stimulation – A modeling study , 2014, Neuroscience.

[91]  Y. Goo,et al.  Spontaneous Oscillatory Rhythms in the Degenerating Mouse Retina Modulate Retinal Ganglion Cell Responses to Electrical Stimulation , 2016, Front. Cell. Neurosci..

[92]  E. Zrenner,et al.  The Spatial Extent of Epiretinal Electrical Stimulation in the Healthy Mouse Retina , 2017, Neurosignals.

[93]  Daniel Palanker,et al.  Contrast Sensitivity With a Subretinal Prosthesis and Implications for Efficient Delivery of Visual Information. , 2015, Investigative ophthalmology & visual science.

[94]  M. Eickenscheidt,et al.  Subretinal electrical stimulation reveals intact network activity in the blind mouse retina. , 2016, Journal of neurophysiology.

[95]  S. Cogan Neural stimulation and recording electrodes. , 2008, Annual review of biomedical engineering.

[96]  Gregg J. Suaning,et al.  Visual Prosthesis: Interfacing Stimulating Electrodes with Retinal Neurons to Restore Vision , 2017, Front. Neurosci..

[97]  A. Stett,et al.  Retinal charge sensitivity and spatial discrimination obtainable by subretinal implants: key lessons learned from isolated chicken retina , 2007, Journal of neural engineering.

[98]  Joseph F Rizzo,et al.  Thresholds for activation of rabbit retinal ganglion cells with an ultrafine, extracellular microelectrode. , 2003, Investigative ophthalmology & visual science.

[99]  Eberhart Zrenner,et al.  The Subretinal Implant: Can Microphotodiode Arrays Replace Degenerated Retinal Photoreceptors to Restore Vision? , 2002, Ophthalmologica.

[100]  E. Zrenner,et al.  Electrical multisite stimulation of the isolated chicken retina , 2000, Vision Research.

[101]  E D Adrian,et al.  The action of light on the eye , 1927, The Journal of physiology.

[102]  Nigel H. Lovell,et al.  Selective activation of ON and OFF retinal ganglion cells to high-frequency electrical stimulation: A computational modeling study , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.