Retinotopic to Spatiotopic Mapping in Blind Patients Implanted With the Argus II Retinal Prosthesis.

Purpose To quantify the precision of mapping from retinotopic (retina-centered) to spatiotopic (world-centered) coordinates in blind humans implanted with a retinal prosthesis device. Additionally, to demonstrate that an eye tracker can be calibrated on sightless patients based on the percept from a visual implant. Methods We directly activated epiretinal electrodes to create retinotopic stimuli and recorded the location of the percept at world-based coordinates. In contrast to normal Argus II use where stimulation is a function of the captured scene's image, in this research we directly controlled the waveform in each electrode and measured the percept's location using a trackable handheld marker. For eye tracking, pupil images were recorded with a timestamp synchronized to the stimulation and marker positions. Results Remapping of the measured world locations to the position of the electrodes on the retina is feasible by accounting for eye orientation at the onset of stimulation. Transformation of pupil images to the eye's orientation (i.e., eye tracker calibration) can be done by solving for the variables that minimize the spread of the remapped retinal electrode locations. After mapping to retinal coordinates based on eye positions, the measured precision of pointing was 2° to 3°, which is comparable to open-loop pointing in sighted individuals. Conclusions The brain accurately maps the artificial vision induced by a retinal prosthesis based on instantaneous gaze position. Remapping based on eye position is feasible and will increase visual stability in prosthetic vision.

[1]  R. Wurtz Neuronal mechanisms of visual stability , 2008, Vision Research.

[2]  G. E. Tassicker Preliminary report on a retinal stimulator. , 1956, The British journal of physiological optics.

[3]  Wilsaan M. Joiner,et al.  Neuronal mechanisms for visual stability: progress and problems , 2011, Philosophical Transactions of the Royal Society B: Biological Sciences.

[4]  Robert H. Wurtz,et al.  Influence of the thalamus on spatial visual processing in frontal cortex , 2006, Nature.

[5]  Gang Luo,et al.  The role of peripheral vision in saccade planning: learning from people with tunnel vision. , 2008, Journal of vision.

[6]  Matthew R. Behrend,et al.  The Argus™ II retinal prosthesis: Factors affecting patient selection for implantation , 2013, Progress in Retinal and Eye Research.

[7]  Alfred Stett,et al.  Subretinal electronic chips allow blind patients to read letters and combine them to words , 2010, Proceedings of the Royal Society B: Biological Sciences.

[8]  Eli Peli,et al.  Motion perception during involuntary eye vibration , 2003, Experimental Brain Research.

[9]  Eduardo Fernandez,et al.  Toward the development of a cortically based visual neuroprosthesis , 2009, Journal of neural engineering.

[10]  R. T. Smith,et al.  PREFERRED RETINAL LOCUS IN MACULAR DISEASE: Characteristics and Clinical Implications , 2008, Retina.

[11]  Michael F. Land,et al.  The Human Eye: Structure and Function , 1999, Nature Medicine.

[12]  Jessy D. Dorn,et al.  Factors Affecting Perceptual Threshold in Argus II Retinal Prosthesis Subjects. , 2013, Translational vision science & technology.

[13]  D. Burr,et al.  Selective suppression of the magnocellular visual pathway during saccadic eye movements , 1994, Nature.

[14]  Lyndon da Cruz,et al.  Long-term Repeatability and Reproducibility of Phosphene Characteristics in Chronically Implanted Argus II Retinal Prosthesis Subjects. , 2016, American journal of ophthalmology.

[15]  A. Sher,et al.  Photovoltaic restoration of sight with high visual acuity , 2015, Nature Medicine.

[16]  A. A. Skavenski,et al.  Extraretinal Eye Position Signals Determine Perceived Target Location when they Conflict with Visual Cues , 1997, Vision Research.

[17]  Donald W. Bouldin,et al.  A Cluster Separation Measure , 1979, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  M. Steinbach Proprioceptive knowledge of eye position , 1987, Vision Research.

[19]  J. T. Enright,et al.  The non-visual impact of eye orientation on eye—hand coordination , 1995, Vision Research.

[20]  Gislin Dagnelie,et al.  Hand-Camera Coordination Varies over Time in Users of the Argus® II Retinal Prosthesis System , 2016, Front. Syst. Neurosci..

[21]  Jessy D. Dorn,et al.  Interim results from the international trial of Second Sight's visual prosthesis. , 2012, Ophthalmology.

[22]  Daniela Balslev,et al.  The University of Birmingham (live System) Eye Position Representation in Human Anterior Parietal Cortex Eye Position Representation in Human Anterior Parietal Cortex , 2022 .

[23]  José-Alain Sahel,et al.  Importance of eye position on spatial localization in blind subjects wearing an Argus II retinal prosthesis. , 2014, Investigative ophthalmology & visual science.

[24]  Mingsha Zhang,et al.  The proprioceptive representation of eye position in monkey primary somatosensory cortex , 2007, Nature Neuroscience.

[25]  Gislin Dagnelie,et al.  Visual perception in a blind subject with a chronic microelectronic retinal prosthesis , 2003, Vision Research.

[26]  Mark S Humayun,et al.  Frequency and amplitude modulation have different effects on the percepts elicited by retinal stimulation. , 2012, Investigative ophthalmology & visual science.

[27]  Martina Poletti,et al.  Stability of the Visual World during Eye Drift , 2010, The Journal of Neuroscience.

[28]  O. Bock,et al.  Contribution of retinal versus extraretinal signals towards visual localization in goal-directed movements , 2004, Experimental Brain Research.

[29]  Jeffrey C. Lagarias,et al.  Convergence Properties of the Nelder-Mead Simplex Method in Low Dimensions , 1998, SIAM J. Optim..

[30]  Gislin Dagnelie,et al.  Initiation and stability of pursuit eye movements in simulated retinal prosthesis at different implant locations. , 2008, Investigative ophthalmology & visual science.

[31]  Ziad M. Hafed,et al.  Oculomotor behavior of blind patients seeing with a subretinal visual implant , 2016, Vision Research.

[32]  David C. Burr,et al.  Optimal Multimodal Integration in Spatial Localization , 2013, The Journal of Neuroscience.

[33]  R. M. Siegel,et al.  Encoding of spatial location by posterior parietal neurons. , 1985, Science.

[34]  Daniel Palanker,et al.  SiC protective coating for photovoltaic retinal prosthesis , 2016, Journal of neural engineering.

[35]  B. Wandell,et al.  Visual Field Maps in Human Cortex , 2007, Neuron.

[36]  Larry Greenemeier,et al.  FDA Approves First Retinal Implant , 2013, Nature.

[37]  J. Crawford,et al.  Gaze-Centered Remapping of Remembered Visual Space in an Open-Loop Pointing Task , 1998, The Journal of Neuroscience.

[38]  Tassicker Ge Preliminary report on a retinal stimulator. , 1956 .

[39]  J R Duhamel,et al.  The updating of the representation of visual space in parietal cortex by intended eye movements. , 1992, Science.

[40]  N Drasdo,et al.  Non-linear projection of the retinal image in a wide-angle schematic eye. , 1974, The British journal of ophthalmology.

[41]  Kang Ryoung Park,et al.  A Novel Gaze Tracking Method Based on the Generation of Virtual Calibration Points , 2013, Sensors.

[42]  D. Zee,et al.  Oculomotor function in the rhesus monkey after deafferentation of the extraocular muscles , 2001, Experimental Brain Research.

[43]  R Clay Reid,et al.  Demonstration of artificial visual percepts generated through thalamic microstimulation , 2007, Proceedings of the National Academy of Sciences.

[44]  J. Vercher,et al.  The role of ocular muscle proprioception in visual localization of targets. , 1990, Science.