Reading Visual Braille with a Retinal Prosthesis

Retinal prostheses, which restore partial vision to patients blinded by outer retinal degeneration, are currently in clinical trial. The Argus II retinal prosthesis system was recently awarded CE approval for commercial use in Europe. While retinal prosthesis users have achieved remarkable visual improvement to the point of reading letters and short sentences, the reading process is still fairly cumbersome. This study investigates the possibility of using an epiretinal prosthesis to stimulate visual braille as a sensory substitution for reading written letters and words. The Argus II retinal prosthesis system, used in this study, includes a 10 × 6 electrode array implanted epiretinally, a tiny video camera mounted on a pair of glasses, and a wearable computer that processes the video and determines the stimulation current of each electrode in real time. In the braille reading system, individual letters are created by a subset of dots from a 3 by 2 array of six dots. For the visual braille experiment, a grid of six electrodes was chosen out of the 10 × 6 Argus II array. Groups of these electrodes were then directly stimulated (bypassing the camera) to create visual percepts of individual braille letters. Experiments were performed in a single subject. Single letters were stimulated in an alternative forced choice (AFC) paradigm, and short 2–4-letter words were stimulated (one letter at a time) in an open-choice reading paradigm. The subject correctly identified 89% of single letters, 80% of 2-letter, 60% of 3-letter, and 70% of 4-letter words. This work suggests that text can successfully be stimulated and read as visual braille in retinal prosthesis patients.

[1]  M. Mladejovsky,et al.  ‘Braille’ reading by a blind volunteer by visual cortex stimulation , 1976, Nature.

[2]  Boris New,et al.  Une base de données lexicales du français contemporain sur internet: LEXIQUE , 2001 .

[3]  Gislin Dagnelie,et al.  Visual perception in a blind subject with a chronic microelectronic retinal prosthesis , 2003, Vision Research.

[4]  Alan L. Yuille,et al.  Detecting and reading text in natural scenes , 2004, CVPR 2004.

[5]  Marc Brysbaert,et al.  Lexique 2 : A new French lexical database , 2004, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[6]  Wolfgang L. Zagler,et al.  Computers Helping People with Special Needs, 12th International Conference, ICCHP 2010, Vienna, Austria, July 14-16, 2010, Proceedings, Part II , 2010, ICCHP.

[7]  Gislin Dagnelie,et al.  Patients Blinded by Outer Retinal Dystrophies Are Able to Identify Letters Using the Argus TM II Retinal Prosthesis System , 2010 .

[8]  Alfred Stett,et al.  Subretinal electronic chips allow blind patients to read letters and combine them to words , 2010, Proceedings of the Royal Society B: Biological Sciences.

[9]  Eberhart Zrenner,et al.  Fading Of Perception In Retinal Implants Is A Function Of Time And Space Between Sites Of Stimulation , 2011 .

[10]  B. Wilhelm,et al.  Spatial resolution and perception of patterns mediated by a subretinal 16-electrode array in patients blinded by hereditary retinal dystrophies. , 2011, Investigative ophthalmology & visual science.

[11]  J. Weiland,et al.  Inter-electrode Discriminability Correlates With Spatial Visual Performance In ArgusTM II Subjects , 2011 .

[12]  Subjects Blind From Outer Retinal Dystrophies Are Able To Consistently Read Short Sentences Using The ArgusTM Ii Retinal Prosthesis System , 2011 .

[13]  James M. Coughlan,et al.  Towards a Real-Time System for Finding and Reading Signs for Visually Impaired Users , 2012, ICCHP.

[14]  J. S. Lauritzen,et al.  Building retinal connectomes , 2012, Current Opinion in Neurobiology.

[15]  James R. Anderson,et al.  Retinal connectomics: Towards complete, accurate networks , 2013, Progress in Retinal and Eye Research.

[16]  Jessy D. Dorn,et al.  The Argus II epiretinal prosthesis system allows letter and word reading and long-term function in patients with profound vision loss , 2013, British Journal of Ophthalmology.