Extraspectral Imaging for Improving the Perceived Information Presented in Retinal Prosthesis

Retinal prosthesis is steadily improving as a clinical treatment for blindness caused by retinitis pigmentosa. However, despite the continued exciting progress, the level of visual return is still very poor. It is also unlikely that those utilising these devices will stop being legally blind in the near future. Therefore, it is important to develop methods to maximise the transfer of useful information extracted from the visual scene. Such an approach can be achieved by digitally suppressing less important visual features and textures within the scene. The result can be interpreted as a cartoon-like image of the scene. Furthermore, utilising extravisual wavelengths such as infrared can be useful in the decision process to determine the optimal information to present. In this paper, we, therefore, present a processing methodology that utilises information extracted from the infrared spectrum to assist in the preprocessing of the visual image prior to conversion to retinal information. We demonstrate how this allows for enhanced recognition and how it could be implemented for optogenetic forms of retinal prosthesis. The new approach has been quantitatively evaluated on volunteers showing 112% enhancement in recognizing objects over normal approaches.

[1]  Spencer C. Chen,et al.  Simulating prosthetic vision: I. Visual models of phosphenes , 2009, Vision Research.

[2]  Narendra Ahuja,et al.  Real-time O(1) bilateral filtering , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[3]  Patrick Degenaar,et al.  This Work Is Licensed under a Creative Commons Attribution 4.0 International License Blockade of Pathological Retinal Ganglion Cell Hyperactivity Improves Optogenetically Evoked Light Responses in Rd1 Mice , 2022 .

[4]  K. Nikolic,et al.  A Non-Invasive Retinal Prosthesis - Testing the Concept , 2007, 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[5]  Walid I Al-Atabany,et al.  Designing and testing scene enhancement algorithms for patients with retina degenerative disorders , 2010, Biomedical engineering online.

[6]  Tetsuya Yagi,et al.  Real-Time Simulation of Phosphene Images Evoked by Electrical Stimulation of the Visual Cortex , 2010, ICONIP.

[7]  Holger Winnemöller,et al.  Real-time video abstraction , 2006, ACM Trans. Graph..

[8]  Patrick Degenaar,et al.  Optobionic vision—a new genetically enhanced light on retinal prosthesis , 2009, Journal of neural engineering.

[9]  Ramesh Raskar,et al.  Non-photorealistic camera: depth edge detection and stylized rendering using multi-flash imaging , 2004 .

[10]  Jitendra Malik,et al.  Scale-Space and Edge Detection Using Anisotropic Diffusion , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Patrick Degenaar,et al.  A New Individually Addressable Micro-LED Array for Photogenetic Neural Stimulation , 2010, IEEE Transactions on Biomedical Circuits and Systems.

[12]  Christofer Toumazou,et al.  Noise reduction in analogue computation of Drosophila photoreceptors , 2008 .

[13]  Alice K. Cho,et al.  Retinal prostheses: current clinical results and future needs. , 2011, Ophthalmology.

[14]  G. Brindley,et al.  The sensations produced by electrical stimulation of the visual cortex , 1968, The Journal of physiology.

[15]  S. Resnikoff,et al.  The impact of Vision 2020 on global blindness , 2005, Eye.

[16]  W. Atabany,et al.  A Robust Edge Enhancement Approach for Low Vision Patients Using Scene Simplification , 2008, 2008 Cairo International Biomedical Engineering Conference.

[17]  Alfred Stett,et al.  Subretinal electronic chips allow blind patients to read letters and combine them to words , 2010, Proceedings of the Royal Society B: Biological Sciences.

[18]  Douglas DeCarlo,et al.  Stylization and abstraction of photographs , 2002, ACM Trans. Graph..

[19]  James Weiland,et al.  Artificial vision: needs, functioning, and testing of a retinal electronic prosthesis. , 2009, Progress in brain research.

[20]  Mahmood Fathy,et al.  A classified and comparative study of edge detection algorithms , 2002, Proceedings. International Conference on Information Technology: Coding and Computing.

[21]  J. Dowling,et al.  Chapter 1 - Restoring Vision to the Blind: The New Age of Implanted Visual Prostheses. , 2014, Translational vision science & technology.

[22]  Eberhart Zrenner,et al.  Fighting Blindness with Microelectronics , 2013, Science Translational Medicine.

[23]  Gang Luo,et al.  22.4: Invited Paper: Augmented Vision Head‐Mounted Systems for Vision Impairments , 2007 .

[24]  A. Dizhoor,et al.  Ectopic Expression of a Microbial-Type Rhodopsin Restores Visual Responses in Mice with Photoreceptor Degeneration , 2006, Neuron.

[25]  Karl Deisseroth,et al.  Genetic Reactivation of Cone Photoreceptors Restores Visual Responses in Retinitis Pigmentosa , 2010, Science.

[26]  Jessy D. Dorn,et al.  Interim results from the international trial of Second Sight's visual prosthesis. , 2012, Ophthalmology.

[27]  Patrick Degenaar,et al.  A Processing Platform for Optoelectronic/Optogenetic Retinal Prosthesis , 2013, IEEE Transactions on Biomedical Engineering.

[28]  Walid I Al-Atabany,et al.  Improved content aware scene retargeting for retinitis pigmentosa patients , 2010, Biomedical engineering online.

[29]  J. Dowling,et al.  Current and future prospects for optoelectronic retinal prostheses , 2009, Eye.

[30]  Ramesh Raskar,et al.  Non-photorealistic camera: depth edge detection and stylized rendering using multi-flash imaging , 2004, SIGGRAPH 2004.

[31]  A. Y. Chow,et al.  The artificial silicon retina microchip for the treatment of vision loss from retinitis pigmentosa. , 2004, Archives of ophthalmology.

[32]  J. Weiland,et al.  Retinal prosthesis for the blind. , 2002, Survey of ophthalmology.

[33]  J. L. Stone,et al.  Morphometric analysis of macular photoreceptors and ganglion cells in retinas with retinitis pigmentosa. , 1992, Archives of ophthalmology.

[34]  Patrick Degenaar,et al.  Scene optimization for optogenetic retinal prosthesis , 2011, 2011 IEEE Biomedical Circuits and Systems Conference (BioCAS).

[35]  Andrew Adams,et al.  Fast High‐Dimensional Filtering Using the Permutohedral Lattice , 2010, Comput. Graph. Forum.

[36]  Ahmed Soltan,et al.  High density, high radiance μLED matrix for optogenetic retinal prostheses and planar neural stimulation , 2017, IEEE Transactions on Biomedical Circuits and Systems.

[37]  Photovoltaic Restoration of Sight in Rats with Retinal Degeneration: Assessment of Spatial Resolution and Visual Functions , 2014 .

[38]  J. Barrett,et al.  Optogenetic approaches to retinal prosthesis , 2014, Visual Neuroscience.

[39]  Douglas S Kim,et al.  Light-activated channels targeted to ON bipolar cells restore visual function in retinal degeneration , 2008, Nature Neuroscience.

[40]  W. H. Dobelle Artificial vision for the blind by connecting a television camera to the visual cortex. , 2000, ASAIO journal.

[41]  P. S. Ramaiah,et al.  Image Compression and Resizing for Retinal Implant in Bionic Eye , 2011 .

[42]  Spencer C. Chen,et al.  Simulating prosthetic vision: II. Measuring functional capacity , 2009, Vision Research.

[43]  Stephen L Hicks,et al.  Simulating prosthetic vision: Optimizing the information content of a limited visual display. , 2010, Journal of vision.

[44]  Karl M. Fant,et al.  A Nonaliasing, Real-Time Spatial Transform Technique , 1986, IEEE Computer Graphics and Applications.

[45]  Christofer Toumazou,et al.  Modeling Study of the Light Stimulation of a Neuron Cell With Channelrhodopsin-2 Mutants , 2011, IEEE Transactions on Biomedical Engineering.

[46]  Shih-Jen Chen,et al.  Retinal prostheses in degenerative retinal diseases , 2015, Journal of the Chinese Medical Association : JCMA.