Effects of Depth-Based Object Isolation in Simulated Retinal Prosthetic Vision

Visual retinal prostheses aim to restore vision for blind individuals who suffer from outer retinal degenerative diseases, such as retinitis pigmentosa and age-related macular degeneration. Perception through retinal prostheses is very limited, but it can be improved by applying object isolation. We used an object isolation algorithm based on integral imaging to isolate objects of interest according to their depth from the camera and applied image processing manipulation to the isolated-object images. Subsequently, we applied a spatial prosthetic vision simulation that converted the isolated-object images to phosphene images. We compared the phosphene images for two types of input images, the original image (before applying object isolation), and the isolated-object image to illustrate the effects of object isolation on simulated prosthetic vision without and with multiple spatial variations of phosphenes, such as size and shape variations, spatial shifts, and dropout rate. The results show an improvement in the perceived shape, contrast, and dynamic range (number of gray levels) of objects in the phosphene image.

[1]  S. B. Brummer,et al.  Electrical Stimulation with Pt Electrodes: II-Estimation of Maximum Surface Redox (Theoretical Non-Gassing) Limits , 1977, IEEE Transactions on Biomedical Engineering.

[2]  Robert J Greenberg,et al.  Spatiotemporal interactions in retinal prosthesis subjects. , 2010, Investigative ophthalmology & visual science.

[3]  Steffen Schmitz-Valckenberg,et al.  Geographic atrophy: clinical features and potential therapeutic approaches. , 2014, Ophthalmology.

[4]  Angelika Braun,et al.  Artificial vision with wirelessly powered subretinal electronic implant alpha-IMS , 2013, Proceedings of the Royal Society B: Biological Sciences.

[5]  G. Brindley,et al.  The sensations produced by electrical stimulation of the visual cortex , 1968, The Journal of physiology.

[6]  Andrew J. Whalen,et al.  The impact of synchronous versus asynchronous electrical stimulation in artificial vision , 2021, Journal of neural engineering.

[7]  Yuan Yang,et al.  Object recognition under distorted prosthetic vision. , 2010, Artificial organs.

[8]  Yitzhak Yitzhaky,et al.  Active confocal imaging for visual prostheses , 2015, Vision Research.

[9]  J. D. Weiland,et al.  Resolution of the Epiretinal Prosthesis is not Limited by Electrode Size , 2011, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[10]  Ying Zhao,et al.  Recognition of pixelized Chinese characters using simulated prosthetic vision. , 2007, Artificial organs.

[11]  J. Weiland,et al.  Perceptual thresholds and electrode impedance in three retinal prosthesis subjects , 2005, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[12]  Liron Pantanowitz,et al.  Exploring virtual reality technology and the Oculus Rift for the examination of digital pathology slides , 2016, Journal of pathology informatics.

[13]  B. Sellhaus,et al.  Implantation and explantation of a wireless epiretinal retina implant device: observations during the EPIRET3 prospective clinical trial. , 2009, Investigative ophthalmology & visual science.

[14]  Daniel Palanker,et al.  Design of a high-resolution optoelectronic retinal prosthesis , 2005, Journal of neural engineering.

[15]  R. Hornig,et al.  The IMI Retinal Implant System , 2007 .

[16]  Bahram Javidi,et al.  Three dimensional visualization by photon counting computational Integral Imaging. , 2008, Optics express.

[17]  Avi Caspi,et al.  Feasibility study of a retinal prosthesis: spatial vision with a 16-electrode implant. , 2009, Archives of ophthalmology.

[18]  Gislin Dagnelie,et al.  Paragraph text reading using a pixelized prosthetic vision simulator: parameter dependence and task learning in free-viewing conditions. , 2006, Investigative ophthalmology & visual science.

[19]  Arup Roy,et al.  Factors affecting perceptual thresholds in epiretinal prostheses. , 2008, Investigative ophthalmology & visual science.

[20]  Farhad Hafezi,et al.  Temporal properties of visual perception on electrical stimulation of the retina. , 2012, Investigative ophthalmology & visual science.

[21]  J D Loudin,et al.  Optoelectronic retinal prosthesis: system design and performance , 2007, Journal of neural engineering.

[22]  Ione Fine,et al.  A model of ganglion axon pathways accounts for percepts elicited by retinal implants , 2018, Scientific Reports.

[23]  Gislin Dagnelie,et al.  An update on retinal prostheses , 2019, Clinical Neurophysiology.

[24]  Gislin Dagnelie,et al.  The functional performance of the Argus II retinal prosthesis , 2014, Expert review of medical devices.

[25]  Hugh J. McDermott,et al.  The Appearance of Phosphenes Elicited Using a Suprachoroidal Retinal Prosthesis. , 2016, Investigative ophthalmology & visual science.

[26]  R. H. Propst,et al.  Visual perception elicited by electrical stimulation of retina in blind humans. , 1996, Archives of ophthalmology.

[27]  S. Kelly,et al.  Perceptual efficacy of electrical stimulation of human retina with a microelectrode array during short-term surgical trials. , 2003, Investigative ophthalmology & visual science.

[28]  R. Casson,et al.  A review of the mechanisms of cone degeneration in retinitis pigmentosa , 2016, Acta ophthalmologica.

[29]  J. Weiland,et al.  Visual performance using a retinal prosthesis in three subjects with retinitis pigmentosa. , 2007, American journal of ophthalmology.

[30]  Spencer C. Chen,et al.  Simulating prosthetic vision: I. Visual models of phosphenes , 2009, Vision Research.

[31]  G. Lippmann.  Epreuves reversibles donnant la sensation du relief , 1908 .

[32]  M. Mehta,et al.  Retinitis Pigmentosa: Review of Current Treatment. , 2019, International ophthalmology clinics.

[33]  Gislin Dagnelie,et al.  Visual perception in a blind subject with a chronic microelectronic retinal prosthesis , 2003, Vision Research.

[34]  Chris E. Williams,et al.  First-in-Human Trial of a Novel Suprachoroidal Retinal Prosthesis , 2014, PloS one.

[35]  Philip R. Troyk,et al.  In vitro comparison of the charge-injection limits of activated iridium oxide (AIROF) and platinum-iridium microelectrodes , 2005, IEEE Transactions on Biomedical Engineering.

[36]  Yinghong Peng,et al.  Adaptation to Phosphene Parameters Based on Multi-Object Recognition Using Simulated Prosthetic Vision. , 2015, Artificial organs.

[37]  S. Kelly,et al.  Methods and perceptual thresholds for short-term electrical stimulation of human retina with microelectrode arrays. , 2003, Investigative ophthalmology & visual science.

[38]  Devi S. Klein,et al.  Deep Learning–Based Scene Simplification for Bionic Vision , 2021, AHs.

[39]  Yitzhak Yitzhaky,et al.  Detection of Object Existence From a Single Reconstructed Plane Obtained by Integral Imaging , 2014, IEEE Photonics Technology Letters.

[40]  Mark S Humayun,et al.  Frequency and amplitude modulation have different effects on the percepts elicited by retinal stimulation. , 2012, Investigative ophthalmology & visual science.

[41]  J. Weiland,et al.  Pattern electrical stimulation of the human retina , 1999, Vision Research.

[42]  E J Chichilnisky,et al.  Activation of ganglion cells and axon bundles using epiretinal electrical stimulation. , 2017, Journal of neurophysiology.

[43]  E. Peli,et al.  Retinal prosthetic vision simulation: temporal aspects , 2021, Journal of neural engineering.

[44]  Yitzhak Yitzhaky,et al.  Automatic 3D object localization and isolation using computational integral imaging. , 2015, Applied optics.

[45]  Yvonne Hsu-Lin Luo,et al.  The Argus II Retinal Prosthesis System , 2019, Prosthesis.

[46]  Richard A. Normann,et al.  Simulation of a phosphene-based visual field: Visual acuity in a pixelized vision system , 2006, Annals of Biomedical Engineering.

[47]  Jessy D. Dorn,et al.  Interim results from the international trial of Second Sight's visual prosthesis. , 2012, Ophthalmology.