Object recognition based on a foreground extraction method under simulated prosthetic vision

At present, retinal prostheses only generate low-resolution visual percepts because of a limited number of implantable electrodes. Prosthetic recipients are able to perform some simple visual tasks, but more complex tasks like object recognition are difficult. Therefore, image processing strategies to optimize the visual percepts of recipients were investigated. This study focused on object recognition under simulated prosthetic vision. A foreground extraction method based on a saliency model was proposed to obtain foreground object. Based on this, an image enhancement strategy combining edge information with foreground object was presented to obtain the pixelized image. Results showed that foreground extraction method achieved superior effects in foreground extraction. Psychophysical experiments verified that under simulated prosthetic vision, our method had prominent advantages in comparison with direct pixelization in terms of recognition accuracy and efficiency.

[1]  S. Kelly,et al.  Perceptual efficacy of electrical stimulation of human retina with a microelectrode array during short-term surgical trials. , 2003, Investigative ophthalmology & visual science.

[2]  Robert J. Greenberg,et al.  The Argus® II retinal prosthesis system: An overview , 2013, 2013 IEEE International Conference on Multimedia and Expo Workshops (ICMEW).

[3]  Y. Luo,et al.  A review and update on the current status of retinal prostheses (bionic eye). , 2014, British medical bulletin.

[4]  Alfred Stett,et al.  Subretinal electronic chips allow blind patients to read letters and combine them to words , 2010, Proceedings of the Royal Society B: Biological Sciences.

[5]  G. Suaning,et al.  Attaining higher resolution visual prosthetics: a review of the factors and limitations , 2013, Journal of neural engineering.

[6]  Christophe Jouffrais,et al.  Simulated Prosthetic Vision: The Benefits of Computer-Based Object Recognition and Localization. , 2015, Artificial organs.

[7]  Nick Barnes,et al.  Mobility and low contrast trip hazard avoidance using augmented depth , 2015, Journal of neural engineering.

[8]  Liming Li,et al.  Image Processing Strategies Based on a Visual Saliency Model for Object Recognition Under Simulated Prosthetic Vision. , 2016, Artificial organs.

[9]  Gislin Dagnelie,et al.  Visual perception in a blind subject with a chronic microelectronic retinal prosthesis , 2003, Vision Research.

[10]  J. Weiland,et al.  Retinal prosthesis. , 2014, IEEE transactions on bio-medical engineering.

[11]  N Parikh,et al.  Performance of visually guided tasks using simulated prosthetic vision and saliency-based cues , 2013, Journal of neural engineering.

[12]  Pierre Soille,et al.  Morphological Image Analysis: Principles and Applications , 2003 .

[13]  H. Kishima,et al.  Testing of semichronically implanted retinal prosthesis by suprachoroidal-transretinal stimulation in patients with retinitis pigmentosa. , 2011, Investigative ophthalmology & visual science.

[14]  Jian Sun,et al.  Geodesic Saliency Using Background Priors , 2012, ECCV.