Image processor for visual prosthesis based on ARM

Visual prosthesis is designed and developed to help the blind people to restore vision [1]. Image processor is an essential part of visual prosthesis. It receives image data from a camera, and fulfills specific image processing strategy to transfer image information to data forms that can be recognized by implanted stimulator. To extract useful information from original image and provide satisfying image processing ability are the basic requirements for the image processor. In this article, an image processor based on ARM Cortex-A9 processor running mobile operating system Android is introduced. Image processing algorithms such as edge detection are applied to provide vital information of the scene to the following components. Software optimizations like using native code and hardware acceleration are made to reduce the processing time. After optimization, this image processor can process a 640*480 image within 50ms. This work could become the foundation of future researches to build visual prosthesis with impressive processing ability and flexibility.

[1]  E. Zrenner.  Will Retinal Implants Restore Vision ? , 2002 .

[2]  Gary R. Bradski,et al.  Learning OpenCV - computer vision with the OpenCV library: software that sees , 2008 .

[3]  Mark A. Tarbell,et al.  Image processing and interface for retinal visual prostheses , 2005, 2005 IEEE International Symposium on Circuits and Systems.

[4]  Wentai Liu,et al.  Electronic visual prosthesis. , 2003, Artificial organs.

[5]  Wilhelm Burger,et al.  Digital Image Processing - An Algorithmic Introduction using Java , 2008, Texts in Computer Science.

[6]  M.S. Humayun,et al.  DSP based image processing for retinal prosthesis , 2004, The 26th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[7]  Nigel H. Lovell,et al.  Smartphones as image processing systems for prosthetic vision , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[8]  Cheng-Min Lin,et al.  Benchmark Dalvik and Native Code for Android System , 2011, 2011 Second International Conference on Innovations in Bio-inspired Computing and Applications.

[9]  Mark S Humayun,et al.  Brightness as a function of current amplitude in human retinal electrical stimulation. , 2009, Investigative ophthalmology & visual science.

[10]  Gary R. Bradski,et al.  Learning OpenCV 3: Computer Vision in C++ with the OpenCV Library , 2016 .

[11]  N Parikh,et al.  Saliency-based image processing for retinal prostheses , 2010, Journal of neural engineering.

[12]  Wolfgang Fink,et al.  Microcomputer-based artificial vision support system for real-time image processing for camera-driven visual prostheses. , 2010, Journal of biomedical optics.

[13]  Nigel H. Lovell,et al.  A wearable real-time image processor for a vision prosthesis , 2009, Comput. Methods Programs Biomed..

[14]  A. Pasyuk,et al.  Second International Conference on Ion Sources , 1973 .

[15]  Anthony J. Maeder,et al.  Region-of-interest processing for electronic visual prostheses , 2008, J. Electronic Imaging.

[16]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Wentai Liu,et al.  A 37.6mm2 1024-channel high-compliance-voltage SoC for epiretinal prostheses , 2013, 2013 IEEE International Solid-State Circuits Conference Digest of Technical Papers.