An insight into assistive technology for the visually impaired and blind people: state-of-the-art and future trends

Assistive technology for the visually impaired and blind people is a research field that is gaining increasing prominence owing to an explosion of new interest in it from disparate disciplines. The field has a very relevant social impact on our ever-increasing aging and blind populations. While many excellent state-of-the-art accounts have been written till date, all of them are subjective in nature. We performed an objective statistical survey across the various sub-disciplines in the field and applied information analysis and network-theory techniques to answer several key questions relevant to the field. To analyze the field we compiled an extensive database of scientific research publications over the last two decades. We inferred interesting patterns and statistics concerning the main research areas and underlying themes, identified leading journals and conferences, captured growth patterns of the research field; identified active research communities and present our interpretation of trends in the field for the near future. Our results reveal that there has been a sustained growth in this field; from less than 50 publications per year in the mid 1990s to close to 400 scientific publications per year in 2014. Assistive Technology for persons with visually impairments is expected to grow at a swift pace and impact the lives of individuals and the elderly in ways not previously possible.

[1]  H. Kajimoto,et al.  HamsaTouch: tactile vision substitution with smartphone and electro-tactile display , 2014, CHI Extended Abstracts.

[2]  Davide Rocchesso,et al.  The Sonification Handbook , 2011 .

[3]  S. Kelly,et al.  Methods and perceptual thresholds for short-term electrical stimulation of human retina with microelectrode arrays. , 2003, Investigative ophthalmology & visual science.

[4]  Alan Borning,et al.  Where's my bus stop?: supporting independence of blind transit riders with StopInfo , 2014, ASSETS.

[5]  J. O'Regan,et al.  Learning to Perceive with a Visuo — Auditory Substitution System: Localisation and Object Recognition with ‘The Voice’ , 2007, Perception.

[6]  Natalie Jeremijenko,et al.  Sound through bone conduction in public interfaces , 2001, CHI Extended Abstracts.

[7]  W. Mokwa,et al.  Implantation and explantation of an active epiretinal visual prosthesis: 2-year follow-up data from the EPIRET3 prospective clinical trial , 2012, Eye.

[8]  David J. Calder Assistive technology interfaces for the blind , 2009, 2009 3rd IEEE International Conference on Digital Ecosystems and Technologies.

[9]  Roberto Manduchi,et al.  Watch your head: A wearable collision warning system for the blind , 2010, 2010 IEEE Sensors.

[10]  Lajos Losonczi,et al.  Assistive Technologies for Visually Impaired People , 2011 .

[11]  Nathan F. Lepora,et al.  The state of the art in biomimetics , 2012, Living Machines.

[12]  Shyamanta M. Hazarika,et al.  IntelliNavi: Navigation for Blind Based on Kinect and Machine Learning , 2014, MIWAI.

[13]  Arthur James Lowery,et al.  Restoration of vision in blind individuals using bionic devices: A review with a focus on cortical visual prostheses , 2015, Brain Research.

[14]  A. Sher,et al.  Photovoltaic Retinal Prosthesis with High Pixel Density , 2012, Nature Photonics.

[15]  Irving P. Herman,et al.  Biological and medical physics, biomedical engineering , 2014 .

[16]  Kate Saenko,et al.  Generating Natural-Language Video Descriptions Using Text-Mined Knowledge , 2013, AAAI.

[17]  N. A. Bradley,et al.  Assistive Technology For Visually Impaired And Blind People , 2008 .

[18]  W. H. Dobelle Artificial vision for the blind by connecting a television camera to the visual cortex. , 2000, ASAIO journal.

[19]  Peter Keller,et al.  Meaning from environmental sounds: types of signal-referent relations and their effect on recognizing auditory icons. , 2004, Journal of experimental psychology. Applied.

[20]  B. Sellhaus,et al.  Implantation and explantation of a wireless epiretinal retina implant device: observations during the EPIRET3 prospective clinical trial. , 2009, Investigative ophthalmology & visual science.

[21]  João Barroso,et al.  Blind Navigation Support System based on Microsoft Kinect , 2012, DSAI.

[22]  Bogdan Raducanu,et al.  New Opportunities for Computer Vision-Based Assistive Technology Systems for the Visually Impaired , 2014, Computer.

[23]  J. C. Bliss,et al.  A direct translation reading aid for the blind , 1966 .

[24]  B. Wilhelm,et al.  Subretinal Visual Implant Alpha IMS – Clinical trial interim report , 2015, Vision Research.

[25]  R. Hornig,et al.  The IMI Retinal Implant System , 2007 .

[26]  Ilenia Tinnirello,et al.  ARIANNA: A smartphone-based navigation system with human in the loop , 2014, 22nd Mediterranean Conference on Control and Automation.

[27]  M. Balakrishnan,et al.  A path-guided audio based indoor navigation system for persons with visual impairment , 2013, ASSETS.

[28]  Ramiro Velazquez,et al.  Wearable Assistive Devices for the Blind , 2016, ArXiv.

[29]  G. Gelderblom,et al.  The Impact of Electronic Mobility Devices for Persons who are Visually Impaired: A Systematic Review of Effects and Effectiveness , 2009 .

[30]  James S. Harris,et al.  Erratum: Photovoltaic retinal prosthesis with high pixel density , 2012 .

[31]  John A. Brabyn,et al.  New Developments in Mobility and Orientation Aids for the Blind , 1982, IEEE Transactions on Biomedical Engineering.

[32]  Mathieu Bastian,et al.  Gephi: An Open Source Software for Exploring and Manipulating Networks , 2009, ICWSM.

[33]  Stephen W. Kercel,et al.  Human Nervous System, Noninvasive Coupling of Electronically Generated Data into , 2006 .

[34]  N. Giudice,et al.  Indoor Scene Knowledge Acquisition using a Natural Language Interface , 2012 .

[35]  Suranga Nanayakkara,et al.  A wearable text-reading device for the visually-impaired , 2014, CHI Extended Abstracts.

[36]  Shachar Maidenbaum,et al.  The "EyeCane", a new electronic travel aid for the blind: Technology, behavior & swift learning. , 2014, Restorative neurology and neuroscience.

[37]  Lutz Bornmann,et al.  Growth rates of modern science: A bibliometric analysis based on the number of publications and cited references , 2014, J. Assoc. Inf. Sci. Technol..

[38]  Harald Reiterer,et al.  NAVI - A Proof-of-Concept of a Mobile Navigational Aid for Visually Impaired Based on the Microsoft Kinect , 2011, INTERACT.

[39]  Nicholas L Opie,et al.  Development of a surgical procedure for implantation of a prototype suprachoroidal retinal prosthesis , 2014, Clinical & experimental ophthalmology.

[40]  野間 春生,et al.  Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems 参加報告 , 1997 .

[41]  Susan M. Downes,et al.  A Depth-Based Head-Mounted Visual Display to Aid Navigation in Partially Sighted Individuals , 2013, PloS one.

[42]  Shachar Maidenbaum,et al.  Author's Personal Copy Neuroscience and Biobehavioral Reviews Sensory Substitution: Closing the Gap between Basic Research and Widespread Practical Visual Rehabilitation Author's Personal Copy , 2022 .

[43]  BENJAMIN WHITE,et al.  Vision Substitution by Tactile Image Projection , 1969, Nature.

[44]  Y. Luo,et al.  A review and update on the current status of retinal prostheses (bionic eye). , 2014, British medical bulletin.

[45]  Vincent Lévesque Blindness, Technology and Haptics , 2005 .

[46]  Ender Tekin,et al.  A Mobile Phone Application Enabling Visually Impaired Users to Find and Read Product Barcodes , 2010, ICCHP.

[47]  Giovanni Fusco,et al.  Determining a Blind Pedestrian's Location and Orientation at Traffic Intersections , 2014, ICCHP.

[48]  J. Fletcher Spatial Representation in Blind Children. 1: Development Compared to Sighted Children , 1980 .

[49]  Brian S. Hoyle,et al.  Mobility AT: The Batcane (UltraCane) , 2008 .

[50]  S. Millar Models of Sensory Deprivation: The Nature/Nurture Dichotomy and Spatial Representation in the Blind , 1988 .

[51]  G. Brindley,et al.  The sensations produced by electrical stimulation of the visual cortex , 1968, The Journal of physiology.

[52]  Lilit Hakobyan,et al.  Mobile assistive technologies for the visually impaired. , 2013, Survey of ophthalmology.

[53]  Uran Oh,et al.  Current and future mobile and wearable device use by people with visual impairments , 2014, CHI.

[54]  Naoki Kawakami,et al.  Optimal design method for selective nerve stimulation and its application to electrocutaneous display , 2002, Proceedings 10th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. HAPTICS 2002.

[55]  Tony Stockman,et al.  A survey of assistive technologies and applications for blind users on mobile platforms: a review and foundation for research , 2015, Journal on Multimodal User Interfaces.

[56]  S. Resnikoff,et al.  The impact of Vision 2020 on global blindness. , 2006, Eye.

[57]  Ben Shneiderman,et al.  Data Sonification for Users with Visual Impairment: A Case Study with Georeferenced Data , 2008, TCHI.

[58]  Angelika Braun,et al.  Artificial vision with wirelessly powered subretinal electronic implant alpha-IMS , 2013, Proceedings of the Royal Society B: Biological Sciences.

[59]  G. Dagnelie Retinal implants: emergence of a multidisciplinary field. , 2012, Current opinion in neurology.

[60]  Marion Hersh,et al.  Assistive technology for blind and visually impaired people: modelling and pratical issues , 2006 .

[61]  S. J. Kim,et al.  A Suprachoroidal Electrical Retinal Stimulator Design for Long-Term Animal Experiments and In Vivo Assessment of Its Feasibility and Biocompatibility in Rabbits , 2008, Journal of biomedicine & biotechnology.

[62]  Gert Jan Gelderblom,et al.  Inventory of Electronic Mobility Aids for Persons with Visual Impairments: A Literature Review , 2008 .

[63]  Ruxandra Tapu,et al.  A survey on wearable devices used to assist the visual impaired user navigation in outdoor environments , 2014, 2014 11th International Symposium on Electronics and Telecommunications (ISETC).

[64]  Peter Young,et al.  Framing Image Description as a Ranking Task: Data, Models and Evaluation Metrics , 2013, J. Artif. Intell. Res..

[65]  A. Sher,et al.  Photovoltaic restoration of sight with high visual acuity , 2015, Nature Medicine.

[66]  Gislin Dagnelie,et al.  Visual prosthetics: physiology, bioengineering, rehabilitation. , 2011 .

[67]  Peter B. L. Meijer,et al.  An experimental system for auditory image representations , 1992, IEEE Transactions on Biomedical Engineering.

[68]  P. Bach-y-Rita SENSORY PLASTICITY , 1967, Acta neurologica Scandinavica.

[69]  Thierry Pun,et al.  Auditory browser for blind and visually impaired users , 1999, CHI Extended Abstracts.

[70]  Jeffrey P. Bigham,et al.  Supporting blind photography , 2011, ASSETS.

[71]  R. H. Propst,et al.  Visual perception elicited by electrical stimulation of retina in blind humans. , 1996, Archives of ophthalmology.

[72]  H. Freiberger Mobility aids for the blind. , 1974, Bulletin of prosthetics research.

[73]  Marion Hersh,et al.  On modelling assistive technology systems - Part I: Modelling framework , 2008 .

[74]  Juan Manuel Sáez,et al.  Aerial Obstacle Detection With 3-D Mobile Devices , 2015, IEEE Journal of Biomedical and Health Informatics.

[75]  Dhruv Jain Path-guided indoor navigation for the visually impaired using minimal building retrofitting , 2014, ASSETS.

[76]  E. Schmeidler,et al.  Adding Audio Description: Does it Make a Difference? , 2001 .

[77]  Priya Narasimhan Assistive embedded technologies , 2006, Computer.

[78]  Priya Narasimhan,et al.  Trinetra: Assistive Technologies for Grocery Shopping for the Blind , 2006, 2006 10th IEEE International Symposium on Wearable Computers.

[79]  R. Hertle,et al.  Effect of tongue stimulation on nystagmus eye movements in blind patients , 2012, Brain Structure and Function.

[80]  Shachar Maidenbaum,et al.  EyeMusic: Introducing a "visual" colorful experience for the blind using auditory sensory substitution. , 2014, Restorative neurology and neuroscience.

[81]  R. Jacobson,et al.  Cognitive Mapping Without Sight: four preliminary studies of spatial learning , 1998 .

[82]  Wai Ho Li A Fast and Flexible Computer Vision System for Implanted Visual Prostheses , 2014, ECCV Workshops.

[83]  HodoshMicah,et al.  Framing image description as a ranking task , 2013 .

[84]  Jessy D. Dorn,et al.  The Detection of Motion by Blind Subjects With the Epiretinal 60-Electrode (Argus II) Retinal Prosthesis. , 2013, JAMA ophthalmology.

[85]  James M. Coughlan,et al.  The Crosswatch Traffic Intersection Analyzer: A Roadmap for the Future , 2012, ICCHP.

[86]  L. Dandona,et al.  Revision of visual impairment definitions in the International Statistical Classification of Diseases , 2006, BMC medicine.

[87]  S. Fortunato,et al.  Resolution limit in community detection , 2006, Proceedings of the National Academy of Sciences.

[88]  Zoran Levnajic,et al.  Quantifying the Consistency of Scientific Databases , 2015, PloS one.

[89]  Johann Borenstein,et al.  The NavBelt - A Computerized Multi-Sensor Travel Aid for Active Guidance of the Blind , 1990 .

[90]  Fei-Fei Li,et al.  Deep visual-semantic alignments for generating image descriptions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[91]  Rabia Jafri,et al.  Computer vision-based object recognition for the visually impaired in an indoors environment: a survey , 2013, The Visual Computer.

[92]  Xinlei Chen,et al.  Mind's eye: A recurrent visual representation for image caption generation , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[93]  Constantine Stephanidis,et al.  Designing universally accessible games , 2009, CIE.

[94]  Werner Bischof,et al.  NAVCOM - WLAN Communication between Public Transport Vehicles and Smart Phones to Support Visually Impaired and Blind People , 2012, ICCHP.

[95]  Suranga Nanayakkara,et al.  FingerReader: A Wearable Device to Explore Printed Text on the Go , 2015, CHI.

[96]  S. Upson Tongue Vision , 2007, IEEE Spectrum.

[97]  Roberto Manduchi,et al.  (Computer) vision without sight , 2012, Commun. ACM.

[98]  Chris E. Williams,et al.  First-in-Human Trial of a Novel Suprachoroidal Retinal Prosthesis , 2014, PloS one.

[99]  C. Thinus-Blanc,et al.  Representation of space in blind persons: vision as a spatial sense? , 1997, Psychological bulletin.

[100]  Jennifer Mankoff,et al.  Is your web page accessible?: a comparative study of methods for assessing web page accessibility for the blind , 2005, CHI.

[101]  M. Mladejovsky,et al.  Artificial Vision for the Blind: Electrical Stimulation of Visual Cortex Offers Hope for a Functional Prosthesis , 1974, Science.

[102]  Shraga Shoval,et al.  Auditory guidance with the Navbelt-a computerized travel aid for the blind , 1998, IEEE Trans. Syst. Man Cybern. Part C.

[103]  I. V. Ramakrishnan,et al.  More than meets the eye: a survey of screen-reader browsing strategies , 2010, W4A.

[104]  M. Osanai,et al.  Transretinal Electrical Stimulation with a Suprachoroidal Multichannel Electrode in Rabbit Eyes , 2004, Japanese Journal of Ophthalmology.

[105]  Jessy D. Dorn,et al.  Interim results from the international trial of Second Sight's visual prosthesis. , 2012, Ophthalmology.

[106]  Pawel Strumillo,et al.  Electronic interfaces aiding the visually impaired in environmental access, mobility and navigation , 2010, 3rd International Conference on Human System Interaction.

[107]  Herbert A. Simon,et al.  Why a Diagram is (Sometimes) Worth Ten Thousand Words , 1987, Cogn. Sci..

[108]  Wai Ho Li Wearable Computer Vision Systems for a Cortical Visual Prosthesis , 2013, 2013 IEEE International Conference on Computer Vision Workshops.

[109]  Jessy D. Dorn,et al.  Blind subjects implanted with the Argus II retinal prosthesis are able to improve performance in a spatial-motor task , 2010, British Journal of Ophthalmology.

[110]  Susumu Tachi,et al.  A vision substitution system using forehead electrical stimulation , 2006, SIGGRAPH '06.

[111]  Nikolaos G. Bourbakis,et al.  Wearable Obstacle Avoidance Electronic Travel Aids for Blind: A Survey , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[112]  Nicholas D. Lane,et al.  Can Deep Learning Revolutionize Mobile Sensing? , 2015, HotMobile.

[113]  James M Coughlan,et al.  Crosswatch: a System for Providing Guidance to Visually Impaired Travelers at Traffic Intersections. , 2013, Journal of assistive technologies.

[114]  P. Bach-y-Rita,et al.  Sensory substitution and the human–machine interface , 2003, Trends in Cognitive Sciences.

[115]  Yolaine Bourda,et al.  Electronic Locomotion Aids for the Blind: Towards More Assistive Systems , 2006, Intelligent Paradigms for Assistive and Preventive Healthcare.

[116]  Qiushi Ren,et al.  Visual Prosthesis, Optic Nerve Approaches , 2014, Encyclopedia of Computational Neuroscience.

[117]  H Freiberger Mobility and reading aids for the blind: recent developments in rehabilitation devices. , 1974, Bulletin of the New York Academy of Medicine.