AN OVERVIEW OF ASSISTIVE DEVICES FOR BLIND AND VISUALLY IMPAIRED PEOPLE

Across the world, there are approximately 253 million people with vision impairments, and assistive devices have constantly been in demand. Advanced research has led to the development of numerous assistive devices for blind people and visually impaired people (VIP) to improve their quality of life. An overview of these different types of assistive devices such as canes, glasses, hats and gloves is presented in this survey. A FCBPSS (F: function, C: context, B: behaviour, P: principle, S: state, S: structure) architecture of visual impairment assistance system is preliminarily proposed to allow other researchers to design the assistive devices with the good experience and the high performance for blind people and VIPs in the future. As VIPs and blind people may have different behaviour patterns, a criterion for classifying different types of vision impairments is presented. Subsequently, we classify the substitutive senses for visual perception into five categories: vision enhancement, audition, somatosense, visual prosthesis, and olfactory and gustation. Two commonly used feedback forms, namely audition and vibration, are elaborated. Based on literature survey, we also present a summary prospective of the development of assistive devices: add more sensing and feedback modules, use the knowledge of perception mechanism and behaviour pattern as the design guideline and design more reliable validation experiments.

[1]  Ter-Feng Wu,et al.  Intelligent wheeled mobile robots for blind navigation application , 2017 .

[2]  Hassan A. Karimi,et al.  Context-aware obstacle detection for navigation by visually impaired , 2017, Image Vis. Comput..

[3]  Byung-Seop Song,et al.  Proposal of a simultaneous ultrasound emission for efficient obstacle searching in autonomous wheelchairs , 2013 .

[4]  C. Kufta,et al.  Feasibility of a visual prosthesis for the blind based on intracortical microstimulation of the visual cortex. , 1996, Brain : a journal of neurology.

[5]  Hasan Siamian,et al.  Information Seeking Behavior in Blind People of Iran : a Survey based on Various Experiences faced by them , 2016 .

[6]  Bogdan Raducanu,et al.  New Opportunities for Computer Vision-Based Assistive Technology Systems for the Visually Impaired , 2014, Computer.

[7]  장윤희,et al.  Y. , 2003, Industrial and Labor Relations Terms.

[8]  Danna Zhou,et al.  d. , 1840, Microbial pathogenesis.

[9]  Bruno Ando,et al.  Smart homecare technologies for the visually impaired: recent advances , 2014 .

[10]  Jong Myung Rhee,et al.  Blindness support using a 3D sound system based on a proximity sensor , 2016, 2016 IEEE International Conference on Consumer Electronics (ICCE).

[11]  A.-C. Scherlen,et al.  "RecognizeCane" : The new concept of a cane which recognizes the most common objects and safety clues , 2007, 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[12]  Dileeka Dias,et al.  A sensor platform for the visually impaired to walk straight avoiding obstacles , 2015, 2015 9th International Conference on Sensing Technology (ICST).

[13]  Annie Vinter,et al.  Local and global processing in blind and sighted children in a naming and drawing task. , 2014, Child development.

[14]  Monica Gori,et al.  Neuroscience and Biobehavioral Reviews , 2022 .

[15]  Roy P. Paily,et al.  Design and Implementation of Blind Assistance System Using Real Time Stereo Vision Algorithms , 2016, 2016 29th International Conference on VLSI Design and 2016 15th International Conference on Embedded Systems (VLSID).

[16]  Laura N. Gitlin,et al.  Gait Implications of Visual Field Damage from Glaucoma , 2017, Translational vision science & technology.

[17]  Arthur James Lowery,et al.  Restoration of vision in blind individuals using bionic devices: A review with a focus on cortical visual prostheses , 2015, Brain Research.

[18]  B Dhillon,et al.  Gaze and pupil changes during navigation in age-related macular degeneration , 2014, British Journal of Ophthalmology.

[19]  P. Alam ‘K’ , 2021, Composites Engineering.

[20]  Pawel Strumillo,et al.  Electronic interfaces aiding the visually impaired in environmental access, mobility and navigation , 2010, 3rd International Conference on Human System Interaction.

[21]  Shyamanta M. Hazarika,et al.  An insight into assistive technology for the visually impaired and blind people: state-of-the-art and future trends , 2017, Journal on Multimodal User Interfaces.

[22]  Shuihua Wang,et al.  Detecting signage and doors for blind navigation and wayfinding , 2013, Network Modeling Analysis in Health Informatics and Bioinformatics.

[23]  István Bókkon,et al.  Phosphene phenomenon: A new concept , 2008, Biosyst..

[24]  Myounghoon Jeon,et al.  Spindex (Speech Index) Improves Auditory Menu Acceptance and Navigation Performance , 2011, TACC.

[25]  Shachar Maidenbaum,et al.  Waist-up protection for blind individuals using the EyeCane as a primary and secondary mobility aid , 2017, Restorative neurology and neuroscience.

[26]  Simon X. Yang,et al.  An Improved Vision-based SLAM Approach Inspired from animal Spatial Cognition , 2019, Int. J. Robotics Autom..

[27]  Jared M Batterman,et al.  Connected cane: Tactile button input for controlling gestures of iOS voiceover embedded in a white cane , 2018, Assistive technology : the official journal of RESNA.

[28]  Gaurav Chitranshi,et al.  Advanced guide cane for the visually impaired people , 2015, 2015 1st International Conference on Next Generation Computing Technologies (NGCT).

[29]  B. Röder,et al.  Auditory and auditory-tactile processing in congenitally blind humans , 2009, Hearing Research.

[30]  David I. Anderson,et al.  The role of locomotion in psychological development , 2013, Front. Psychol..

[31]  Yingli Tian,et al.  Assistive Text Reading from Natural Scene for Blind Persons , 2015, Mobile Cloud Visual Media Computing.

[32]  Ling Chen,et al.  Right mix of speech and non-speech: hybrid auditory feedback in mobility assistance of the visually impaired , 2014, Universal Access in the Information Society.

[33]  Kee-Ho Yu,et al.  Multi-Section Sensing and Vibrotactile Perception for Walking Guide of Visually Impaired Person , 2016, Sensors.

[34]  Kiran H. J. Dellimore,et al.  Development of a wearable support system to aid the visually impaired in independent mobilization and navigation , 2017, 2017 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[35]  Akhilesh Krishnan,et al.  Autonomous walking stick for the blind using echolocation and image processing , 2016, 2016 2nd International Conference on Contemporary Computing and Informatics (IC3I).

[36]  Ramiro Velazquez,et al.  Wearable Assistive Devices for the Blind , 2016, ArXiv.

[37]  György Wersényi,et al.  Overview of auditory representations in human-machine interfaces , 2013, ACM Comput. Surv..

[38]  Nikolaos G. Bourbakis,et al.  Wearable Obstacle Avoidance Electronic Travel Aids for Blind: A Survey , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[39]  Wenjun Zhang,et al.  Piezoelectric friction–inertia actuator—a critical review and future perspective , 2012 .

[40]  G. Fitzgerald,et al.  'I. , 2019, Australian journal of primary health.

[41]  S. Lacey,et al.  Haptic Object Recognition is View-Independent in Early Blind but not Sighted People , 2016, Perception.

[42]  Stephen J. Farenga,et al.  Spatial Intelligence: Why It Matters from Birth through the Lifespan , 2017 .

[43]  David J. Brown,et al.  Audio–Vision Substitution for Blind Individuals: Addressing Human Information Processing Capacity Limitations , 2016, IEEE Journal of Selected Topics in Signal Processing.

[44]  D. D. Alwis,et al.  Low Cost Ultrasonic Based Wide Detection Range Smart Walking Stick for Visually Impaired , 2017 .

[45]  R. Rangarajan,et al.  Voice Recognition Robotic Dog Guides For Visually Impaired People , 2014 .

[46]  Shuihua Wang,et al.  RGB-D image-based detection of stairs, pedestrian crosswalks and traffic signs , 2014, J. Vis. Commun. Image Represent..

[47]  John-Ross Rizzo,et al.  A new primary mobility tool for the visually impaired: A white cane—adaptive mobility device hybrid , 2018, Assistive technology : the official journal of RESNA.

[48]  Guangtao Zhai,et al.  An Augmented-Reality night vision enhancement application for see-through glasses , 2015, 2015 IEEE International Conference on Multimedia & Expo Workshops (ICMEW).

[49]  Connor Lane,et al.  Reduced Left Lateralization of Language in Congenitally Blind Individuals , 2017, Journal of Cognitive Neuroscience.

[50]  Sandy Wong Traveling with blindness: A qualitative space‐time approach to understanding visual impairment and urban mobility , 2018, Health & place.

[51]  A S Romadhon,et al.  Smart Stick For the Blind Using Arduino , 2020, Journal of Physics: Conference Series.

[52]  Eli Peli,et al.  Multiplexing Prisms for Field Expansion. , 2017, Optometry and vision science : official publication of the American Academy of Optometry.

[53]  Hiroshi Suzuki,et al.  Indoor Navigation System based on Passive RFID Transponder with Digital Compass for Visually Impaired People , 2016 .

[54]  C. Carpio,et al.  Study of an inclusive intervention programme in pictorial perception with blind and sighted students , 2017 .

[55]  Yang Li,et al.  Design of see-through near-eye display for presbyopia. , 2017, Optics express.

[56]  Ling Chen,et al.  A Comparative Study of Sonification Methods to Represent Distance and Forward-Direction in Pedestrian Navigation , 2014, Int. J. Hum. Comput. Interact..

[57]  Mari Carmen Domingo,et al.  An overview of the Internet of Things for people with disabilities , 2012, J. Netw. Comput. Appl..

[58]  F. Rösler,et al.  Event-related potentials during auditory language processing in congenitally blind and sighted people , 2000, Neuropsychologia.

[59]  Laehyun Kim,et al.  An electronic traveler aid for the blind using multiple range sensors , 2009, IEICE Electron. Express.

[60]  Liwen Wang,et al.  Chinese-Based Spearcons: Improving Pedestrian Navigation Performance in Eyes-Free Environment , 2016, Int. J. Hum. Comput. Interact..

[61]  ZhangChenyang,et al.  RGB-D image-based detection of stairs, pedestrian crosswalks and traffic signs , 2014 .

[62]  Naif Alajlan,et al.  Fast indoor scene description for blind people with multiresolution random projections , 2017, J. Vis. Commun. Image Represent..

[63]  Anderson Rocha,et al.  A Kinect-Based Wearable Face Recognition System to Aid Visually Impaired Users , 2017, IEEE Transactions on Human-Machine Systems.

[64]  Brian C J Moore,et al.  Blindness enhances auditory obstacle circumvention: Assessing echolocation, sensory substitution, and visual-based navigation , 2017, PloS one.

[65]  Alex D. Hwang,et al.  An Augmented-Reality Edge Enhancement Application for Google Glass , 2014, Optometry and vision science : official publication of the American Academy of Optometry.

[66]  Abhijit C. Pattanshetti,et al.  Advanced Bat Hat for the Visually Impaired , 2016 .

[67]  Delphine Picard,et al.  Haptic Identification of Raised-Line Drawings by Children, Adolescents, and Young Adults: An Age-Related Skill (Short Paper) , 2013 .

[68]  D. Bolgiano,et al.  A laser cane for the blind , 1967 .

[69]  Andrew Sears,et al.  Nomadic Speech-Based Text Entry: A Decision Model Strategy for Improved Speech to Text Processing , 2009, Int. J. Hum. Comput. Interact..

[70]  Yuhki Kitazono,et al.  Development of Guiding Walking Support Device for Visually Impaired People with the GPS , 2017 .

[71]  Gregory J. Christie,et al.  Signal Enhancement, Not Active Suppression, Follows the Contingent Capture of Visual Attention , 2017, Journal of experimental psychology. Human perception and performance.

[72]  J J van Rheede,et al.  Improved mobility with depth-based residual vision glasses , 2014 .

[73]  Nobuo Ezaki,et al.  Kinect cane: an assistive system for the visually impaired based on the concept of object recognition aid , 2015, Personal and Ubiquitous Computing.

[74]  Gang Luo,et al.  Magnifying Smartphone Screen Using Google Glass for Low-Vision Users , 2017, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[75]  Ayush Wattal Obstacle Detection for Visually Impaired Using Raspberry Pi and Ultrasonic Sensors , 2016 .

[76]  Philippe Vaslin,et al.  Overview of Smart White Canes: Connected Smart Cane from Front End to Back End , 2018 .

[77]  Thomas de Quincey [C] , 2000, The Works of Thomas De Quincey, Vol. 1: Writings, 1799–1820.

[78]  Denis Pellerin,et al.  Navigating from a Depth Image Converted into Sound , 2015, Applied bionics and biomechanics.

[79]  Kunal Pal,et al.  Development of an ultrasonic cane as a navigation aid for the blind people , 2014, 2014 International Conference on Control, Instrumentation, Communication and Computational Technologies (ICCICCT).

[80]  Myounghoon Jeon,et al.  Menu Navigation With In-Vehicle Technologies: Auditory Menu Cues Improve Dual Task Performance, Preference, and Workload , 2015, Int. J. Hum. Comput. Interact..

[81]  Guangtao Zhai,et al.  Lightweight smart glass system with audio aid for visually impaired people , 2015, TENCON 2015 - 2015 IEEE Region 10 Conference.

[82]  Byeong-Seok Shin,et al.  A Wearable Guidance System Incorporating Multiple Sensors for Visually Impaired Persons , 2014 .

[83]  Barbara Tversky,et al.  On Abstraction and Ambiguity , 2015 .

[84]  Guangtao Zhai,et al.  A Flash Light System for Individuals with Visual Impairment Based on TPVM , 2016, 2016 7th International Conference on Cloud Computing and Big Data (CCBD).

[85]  Patrick Olivier,et al.  Exploring the acceptability of google glass as an everyday assistive device for people with parkinson's , 2014, CHI.

[86]  Yitzhak Yitzhaky,et al.  Active confocal imaging for visual prostheses , 2015, Vision Research.

[87]  Luigi F. Cuturi,et al.  Neuroscience and Biobehavioral Reviews , 2022 .

[88]  Mohammad Badrul Alam Miah,et al.  An Obstacle Detection in Order to Reduce Navigation Difficulties for Visually Impaired People , 2017 .

[89]  Andrew J. Kolarik,et al.  Partial Visual Loss Affects Self-reports of Hearing Abilities Measured Using a Modified Version of the Speech, Spatial, and Qualities of Hearing Questionnaire , 2017, Front. Psychol..

[90]  Ron Kupers,et al.  Navigation with a sensory substitution device in congenitally blind individuals , 2011, Neuroreport.

[91]  Petra Poulova,et al.  Google Glass Used as Assistive Technology Its Utilization for Blind and Visually Impaired People , 2017, MobiWIS.

[92]  Guangtao Zhai,et al.  Indoor Localization System for Individuals with Visual Impairment , 2017, IFTC.

[93]  William M. Stern,et al.  Shape conveyed by visual-to-auditory sensory substitution activates the lateral occipital complex , 2007, Nature Neuroscience.

[94]  Amy Zhang,et al.  A review of principles in design and usability testing of tactile technology for individuals with visual impairments , 2017, Assistive technology : the official journal of RESNA.

[95]  John-Ross Rizzo,et al.  Sensor fusion for ecologically valid obstacle identification: Building a comprehensive assistive technology platform for the visually impaired , 2017, 2017 7th International Conference on Modeling, Simulation, and Applied Optimization (ICMSAO).

[96]  Sheetal Malagi,et al.  Smart Cane for the Visually Impaired , 2017 .

[97]  Joongsun Yoon,et al.  A robotic cane based on interactive technology , 2002, IEEE 2002 28th Annual Conference of the Industrial Electronics Society. IECON 02.

[98]  Morton A. Heller,et al.  Pattern Perception and Pictures for the Blind , 2005 .

[99]  Tsuyoshi Murata,et al.  {m , 1934, ACML.

[100]  M. Bedny Evidence from Blindness for a Cognitively Pluripotent Cortex , 2017, Trends in Cognitive Sciences.

[101]  Ming Yu Fan,et al.  A Guide Cane System for Assisting the Blind in Travelling in Outdoor Environments , 2014 .

[102]  Joaquín Salas,et al.  A smartphone-based virtual white cane , 2013, Pattern Analysis and Applications.

[103]  E. Hall,et al.  The Hidden Dimension , 1970 .

[104]  Hiroshi Suzuki,et al.  Conceptual design and implementation of electronic spectacle based obstacle detection for visually impaired persons , 2016 .

[105]  Patrice Voss,et al.  Auditory Spatial Perception without Vision , 2016, Front. Psychol..

[106]  P. Shete,et al.  Smart Stick for Blind using Arduino, Ultrasonic Sensor and Android , 2017 .

[107]  Aaron M. Dollar,et al.  Design and Evaluation of Shape-Changing Haptic Interfaces for Pedestrian Navigation Assistance , 2017, IEEE Transactions on Haptics.

[108]  Jörg Conradt,et al.  A mobility device for the blind with improved vertical resolution using dynamic vision sensors , 2016, 2016 IEEE 18th International Conference on e-Health Networking, Applications and Services (Healthcom).

[109]  Manoj Singh Gaur,et al.  Multiple distance sensors based smart stick for visually impaired people , 2017, 2017 IEEE 7th Annual Computing and Communication Workshop and Conference (CCWC).

[110]  Michael J. Proulx,et al.  Congenital blindness improves semantic and episodic memory , 2013, Behavioural Brain Research.

[111]  Anatole Lécuyer,et al.  HOMERE: a multimodal system for visually impaired people to explore virtual environments , 2003, IEEE Virtual Reality, 2003. Proceedings..

[112]  S. Sivagami,et al.  The Navaid –A Navigation System For Visually Challenged Obstacle Detection Using Ultrasonic Sensors , 2017 .

[113]  Wenjun Chris Zhang,et al.  Design theory and methodology for enterprise systems , 2016, Enterp. Inf. Syst..

[114]  Cang Ye,et al.  Co-Robotic Cane: A New Robotic Navigation Aid for the Visually Impaired , 2016, IEEE Systems, Man, and Cybernetics Magazine.

[115]  Peter Gluchowski,et al.  F , 1934, The Herodotus Encyclopedia.

[116]  M. Proulx,et al.  Visual experience facilitates allocentric spatial representation , 2013, Behavioural Brain Research.

[117]  Yoshihiro Niitsu,et al.  Detection and notification of dangerous obstacles and places for visually impaired persons using a smart cane , 2014, 2014 Seventh International Conference on Mobile Computing and Ubiquitous Networking (ICMU).

[118]  Achille Pasqualotto,et al.  Sensory Substitution: The Spatial Updating of Auditory Scenes “Mimics” the Spatial Updating of Visual Scenes , 2016, Front. Behav. Neurosci..

[119]  T. Nakamura,et al.  Quantitative analysis of gait in the visually impaired. , 1997, Disability and rehabilitation.

[120]  Marimuthu Palaniswami,et al.  A vision-based system to detect potholes and uneven surfaces for assisting blind people , 2016, 2016 IEEE International Conference on Communications (ICC).

[121]  Ruxandra Tapu,et al.  When Ultrasonic Sensors and Computer Vision Join Forces for Efficient Obstacle Detection and Recognition , 2016, Sensors.

[122]  Arthur James Lowery,et al.  Advances in implantable bionic devices for blindness: a review , 2016, ANZ journal of surgery.

[123]  M. Mahadevappa,et al.  Way-finding Electronic Bracelet for visually impaired people , 2013, 2013 IEEE Point-of-Care Healthcare Technologies (PHT).

[124]  K. Turano,et al.  Direction of Gaze while Walking a Simple Route: Persons with Normal Vision and Persons with Retinitis Pigmentosa , 2001, Optometry and vision science : official publication of the American Academy of Optometry.

[125]  BENJAMIN WHITE,et al.  Vision Substitution by Tactile Image Projection , 1969, Nature.

[126]  Peter B. L. Meijer,et al.  An experimental system for auditory image representations , 1992, IEEE Transactions on Biomedical Engineering.

[127]  P. Alam ‘A’ , 2021, Composites Engineering: An A–Z Guide.

[128]  Michael J. Proulx,et al.  The role of visual experience for the neural basis of spatial cognition , 2012, Neuroscience & Biobehavioral Reviews.

[129]  Khaled M. Elleithy,et al.  Sensor-Based Assistive Devices for Visually-Impaired People: Current Status, Challenges, and Future Directions , 2017, Sensors.

[130]  Stefano Pisa,et al.  Serial Patch Array Antenna for an FMCW Radar Housed in a White Cane , 2016 .

[131]  F. Rösler,et al.  Auditory memory in congenitally blind adults: a behavioral-electrophysiological investigation. , 2001, Brain research. Cognitive brain research.

[132]  Amol Sawant,et al.  Smart Cane for Visually Impaired Person by Using Arduino , 2016 .

[133]  Muhammad Sheikh Sadi,et al.  Automated walk-in assistant for the blinds , 2014, 2014 International Conference on Electrical Engineering and Information & Communication Technology.

[134]  Asim Majeed,et al.  Facial Recognition Cane for the Visually Impaired , 2017 .

[135]  P. Alam ‘S’ , 2021, Composites Engineering: An A–Z Guide.

[136]  Xian-Sheng Hua,et al.  Mobile Cloud Visual Media Computing: From Interaction to Service , 2015 .

[137]  Shraga Shoval,et al.  NavBelt and the Guide-Cane [obstacle-avoidance systems for the blind and visually impaired] , 2003, IEEE Robotics Autom. Mag..

[138]  Tong Boon Tang,et al.  Smart Glasses for the Visually Impaired People , 2016, ICCHP.

[139]  P. Stoerig,et al.  Seeing ‘Where’ through the Ears: Effects of Learning-by-Doing and Long-Term Sensory Deprivation on Localization Based on Image-to-Sound Substitution , 2008, PloS one.

[140]  P. Alam,et al.  R , 1823, The Herodotus Encyclopedia.

[141]  Cumhur Erkut,et al.  Design of an audio-based mobile journey planner application , 2011, MindTrek.

[142]  Youngjoon Chee,et al.  A Virtual Blind Cane Using a Line Laser-Based Vision System and an Inertial Measurement Unit , 2016, Sensors.