Haptic-assistive technologies for audition and vision sensory disabilities

Abstract Purpose: The aim of this review is to analyze haptic sensory substitution technologies for deaf, blind and deaf–blind individuals. Method: The literature search has been performed in Scopus, PubMed and Google Scholar databases using selected keywords, analyzing studies from 1960s to present. Search on databases for scientific publications has been accompanied by web search for commercial devices. Results have been classified by sensory disability and functionality, and analyzed by assistive technology. Complementary analyses have also been carried out on websites of public international agencies, such as the World Health Organization (WHO), and of associations representing sensory disabled persons. Results: The reviewed literature provides evidences that sensory substitution aids are able to mitigate in part the deficits in language learning, communication and navigation for deaf, blind and deaf–blind individuals, and that the tactile sense can be a means of communication to provide some kind of information to sensory disabled individuals. Conclusions: A lack of acceptance emerged from the discussion of capabilities and limitations of haptic assistive technologies. Future researches shall go towards miniaturized, custom-designed and low-cost haptic interfaces and integration with personal devices such as smartphones for a major diffusion of sensory aids among disabled. Implications for rehabilitation Systematic review of state of the art of haptic assistive technologies for vision and audition sensory disabilities. Sensory substitution systems for visual and hearing disabilities have a central role in the transmission of information for patients with sensory impairments, enabling users to interact with the not disabled community in daily activities. Visual and auditory inputs are converted in haptic feedback via different actuation technologies. The information is presented in the form of static or dynamic stimulation of the skin. Their effectiveness and ease of use make haptic sensory substitution systems suitable for patients with different levels of disabilities. They constitute a cheaper and less invasive alternative to implantable partial sensory restitution systems. Future researches are oriented towards the optimization of the stimulation parameters together with the development of miniaturized, custom-designed and low-cost aids operating in synergy in networks, aiming to increase patients’ acceptability of these technologies.

[1]  T. Nikolopoulos,et al.  Determinants of speech perception in children after cochlear implantation , 2000, The Lancet.

[2]  J M Weisenberger,et al.  Evaluation of two multichannel tactile aids for the hearing impaired. , 1989, The Journal of the Acoustical Society of America.

[3]  S. Das,et al.  A low cost microelectromechanical Braille for blind people to communicate with blind or deaf blind people through SMS subsystem , 2013, 2013 3rd IEEE International Advance Computing Conference (IACC).

[4]  Carl F. Lagenaur,et al.  The surface immobilization of the neural adhesion molecule L1 on neural probes and its effect on neuronal density and gliosis at the probe/tissue interface. , 2011, Biomaterials.

[5]  Gesche Joost,et al.  Mobile Lorm Glove: introducing a communication device for deaf-blind people , 2012, TEI.

[6]  Tetsuo Ono,et al.  CyARM: Haptic Sensing Device for Spatial Localization on Basis of Exploration by Arms , 2009, Adv. Hum. Comput. Interact..

[7]  Victor Pikov,et al.  Neuronal loss due to prolonged controlled-current stimulation with chronically implanted microelectrodes in the cat cerebral cortex , 2010, Journal of neural engineering.

[8]  R. H. Gault TOUCH AS A SUBSTITUTE FOR HEARING IN THE INTERPRETATION AND CONTROL OF SPEECH , 1926 .

[9]  Simon Meers,et al.  A substitute vision system for providing 3D perception and GPS navigation via electro-tactile stimulation , 2005 .

[10]  Charles M. Higgins,et al.  A Navigation Aid for the Blind Using Tactile-Visual Sensory Substitution , 2006, 2006 International Conference of the IEEE Engineering in Medicine and Biology Society.

[11]  Hanfeng Yuan,et al.  Tactual display of consonant voicing to supplement lipreading , 2005, The Journal of the Acoustical Society of America.

[12]  Lynette A. Jones,et al.  Development of a tactile vest , 2004, 12th International Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, 2004. HAPTICS '04. Proceedings..

[13]  Monica Gori,et al.  Neuroscience and Biobehavioral Reviews , 2022 .

[14]  Carolyn McGettigan,et al.  Voice Modulation: A Window into the Origins of Human Vocal Control? , 2016, Trends in Cognitive Sciences.

[15]  M. Miyagi,et al.  Analysis of Prosody in Finger Braille Using Electromyography , 2006, 2006 International Conference of the IEEE Engineering in Medicine and Biology Society.

[16]  Richard E. Ladner,et al.  V-braille: haptic braille perception using a touch-screen and vibration on mobile phones , 2010, ASSETS '10.

[17]  G H Yeni-Komshian,et al.  Identification of speech sounds displayed on a vibrotactile vocoder. , 1977, The Journal of the Acoustical Society of America.

[18]  Pruittikorn Smithmaitrie,et al.  Touching force response of the piezoelectric Braille cell , 2007, i-CREATe '07.

[19]  Tsuneshi Isomura,et al.  Finger Braille Recognition System , 2012 .

[20]  D K Oller,et al.  Speech perception by congenitally deaf subjects using an electrocutaneous vocoder. , 1988, Journal of rehabilitation research and development.

[21]  Joaquim A. Jorge,et al.  BrailleType: Unleashing Braille over Touch Screen Mobile Phones , 2011, INTERACT.

[22]  Marion Hersh,et al.  Deafblind people, stigma and the use of communication and mobility assistive devices , 2013 .

[23]  K. Kaczmarek Sensory Augmentation and Substitution , 1999 .

[24]  J.B.F. van Erp,et al.  Providing directional information with tactile torso displays , 2003 .

[25]  B H Brown,et al.  Electrical stimulation at the wrist as an aid for the profoundly deaf. , 1983, Clinical physics and physiological measurement : an official journal of the Hospital Physicists' Association, Deutsche Gesellschaft fur Medizinische Physik and the European Federation of Organisations for Medical Physics.

[26]  Mark Schalock,et al.  Early Identification of Infants Who Are Deaf-Blind. , 2009 .

[27]  R. Johansson,et al.  Tactile sensibility in the human hand: relative and absolute densities of four types of mechanoreceptive units in glabrous skin. , 1979, The Journal of physiology.

[28]  Alberto Mazzoni,et al.  Encapsulation of Piezoelectric Transducers for Sensory Augmentation and Substitution with Wearable Haptic Devices , 2017, Micromachines.

[29]  G. Hickok,et al.  The human auditory system : fundamental organization and clinical disorders , 2015 .

[30]  Stanislao Rizzo,et al.  The Argus II Retinal Prosthesis: 12-month outcomes from a single-study center. , 2014, American journal of ophthalmology.

[31]  Christian Cipriani,et al.  PARLOMA – A Novel Human-Robot Interaction System for Deaf-Blind Remote Communication , 2015 .

[32]  David A. Ross,et al.  Wearable interfaces for orientation and wayfinding , 2000, Assets '00.

[33]  Stephen A. Brewster,et al.  Feeling what you hear: tactile feedback for navigation of audio graphs , 2006, CHI.

[34]  A. E. Edmonds,et al.  Investigating the MESA (multipoint electrotactile speech aid): the transmission of segmental features of speech. , 1978, The Journal of the Acoustical Society of America.

[35]  Massimo Ferri,et al.  Vibrotactile color rendering for the visually impaired within the VIDET project , 1998, Other Conferences.

[36]  W.J. Tompkins,et al.  Electrotactile and vibrotactile displays for sensory substitution systems , 1991, IEEE Transactions on Biomedical Engineering.

[37]  Hui Tang,et al.  An oral tactile interface for blind navigation , 2006, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[38]  P J Blamey,et al.  A comparison of Tactaid II+ and Tactaid 7 use by adults with a profound hearing impairment. , 1999, Ear and hearing.

[39]  P. Bach-y-Rita,et al.  Form perception with a 49-point electrotactile stimulus array on the tongue: a technical note. , 1998, Journal of rehabilitation research and development.

[40]  E P Gardner,et al.  Simulation of motion on the skin. I. Receptive fields and temporal frequency coding by cutaneous mechanoreceptors of OPTACON pulses delivered to the hand. , 1989, Journal of neurophysiology.

[41]  S. Lucyszyn,et al.  A micromachined refreshable braille cell , 2005, Journal of Microelectromechanical Systems.

[42]  Mark Hollins,et al.  Understanding Blindness: An Integrative Approach , 1989 .

[43]  M. Kringlebotn Experiments with some visual and vibrotactile aids for the deaf. , 1968, American annals of the deaf.

[44]  George A. Gescheider,et al.  Some Comparisons between Touch and Hearing , 1970 .

[45]  S Weinstein,et al.  Intensive and extensive aspects of tactile sensitivity as a function of body part, sex, and laterality , 1968 .

[46]  Lynne E. Bernstein,et al.  OMAR a haptic display for speech perception by deaf and deaf-blind individuals , 1993, Proceedings of IEEE Virtual Reality Annual International Symposium.

[47]  A. Hagr BAHA: Bone-Anchored Hearing Aid. , 2007, International journal of health sciences.

[48]  Louis H. Goldish,et al.  The Optacon: A Valuable Device for Blind Persons , 1974 .

[49]  Daniel Thalmann,et al.  A wearable system for mobility improvement of visually impaired people , 2007, The Visual Computer.

[50]  B L Richardson,et al.  Tactile discrimination of competing sounds , 1978, Perception & psychophysics.

[51]  Richard Lieber,et al.  Rehabilitation engineering , 2007, Annals of Biomedical Engineering.

[52]  P J Blamey,et al.  Preliminary evaluation of a multichannel electrotactile speech processor. , 1988, The Journal of the Acoustical Society of America.

[53]  D. Harrison Causes of Hearing Loss , 1971 .

[54]  Tohru Ifukube,et al.  Tactile pitch feedback system for deafblind or hearing impaired persons singing accuracy of hearing persons under conditions of added noise , 2014, 2014 IEEE Symposium on Computational Intelligence in Robotic Rehabilitation and Assistive Technologies (CIR2AT).

[55]  C M Reed,et al.  Research on the Tadoma method of speech communication. , 1983, The Journal of the Acoustical Society of America.

[56]  M. J. Osberger,et al.  Comparison of multichannel tactile aids and multichannel cochlear implants in children with profound hearing impairments. , 1995, The American journal of otology.

[57]  J. Moorhouse,et al.  Touch-perception thresholds in blind diabetic subjects in relation to the reading of Braille type. , 1969, The New England journal of medicine.

[58]  K O Johnson,et al.  Tactile spatial resolution. I. Two-point discrimination, gap detection, grating resolution, and letter recognition. , 1981, Journal of neurophysiology.

[59]  D. Morris,et al.  The common causes of hearing loss in adults. , 2000, The Practitioner.

[60]  T. Homma,et al.  Development of a piezoelectric actuator for presentation of various tactile stimulation patterns to fingerpad skin , 2004, The 26th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[61]  Miltiadis K. Hatalis,et al.  Tactile displays: Overview and recent advances , 2008, Displays.

[62]  W. D. Stratton Intonation Feedback for the Deaf Through a Tactile Display. , 1974 .

[63]  R. Johansson Tactile sensibility in the human hand: receptive field characteristics of mechanoreceptive units in the glabrous skin area. , 1978, The Journal of physiology.

[64]  Luca Fanucci,et al.  Improving Mobility of Pedestrian Visually-Impaired Users , 2011 .

[65]  Vincent Hayward,et al.  STReSS: A Practical Tactile Display System with One Millimeter Spatial Resolution and 700 Hz Refresh Rate , 2003 .

[66]  P. Rasmussen The congenital insensitivity-to-pain syndrome (analgesia congenita): report of a case. , 2009, International journal of paediatric dentistry.

[67]  Speech communication for the deaf: visual, tactile, and cochlear-implant. , 1986 .

[68]  Sabine Reinfeldt,et al.  New developments in bone-conduction hearing implants: a review , 2015, Medical devices.

[69]  M. Goldstein,et al.  Tactile aids for profoundly deaf children. , 1985, The Journal of the Acoustical Society of America.

[70]  Malekzzi A man-machine vision interface for sensing the environment , 2005 .

[71]  S. Akhter,et al.  A Smartphone-based Haptic Vision Substitution system for the blind , 2011, 2011 IEEE 37th Annual Northeast Bioengineering Conference (NEBEC).

[72]  Steve Mann,et al.  Blind navigation with a wearable range camera and vibrotactile helmet , 2011, ACM Multimedia.

[73]  M. Bouzit,et al.  Evaluation of RU-Netra - Tactile Feedback Navigation System For The Visually Impaired , 2006, 2006 International Workshop on Virtual Rehabilitation.

[74]  Daniel P. Siewiorek,et al.  Design of a wearable tactile display , 2001, Proceedings Fifth International Symposium on Wearable Computers.

[75]  Vincent Lévesque Blindness, Technology and Haptics , 2005 .

[76]  Paul Bach-y-Rita,et al.  Neurophysiological Basis of a Tactile Vision-Substitution System , 1970 .

[77]  P L Brooks,et al.  Evaluation of a tactile vocoder for work recognition. , 1983, The Journal of the Acoustical Society of America.

[78]  BENJAMIN WHITE,et al.  Vision Substitution by Tactile Image Projection , 1969, Nature.

[79]  Arne Risberg,et al.  A critical review of work on speech analyzing hearing aids , 1969 .

[80]  Carlos Delgado-Mata,et al.  Vibrating insoles for tactile communication with the feet , 2011, 2011 15th International Conference on Advanced Robotics (ICAR).

[81]  Tohru Ifukube,et al.  Voice pitch control using tactile feedback for the deafblind or the hearing impaired persons to assist their singing , 2010, 2010 IEEE International Conference on Systems, Man and Cybernetics.

[82]  Marjorie Darrah,et al.  Haptics-Based Apps for Middle School Students with Visual Impairments , 2015, IEEE Transactions on Haptics.

[83]  Andrew W. Haines Definition of disability. , 2013, Benefits quarterly.

[84]  Richard Foulds,et al.  American Sign Language finger spelling recognition system , 2003, 2003 IEEE 29th Annual Proceedings of Bioengineering Conference.

[85]  Alberto Caballero-Ruiz,et al.  Prótesis de substitución sensorial visual para pacientes ciegos , 2009 .

[86]  Ramiro Velazquez,et al.  A shoe-integrated tactile display for directional navigation , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[87]  D. Markle,et al.  Hearing Aids , 1936, The Journal of Laryngology & Otology.

[88]  N Marangos,et al.  COCHLEAR IMPLANTS , 1976, The Lancet.

[89]  Tanay Choudhary,et al.  A Braille-based mobile communication and translation glove for deaf-blind people , 2015, 2015 International Conference on Pervasive Computing (ICPC).

[90]  Van Boven RW,et al.  Tactile spatial resolution in blind braille readers(1) , 2000, American journal of ophthalmology.

[91]  L. Pimonow La Parole Synthétique et son Application Dans la Correction Auditive , 1965 .

[92]  Roberto Manduchi,et al.  A Tool for Range Sensing and Environment Discovery for the Blind , 2004, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[93]  Tohru Ifukube,et al.  Voice pitch control ability of hearing persons with or without tactile feedback using a two-dimensional tactile display system , 2011, 2011 IEEE International Conference on Systems, Man, and Cybernetics.

[94]  Etienne Burdet,et al.  Deaf-Blind Can Practise Horse Riding with the Help of Haptics , 2016, EuroHaptics.

[95]  David J. Calder,et al.  Ecological solutions for the blind , 2010, 4th IEEE International Conference on Digital Ecosystems and Technologies.

[96]  Aiguo Song,et al.  A vibro-tactile system for image contour display , 2011, 2011 IEEE International Symposium on VR Innovation.

[97]  Thomas Ertl,et al.  Making Digital Maps Accessible Using Vibrations , 2010, ICCHP.

[98]  F. Khan,et al.  A Wireless Navigation System For the Visually Impaired , 2015 .

[99]  Gabrielle H. Saunders,et al.  An Overview of Dual Sensory Impairment in Older Adults: Perspectives for Rehabilitation , 2007, Trends in amplification.

[100]  Lynette A. Jones,et al.  Tactile Displays: Guidance for Their Design and Application , 2008, Hum. Factors.

[101]  M. Sile O'Modhrain,et al.  Refreshing Refreshable Braille Displays , 2015, IEEE Transactions on Haptics.

[102]  Arthur Boothroyd,et al.  A wearable tactile intonation display for the deaf , 1985, IEEE Trans. Acoust. Speech Signal Process..

[103]  Carter C. Collins,et al.  On Mobility Aids for the Blind , 1985 .

[104]  Nikolaos G. Bourbakis,et al.  Wearable Obstacle Avoidance Electronic Travel Aids for Blind: A Survey , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[105]  Shiri Azenkot,et al.  Improving public transit usability for blind and deaf-blind people by connecting a braille display to a smartphone , 2010, ASSETS '10.

[106]  Deborah I. Fels,et al.  Composing vibrotactile music: A multi-sensory experience with the emoti-chair , 2012, 2012 IEEE Haptics Symposium (HAPTICS).

[107]  Emerson Foulke,et al.  Tactile acuity, aging, and braille reading in long-term blindness , 1996 .

[108]  Paul Bach-y-Rita,et al.  Seeing with the Brain , 2003, Int. J. Hum. Comput. Interact..

[109]  Aaron M. Dollar,et al.  Design and Evaluation of Shape-Changing Haptic Interfaces for Pedestrian Navigation Assistance , 2017, IEEE Transactions on Haptics.

[110]  Janet M. Weisenberger,et al.  Evaluation of a 32‐channel electrotactile vocoder , 1989 .

[111]  Georg v. Békésy,et al.  Human Skin Perception of Traveling Waves Similar to Those on the Cochlea , 1955 .

[112]  Tomohiro Amemiya,et al.  Design of a Haptic Direction Indicator for Visually Impaired People in Emergency Situations , 2008, ICCHP.

[113]  Sudhanshu Kumar Semwal,et al.  Shapes: A multi-sensory environment for the B/VI and hearing impaired community , 2014, 2014 2nd Workshop on Virtual and Augmented Assistive Technology (VAAT).

[114]  E. Pissaloux,et al.  Coding the Environment in Tactile Maps for Real-Time Guidance of the Visually Impaired , 2006, 2006 IEEE International Symposium on MicroNanoMechanical and Human Science.

[115]  Antonio Frisoli,et al.  The Museum of Pure Form: touching real statues in an immersive virtual museum , 2004, VAST.

[116]  N Sugie,et al.  Tactile-audio diagram for blind persons. , 1996, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[117]  M. Wickremaratchi,et al.  Effects of ageing on touch , 2006, Postgraduate Medical Journal.

[118]  Sharmistha Roy,et al.  SPARSHA: A Low Cost Refreshable Braille for Deaf-Blind People for Communication with Deaf-Blind and Non-disabled Persons , 2013, ICDCIT.

[119]  Katherine J. Kuchenbecker,et al.  HALO: Haptic Alerts for Low-hanging Obstacles in white cane navigation , 2012, 2012 IEEE Haptics Symposium (HAPTICS).

[120]  T. Willemain,et al.  Tactile Pitch Feedback for Deaf Speakers. , 1971 .

[121]  R. Canalis,et al.  The Ear: Comprehensive Otology , 2000 .

[122]  J. Zelek,et al.  A Stereo-vision System for the Visually Impaired , 2000 .

[123]  Marc L. Bennett,et al.  Cochlear implantation: a biomechanical prosthesis for hearing loss , 2015, F1000prime reports.

[124]  P. König,et al.  Beyond sensory substitution—learning the sixth sense , 2005, Journal of neural engineering.

[125]  Sunita Ram,et al.  The people sensor: a mobility aid for the visually impaired , 1998, Digest of Papers. Second International Symposium on Wearable Computers (Cat. No.98EX215).

[126]  Beryl Plimmer,et al.  Signing on the tactile line: A multimodal system for teaching handwriting to blind children , 2011, TCHI.

[127]  James C. Bliss,et al.  Optical-to-Tactile Image Conversion for the Blind , 1970 .

[128]  V. Hayward,et al.  Segregation of Tactile Input Features in Neurons of the Cuneate Nucleus , 2014, Neuron.

[129]  Matthias Harders,et al.  Identification of Vibrotactile Patterns Encoding Obstacle Distance Information , 2015, IEEE Transactions on Haptics.

[130]  Christian Cipriani,et al.  Real-Time Single Camera Hand Gesture Recognition System for Remote Deaf-Blind Communication , 2014, AVR.

[131]  Hyoukryeol Choi,et al.  Development of Soft-Actuator-Based Wearable Tactile Display , 2008, IEEE Transactions on Robotics.

[132]  Gordon E. Legge,et al.  Designing Media for Visually-Impaired Users of Refreshable Touch Displays: Possibilities and Pitfalls , 2015, IEEE Transactions on Haptics.

[133]  M. J. Osberger,et al.  Speech perception abilities of children with cochlear implants, tactile aids, or hearing aids. , 1991, The American journal of otology.

[134]  Hendrik A. H. C. van Veen,et al.  Waypoint navigation with a vibrotactile waist belt , 2005, TAP.

[135]  Ziad O. Abu-Faraj,et al.  Design and development of a prototype rehabilitative shoes and spectacles for the blind , 2012, 2012 5th International Conference on BioMedical Engineering and Informatics.

[136]  Joel C. Huegel,et al.  MyVox—Device for the communication between people: blind, deaf, deaf-blind and unimpaired , 2014, IEEE Global Humanitarian Technology Conference (GHTC 2014).

[137]  R. W. Guelke,et al.  Development of Apparatus for the Analysis of Sound by the Sense of Touch , 1959 .

[138]  Iain Murray,et al.  An electronic design of a low cost Braille typewriter , 2001, The Seventh Australian and New Zealand Intelligent Information Systems Conference, 2001.

[139]  Siegfried Engelmann,et al.  Tactual Hearing Experiment with Deaf and Hearing Subjects , 1975 .

[140]  Carl E. Sherrick,et al.  Basic and applied research on tactile aids for deaf people: Progress and prospects , 1984 .

[141]  J. C. Cunha,et al.  A Novel Instrumentation to Investigate the Alternative Tactile Communication through Mechanical Stimulation Using CO 2 Jets , 2015 .

[142]  Koji Tsukada,et al.  ActiveBelt: Belt-Type Wearable Tactile Display for Directional Navigation , 2004, UbiComp.

[143]  Ziad O. Abu-Faraj,et al.  Handbook of Research on Biomedical Engineering Education and Advanced Bioengineering Learning: Interdisciplinary Concepts , 2012 .

[144]  F. A. Geldard Adventures in tactile literacy. , 1957 .

[145]  N. A. Bradley,et al.  Assistive Technology For Visually Impaired And Blind People , 2008 .

[146]  Ramiro Velazquez,et al.  Preliminary evaluation of podotactile feedback in sighted and blind users , 2010, 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology.

[147]  Suranga Nanayakkara,et al.  The haptic chair as a speech training aid for the deaf , 2012, OZCHI.

[148]  Suranga Nanayakkara,et al.  Effectiveness of the haptic chair in speech training , 2012, ASSETS '12.

[149]  Denise Filippo,et al.  Hey yaa: A Haptic Warning Wearable to Support Deaf People Communication , 2011, CRIWG.

[150]  Vincent Hayward,et al.  Spatio-temporal skin strain distributions evoke low variability spike responses in cuneate neurons , 2014, Journal of The Royal Society Interface.

[151]  R. Gassert,et al.  Augmented white cane with multimodal haptic feedback , 2010, 2010 3rd IEEE RAS & EMBS International Conference on Biomedical Robotics and Biomechatronics.

[152]  C W Garland Sensory devices for the blind. , 1977, Journal of medical engineering & technology.

[153]  Lynette A. Jones,et al.  Tactile display and vibrotactile pattern recognition on the torso , 2006, Adv. Robotics.

[154]  R. Johansson,et al.  Properties of cutaneous mechanoreceptors in the human hand related to touch sensation. , 1984, Human neurobiology.

[155]  Masayoshi Esashi,et al.  Dynamic Braille display using SMA coil actuator and magnetic latch , 2005 .

[156]  Mandayam A. Srinivasan,et al.  BlindAid: Virtual environment system for self-reliant trip planning and orientation and mobility training , 2010, 2010 IEEE Haptics Symposium.

[157]  Vincent Hayward,et al.  Tactile Display Device Using Distributed Lateral Skin Stretch , 2000, Dynamic Systems and Control: Volume 2.

[158]  E. Zrenner Will Retinal Implants Restore Vision ? , 2002 .

[159]  Soh-Khim Ong,et al.  A multiple sensor-based shoe-mounted user interface designed for navigation systems for the visually impaired , 2010, 2010 The 5th Annual ICST Wireless Internet Conference (WICON).

[160]  Christopher Rose,et al.  Interactive Navigation System for the Visually Impaired with Auditory and Haptic Cues in Crosswalks, Indoors and Urban Areas , 2015, HCI.

[161]  M L Max,et al.  Blind persons navigate in virtual reality (VR); hearing and feeling communicates "reality". , 1997, Studies in health technology and informatics.

[162]  J M Pickett,et al.  Auditory implants and tactile aids for the profoundly deaf. , 1985, Journal of speech and hearing research.

[163]  D. Durand,et al.  A novel integrable microvalve for refreshable Braille display system , 2003 .

[164]  D. Edell,et al.  Factors influencing the biocompatibility of insertable silicon microshafts in cerebral cortex , 1992, IEEE Transactions on Biomedical Engineering.

[165]  Lynette A. Jones,et al.  An actuator for the tactile vest - a torso-based haptic device , 2003, 11th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, 2003. HAPTICS 2003. Proceedings..

[166]  M. D. Evans,et al.  A multifunction domestic alert system for the deaf-blind , 1995 .

[167]  A. Levey,et al.  Implanted neural electrodes cause chronic, local inflammation that is correlated with local neurodegeneration , 2009, Journal of neural engineering.

[168]  Eelke Folmer,et al.  A tactile-proprioceptive communication aid for users who are deafblind , 2014, 2014 IEEE Haptics Symposium (HAPTICS).

[169]  Robert H. Gault,et al.  Tactual Patterns from Certain Vowel Qualities Instrumentally Communicated from a Speaker to a Subject's Fingers , 1928 .

[170]  Carter C. Collins,et al.  Tactile Television - Mechanical and Electrical Image Projection , 1970 .

[171]  Arthur C. Grant,et al.  Tactile perception in blind Braille readers: A psychophysical study of acuity and hyperacuity using gratings and dot patterns , 2000, Perception & psychophysics.

[172]  Nobuyuki Sasaki,et al.  Communication System between Deaf-Blind People and Non-Disabled People Using Body-Braille and Infrared Communication , 2010, 2010 7th IEEE Consumer Communications and Networking Conference.

[173]  Kathryn Ziegler-Graham,et al.  Estimating the prevalence of limb loss in the United States: 2005 to 2050. , 2008, Archives of physical medicine and rehabilitation.

[174]  H. Hartung,et al.  Autosomal dominant inherited neuropathies with prominent sensory loss and mutilations: a review. , 2003, Archives of neurology.

[175]  E. Emerson,et al.  Estimating the number of people with co-occurring vision and hearing impairments in the UK , 2010 .

[176]  S. Liebowitz Retinitis pigmentosa. , 1979, Journal - American Intra-Ocular Implant Society.

[177]  Percy Nohama,et al.  Tactile communication using a CO2 flux stimulation for blind or deafblind people , 2010, 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology.

[178]  Chikamune Wada Proposal and evaluation of the sweeping display of the speech spectrum for a tactile vocoder used by the profoundly hearing impaired , 1996 .

[179]  Vincent Hayward,et al.  Display of virtual braille dots by lateral skin deformation: feasibility study , 2005, TAP.

[180]  K. Burger Sign Language The Study Of Deaf People And Their Language , 2016 .

[181]  Michitaka Hirose,et al.  Virtual leading blocks for the deaf-blind: a real-time way-finder by verbal-nonverbal hybrid interface and high-density RFID tag space , 2004, IEEE Virtual Reality 2004.

[182]  Lorna M. Brown,et al.  Tactons: Structured Tactile Messages for Non-Visual Information Display , 2004, AUIC.

[183]  Constantinos Mavroidis,et al.  Tactile Feedback Navigation Handle for the Visually Impaired , 2004 .

[184]  Lorna M. Brown,et al.  Non-visual information display using tactons , 2004, CHI EA '04.

[185]  Leonardo Badia,et al.  A Multimodal Interface Device for Online Board Games Designed for Sight-Impaired People , 2010, IEEE Transactions on Information Technology in Biomedicine.

[186]  Barbara Leporini,et al.  Vibrotactile feedback as an orientation aid for blind users of mobile guides , 2008, Mobile HCI.

[187]  Roberto Manduchi,et al.  Vibrotactile Guidance for Wayfinding of Blind Walkers , 2015, IEEE Transactions on Haptics.

[188]  Nicholas Caporusso,et al.  A wearable Malossi alphabet interface for deafblind people , 2008, AVI '08.

[189]  Chung Hyuk Park,et al.  Telerobotic Haptic Exploration in Art Galleries and Museums for Individuals with Visual Impairments , 2015, IEEE Transactions on Haptics.

[190]  V. Balasubramanian,et al.  Using a haptic belt to convey non-verbal communication cues during social interactions to individuals who are blind , 2008, 2008 IEEE International Workshop on Haptic Audio visual Environments and Games.

[191]  K Gangadhara Somayaji,et al.  Middle ear implants , 2013 .

[192]  Deborah I. Fels,et al.  Modelling Perceptual Elements of Music in a Vibrotactile Display for Deaf Users: A Field Study , 2009, 2009 Second International Conferences on Advances in Computer-Human Interactions.

[193]  Á. Pascual-Leone,et al.  Tactile spatial resolution in blind Braille readers , 2000, Neurology.

[194]  N Guttman,et al.  An instrument that creates some artificial speech spectra for the severely hard of hearing. , 1968, American annals of the deaf.

[195]  Ali Israr,et al.  Tactile display for the visually impaired using TeslaTouch , 2011, CHI Extended Abstracts.

[196]  Luís Carriço,et al.  UbiBraille: designing and evaluating a vibrotactile Braille-reading device , 2013, ASSETS.

[197]  Stefan Egersdörfer,et al.  Modelling the response of a tactile array using electrorheological fluids , 2004 .

[198]  Miltiadis K. Hatalis,et al.  Tactile display applications: a state of the art survey , 2005 .

[199]  J. Pickett,et al.  COMMUNICATION OF SPEECH SOUNDS BY A TACTUAL VOCODER. , 1963, Journal of speech and hearing research.

[200]  David C. Martin,et al.  Neuronal cell loss accompanies the brain tissue response to chronically implanted silicon microelectrode arrays , 2005, Experimental Neurology.

[201]  J M Pickett Speech communication for the deaf: visual, tactile, and cochlear-implant. , 1986, Journal of rehabilitation research and development.

[202]  Arthur James Lowery,et al.  Restoration of vision in blind individuals using bionic devices: A review with a focus on cortical visual prostheses , 2015, Brain Research.

[203]  Makoto Kobayashi,et al.  A Tactile Display System Equipped with a Pointing Device - MIMIZU , 2002, ICCHP.

[204]  François Routhier,et al.  Field testing of two electronic mobility aid devices for persons who are deaf-blind , 2014, Disability and rehabilitation. Assistive technology.

[205]  Tomohiro Amemiya,et al.  Wearable Finger-Braille Interface for Navigation of Deaf-Blind in Ubiquitous Barrier-Free Space , 2003 .

[206]  M. J. Osberger,et al.  Hearing handicap as a function of central auditory abilities in the elderly. , 1991 .

[207]  Nick Bryan-Kinns,et al.  Mood Glove: A haptic wearable prototype system to enhance mood music in film , 2016, Entertain. Comput..

[208]  David Travieso,et al.  Stepping on Obstacles with a Sensory Substitution Device on the Lower Leg: Practice without Vision Is More Beneficial than Practice with Vision , 2014, PloS one.

[209]  G A Gescheider,et al.  Cutaneous sound localization. , 1965, Journal of experimental psychology.

[210]  Nikolaos G. Bourbakis,et al.  A 2D Vibration Array as an Assistive Device for Visually Impaired , 2007, 2007 IEEE 7th International Symposium on BioInformatics and BioEngineering.

[211]  Tohru Ifukube,et al.  Effect of voice pitch control training using a two-dimensional tactile feedback display system , 2012, 2012 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[212]  Jin Sook Kim,et al.  A Review of Assistive Listening Device and Digital Wireless Technology for Hearing Instruments , 2014, Korean journal of audiology.

[213]  K E Spens,et al.  A hand held two-channel vibro-tactile speech communication aid for the deaf: characteristics and results. , 1997, Scandinavian audiology. Supplementum.

[214]  J. Harkins,et al.  Vibration signaling in mobile devices for emergency alerting: a study with deaf evaluators. , 2010, Journal of deaf studies and deaf education.

[215]  S. Bolanowski,et al.  Four channels mediate the mechanical aspects of touch. , 1988, The Journal of the Acoustical Society of America.

[216]  Yon Visell,et al.  Tactile sensory substitution: Models for enaction in HCI , 2009, Interact. Comput..

[217]  Christophe Jouffrais,et al.  Guiding Blind People with Haptic Feedback , 2012 .

[218]  Stefano Mattoccia,et al.  Perception of depth information by means of a wire-actuated haptic interface , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[219]  Ralph Etienne-Cummings,et al.  A color detection glove with haptic feedback for the visually disabled , 2009, 2009 43rd Annual Conference on Information Sciences and Systems.