Fitting a bionic eye to the body: how haptics can help

The function of any visual prosthetic will be to generate patterned stimulation of the visual cortex arising from either direct stimulation e.g. using cortical implants or more peripheral inputs e.g. an artificial retina. Direct cortical stimulation may result in patterns containing relatively few elements say 10-100 while an artificial retina may deliver more complex patterns. We propose that regardless of the site of intervention, a tactile copy of the input, delivered to the skin at the same time as it is sent to the visual cortex, will offer significant advantages, especially during early stages of testing and development in which the user must 'make sense' of the novel input. The advantages of such a display include: 1 exploitation of multisensory processes such as cross-calibration, learning to discriminate sub-threshold stimuli and perceptual redundancy, 2 a means of measuring strengths and weaknesses of the prosthetic's visual input and evaluation of improvements and 3 a way of quickly adapting the congenitally-or late-blind user to the prosthetic.

[1]  O. Périer,et al.  A prosthetic device utilizing vibro-tactile perception of profoundly deaf children. , 1982, British journal of audiology.

[2]  D. Bavelier,et al.  Cross-modal plasticity: where and how? , 2002, Nature Reviews Neuroscience.

[3]  Ian R Summers,et al.  A broadband tactile array on the fingertip. , 2002, The Journal of the Acoustical Society of America.

[4]  G. Rizzolatti,et al.  Mirrors in the Brain: How Our Minds Share Actions and Emotions , 2007 .

[5]  R. Klatzky,et al.  Haptic integration of object properties: texture, hardness, and planar contour. , 1989, Journal of experimental psychology. Human perception and performance.

[6]  P. Haggard,et al.  Viewing the body modulates tactile receptive fields , 2007, Experimental Brain Research.

[7]  P. Haggard,et al.  The Posterior Parietal Cortex Remaps Touch into External Space , 2010, Current Biology.

[8]  C. Frith,et al.  Modulation of human visual cortex by crossmodal spatial attention. , 2000, Science.

[9]  B J Frost,et al.  Sensory substitution and the design of an artificial ear. , 1977, The Journal of psychology.

[10]  David C. Burr,et al.  Young Children Do Not Integrate Visual and Haptic Form Information , 2008, Current Biology.

[11]  Neil Burgess,et al.  Integrating hippocampal and parietal functions: a spatial point of view , 1998 .

[12]  A. Markides.  Age at fitting of hearing aids and speech intelligibility. , 1986, British journal of audiology.

[13]  L. Merabet,et al.  What blindness can tell us about seeing again: merging neuroplasticity and neuroprostheses , 2005, Nature Reviews Neuroscience.

[14]  BENJAMIN WHITE,et al.  Vision Substitution by Tactile Image Projection , 1969, Nature.

[15]  Susanna Millar,et al.  Network models for haptic perception , 2005 .

[16]  P. Haggard,et al.  Visual enhancement of touch in spatial body representation , 2003, Experimental Brain Research.

[17]  H. Ackermann,et al.  Enhanced speech perception capabilities in a blind listener are associated with activation of fusiform gyrus and primary visual cortex , 2009, Neurocase.

[18]  L. Merabet,et al.  Visual Phosphene Perception Modulated by Subthreshold Crossmodal Sensory Stimulation , 2007, The Journal of Neuroscience.

[19]  G. Brindley,et al.  The sensations produced by electrical stimulation of the visual cortex , 1968, The Journal of physiology.

[20]  Richards Bl.  Tactile hearing aids may enhance cortical connections. , 1986 .

[21]  G Guarniero,et al.  Experience of Tactile Vision , 1974, Perception.

[22]  E. Eskandar,et al.  Getting signals into the brain: visual prosthetics through thalamic microstimulation. , 2009, Neurosurgical focus.

[23]  L. Marks,et al.  Cross-Modal Interaction between Vision and Touch: The Role of Synesthetic Correspondence , 2000, Perception.

[24]  P. Haggard,et al.  Noninformative vision improves the spatial resolution of touch in humans , 2001, Current Biology.

[25]  P F Seitz,et al.  The use of visible speech cues for improving auditory detection of spoken sentences. , 2000, The Journal of the Acoustical Society of America.

[26]  J. Rizzo,et al.  Outer retinal degeneration: an electronic retinal prosthesis as a treatment strategy. , 2004, Archives of ophthalmology.

[27]  N H Lovell,et al.  The bionic eye (electronic visual prosthesis): a review. , 1998, Australian and New Zealand journal of ophthalmology.

[28]  Yon Visell,et al.  Tactile sensory substitution: Models for enaction in HCI , 2009, Interact. Comput..

[29]  R. Wilton,et al.  Grouping by Proximity or Similarity? Competition between the Gestalt Principles in Vision , 1998, Perception.

[30]  C. Gross,et al.  The representation of extrapersonal space: A possible role for bimodal, visual-tactile neurons , 1995 .

[31]  M. Heller.  Haptic Dominance in Form Perception: Vision versus Proprioception , 1992, Perception.

[32]  P L Brooks,et al.  Continuing evaluation of the Queen's University tactile vocoder II: Identification of open set sentences and tracking narrative. , 1986, Journal of rehabilitation research and development.

[33]  I. Wickelgren.  A Vision for the Blind , 2006, Science.

[34]  Knut Drewing,et al.  Human Haptic Perception and the Design of Haptic-Enhanced Virtual Environments , 2008, The Sense of Touch and its Rendering.

[35]  Justin Boyle.  Improving Perception From Electronic Visual Prostheses , 2005 .

[36]  S B Waltzman,et al.  Telephone Speech Comprehension with Use of the Nucleus Cochlear Implant , 1989, The Annals of otology, rhinology & laryngology. Supplement.

[37]  V J Manyam,et al.  A Psychophysical Measure of Visual and Kinaesthetic Spatial Discriminative Abilities of Adults and Children , 1986, Perception.

[38]  E. Zrenner.  Will Retinal Implants Restore Vision ? , 2002 .

[39]  Jason Dowling,et al.  Artificial human vision , 2005, Expert review of medical devices.

[40]  R. Held,et al.  MOVEMENT-PRODUCED STIMULATION IN THE DEVELOPMENT OF VISUALLY GUIDED BEHAVIOR. , 1963, Journal of comparative and physiological psychology.

[41]  Lars Muckli,et al.  Cortical Plasticity of Audio–Visual Object Representations , 2008, Cerebral cortex.

[42]  Ethan D Cohen,et al.  Prosthetic interfaces with the visual system: biological issues , 2007, Journal of neural engineering.

[43]  M A Heller,et al.  Haptic Dominance in Form Perception with Blurred Vision , 1983, Perception.