Human Spatial Navigation via a Visuo-Tactile Sensory Substitution System

Spatial navigation within a real 3-D maze was investigated to study space perception on the sole basis of tactile information transmitted by means of a ‘tactile vision substitution system' (TVSS) allowing the conversion of optical images—collected by a micro camera—into ‘tactile images’ via a matrix in contact with the skin. The development of such a device is based on concepts of cerebral and functional plasticity, enabling subjective reproduction of visual images from tactile data processing. Blindfolded sighted subjects had to remotely control the movements of a robot on which the TVSS camera was mounted. Once familiarised with the cues in the maze, the subjects were given two exploration sessions. Performance was analysed according to an objective point of view (exploration time, discrimination capacity), as well as a subjective one (speech). The task was successfully carried out from the very first session. As the subjects took a different path during each navigation, a gradual improvement in performance (discrimination and exploration time) was noted, generating a phenomenon of learning. Moreover, subjective analysis revealed an evolution of the spatialisation process towards distal attribution. Finally, some emotional expressions seemed to reflect the genesis of ‘qualia’ (emotional qualities of stimulation).

[1]  G Guarniero,et al.  Experience of Tactile Vision , 1974, Perception.

[2]  Carter C. Collins,et al.  Seeing with the skin , 1970 .

[3]  G Jansson,et al.  Tactile guidance of movement. , 1983, The International journal of neuroscience.

[4]  Nora Kay.  Reaching to Sound , 1980 .

[5]  Eric Hardy.,et al.  Bird Navigation , 1971, Nature.

[6]  Gerard Guarniero,et al.  Tactile Vision: A Personal View , 1977 .

[7]  E. Sampaio,et al.  Is There a Critical Age for Using the Sonicguide with Blind Infants? , 1989 .

[8]  E. R. Strelow,et al.  Electronic Spatial Sensing for the Blind , 1985 .

[9]  Jordan Grafman,et al.  PET imaging of maze processing , 1997, Neuropsychologia.

[10]  J. Gibson.  The Ecological Approach to Visual Perception , 1979 .

[11]  Catherine Marque,et al.  LA SUBSTITUTION SENSORIELLE: LIMITES ET PERSPECTIVES , 2003 .

[12]  P Bach-y-Rita,et al.  Transmission of pictorial information through the skin. , 1973, Advances in biological and medical physics.

[13]  Paul Bach-y-Rita,et al.  Tactile displays , 1995 .

[14]  Ernst Niedermeyer.  Nonsynaptic diffusion, neurotransmission and late brain reorganization , 1995 .

[15]  D H Ashmead,et al.  Obstacle perception by congenitally blind children. , 1989, Perception & psychophysics.

[16]  P. Bach-y-Rita.  Theoretical aspects of sensory substitution and of neurotransmission-related reorganization in spinal cord injury , 1999, Spinal Cord.

[17]  BENJAMIN WHITE,et al.  Vision Substitution by Tactile Image Projection , 1969, Nature.

[18]  Rod McCall,et al.  Measuring presence in virtual environments , 2004, CHI EA '04.

[19]  Paul Bach-y-Rita,et al.  Brain plasticity: ‘visual’ acuity of blind persons via the tongue , 2001, Brain Research.

[20]  S. Hook.  Lighthouse Handbook on Vision Impairment and Vision Rehabilitation , 2001 .

[21]  Joëlle Proust,et al.  Perception et intermodalité , 1997 .

[22]  Daniel R. Weinberger,et al.  Changing patterns of brain activation during maze learning , 1998, Brain Research.

[23]  R. Morris.  Spatial Localization Does Not Require the Presence of Local Cues , 1981 .

[24]  Rene Farcy,et al.  Un profilomètre laser pour la perception de l'espace par les non-voyants A laser profilometer as a space perception system for blind people , 1997 .

[25]  M. Wanet-Defalque,et al.  Auditory coding of visual patterns for the blind. , 1999, Perception.

[26]  Claudia Arias.  L'écholocation humaine chez les handicapés visuels , 1996 .

[27]  Y. Breniere,et al.  La vision est-elle nécessaire pour apprendre à marcher? Etude préliminaire et approche méthodologique , 1989 .

[28]  Neil Burgess,et al.  Human spatial navigation: cognitive maps, sexual dimorphism, and neural substrates , 1999, Current Opinion in Neurobiology.

[29]  G L Aiello,et al.  Multidimensional electrocutaneous stimulation. , 1998, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[30]  G. Brindley.  “Seeing” with Skin , 1973, Nature.