An experimental system for auditory image representations

An experimental system for the conversion of images into sound patterns was designed to provide auditory image representations within some of the known limitations of the human hearing systems possibly as a step towards the development of a vision substitution device for the blind. The application of an invertible (one-to-one) image-to-sound mapping ensures the preservation of visual information. The system implementation involves a pipelined special-purpose computer connected to a standard television camera. A novel design and the use of standard components have made for a low-cost portable prototype conversion system with a power dissipation suitable for battery operation. Computerized sampling of the system output and subsequent calculation of the approximate inverse (sound-to-image) mapping provided the first convincing experimental evidence for the preservation of visual information in sound representations of complicated images.<<ETX>>

[1]  Minoru Abe,et al.  Electrocutaneous Communication in a Guide Dog Robot (MELDOG) , 1985, IEEE Transactions on Biomedical Engineering.

[2]  M. Mladejovsky,et al.  Artificial Vision for the Blind: Electrical Stimulation of Visual Cortex Offers Hope for a Functional Prosthesis , 1974, Science.

[3]  Raymond M. Fish.  An Audio Display for the Blind , 1976, IEEE Transactions on Biomedical Engineering.

[4]  Frank A. Saunders,et al.  Electrocutaneous Stimulation for Sensory Communication in Rehabilitation Engineering , 1982, IEEE Transactions on Biomedical Engineering.

[5]  Current Developments in Peripheral Auditory Frequency Analysis , 1989 .

[6]  BENJAMIN WHITE,et al.  Vision Substitution by Tactile Image Projection , 1969, Nature.

[7]  Willis J. Tompkins,et al.  A 64-Solenoid, Four-Level Fingertip Search Display for the Blind , 1987, IEEE Transactions on Biomedical Engineering.

[8]  L. Kay,et al.  Electronic Aids for Blind Persons : an Interdisciplinary Subject , 1984 .

[9]  F A Saunders.  Information transmission across the skin: high-resolution tactile sensory aids for the deaf and the blind. , 1983, The International journal of neuroscience.

[10]  A. D. Heyes.  Human navigation by sound , 1983 .

[11]  Willis J. Tompkins,et al.  A Tactile Vision-Substitution System for the Blind: Computer-Controlled Partial Image Sequencing , 1985, IEEE Transactions on Biomedical Engineering.

[12]  John Brabyn,et al.  Developments in Electronic Aids for the Blind and Visually Impaired , 1985, IEEE Engineering in Medicine and Biology Magazine.

[13]  R. Fish.  Visual Substitution Systems: Control and Information Processing Considerations , 1975 .

[14]  D. D. Greenwood.  Critical Bandwidth and the Frequency Coordinates of the Basilar Membrane , 1961 .

[15]  S. S. Stevens,et al.  Critical Band Width in Loudness Summation , 1957 .