论文信息 - Color Sonification for the Visually Impaired

Color Sonification for the Visually Impaired

Abstract We present a software tool developed to help the visually impaired to perceive characteristics of the environment related to color and luminosity. The tool converts color information extracted from images into sound, where the images can be still images, or video frames from live or stored video. The color information is extracted from the hue, saturation and value attributes, which are mapped into audio attributes directly related to the perception of pitch, timbre and loudness. The tool can be used to gather information about the range of colors present in the images, presence or absence of light sources as well the location and shape of the objects in the images. It is useful for blind people, but it has also applications in other areas such as chemistry and arts.

[1] P. Bach-y-Rita,et al. Sensory substitution and the human–machine interface , 2003, Trends in Cognitive Sciences.

[2] C. Trullemans,et al. A real-time experimental prototype for enhancement of vision rehabilitation using auditory substitution , 1998, IEEE Transactions on Biomedical Engineering.

[3] K. O’regan,et al. There is something out there: distal attribution in sensory substitution, twenty years later. , 2005, Journal of integrative neuroscience.

[4] Nuno Correia,et al. From Color to Sound: Assessing the Surrounding Environment , 2012 .

[5] Peter B. L. Meijer,et al. An experimental system for auditory image representations , 1992, IEEE Transactions on Biomedical Engineering.

[6] Guido Bologna,et al. Sonification of Colour and Depth in a Mobility Aid for Blind People , 2010 .

[7] J. O'Regan,et al. Learning to Perceive with a Visuo — Auditory Substitution System: Localisation and Object Recognition with ‘The Voice’ , 2007, Perception.