VisibleSound: Perceiving Environmental Sound with 4D Form

The progression of application software and high-speed Internet access has, in general, the ability to commonly engage synesthetic experience. However, current synesthesia systems do not meet their full potential, as they are restricted by the simple display of non-intelligent two-dimensional form. This paper is going to present a system for enhancing visual and auditory attributes connection by augmenting the traditional sound visualization system with natural perceptual properties beyond two-dimensional space. A method of expanding the analysis capabilities of the system over changes in the frequencies and sound pressure levels of the live environmental sound stream was explored. With this method, a semantically rich four-dimensional form of sound containing information regarding audio properties and location could be generated. Some specific scenarios are discussed in order to explore visual form of natural perception of environmental sounds, multimedia voice and musical performance.