Sonic panoramas: experiments with interactive landscape image sonification

This paper describes research into the sonification of large-scale landscape imagery. Techniques for image sonification are coupled with users' physical navigation of the image data and a visual representation of the correspondence between the image and sound. One application of this research, an interactive art installation titled Sonic Panoramas, is discussed. Through the use of vision-based motion tracking, immersive projection, image analysis and real-time spatialized sound, a multi-modal representation of landscape image data is deployed.

[1]  Kees van den Doel,et al.  SOUNDVIEW: SENSING COLOR IMAGES BY KINESTHETIC AUDIO , 2003 .

[2]  Paul Dourish,et al.  From Interaction to Participation: Configuring Space Through Embodied Interaction , 2005, UbiComp.

[3]  R. Wechsler.  EyeCon-- a motion sensing tool for creating interactive dance , music and video projections , 2004 .

[4]  Maia Engeli,et al.  "living-room": interactive, space-oriented augmented reality , 2004, MULTIMEDIA '04.

[5]  Patrick Roth,et al.  Graphics and User's Exploration via Simple Sonics (GUESS): Providing Interrelational Representation of Objects in a Non-visual Environment , 2001 .

[6]  Peter B. L. Meijer,et al.  An experimental system for auditory image representations , 1992, IEEE Transactions on Biomedical Engineering.

[7]  Robert Rowe,et al.  Interactive Music Systems: Machine Listening and Composing , 1992 .

[8]  Myron W. Krueger,et al.  Responsive environments , 1977, AFIPS '77.

[9]  J. Solomon,et al.  On the other side. , 1996, RN.

[10]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[11]  R. M. Schafer,et al.  The Soundscape: Our Sonic Environment and the Tuning of the World , 1993 .

[12]  Ben Shneiderman,et al.  Sonification of Geo-Referenced Data for Auditory Information Seeking: Design Principle and Pilot Study , 2004, ICAD.

[13]  Phoebe Sengers,et al.  Traces Embodied Immersive Interaction with Semi-Autonomous Avatars , 2001 .

[14]  Paul Dourish,et al.  Symbolic objects in a networked gestural sound interface , 2005, CHI EA '05.

[15]  L. Lawyer,et al.  From the other side , 1994 .

[16]  Eduardo Reck Miranda,et al.  Composition for Ubiquitous Responsive Sound Environments , 2004, ICMC.