Multi-Touch Enhanced Visual Audio-Morphing

Many digital interfaces for audio effects still resemble racks and cases of their hardware counterparts. For instance, DSP-algorithms are often adjusted via direct value input, sliders, or knobs. While recent research has started to experiment with the capabilities offered by modern interfaces, there are no examples for productive applications such as audio-morphing. Audio-morphing as a special field of DSP has a high complexity for the morph itself and for the parametrization of the transition between two sources. We propose a multi-touch enhanced interface for visual audiomorphing. This interface visualizes the internal processing and allows direct manipulation of the morphing parameters in the visualization. Using multi-touch gestures to manipulate audio-morphing in a visual way, sound design and music production becomes more unrestricted and creative.

[1]  Michael Klingbeil,et al.  Software for spectral Analysis, Editing, and synthesis , 2005, ICMC.

[2]  Christian Schörkhuber.  CONSTANT-Q TRANSFORM TOOLBOX FOR MUSIC PROCESSING , 2010 .

[3]  D. Gabor,et al.  Theory of communication. Part 1: The analysis of information , 1946 .

[4]  Allan Seago,et al.  A New Interaction Strategy for Musical Timbre Design , 2013, Music and Human-Computer Interaction.

[5]  William A. Sethares,et al.  Spectral Tools for Dynamic Tonality and Audio Morphing , 2009, Computer Music Journal.

[6]  X. Rodet,et al.  Sound Analysis and Processing with AudioSculpt 2 , 2004, ICMC.

[7]  Eli Shechtman,et al.  PatchMatch: a randomized correspondence algorithm for structural image editing , 2009, ACM Trans. Graph..

[8]  Rainer Groh,et al.  Gesture Formalization for Multitouch , 2015, Softw. Pract. Exp..

[9]  Sung Yong Shin,et al.  On pixel-based texture synthesis by non-parametric sampling , 2006, Comput. Graph..

[10]  Xavier Rodet,et al.  Automatic Timbral Morphing Of Musical Instruments Sounds By High-Level Descriptors , 2010, ICMC.

[11]  Meredith Ringel Morris,et al.  User-defined gestures for surface computing , 2009, CHI.

[12]  Michael Gurevich,et al.  PARAMETERIZED MORPHING AS A MAPPING TECHNIQUE FOR SOUND SYNTHESIS , 2006 .

[13]  George Wolberg,et al.  Image morphing: a survey , 1998, The Visual Computer.

[14]  Naotoshi Osaka,et al.  Sound timbre interpolation based on physical modeling , 2001 .

[15]  Carlo Drioli,et al.  Sound Morphing With Gaussian Mixture Models , 2001 .

[16]  Malcolm Slaney,et al.  Automatic audio morphing , 1996, 1996 IEEE International Conference on Acoustics, Speech, and Signal Processing Conference Proceedings.

[17]  Meredith Ringel Morris,et al.  Understanding users' preferences for surface gestures , 2010, Graphics Interface.