Tailoring tabletop interfaces for musical control

The computer control of sound and musical processes through performer interaction places certain requirements on the electronic interface. This paper outlines the ongoing development of a musically effective tabletop controller through modification of the common camera-based framework. The notion of control intimacy is introduced alongside design goals that foster this sense of close relationship between player and instrument. Limitations of some existing systems are noted and our specific approaches to the provision of musical control and feedback are presented. Progress to date on a number of novel implementations is described. ACM Classification: H5.2 [Information interfaces and presentation]: User Interfaces. Graphical user interfaces. General terms: Human Factors, Performance, Design, Experimentation, Theory.

[1]  W. Köhler.  Gestalt psychology , 1967 .

[2]  Matthew Wright,et al.  Problems and prospects for intimate musical control of computers , 2001 .

[3]  Kostas Giannakis,et al.  A comparative evaluation of auditory-visual mappings for sound visualisation , 2006, Organised Sound.

[4]  M. Wertheimer,et al.  Some Physiognomic Aspects of Naming, or, Maluma and Takete Revisited , 1964, Perceptual and motor skills.

[5]  Jon R Drummond,et al.  Understanding Interactive Systems , 2009, Organised Sound.

[6]  Sergi Jordà,et al.  The reacTable: exploring the synergy between live music performance and tabletop tangible interfaces , 2007, TEI.

[7]  Loïc Kessous,et al.  Strategies of mapping between gesture data and synthesis model parameters using perceptual spaces , 2002, Organised Sound.

[8]  Golan Levin,et al.  In-situ speech visualization in real-time interactive installation and performance , 2004, NPAR '04.

[9]  Adriano Abbado,et al.  Perceptual Correspondences of Abstract Animation and Synthetic Sound , 1988 .

[10]  Liam O'Sullivan.  Development of a Graphical Sound Synthesis Controller Exploring Cross-Modal Perceptual Analogies , 2007 .

[11]  Peter F. Driessen,et al.  A Force-Sensitive Surface for Intimate Control , 2009, NIME.

[12]  Chuichi Arakawa,et al.  Sound Rose: Creating Music and Images with a Touch Table , 2006, NIME.

[13]  Joseph A. Paradiso,et al.  Tracking and characterizing knocks atop large interactive displays , 2005 .

[14]  Philip L. Davidson,et al.  Synthesis and Control on Large Scale Multi-Touch Sensing Displays , 2006, NIME.

[15]  G. Paine.  Towards Unified Design Guidelines for New Interfaces for Musical Expression , 2009, Organised Sound.

[16]  Ross Bencina,et al.  reacTIVision: a computer-vision framework for table-based tangible interaction , 2007, TEI.

[17]  Sidney Fels,et al.  Mapping virtual object manipulation to sound variation , 1997 .