Segments and Mapping for Scores and Signal Representations

We present a general theoretical framework to describe segments and the different possible mapping that can be established between them. Each segment can be related to different music representations, graphical scores, music signals or gesture signals. This theoretical formalism is general and is compatible with large number of problems found in sound and gesture computing. We describe some examples we developed in interactive score representation, superposed with signal representation, and the description of synchronization between gesture and sound signals.

[1]  Philipp Hoschka,et al.  An Introduction to the Synchronized Multimedia Integration Language , 1998, IEEE Multim..

[2]  Norbert Schnell,et al.  Online Gesture Analysis and Control of Audio Processing , 2011 .

[3]  Norbert Schnell,et al.  Wireless sensor interface and gesture-follower for music pedagogy , 2007, NIME '07.

[4]  Jean Bresson,et al.  Scores, Programs, and Time Representation: The Sheet Object in OpenMusic , 2008, Computer Music Journal.

[5]  Dominique Fober,et al.  INScore - An Environment for the Design of Live Music Scores , 2012 .

[6]  Frédéric Bevilacqua,et al.  Perspectives on Gesture–Sound Relationships Informed from Acoustic Instrument Studies , 2009, Organised Sound.

[7]  Roger B. Dannenberg,et al.  A Reference Architecture and Score Representation for Popular Music Human-Computer Music Performance Systems , 2011, NIME.

[8]  Serge Lemouton,et al.  The Augmented String Quartet: Experiments and Gesture Following , 2012 .

[9]  Steven R. Newcomb,et al.  The “HyTime ”: hypermedia/time-based document structuring language , 1991, CACM.

[10]  Jules Françoise,et al.  A HIERARCHICAL APPROACH FOR THE DESIGN OF GESTURE-TO-SOUND MAPPINGS , 2012 .

[11]  Dominique Fober,et al.  Interlude - A Framework For Augmented Music Scores , 2010 .

[12]  Denis L. Baggi,et al.  IEEE 1599: Music Encoding and Interaction , 2009, Computer.

[13]  Dominique Fober,et al.  VEMUS - Feedback and Groupware Technologies for Music Instrument Learning , 2007 .

[14]  Roger B. Dannenberg,et al.  A Framework for Coordination and Synchronization of Media , 2011, NIME.