pOM: Linking Pen Gestures to Computer-Aided Composition Processes

Illuminated manuscripts of medieval music contain rich decorations in addition to handwritten neumatic notation. Our project with composer Philippe Leroux investigates the use of such handwritten symbols during the composition of his piece Quid sit musicus. We introduce pOM, an interactive paper application and a library for the OpenMusic computer-aided composition environment which links pen gestures over an old manuscript to compositional processes. The paper interface analyzes the stroke while writing and transmits several features to reactive programs in OpenMusic. pOM allows the composer to define his own functions and get direct musical feedback from pen interactions.

[1]  Norbert Schnell,et al.  A multimodal probabilistic model for gesture--based control of sound synthesis , 2013, MM '13.

[2]  Wendy E. Mackay,et al.  Structured observation with polyphony: a multifaceted tool for studying music composition , 2014, Conference on Designing Interactive Systems.

[3]  Jürgen Steimle,et al.  Towards Understanding Erasing-based Interactions: Adding Erasing Capabilities to Anoto Pens , 2010 .

[4]  Jean-Louis Giavitto,et al.  A reactive extension of the OpenMusic visual programming language , 2014, J. Vis. Lang. Comput..

[5]  Antony Galton,et al.  Efficient generation of simple polygons for characterizing the shape of a set of points in the plane , 2008, Pattern Recognit..

[6]  Christopher De Hamel,et al.  The British Library Guide to Manuscript Illumination: History and Techniques , 2001 .

[7]  Wendy E. Mackay,et al.  PaperTonnetz: Music Composition with Interactive Paper , 2012 .

[8]  Wendy E. Mackay,et al.  InkSplorer: Exploring Musical Ideas on Paper and Computer , 2011, NIME.

[9]  Camilo Rueda,et al.  Computer-Assisted Composition at IRCAM: From PatchWork to OpenMusic , 1999, Computer Music Journal.

[10]  Guy J. Brown,et al.  Composition systems requirements for creativity: what research methodology? , 2001 .

[11]  Miller S. Puckette,et al.  Combining Event and Signal Processing in the MAX Graphical Programming Environment , 1991 .

[12]  Thor Magnusson,et al.  The acoustic, the digital and the body: a survey on musical instruments , 2007, NIME '07.

[13]  Jean Bresson.  Reactive visual programs for computer-aided music composition , 2014, 2014 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC).

[14]  Wendy E. Mackay,et al.  Musink: composing music through augmented drawing , 2009, CHI.

[15]  Gérard Assayag,et al.  Visual Lisp/CLOS programming in OpenMusic , 2009, High. Order Symb. Comput..

[16]  Alicia Fornés,et al.  Primitive Segmentation in Old Handwritten Music Scores , 2005, GREC.

[17]  Camilo Rueda,et al.  Composition at IRCAM: From PatchWork to OpenMusic , 1999 .

[18]  Angelica Lim.  Musical Robots and Interactive Multimodal Systems , 2012, Int. J. Synth. Emot..

[19]  Marcelo M. Wanderley,et al.  Input Devices and Music Interaction , 2011 .

[20]  Matthew Wright,et al.  Open SoundControl: A New Protocol for Communicating with Sound Synthesizers , 1997, ICMC.

[21]  Philippe Leroux,et al.  … phraser le monde : continuité, geste et énergie dans l’oeuvre musicale , 2011 .