Caress: An Enactive Electro-acoustic Percussive Instrument for Caressing Sound

This paper documents the development of Caress, an electroacoustic percussive instrument that blends drumming and audio synthesis in a small and portable form factor. Caress is an octophonic miniature drum-set for the fingertips that employs eight acoustically isolated piezo-microphones, coupled with eight independent signal chains that excite a unique resonance model with audio from the piezos. The hardware is designed to be robust and quickly reproducible (parametric design and machine fabrication), while the software aims to be light-weight (low-CPU requirements) and portable (multiple platforms, multiple computing architectures). Above all, the instrument aims for the level of control intimacy and tactile expressivity achieved by traditional acoustic percussive instruments, while leveraging real-time software synthesis and control to expand the sonic palette. This instrument as well as this document are dedicated to the memory of the late David Wessel, pioneering composer, performer, researcher, mentor and all-around Yoda of electroacoustic music.

[1]  Ming C. Lin,et al.  Tabletop Ensemble: touch-enabled virtual percussion instruments , 2012, I3D '12.

[2]  Diemo Schwarz,et al.  REAL-TIME CORPUS-BASED CONCATENATIVE SYNTHESIS WITH CATART , 2006 .

[3]  Robert Xiao,et al.  Acoustic barcodes: passive, durable and inexpensive notched identification tags , 2012, UIST.

[4]  Peter F. Driessen,et al.  A new control paradigm: software-based gesture analysis for music , 2003, 2003 IEEE Pacific Rim Conference on Communications Computers and Signal Processing (PACRIM 2003) (Cat. No.03CH37490).

[5]  Adam R. Tindale.  A hybrid method for extended percussive gesture , 2007, NIME '07.

[6]  Perry R. Cook,et al.  The Synthesis ToolKit (STK) , 1999, ICMC.

[7]  Marcelo M. Wanderley,et al.  From Real to Virtual: A Comparison of Input Devices for Percussion Tasks , 2009, NIME.

[8]  Alan McCree,et al.  Efficient analysis/synthesis of percussion musical instrument sounds using an all-pole model , 1998, Proceedings of the 1998 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP '98 (Cat. No.98CH36181).

[9]  M. Sile O'Modhrain,et al.  Physical models and musical controllers: designing a novel electronic percussion instrument , 2007, NIME '07.

[10]  Ali Momeni,et al.  Characterizing and Controlling Musical Material Intuitively with Geometric Models , 2003, NIME.

[11]  Ajay Kapur,et al.  A Comparison of Sensor Strategies for Capturing Percussive Gestures , 2005, NIME.

[12]  Scott E. Hudson,et al.  Rapid construction of functioning physical interfaces from cardboard, thumbtacks, tin foil and masking tape , 2006, UIST.

[13]  Cumhur Erkut,et al.  Synthesis of Hand Clapping Sounds , 2007, IEEE Transactions on Audio, Speech, and Language Processing.

[14]  Cynthia Bruyns,et al.  Modal Synthesis for Arbitrarily Shaped Objects , 2006, Computer Music Journal.

[15]  Diana Young,et al.  A New Beatbug: Revisions, Simplifications, and New Directions , 2004, ICMC.

[16]  Peter F. Driessen,et al.  New algorithms and technology for analyzing gestural data , 2001, 2001 IEEE Pacific Rim Conference on Communications, Computers and Signal Processing (IEEE Cat. No.01CH37233).

[17]  Roberto Aimi,et al.  Percussion instruments using realtime convolution: physical controllers , 2007, NIME '07.

[18]  Stefan Bilbao,et al.  Percussion Synthesis Based on Models of Nonlinear Shell Vibration , 2010, IEEE Transactions on Audio, Speech, and Language Processing.

[19]  Arjan Kuijper,et al.  OpenCapSense: A rapid prototyping toolkit for pervasive interaction using capacitive sensing , 2013, 2013 IEEE International Conference on Pervasive Computing and Communications (PerCom).

[20]  W. Andrew Schloss,et al.  Controlling a physical model with a 2D force matrix , 2007, NIME '07.

[21]  Golan Levin.  Painterly interfaces for audiovisual performance , 2000 .

[22]  Dinesh K. Pai,et al.  Modal Synthesis for Vibrating Objects , 2007 .

[23]  Stefan Bilbao,et al.  Time domain simulation and sound synthesis for the snare drum. , 2012, The Journal of the Acoustical Society of America.

[24]  Richard Polfreman,et al.  Modalys-ER for OpenMusic (MfOM): virtual instruments and virtual musicians , 2002, Organised Sound.

[25]  Marcelo M. Wanderley,et al.  Advantages and Limitations of Simulating Percussion Gestures for Sound Synthesis , 2009, ICMC.

[26]  George Tzanetakis,et al.  Indirect Acquisition of Percussion Gestures Using Timbre Recognition , 2005 .

[27]  Peter F. Driessen,et al.  Non-invasive sensing and gesture control for pitched percussion hyper-instruments using the Kinect , 2012, NIME.

[28]  Thad Starner,et al.  Hambone: A Bio-Acoustic Gesture Interface , 2007, 2007 11th IEEE International Symposium on Wearable Computers.

[29]  Ajay Kapur,et al.  The Electronic Tabla Controller , 2002, NIME.

[30]  Ajay Kapur,et al.  Techniques in Swept Frequency Capacitive Sensing: An Open Source Approach , 2014, NIME.

[31]  Richard Dudas,et al.  Musical Applications of New Filter Extensions to Max/MSP , 1999, ICMC.

[32]  Matthew Wright,et al.  Problems and Prospects for Intimate Musical Control of Computers , 2002, Computer Music Journal.

[33]  Björn Hartmann,et al.  Midas: fabricating custom capacitive touch sensors to prototype interactive objects , 2012, UIST '12.

[34]  Marcelo M. Wanderley,et al.  Trends in Gestural Control of Music , 2000 .

[35]  Ajay Kapur,et al.  Learning Indirect Acquisition of Instrumental Gestures using Direct Sensors , 2006, 2006 IEEE Workshop on Multimedia Signal Processing.

[36]  Sergi Jordà.  Digital Lutherie Crafting musical computers for new musics' performance and improvisation , 2005 .

[37]  Federico Avanzini,et al.  A Modular Physically Based Approach to the Sound Synthesis of Membrane Percussion Instruments , 2010, IEEE Transactions on Audio, Speech, and Language Processing.