An evaluation of digital interfaces for music composition and improvisation

.................................................................................................................... II! CONTENTS ................................................................................................................... III! LIST OF FIGURES ........................................................................................................ VII! LIST OF TABLES ......................................................................................................... VIII! SUBMITTED MEDIA ...................................................................................................... IX! SUBMITTED SOFTWARE ............................................................................................... X! ACKNOWLEDGEMENTS ................................................................................................ XI! OVERVIEW ..................................................................................................................... 1! INTRODUCTION ............................................................................................................ 4! 1.! LIVE CODING .......................................................................................................... 7! 1.1.! INTRODUCTION!........................................................................................................................!7! 1.2.! ROUTES!..................................................................................................................................!9! 1.3.! ENVIRONMENTS!FOR!LIVE!CODING!.............................................................................................!11! 1.4.! PERFORMING!WITH!BEER!.......................................................................................................!11! 1.5.! THE!MANY!FACES!OF!CODE!.......................................................................................................!12! 1.5.1.! Code(as(interface(.........................................................................................................(12! 1.5.2.! Code(as(communication(medium(................................................................................(14! 1.6.! LIVE!CODING!AND!THE!AUDIENCE!..............................................................................................!15! 1.7.! MUSIC!COMPOSED!WITH!LIVE!CODING!.......................................................................................!17! 1.8.! MAPPING!IMMUTABILITY!AND!HYBRID!ENVIRONMENTS!.................................................................!19! 1.9.! LIVE!CODING!IN!STUDIO:!FROM!CODE!TO!TAPE!.............................................................................!25! 1.10.! OTHER!ASPECTS!OF!LIVE!CODING!.............................................................................................!27! 1.11.! CONCLUSION!.......................................................................................................................!28! iv 2.! HARDWARE PROTOTYPING ................................................................................. 31! 2.1.! INTRODUCTION!......................................................................................................................!31! 2.2.! OVERVIEW!OF!POP!.................................................................................................................!31! 2.3.! CALIBRATION!AND!SCALING:!SENSORS!MAKING!SENSE!...................................................................!33! 2.4.! MAPPING!OF!POP!..................................................................................................................!34! 2.5.! MODES!OF!INTERACTION!OF!POP!..............................................................................................!35! 2.6.! CONTROL!AND!STRUCTURE!.......................................................................................................!35! 2.7.! MUSIC!COMPOSED!WITH!POP!..................................................................................................!36! 2.8.! REMARKS!ON!POP!..................................................................................................................!38! 2.9.! CONCLUSION!.........................................................................................................................!41! 3.! TANGIBLE INTERFACES ....................................................................................... 43! 3.1.! INTRODUCTION!......................................................................................................................!43! 3.2.! DIGITAL!MUSICAL!INSTRUMENTS!(DMI)!.....................................................................................!44! 3.3.! OVERVIEW!OF!BIGRAIN!...........................................................................................................!46! 3.3.1.! Mapping(of(BiGrain(.....................................................................................................(47! 3.4.! OVERVIEW!OF!STAY!ON!THIS!GESTURE!......................................................................................!49! 3.4.1.! Mapping(of(Stay(On(This(Gesture(................................................................................(49! 3.5.! MUSIC!COMPOSED!WITH!THE!WIIMOTE!.....................................................................................!50! 3.6.! CONCLUSION!.........................................................................................................................!53! 4.! OPTICAL INTERFACES .......................................................................................... 56! 4.1.! INTRODUCTION!......................................................................................................................!56! 4.2.! OVERVIEW!OF!GREAP!.............................................................................................................!58! 4.2.1.! Scene(handling/snapshots(..........................................................................................(59! 4.3.! MAPPING!VARIABILITY!.............................................................................................................!60! 4.4.! INTERACTION!AFFORDANCES!OF!GREAP!......................................................................................!62! 4.5.! EFFORT!AND!VISUALISATION!OF!MUSICAL!TENSION!.......................................................................!63! v 4.6.! TANGIBLE!SOUND!...................................................................................................................!63! 4.7.! METAPHORS!.........................................................................................................................!64! 4.8.! MUSIC!COMPOSED!WITH!GREAP!...............................................................................................!64! 4.9.! CONCLUSION!.........................................................................................................................!67! 5.! CONCLUSIONS – DISCUSSION OF MUSICAL IMPLICATIONS .............................. 70! 5.1.! ENCORE!................................................................................................................................!77! 6.! FURTHER RESEARCH ........................................................................................... 77! REFERENCES ............................................................................................................... 79! APPENDIX – ATARAXIA ............................................................................................... 88! INSTRUCTIONS AND TECHNICAL REQUIREMENTS ................................................... 89! HOW TO LAUNCH GREAP ........................................................................................... 89! TROUBLESHOOTING ................................................................................................... 90! INSTRUCTIONS FOR THE PERFORMANCE OF ATARAXIA .......................................... 90! SCORE OF ATARAXIA .................................................................................................. 92! APPENDIX – BLIND DATE ............................................................................................ 99! INSTRUCTIONS AND TECHNICAL REQUIREMENTS ................................................... 99! FAIR ALGO ................................................................................................................. 100! TROUBLESHOOTING ................................................................................................. 102! INSTRUCTIONS FOR THE PERFORMANCE OF BLIND DATE ..................................... 102! FAIR ALGO CODE ..................................................................................................... 103! APPENDIX – POP ....................................................................................................... 104! INSTRUCTIONS AND TECHNICAL REQUIREMENTS ................................................. 104!

[1]  Ernest Lee Hammer,et al.  Electronic and Computer Music , 1985 .

[2]  Sidney S. Fels,et al.  MetaMuse: Metaphors for Expressive Instruments , 2002, NIME.

[3]  Sidney Fels,et al.  Mapping transparency through metaphor: towards more expressive musical instruments , 2002, Organised Sound.

[4]  Marcelo M. Wanderley,et al.  Instrumental Gestural Mapping Strategies as Expressivity Determinants in Computer Music Performance , 1997 .

[5]  Marcelo M. Wanderley,et al.  Mapping performer parameters to synthesis engines , 2002, Organised Sound.

[6]  Bruce N. Walker,et al.  Mappings and metaphors in auditory displays: An experimental assessment , 2005, TAP.

[7]  Marcelo M. Wanderley,et al.  Libmapper: (a library for connecting things) , 2013, CHI Extended Abstracts.

[8]  Sidney Fels,et al.  Sound Sculpting: Manipulating Sound through Virtual Sculpting , 1998 .

[9]  Jan C. Schacher,et al.  Flowspace - A Hybrid Ecosystem , 2011, NIME.

[10]  Roel Vertegaal,et al.  Quarterly Progress and Status Report Towards a musician’s cockpit: Transducers, feedback and musical function , 2007 .

[11]  Curtis Roads,et al.  The Computer Music Tutorial , 1996 .

[12]  Agostino Di Scipio,et al.  The place and meaning of computing in a sound relationship of man, machines, and environment , 2014, ICMC.

[13]  Perry R. Cook,et al.  "On-the-fly Programming: Using Code as an Expressive Musical Instrument" , 2004, NIME.

[14]  Agostino Di Scipio,et al.  Listening to Yourself through the Otherself: On Background Noise Study and other works , 2011, Organised Sound.

[15]  Scott Wilson,et al.  Free as in BEER: Some Explorations into Structured Improvisation Using Networked Live-Coding Systems , 2014, Computer Music Journal.

[16]  Marcelo M. Wanderley,et al.  Towards a Model for Instrumental Mapping in Expert Musical Interaction , 2000, ICMC.

[17]  Marcelo M. Wanderley,et al.  The Importance of Parameter Mapping in Electronic Instrument Design , 2002, NIME.

[18]  Matthew Wright,et al.  Intimate Musical Control of Computers with a Variety of Controllers and Gesture Mapping Metaphors , 2002, NIME.

[19]  Veronica Teichrieb,et al.  A Preliminary Evaluation of the Leap Motion Sensor as Controller of New Digital Musical Instruments , 2013 .

[20]  Thor Magnusson,et al.  Designing Constraints: Composing and Performing with Digital Musical Systems , 2010, Computer Music Journal.

[21]  Click Nilson Live coding practice , 2007, NIME '07.