Live Writing : Writing as a Real-time Audiovisual Performance

This paper suggests a novel form of audiovisual performancelive writingthat transforms creative writing into a realtime performing art. The process of typing a poem on the fly is captured and augmented to create an audiovisual performance that establishes natural links among the components of typing gestures, the poem being written on the fly, and audiovisual artifacts. Live writing draws upon ideas from the tradition of live coding in which the process of programming is revealed to the audience in real-time. This paper discusses the motivation behind the idea, interaction schemes and a performance interface for such a performance practice. Our live writing performance system is enabled by a custom text editor, writing-sound mapping strategies of our choice, a poem-sonification, and temporal typography. We describe two live writing performances that take different approaches as they vary the degree of composition and improvisation in writing.

[1]  Nick Collins,et al.  Live coding in laptop performance , 2003, Organised Sound.

[2]  Matthew Wright,et al.  The Web Browser As Synthesizer And Interface , 2013, NIME.

[3]  Chih-Fang Huang,et al.  Algorithmic approach to sonification of classical Chinese poetry , 2011, Multimedia Tools and Applications.

[4]  Boris Smus Web Audio API , 2013 .

[5]  Si Waite,et al.  Reimagining the computer keyboard as a musical interface , 2015, NIME.

[6]  Alan F. Blackwell,et al.  The Programming Language as a Musical Instrument , 2005, PPIG.

[7]  J. Novak Live Poetry: An Integrated Approach to Poetry in Performance. , 2011 .

[8]  Michael Rohs,et al.  Use the Force (or something) - Pressure and Pressure - Like Input for Mobile Music Performance , 2010, NIME.

[9]  Sang Won Lee,et al.  Real-Time Music Notation in Mixed Laptop–Acoustic Ensembles , 2013, Computer Music Journal.

[10]  Jonathan Berger,et al.  WAAX: Web Audio API eXtension , 2013, NIME.

[11]  Thor Magnusson,et al.  Designing Constraints: Composing and Performing with Digital Musical Systems , 2010, Computer Music Journal.

[12]  Alex McLean,et al.  Collaboration and learning through live coding , 2014 .

[13]  Joseph A. Paradiso,et al.  MusicGrip: A Writing Instrument for Music Control , 2009, NIME.

[14]  Sang Won Lee,et al.  Web-based temporal typography for musical expression and performance , 2015, NIME.

[15]  Sang Won Lee,et al.  Live Writing: Asynchronous Playback of Live Coding and Writing , 2015 .

[16]  Steven Bathiche,et al.  A practical pressure sensitive computer keyboard , 2009, UIST '09.

[17]  Perry R. Cook,et al.  Don't forget the laptop: using native input capabilities for expressive musical control , 2007, NIME '07.

[18]  Alex McLean,et al.  Visualisation of live code , 2010, EVA.