Vicarious: A Flexible Framework for the Creative Use of Sensed Biodata

In this paper we discuss vicarious, a flexible, extensible, distributed framework for capturing, processing, visualising, recording and generally handling sensed biodata. We outline six specific creative needs: heterogeneity of sensor inputs, liveness, high quality video, synchronisation, scalability, usability. Next, by outlining the architecture and features of vicarious, we show how the system meets each of those expectations. We then provide four examples of creative experiences developed using vicarious. The paper thus contributes the tool vicarious as support for creative experience design, as well as concrete examples of creative, artistic or performative applications of the system.

[1]  Sara Ilstedt Hjelm,et al.  Brainball - using brain activity for cool competition , 2000 .

[2]  A. Morrison,et al.  Coordinated Visualisation of Video and System Log Data , 2006, Fourth International Conference on Coordinated & Multiple Views in Exploratory Visualization (CMV'06).

[3]  Stefan Rennick Egglestone,et al.  The gas mask: a probe for exploring fearsome interactions , 2011, CHI EA '11.

[4]  Joe Marshall,et al.  Uncomfortable interactions , 2012, CHI.

[5]  Steve Benford,et al.  Supporting ethnographic studies of ubiquitous computing in the wild , 2006, DIS '06.

[6]  Magnus Moar,et al.  ‘Ere Be Dragons: heartfelt gaming , 2006, Digit. Creativity.

[7]  Stefan Rennick Egglestone,et al.  Breathalising games: understanding the potential of breath control in game interfaces , 2011, Advances in Computer Entertainment Technology.

[8]  Joe Marshall,et al.  The machine in the ghost: augmenting broadcasting with biodata , 2012, CHI EA '12.

[9]  T. C. Nicholas Graham,et al.  Heart rate control of exercise video games , 2009, Graphics Interface.

[10]  Stephen J. Burn.  The Machine in the Ghost , 2011 .

[11]  Marco Donnarumma.  Music for Flesh II: informing interactive music performance with the viscerality of the body system , 2012, NIME.

[12]  Junichi Hoshino,et al.  A fitness game reflecting heart rate , 2006, ACE '06.

[13]  Gabriel Moshenska.  The Gas Mask , 2010 .

[14]  Michael Kipp,et al.  ANVIL - a generic annotation tool for multimodal dialogue , 2001, INTERSPEECH.