Bio-Sensing Systems and Bio-Feedback Systems for Interactive Media Arts

This is a report of research and some experimental applications of human-computer interaction in multi-media performing arts. The human performer and the computer systems perform computer graphic and computer music interactively in real-time. In general, many sensors are used for the interactive communication as interfaces, and the performer receives the output of the system via graphics, sounds and physical reactions of interfaces like musical instruments. I have produced many types of interfaces, not only with physical/electrical sensors but also with biological/physiological sensors. This paper is intended as an investigation of some special approaches: (1) 16-channel electromyogram sensor called "MiniBioMuse-III" and its application work called "BioCosmicStorm-II" performed in Paris, Kassel and Hamburg in 2001, (2) sensing/reacting with "breathing" in performing arts, (3) 8-channel electric-feedback system and its experiments of "body-hearing sounds" and "body-listening to music".

[1]  Seiji Inokuchi,et al.  Gesture Sensor in Virtual Performer , 1993, ICMC.

[2]  Curtis Roads,et al.  The Computer Music Tutorial , 1996 .

[3]  Antonio Camurri,et al.  Interactive Dance/Music Systems , 1995, ICMC.

[4]  Yoichi Nagashima.  Multimedia interactive art: system design and artistic concept of real-time performance with computer graphics and computer music , 1995 .

[5]  Joel Chadabe,et al.  The Limitations of Mapping and a Structural Descriptive in Electronic Instruments , 2002, NIME.

[6]  Yoichi Nagashima,et al.  "It's SHO time" - An Interactive Environment for SHO(Sheng) Performance , 1999, ICMC.

[7]  Yoichi Nagashima.  Biosensorfusion: New Interfaces for Interactive Multimedia Art , 1998, ICMC.

[8]  Seiji Inokuchi,et al.  Pegasus-2: Real-Time Composing Environment with Chaotic Interaction Model , 1993, ICMC.

[9]  Max V. Mathews,et al.  The 1997 Mathews Radio-Baton and Improvisation Modes , 1997, ICMC.

[10]  Dan Trueman,et al.  Physicality and Feedback: A Focus on the Body in the Performance of Electronic Music , 2001, ICMC.

[11]  Robert Rowe,et al.  Interactive Music Systems: Machine Listening and Composing , 1992 .

[12]  Seiji Inokuchi,et al.  A Compositional Environment with Intersection and Interaction between Musical Model and Graphical Model: "Listen to the Graphics, Watch the Music" , 1995, ICMC.

[13]  R. Jacob.  Human-computer interaction: input devices , 1996, CSUR.

[14]  Chris Chafe.  Tactile Audio Feedback , 1993, ICMC.

[15]  Robert Rowe,et al.  Interactive Music Systems: Machine Listening and Composing , 1992 .

[16]  Sergi Jordà,et al.  Improvising With Computers: A Personal Survey (1989–2001) , 2002, ICMC.

[17]  Takashi Sakaguchi,et al.  Sensor Integration for Interactive Digital Art , 1995, ICMC.

[18]  Atau Tanaka,et al.  Musical Technical Issues in Using Interactive Instrument Technology with Application to the BioMuse , 1993, International Conference on Mathematics and Computing.

[19]  Yoichi Nagashima.  Real-Time Interactive Performance with Computer Graphics and Computer Music , 1998 .

[20]  R. Benjamin Knapp,et al.  A Bioelectric Controller for Computer Music Applications , 1990 .