A Music Expressive Communication with Sensor - Doll Interface

We propose a music expression system which generates music by interaction between the user and a sensorequipped doll named \Com-music." Since the sensor-doll includes various sensors and a PC, it can detect not only raw data but also pre-de ned gestures and contexts using HMMs (Hidden Markov Models). The doll has ve levels of interaction as pre-de ned contexts, that correspond to the strength and the frequency of the interaction with the user. Each interaction level has di erent set of music control mappings, so the doll reacts with music expressions correspondent to context. In this paper, we consider the sensor-doll system as a device of the new type of communication, which uses music expressions as the communication media.