Sensemble: A Wireless, Compact, Multi-User Sensor System for Interactive Dance

We describe the design of a system of compact, wireless sensor modules meant to capture expressive motion when worn at the wrists and ankles of a dancer. The sensors form a high-speed RF network geared toward real-time data acquisition from multiple devices simultaneously, enabling a small dance ensemble to become a collective interface for music control. Each sensor node includes a 6-axis inertial measurement unit (IMU) comprised of three orthogonal gyroscopes and accelerometers in order to capture local dynamics, as well as a capacitive sensor to measure close range node-to-node proximity. The nodes may also be augmented with other digital or analog sensors. This paper describes application goals, presents the prototype hardware design, introduces concepts for feature extraction and interpretation, and discusses early test results.

[1]  M. Laibowitz,et al.  Wearable Wireless Transceivers , 2004 .

[2]  Joseph A. Paradiso FootNotes: Personal Reflections on the Development of Instrumented Dance Shoes and their Musical Applications , 2000 .

[3]  R. Zacks DANCES WITH MACHINES , 1999 .

[4]  Joshua R. Smith,et al.  Electric field imaging , 1999 .

[5]  Joseph A. Paradiso,et al.  Design and implementation of expressive footwear , 2000, IBM Syst. J..

[6]  Kent Larson,et al.  MITes: Wireless Portable Sensors for Studying Behavior , 2004 .

[7]  Steven Daniel Lovell A System for Real-Time Gesture Recognition and Classification of Coordinated Motion , 2005 .

[8]  Antonio Camurri,et al.  EyesWeb-toward gesture and affect recognition in dance/music interactive systems , 1999, Proceedings IEEE International Conference on Multimedia Computing and Systems.

[9]  Emmanuel Fléty The WiSe Box: a Multi-performer Wireless Sensor Interface using WiFi and OSC , 2005, NIME.

[10]  Marc Downie,et al.  Choreographing the extended agent: performance graphics for dance theater , 2005 .

[11]  Shuji Hashimoto,et al.  EyesWeb: Toward Gesture and Affect Recognition in Interactive Dance and Music Systems , 2000, Computer Music Journal.

[12]  Jens Jacobsen,et al.  The challenges of interactive dance: An overview and case study , 1998 .

[13]  Joseph A. Paradiso,et al.  Musical Applications of Electric Field Sensing , 1997 .

[14]  Albrecht Schmidt,et al.  Building intelligent environments with Smart-Its , 2004, IEEE Computer Graphics and Applications.

[15]  Joseph A. Paradiso,et al.  A compact, wireless, wearable sensor network for interactive dance ensembles , 2006, International Workshop on Wearable and Implantable Body Sensor Networks (BSN'06).

[16]  R. Wechsler EyeCon-- a motion sensing tool for creating interactive dance , music and video projections , 2004 .

[17]  Joseph A. Paradiso,et al.  Gait Analysis Using a Shoe-Integrated Wireless Sensor System , 2008, IEEE Transactions on Information Technology in Biomedicine.

[18]  Joseph A. Paradiso,et al.  A compact modular wireless sensor platform , 2005, IPSN 2005. Fourth International Symposium on Information Processing in Sensor Networks, 2005..