Playing the Body: Making Music through Various Body Movements

We explore a bodily interaction as a creative experience to support musical expression. This paper discusses an interactive system---Playing the Body---that supports the creative activity of composing music by incorporating large body movements in space. In order to encourage the user to form an overall image of the melody in the early stages of composition, the proposed system supports interaction using the whole body to generate a melody. Then, after going through a trial-and-error stage, it provides a refinement stage that encourages introspection, refining the melody to make the sound more consistent with the ideal image. This is done by supporting interaction using the hands and arms, which have a greater degree of freedom. In a pilot study, positive responses were obtained regarding the creation of a melody using the whole body. Future work includes improving the use of the hands and arms to refine the melody.

[1]  D. Schoen,et al.  The Reflective Practitioner: How Professionals Think in Action , 1985 .

[2]  Eric Rosenbaum,et al.  Singing Fingers: fingerpainting with sound , 2010, IDC.

[3]  Alison Black Visible planning on paper and on screen: The impact of working medium on decision-making by novice graphic designers , 1990 .

[4]  Hiroshi Ishii,et al.  BodyBeats: whole-body, musical interfaces for children , 2006, CHI Extended Abstracts.

[5]  Horace Ho-Shing Ip,et al.  BodyMusic: a novel framework design for body-driven music composition , 2005, ACE '05.

[6]  Kevin Jennings,et al.  Hyperscore: a graphical sketchpad for novice composers , 2004, IEEE Computer Graphics and Applications.

[7]  Jakob Tholander,et al.  MoBoogie: creative expression through whole body musical interaction , 2011, CHI.

[8]  Adrienne M Frater Betty Greenhatch Making music. , 1988, Nursing standard (Royal College of Nursing (Great Britain) : 1987).

[9]  Wendy E. Mackay,et al.  PaperTonnetz: supporting music composition with interactive paper , 2013, CHI Extended Abstracts.

[10]  M. Sheelagh T. Carpendale,et al.  Vuzik: the effect of large gesture interaction on children's creative musical expression , 2014, OZCHI.

[11]  Henning Lohner The UPIC System: A User's Report , 1986 .

[12]  L. A. Hausman How we Think , 1921 .

[13]  Paul Fergus,et al.  Towards an Advanced Framework for Whole Body Interaction , 2009, HCI.

[14]  R. J. Bogumil,et al.  The reflective practitioner: How professionals think in action , 1985, Proceedings of the IEEE.

[15]  Faber Birren,et al.  Color psychology and color therapy : a factual study of the influence of color on human life , 1961 .