A Systemic Approach to Music Performance Learning with Multimodal Technology Support

The use of technology-enhanced learning in education is mostly seen as support for conveying and testing clearly defined knowledge and skills. In music performance education, the goal of the education is more personal and dynamically determined in the pedagogic and aesthetic interaction between the teacher and student. The approach taken in the i-Maestro project is therefore to support the teaching process by adding interaction forms and feedback loops that create new dynamics in the learning process. For music performance on string instruments, we use multimodal feedback with 3D motion tracking and sensor input to give students and teachers new forms of feedback and to make available aspects of performance that are hard to access by direct perception alone. We give examples how the integration these tools into the interaction and feedback loops of traditional music education can help to address problems like the gap between music theory and practice teaching.

[1]  Jeff Pressing,et al.  Improvisation: Methods and models. , 1988 .

[2]  Martin White,et al.  The EPOCH Multimodal Interface for Interacting with Digital Heritage Artefacts , 2006, VSMM.

[3]  J. Sloboda The Musical Mind: The Cognitive Psychology of Music , 1987 .

[4]  Charles Byrne,et al.  Ebb and flow of assessment in music , 2002 .

[5]  C. Winstein Knowledge of results and motor learning--implications for physical therapy. , 1991, Physical therapy.

[6]  Jonathan Savage,et al.  Dunwich Revisited: collaborative composition and performance with new technologies , 2001, British Journal of Music Education.

[7]  Norbert Schnell,et al.  Wireless sensor interface and gesture-follower for music pedagogy , 2007, NIME '07.

[8]  Anna-Lena Rostvall,et al.  A Study of Interaction and Learning in Instrumental Teaching , 2003 .

[9]  Nigel Harvey,et al.  Vocal control in singing: A cognitive approach , 1985 .

[10]  G. Bateson,et al.  Mind and Nature: A Necessary Unity , 1979 .

[11]  H. Maturana The tree of knowledge , 1987 .

[12]  Diemo Schwarz,et al.  Score Following at Ircam , 2006 .

[13]  A. Williamon,et al.  Awareness and incidence of health problems among conservatoire students , 2006 .

[14]  C. William Thorpe VISUAL FEEDBACK OF ACOUSTIC VOICE FEATURES IN VOICE TRAINING , 2002 .

[15]  C. Palmer Music performance. , 1997, Annual review of psychology.

[16]  Raymond MacDonald,et al.  Creativity and flow in musical composition: an empirical investigation , 2006 .

[17]  Janet Mills,et al.  Music technology inspected: good teaching in Key Stage 3 , 2000, British Journal of Music Education.

[18]  Pierfrancesco Bellini,et al.  Symbolic music representation in MPEG , 2005, IEEE MultiMedia.

[19]  K. Newell,et al.  The informational role of knowledge of results in motor learning. , 1996, Acta psychologica.

[20]  Heather Carnahan,et al.  When to Provide Knowledge of Results During Motor Learning: Scheduling Effects , 1990 .

[21]  T. Priest Self-evaluation, creativity, and musical achievement , 2006 .

[22]  Paul J Silvia,et al.  Self-Awareness, Self-Evaluation, and Creativity , 2004, Personality & social psychology bulletin.