Piano Technique as a Case Study in Expressive Gestural Interaction

There is a longstanding disconnect between mechanical models of the piano, in which key velocity is the sole determinant of each note’s sound, and the subjective experience of trained pianists, who take a nuanced, multidimensional approach to physical gestures at the keyboard (commonly known as “touch”). We seek to peel back the abstraction of the key press as a discrete event, developing models of key touch that link qualitative musical intention to quantitative key motion. The interaction between performer and instrument (whether acoustic or electronic) can be considered a special case of human-machine interaction, and one that takes place on far different terms than ordinary human-computer interaction: a player’s physical gestures are often the result of intuitive, subconscious processes. Our proposed models will therefore aid the development of computer interfaces which connect with human users on an intuitive, expressive level, with applications within and beyond the musical domain.