The Coupling of Action and Perception in Musical Meaning Formation

The embodied perspective on music cognition has stressed the central role of the body and body movements in musical meaning formation processes. In the present study, we investigate by means of a behavioral experiment how free body movements in response to music (i.e., action) can be linked to specific linguistic, metaphorical descriptions people use to describe the expressive qualities they perceive in the music (i.e., perception). We introduce a dimensional model based on the Effort/Shape theory of Laban in order to target musical expressivity from an embodied perspective. Also, we investigate whether a coupling between action and perception is dependent on the musical background of the participants (i.e., trained versus untrained). The results show that the physical appearance of the free body movements that participants perform in response to music are reliably linked to the linguistic descriptions of musical expressiveness in terms of the underlying quality. Moreover, this result is found to be independent of the participants’ musical background.

[1]  Mats B. Küssner,et al.  Music and shape , 2013, Lit. Linguistic Comput..

[2]  Marc Leman,et al.  Expressing Induced Emotions Through Free Dance Movement , 2013 .

[3]  Marc Leman,et al.  The Influence of Body Movements on Children’s Perception of Music with an Ambiguous Expressive Character , 2013, PloS one.

[4]  T. Wheatley,et al.  Music and movement share a dynamic structure that supports universal expressions of emotion , 2012, Proceedings of the National Academy of Sciences.

[5]  Francesca M. M. Citron.  Neural correlates of written emotion word processing: A review of recent electrophysiological and hemodynamic neuroimaging studies , 2012, Brain and Language.

[6]  Kristen A. Lindquist,et al.  The brain basis of emotion: A meta-analytic review , 2012, Behavioral and Brain Sciences.

[7]  Mikko Sams,et al.  Large-scale brain networks emerge from dynamic processing of musical timbre, key and rhythm , 2012, NeuroImage.

[8]  Friedemann Pulvermüller,et al.  A Role for the Motor System in Binding Abstract Emotional Meaning , 2011, Cerebral cortex.

[9]  P. Sedlmeier,et al.  Music is in the Muscle: How Embodied Cognition May Influence Music Preferences , 2011 .

[10]  Fred L. Steinberg,et al.  Dynamic Emotional and Neural Responses to Music Depend on Performance Expression and Listener Experience , 2010, PloS one.

[11]  Mark B. Sandler,et al.  Sonic visualiser: an open source application for viewing, analysing, and annotating music audio files , 2010, ACM Multimedia.

[12]  Marc Leman,et al.  From expressive gesture to sound , 2010, Journal on Multimodal User Interfaces.

[13]  B. Repp,et al.  Performed or observed keyboard actions affect pianists’ judgements of relative pitch , 2009, Quarterly journal of experimental psychology.

[14]  L. Elizabeth Crawford,et al.  Conceptual Metaphors of Affect , 2009 .

[15]  Marc Leman,et al.  Sharing Musical Expression Through Embodied Listening: A Case Study Based on Chinese Guqin Music , 2009 .

[16]  R. Zatorre,et al.  Listening to musical rhythms recruits motor regions of the brain. , 2008, Cerebral cortex.

[17]  David Petersen,et al.  Space, Time, Weight, and Flow: suggestions for enhancing assessment of creative movement , 2008 .

[18]  Rinie Geenen,et al.  Development and Validation of a Dutch Translation of the Big Five Inventory (BFI) , 2008, Journal of personality assessment.

[19]  L. Trainor,et al.  Hearing what the body feels: Auditory encoding of rhythmic movement , 2007, Cognition.

[20]  E. Bigand,et al.  Are we “experienced listeners”? A review of the musical capacities that do not depend on formal musical training , 2006, Cognition.

[21]  Hans-Jochen Heinze,et al.  Shared networks for auditory and motor processing in professional pianists: Evidence from fMRI conjunction , 2006, NeuroImage.

[22]  J. Marozeau,et al.  Multidimensional scaling of emotional responses to music: The effect of musical expertise and of the duration of the excerpts , 2005 .

[23]  L. Trainor,et al.  Feeling the Beat: Movement Influences Infant Rhythm Perception , 2005, Science.

[24]  R. Gibbs,et al.  Metaphor is grounded in embodied experience , 2004 .

[25]  Rolf Inge Godøy,et al.  Motor-Mimetic Music Cognition , 2003 .

[26]  Steve Larson,et al.  "Something in the Way She Moves"-Metaphors of Musical Motion , 2003 .

[27]  P. Kroonenberg,et al.  Three-Mode Models and Individual Differences in Semantic Differential Data , 2003 .

[28]  Jens Haueisen,et al.  Involuntary Motor Activity in Pianists Evoked by Music Perception , 2001, Journal of Cognitive Neuroscience.

[29]  L. Barsalou,et al.  Whither structured representation? , 1999, Behavioral and Brain Sciences.

[30]  Andrew W. Mead.  Bodily Hearing: Physiological Metaphors and Musical Understanding , 1999 .

[31]  Michael I. Jordan,et al.  Smoothness maximization along a predefined path accurately predicts the speed profiles of complex arm movements. , 1998, Journal of neurophysiology.

[32]  C. J. Huberty,et al.  Multivariate analysis versus multiple univariate analyses. , 1989 .

[33]  F. E. Maus,et al.  Music as Drama , 1988 .

[34]  Kengo Ohgushi,et al.  How Are the Player's Ideas Conveyed to the Audience? , 1987 .

[35]  P. Kroonenberg.  Three-Mode Principal Components Analysis of Semantic Differential Data: The Case of a Triple Personality , 1985 .

[36]  Z. Cesarec,et al.  On the Perception of Emotional Meaning in Music , 1981 .

[37]  W. A. Wilbanks,et al.  The effect of context on the perception of music , 1978 .

[38]  H. Kaiser.  An index of factorial simplicity , 1974 .

[39]  K. Gabriel,et al.  The biplot graphic display of matrices with application to principal component analysis , 1971 .

[40]  J. H. Butler,et al.  Classifying Meaning in Contemporary Music , 1968 .

[41]  L. Tucker,et al.  Some mathematical notes on three-mode factor analysis , 1966, Psychometrika.

[42]  K. Hevner.  Experimental studies of the elements of expression in music , 1936 .

[43]  Joel Krueger.  Enacting Musical Experience , 2009 .

[44]  Jamie Bullock,et al.  Libxtract: a Lightweight Library for audio Feature Extraction , 2007, ICMC.

[45]  T. Fujihara,et al.  A multidimensional scaling of classical music perception , 1984 .