Cognition and the temporal arts: Investigating audience response to dance using PDAs that record continuous data during live performance

If artists and art explore organization of the brain [Zeki, S., Lamb, M., 1994. The neurology of kinetic art. Brain 117, 607-636], then investigation of response to artistic performance holds promise as a window to perceptual and cognitive processes. A new instrument for recording real-time audience response - the portable Audience Response Facility (pARF) - is described. Twenty, hand-held, Personal Digital Assistants (PDAs) collect responses on customizable skin interfaces. The pARF server transmits the customizable options, synchronizes devices and collects data for export. We report two studies using the pARF that demonstrate respondent agreement of perceived emotion during particular sections of two dance works. Greater agreement was evident in continuous ratings of arousal than valence; arousal appears to be related to surface features of the dance work. Future applications of the pARF to studies of multi-modal perception and cognition are discussed.

[1]  Robert O. Gjerdingen,et al.  The Psychology of Music , 1972 .

[2]  Suk Won Yi,et al.  Music, mind, and science , 1999 .

[3]  Richard Loren Bruce,et al.  Fundamentals of physiological psychology , 1977 .

[4]  Michael J. Martinez,et al.  Cerebral Cortex doi:10.1093/cercor/bhj057 Cerebral Cortex Advance Access published October 12, 2005 The Neural Basis of Human Dance , 2022 .

[5]  Klaus R. Scherer,et al.  Vocal communication of emotion: A review of research paradigms , 2003, Speech Commun..

[6]  T. Mexia,et al.  Author ' s personal copy , 2009 .

[7]  S Zeki,et al.  The neurology of kinetic art. , 1994, Brain : a journal of neurology.

[8]  C. Krumhansl.  Music as Cognition. , 1987 .

[9]  Catherine J. Stevens,et al.  Judgments of complexity and pleasingness in music: The effect of structure, Repetition, and training , 1991 .

[10]  B. Haseman.  A Manifesto for Performative Research , 2006 .

[11]  G. A. Mendelsohn,et al.  Affect grid : A single-item scale of pleasure and arousal , 1989 .

[12]  James H. Watt,et al.  Dynamic patterns in communication processes , 1996 .

[13]  Scott deLahunta,et al.  Bodies Meet Minds: Choreography and Cognition , 2006, Leonardo.

[14]  Clifford K. Madsen,et al.  The Experience of Musical Tension: A Replication of Nielsen's Research Using the Continuous Response Digital Interface , 1993 .

[15]  Eckart Altenmüller,et al.  EMuJoy: Software for continuous measurement of perceived emotions in music , 2007, Behavior research methods.

[16]  V. Ramachandran,et al.  The science of art: A neurological theory of aesthetic experience , 1999 .

[17]  Emery Schubert.  Measuring emotion continuously: Validity and reliability of the two-dimensional emotion-space , 1999 .

[18]  Emery Schubert.  Modeling Perceived Emotion With Continuous Musical Features , 2004 .

[19]  Catherine J. Stevens,et al.  Proceedings of the Inaugural International Conference on Music Communication Science , 2007 .

[20]  Stephen McAdams,et al.  Influences of Large-Scale Form on Continuous Ratings in Response to a Contemporary Piece in a Live Concert Setting , 2004 .

[21]  J. Sloboda,et al.  Music and emotion: Theory and research , 2001 .

[22]  Charles W. Ostrom.  Time Series Analysis: Regression Techniques , 1978 .

[23]  D. Ariely.  Combining experiences over time: the effects of duration, intensity changes and on‐line measurements on retrospective pain evaluations , 1998 .

[24]  Antonio Camurri,et al.  Recognizing emotion from dance movement: comparison of spectator recognition and automated techniques , 2003, Int. J. Hum. Comput. Stud..

[25]  W. Dowling.  Emotion and Meaning in Music , 2008 .

[26]  Roddy Cowie,et al.  FEELTRACE: an instrument for recording perceived emotion in real time , 2000 .

[27]  Robin Grove.  3. Show Me What You Just Did , 2005 .

[28]  Catherine J. Stevens,et al.  Knowledge unspoken : contemporary dance and the cycle of practice-led research, basic and applied research, and research-led practice , 2009 .

[29]  Karen Bennett,et al.  The Language of Dance , 2008 .

[30]  Daniel C. Johnson,et al.  Exploring the musical mind : cognition, emotion, ability, function , 2006 .

[31]  R. Weale,et al.  Discovering How Accessible Electroacoustic Music Can Be: the Intention/Reception project , 2006, Organised Sound.

[32]  Catherine J. Stevens,et al.  Analysis of contemporary dance movement in the presence and absence of a musical coundscape , 2008 .

[33]  Paul Rozin,et al.  The Feeling of Music Past: How Listeners Remember Musical Affect , 2004 .

[34]  J. Sloboda.  Exploring the Musical MindCognition, emotion, ability, function , 2004 .

[35]  Catherine J. Stevens,et al.  Minds and motion : dynamical systems in choreography, creativity, and dance , 2005 .

[36]  Catherine J. Stevens,et al.  Moving with and without music : scaling and lapsing in time in the performance of contemporary dance , 2009 .

[37]  W. Thompson,et al.  A Comparison of Acoustic Cues in Music and Speech for Three Dimensions of Affect , 2006 .

[38]  C. Krumhansl.  A Perceptual Analysis of Mozart's Piano Sonata K. 282: Segmentation, Tension, and Musical Ideas , 1996 .

[39]  Clifford K. Madsen,et al.  Emotion versus Tension in Haydn's Symphony no. 104 as Measured by the Two-Dimensional Continuous Response Digital Interface , 1998 .

[40]  J. Sloboda.  Music Structure and Emotional Response: Some Empirical Findings , 1991 .

[41]  J. Russell.  Core affect and the psychological construction of emotion. , 2003, Psychological review.

[42]  J. Hanna,et al.  To Dance is Human: A Theory of Nonverbal Communication , 1979 .

[43]  C. Stevens,et al.  Choreographic Cognition: The Time-Course and Phenomenology of Creating a Dance , 2003 .

[44]  Catherine J. Stevens,et al.  Thinking in Four Dimensions: Creativity and Cognition in Contemporary Dance , 2005 .

[45]  Catherine J. Stevens,et al.  Thinking in action: thought made visible in contemporary dance , 2005, Cognitive Processing.

[46]  C. Krumhansl,et al.  Cross-modal interactions in the perception of musical performance , 2006, Cognition.

[47]  J. Singer,et al.  Cognitive, social, and physiological determinants of emotional state. , 1962, Psychological review.

[48]  R. Passingham,et al.  Action observation and acquired motor skills: an FMRI study with expert dancers. , 2005, Cerebral cortex.

[49]  J. Russell.  A circumplex model of affect. , 1980 .