Both acoustic intensity and loudness contribute to time-series models of perceived affect in response to music.

Research in the fields of music and emotion has investigated relationships between acoustic properties of music and listeners' perception of affect in response to music. Specifically, the dimensions of arousal and valence that comprise a two-dimensional circumplex model of experienced affect (Russell, 1980, 2003) are commonly measured in experiments investigating the multiplicity of acoustic cues associated with perceived affect (Bailes & Dean, 2012; Dean & Bailes, 2010; Dean, Bailes, & Schubert, 2011; Gingras, Marin, & Fitch, 2014; Olsen & Stevens, 2013; Ritossa & Rickard, 2004; Schubert, 1999, 2004, 2013). With additional use of continuous perceptual measurements, a clearer picture of the real-time factors that underpin affective response to music as it unfolds through time is beginning to emerge.From causal experiments, time-series models of continuous responses to music from the Western classical tradition have shown that manipulations of acoustic intensity profiles of performed music, as measured by decibels (dB) in SPL, significantly influence listeners' real-time perception of affect and loudness (Dean et al., 2011). A strong impact of acoustic intensity on perceived loudness in music perception is to be expected, as a long tradition of psychophysical research reports an intimate (yet not straightforward) relationship between loudness and acoustic intensity (Canevet & Scharf, 1990; Fletcher & Munson, 1933; Florentine, Popper, & Fay, 2011; Olsen, 2014; Olsen, Stevens, & Tardieu, 2010; Scharf, 1978; Stevens, 1956). One would also expect, therefore, that where intensity predicts perceived loudness and perceived affect, loudness might either share with intensity a predictive capacity for perceived affect, or mediate the role of intensity when affective responses are modeled.Somewhat contrary to this hypothesis, time-series modeling of continuously perceived affect in response to one piece from the Western classical tradition (an extract from Dvorak's Slavonic Dance Opus 46, No. 1) included better prediction of perceived affect from acoustic intensity than from continuous loudness (Dean et al., 2011), with loudness not required as a component of the optimized model. The relevance of the surprising exclusion of loudness in this particular model is assessed in the present study. Is this phenomenon specific to the particular Dvorak piece, or is it more general across music with varied complexity and familiarity? As argued above, we expect that loudness will either share a predictive capacity with intensity or mediate the role of intensity when affective responses to more diverse musical stimuli are modeled. To investigate this hypothesis further, acoustic intensity and perceived loudness must be manipulated in a way that subtly distorts the inherently strong psychophysical relationship, so their potential influences on affect can be distinguished empirically. This is accomplished here with the manipulation of synthesized reverberation, an acoustic cue active for listeners' impressions of auditory space and perceived auditory distance, which in turn has been shown to affect perceived loudness of a sound source (Butler, Levy, & Neff, 1980; Lee, Cabrera, & Martens, 2012; Mershon, Desaulniers, Kiefer, Amerson, & Mills, 1981; Stecker & Hafter, 2000; Zahorik, Brungart, & Bronkhorst, 2005; but see, Zahorik & Wightman, 2001).Thus, the aim of the present article is to further address the predictive power of continuous intensity and loudness change in time-series models of perceived affect. This is achieved by manipulating continuous loudness perception without concurrent changes in the intensity profile of the stimulus; intensity changes that would normally be deemed necessary to manipulate loudness. Here, one group of participants continuously rated the affective elements of perceived arousal and valence (Experiment 1), while another participant group continuously rated loudness (Experiment 2). …

[1]  Freya Bailes,et al.  Comparative time series analysis of perceptual responses to electroacoustic music , 2012 .

[2]  Manfred R. Schroeder,et al.  Natural Sounding Artificial Reverberation , 1962 .

[3]  W. Fitch,et al.  Beyond Intensity: Spectral Features Effectively Predict Music-Induced Subjective Arousal , 2014, Quarterly journal of experimental psychology.

[4]  Emery Schubert Modeling Perceived Emotion With Continuous Musical Features , 2004 .

[5]  S. S. Stevens The direct estimation of sensory magnitudes-loudness. , 1956, The American journal of psychology.

[6]  J. Valls-Solé,et al.  Reaction time and acoustic startle in normal human subjects , 1995, Neuroscience Letters.

[7]  Julien Tardieu,et al.  Loudness change in response to dynamic acoustic intensity. , 2010, Journal of experimental psychology. Human perception and performance.

[8]  W. D. Neff,et al.  Apparent distance of sounds recorded in echoic and anechoic chambers. , 1980, Journal of experimental psychology. Human perception and performance.

[9]  Joy Ollen,et al.  A criterion-related validity test of selected indicators of musical sophistication using expert ratings , 2006 .

[10]  Roger T. Dean,et al.  Modelling perception of structure and affect in music : spectral centroid and Wishart's Red Bird , 2011 .

[11]  Emery Schubert Measuring emotion continuously: Validity and reliability of the two-dimensional emotion-space , 1999 .

[12]  W. A. Mvnso,et al.  Loudness , Its Definition , Measurement and Calculation , 2004 .

[13]  Emery Schubert,et al.  Reliability issues regarding the beginning, middle and end of continuous emotion ratings to music , 2013 .

[14]  Kirk N. Olsen,et al.  Psychophysiological response to acoustic intensity change in a musical chord , 2013 .

[15]  James A. Moorer,et al.  About This Reverberation Business , 1978 .

[16]  Freya Bailes,et al.  Time Series Analysis as a Method to Examine Acoustical Influences on Real-time Perception of Music , 2010 .

[17]  D H Mershon,et al.  Perceived Loudness and Visually-Determined Auditory Distance , 1981, Perception.

[18]  N. Rickard,et al.  The Relative Utility of ‘Pleasantness’ and ‘Liking’ Dimensions in Predicting the Emotions Expressed by Music , 2004 .

[19]  Emery Schubert,et al.  Acoustic Intensity Causes Perceived Changes in Arousal Levels in Music: An Experimental Investigation , 2011, PloS one.

[20]  Freya Bailes,et al.  Shared and distinct mechanisms of individual and expertise-group perception of expressed arousal in four works , 2014 .

[21]  Catherine J. Stevens,et al.  A Continuous measure of musical engagement contributes to prediction of perceived arousal and valence , 2014 .

[22]  S. S. Stevens,et al.  The quantification of tonal volume. , 1962, The American journal of psychology.

[23]  B. Moore,et al.  A Model of Loudness Applicable to Time-Varying Sounds , 2002 .

[24]  W. Fuller,et al.  Distribution of the Estimators for Autoregressive Time Series with a Unit Root , 1979 .

[25]  B. Scharf,et al.  The loudness of sounds that increase and decrease continuously in level. , 1990, The Journal of the Acoustical Society of America.

[26]  E R Hafter,et al.  An effect of temporal asymmetry on loudness. , 2000, The Journal of the Acoustical Society of America.

[27]  A. Bronkhorst,et al.  Auditory distance perception in humans : A summary of past and present research , 2005 .

[28]  H. Fastl,et al.  Dynamic Loudness Model (DLM) for Normal and Hearing-Impaired Listeners , 2002 .

[29]  J. Russell Core affect and the psychological construction of emotion. , 2003, Psychological review.

[30]  J. Russell A circumplex model of affect. , 1980 .

[31]  Pavel Zahorik,et al.  Loudness constancy with varying sound source distance , 2001, Nature Neuroscience.

[32]  Densil Cabrera,et al.  The effect of loudness on the reverberance of music: reverberance prediction using loudness models. , 2012, The Journal of the Acoustical Society of America.

[33]  William T. M. Dunsmuir,et al.  Time series analysis of real-time music perception: approaches to the assessment of individual and expertise differences in perception of expressed affect , 2014 .

[34]  Kirk N. Olsen INTENSITY DYNAMICS AND LOUDNESS CHANGE: A REVIEW OF METHODS AND PERCEPTUAL PROCESSES , 2014 .