Measuring and Modeling Real-Time Responses to Music: The Dynamics of Tonality Induction

We examined a variety of real-time responses evoked by a single piece of music, the organ Duetto BWV 805 by J S Bach. The primary data came from a concurrent probe-tone method in which the probe-tone is sounded continuously with the music. Listeners judged how well the probe tone fit with the music at each point in time. The process was repeated for all probe tones of the chromatic scale. A self-organizing map (SOM) [Kohonen 1997 Self-organizing Maps (Berlin: Springer)] was used to represent the developing and changing sense of key reflected in these judgments. The SOM was trained on the probe-tone profiles for 24 major and minor keys (Krumhansl and Kessler 1982 Psychological Review 89 334–368). Projecting the concurrent probe-tone data onto the map showed changes both in the perceived keys and in their strengths. Two dynamic models of tonality induction were tested. Model 1 is based on pitch class distributions. Model 2 is based on the tone-transition distributions; it tested the idea that the order of tones might provide additional information about tonality. Both models contained dynamic components for characterizing pitch strength and creating pitch memory representations. Both models produced results closely matching those of the concurrent probe-tone data. Finally realtime judgments of tension were measured. Tension correlated with distance away from the predominant key in the direction of keys built on the dominant and supertonic tones, and also correlated with dissonance.

[1]  Curt Sachs Rhythm and tempo , 1953 .

[2]  J. Youngblood Style as Information , 1958 .

[3]  Wilhelm Fucks,et al.  Mathematical analysis of formal structure of music , 1962, IRE Trans. Inf. Theory.

[4]  A. Treisman VERBAL CUES, LANGUAGE, AND MEANING IN SELECTIVE ATTENTION. , 1964, The American journal of psychology.

[5]  Michael T. Turvey,et al.  An auditory analogue of the sperling partial report procedure: Evidence for brief auditory storage , 1972 .

[6]  D Deutsch,et al.  Effect of repetition of standard and comparison tones on recognition memory for pitch. , 1972, Journal of experimental psychology.

[7]  Diana Deutsch,et al.  Disinhibition in pitch memory , 1975 .

[8]  J. Grey Multidimensional perceptual scaling of musical timbres. , 1977, The Journal of the Acoustical Society of America.

[9]  D Deutsch,et al.  Delayed pitch comparisons and the principle of proximity , 1978, Perception & psychophysics.

[10]  William Hutchinson,et al.  The acoustic component of western consonance , 1978 .

[11]  R. Shepard,et al.  Quantification of the Hierarchy of Tonal Functions Within a Diatonic Context , 1979 .

[12]  R. Shepard,et al.  Quantification of the hierarchy of tonal functions within a diatonic context. , 1979, Journal of experimental psychology. Human perception and performance.

[13]  C. Krumhansl The psychological representation of musical pitch in a tonal context , 1979, Cognitive Psychology.

[14]  D J Mewhort,et al.  Perception of structure in short melodic sequences. , 1981, Journal of experimental psychology. Human perception and performance.

[15]  P. Fraisse 6 – Rhythm and Tempo , 1982 .

[16]  C. Krumhansl,et al.  Tracing the dynamic changes in perceived tonal organization in a spatial representation of musical keys. , 1982, Psychological review.

[17]  C. Krumhansl,et al.  Tracing the dynamic changes in perceived tonal organization in a spatial representation of musical keys. , 1982 .

[18]  R. Shepard,et al.  Tonal Schemata in the Perception of Music in Bali and in the West , 1984 .

[19]  C. Krumhansl,et al.  Tonal hierarchies in the music of north India. , 1984, Journal of experimental psychology. General.

[20]  Edward C. Carterette,et al.  Pitch and Duration as Determinants of Musical Space , 1985 .

[21]  C. Krumhansl,et al.  The Petroushka Chord: A Perceptual Investigation , 1986 .

[22]  C. Krumhansl,et al.  The Perception of Tone Hierarchies and Mirror Forms in Twelve-Tone Serial Music , 1987 .

[23]  Mark Steedman,et al.  On Interpreting Bach , 1987 .

[24]  William Forde Thompson,et al.  Sensitivity to Key Change in Chorale Sequences: A Comparison of Single Voices and Four-Voice Harmony , 1989 .

[25]  M. Schmuckler Expectation in music: Investigation of melodic and harmonic processes. , 1989 .

[26]  C. Krumhansl Cognitive Foundations of Musical Pitch , 1990 .

[27]  Annabel J. Cohen,et al.  Tonality and perception: Musical scales primed by excerpts fromThe Well-Tempered Clavier of J. S. Bach , 1991, Psychological research.

[28]  W F Thompson,et al.  Asymmetry of perceived key movement in chorale sequences: Converging evidence from a probe-tone analysis , 1992, Psychological research.

[29]  William Forde Thompson,et al.  Perceived Key Movement in Four- Voice Harmony and Single Voices , 1992 .

[30]  C. Krumhansl,et al.  Isolating the dynamic attributes of musical timbre. , 1993, The Journal of the Acoustical Society of America.

[31]  Clifford K. Madsen,et al.  The Experience of Musical Tension: A Replication of Nielsen's Research Using the Continuous Response Digital Interface , 1993 .

[32]  Robert O. Gjerdingen,et al.  Apparent Motion in Music , 1994 .

[33]  Robert O. Gjerdingen,et al.  Apparent Motion in Music?: Music Perception , 1994 .

[34]  R. Parncutt A Perceptual Model of Pulse Salience and Metrical Accent in Musical Rhythms , 1994 .

[35]  C. Krumhansl Music Psychology and Music Theory: Problems and Prospects , 1995 .

[36]  Teuvo Kohonen,et al.  Self-Organizing Maps , 2010 .

[37]  Dina Q. Goldin,et al.  On Similarity Queries for Time-Series Data: Constraint Specification and Implementation , 1995, CP.

[38]  Marc Leman,et al.  A Model of Retroactive Tone-Center Perception , 1995 .

[39]  Petri Toiviainen,et al.  Musical timbre: Similarity ratings correlate with computational feature space distances* , 1995 .

[40]  W. E. Fredrickson,et al.  A Comparison of Perceived Musical Tension and Aesthetic Response , 1995 .

[41]  L. Cuddy,et al.  Expectancies generated by melodic intervals: Perceptual judgments of melodic continuity , 1995, Perception & psychophysics.

[42]  Francesca Rossi,et al.  Proceedings of the First International Conference on Principles and Practice of Constraint Programming , 1995 .

[43]  C. Krumhansl A Perceptual Analysis of Mozart's Piano Sonata K. 282: Segmentation, Tension, and Musical Ideas , 1996 .

[44]  Fred Lerdahl,et al.  Calculating Tonal Tension , 1996 .

[45]  Marc Leman,et al.  Schema and Gestalt: Testing the Hypothesis of Psychoneural Isomorphism by Computer Simulation , 1996, Joint International Conference on Cognitive and Systematic Musicology.

[46]  C. Krumhansl An exploratory study of musical emotions and psychophysiology. , 1997, Canadian journal of experimental psychology = Revue canadienne de psychologie experimentale.

[47]  C. Krumhansl,et al.  Can Dance Reflect the Structural and Expressive Qualities of Music? A Perceptual Experiment on Balanchine's Choreography of Mozart's Divertimento No. 15 , 1997 .

[48]  Risto Näätänen,et al.  Timbre Similarity: Convergence of Neural, Behavioral, and Computational Approaches , 1998 .

[49]  Carol L. Krumhansl,et al.  Topic in Music: An Empirical Study of Memorability, Openness, and Emotion in Mozart's String Quintet in C Major and Beethoven's String Quartet in A Minor , 1998 .

[50]  C. Krumhansl,et al.  Melodic Expectation in Finnish Spiritual Folk Hymns: Convergence of Statistical, Behavioral, and Computational Approaches , 1999 .

[51]  Jamshed J. Bharucha,et al.  Neural Nets, Temporal Composites, and Tonality , 1999 .

[52]  David Temperley,et al.  What's Key for Key? The Krumhansl-Schmuckler Key-Finding Algorithm Reconsidered , 1999 .

[53]  M. Schmuckler Testing Models of Melodic Contour Similarity , 1999 .

[54]  Ilya Shmulevich,et al.  Localized Key Finding: Algorithms and Applications , 2000 .

[55]  L. Boroditsky Metaphoric structuring: understanding time through spatial metaphors , 2000, Cognition.

[56]  Barbara Tillmann,et al.  Implicit learning of tonality: A self-organizing approach , 2000 .

[57]  B. Tillmann,et al.  Implicit learning of tonality: a self-organizing approach. , 2000, Psychological review.

[58]  Marc Leman,et al.  Guest Editorial: Tonality Induction , 2000 .

[59]  C. Krumhansl,et al.  Cross-cultural music cognition: cognitive methodology applied to North Sami yoiks , 2000, Cognition.

[60]  B. Silverman,et al.  Functional Data Analysis , 1997 .

[61]  Fred Lerdahl,et al.  Tonal Pitch Space , 2001 .

[62]  Emery Schubert Correlation analysis of continuous emotional response to music: Correcting for the effects of serial correlation , 2001 .

[63]  J. Snyder,et al.  Tapping to Bach: Resonance-Based Modeling of Pulse , 2003 .