Perceiving temporal regularity in music

We address how listeners perceive temporal regularity in music performances, which are rich in temporal irregularities. A computational model is described in which a small system of internal self-sustained oscillations, operating at different periods with specific phase and period relations, entrains to the rhythms of music performances. Based on temporal expectancies embodied by the oscillations, the model predicts the categorization of temporally changing event intervals into discrete metrical categories, as well as the perceptual salience of deviations from these categories. The model's predictions are tested in two experiments using piano performances of the same music with different phrase structure interpretations (Experiment 1) or different melodic interpretations (Experiment 2). The model successfully tracked temporal regularity amidst the temporal fluctuations found in the performances. The model's sensitivity to performed deviations from its temporal expectations compared favorably with the performers' structural (phrasal and melodic) intentions. Furthermore, the model tracked normal performances (with increased temporal variability) better than performances in which temporal fluctuations associated with individual voices were removed (with decreased variability). The small, systematic temporal irregularities characteristic of human performances (chord asynchronies) improved tracking, but randomly generated temporal irregularities did not. These findings suggest that perception of temporal regularity in complex musical sequences is based on temporal expectancies that adapt in response to temporally fluctuating input.

[1]  Robert Rowe,et al.  Action and Perception in Rhythm and Music , 1989 .

[2]  C. Hoequist,et al.  Syllable Duration in Stress-, Syllable- and Mora-Timed Languages , 1983 .

[3]  C. Krumhansl,et al.  Mental representations for musical meter. , 1990, Journal of experimental psychology. Human perception and performance.

[4]  From Clocks to Chaos: The Rhythms of Life , 1988 .

[5]  T Nakamura,et al.  The communication of dynamics between musicians and listeners through musical performance. , 1989, Perception & psychophysics.

[6]  B H Repp,et al.  Patterns of expressive timing in performances of a Beethoven minuet by nineteen famous pianists. , 1988, The Journal of the Acoustical Society of America.

[7]  S. Black The Musical Mind. , 1997 .

[8]  Mari Riess Jones,et al.  Sensitivity to time change : The role of context and skill , 1997 .

[9]  J.C. Brown Determination of Musical Meter using the Method of Autocorrelation , 1991, Final Program and Paper Summaries 1991 IEEE ASSP Workshop on Applications of Signal Processing to Audio and Acoustics.

[10]  James R. Hurford,et al.  Linguistic Controversies: Essays in Linguistic Theory and Practice in Honour of F. R. Palmer , 1984 .

[11]  J G Martin,et al.  Rhythmic (hierarchical) versus serial structure in speech and other behavior. , 1972, Psychological review.

[12]  N. Todd A Model of Expressive Timing in Tonal Music , 1985 .

[13]  J. Devin McAuley,et al.  Temporally directed attending in the discrimination of tempo: Further support for an entrainment model , 1995 .

[14]  K. Pike,et al.  The intonation of American English , 1946 .

[15]  Caroline Palmer,et al.  Accent structures in music performance. , 1993 .

[16]  P. Jusczyk,et al.  Episodic memory for musical prosody. , 2001 .

[17]  A. Prince,et al.  On stress and linguistic rhythm , 1977 .

[18]  Elisabeth Selkirk,et al.  Phonology and Syntax: The Relation between Sound and Structure , 1984 .

[19]  piano Barbara Scheidker,et al.  Sonata in A Major, K. 331 , 1979 .

[20]  E. Large Modeling Beat Perception with a Nonlinear Oscillator , .

[21]  H C Longuet-Higgins,et al.  The Perception of Musical Rhythms , 1982, Perception.

[22]  Alf Gabrielsson,et al.  Performance of rhythm patterns , 1974 .

[23]  W. R. Garner,et al.  The Perception and Learning of Temporal Patterns , 1968, The Quarterly journal of experimental psychology.

[24]  Jeff Pressing,et al.  The referential dynamics of cognition and action , 1999 .

[25]  Caroline Palmer,et al.  On the Assignment of Structure in Music Performance , 1996 .

[26]  Hans-Henning Schulze,et al.  Categorical perception of rhythmic patterns , 1989 .

[27]  C Palmer,et al.  Range of planning in music performance. , 1995, Journal of experimental psychology. Human perception and performance.

[28]  B. Repp Probing the cognitive representation of musical time: Structural constraints on the perception of timing perturbations , 1992, Cognition.

[29]  B. C. Griffith,et al.  The discrimination of speech sounds within and across phoneme boundaries. , 1957, Journal of experimental psychology.

[30]  Carl E. Seashore Objective Analysis of Musical Performance , 1937 .

[31]  E. Clarke,et al.  The perception of expressive timing in music , 1989, Psychological research.

[32]  R. Jackendoff,et al.  A Generative Theory of Tonal Music , 1985 .

[33]  Peter Desain,et al.  A (De)Composable Theory of Rhythm Perception , 1992 .

[34]  Neil P. McAngus Todd,et al.  The auditory “Primal Sketch”: A multiscale model of rhythmic grouping , 1994 .

[35]  Yoshitaka Nakajima,et al.  Auditory Scene Analysis: The Perceptual Organization of Sound Albert S. Bregman , 1992 .

[36]  John F. Kolen,et al.  Resonance and the Perception of Musical Meter , 1994, Connect. Sci..

[37]  B. Hayes The phonology of rhythm in English , 1984 .

[38]  Judith C. Brown Determination of musical meter using the method of autocorrelation. , 1992 .

[39]  B. Repp Patterns of note onset asynchronies in expressive piano performance. , 1996, The Journal of the Acoustical Society of America.

[40]  L. H. Shaffer,et al.  Metre and rhythm in piano playing , 1985, Cognition.

[41]  M. R. Jones,et al.  Time, our lost dimension: toward a new theory of perception, attention, and memory. , 1976, Psychological review.

[42]  D. Pisoni,et al.  SPEECH PERCEPTION AS A TALKER-CONTINGENT PROCESS. , 1993, Psychological science.

[43]  J. Sloboda The Communication of Musical Metre in Piano Performance , 1983 .

[44]  J. Mullennix,et al.  Talker Variability in Speech Processing , 1997 .

[45]  E. Large,et al.  The dynamics of attending: How people track time-varying events. , 1999 .

[46]  D Marr,et al.  Theory of edge detection , 1979, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[47]  Christopher Francis Hasty Meter As Rhythm , 1997 .

[48]  D J Povel,et al.  Internal representation of simple temporal patterns. , 1981, Journal of experimental psychology. Human perception and performance.

[49]  J. A. S. Kelso,et al.  The Self-Organized Phase Attractive Dynamics of Coordination , 1991 .

[50]  Alan M. Wing,et al.  Modeling variability and dependence in timing , 1996 .

[51]  G. Johansson Visual perception of biological motion and a model for its analysis , 1973 .

[52]  J. Sloboda Generative Processes in Music: The Psychology of Performance, Improvisation, and Composition , 1985 .

[53]  Caroline Palmer,et al.  Linguistic prosody and musical meter in song , 1992 .

[54]  Carol L. Krumhansl,et al.  Tapping to Ragtime: Cues to Pulse Finding , 2001 .

[55]  C. Palmer Mapping musical thought to musical performance. , 1989, Journal of experimental psychology. Human perception and performance.

[56]  H. Woodrow,et al.  The effect of rate of sequence upon the accuracy of synchronization. , 1932 .

[57]  Peter Roach On the distinction between 'stress-timed' and 'syllable-timed' languages , 1982 .

[58]  P. Howell,et al.  Musical structure and cognition , 1985 .

[59]  C. Palmer Music performance. , 1997, Annual review of psychology.

[60]  D. Povel,et al.  Accents in equitone sequences , 1981, Perception & psychophysics.

[61]  Rudolf Stephan,et al.  The New Harvard Dictionary of Music , 1988 .

[62]  Eric Clarke,et al.  Timing in the performance of Erik Satie's ‘Vexations’ ☆ , 1982 .

[63]  D. Abercrombie,et al.  Elements of General Phonetics , 1967 .

[64]  D. Randel,et al.  The New Harvard Dictionary of Music , 1988 .

[65]  Edward W. Large,et al.  Dynamic representation of musical structure , 1994 .

[66]  E. Clarke Generative principles in music performance. , 1988 .

[67]  E. Large On synchronizing movements to music , 2000 .

[68]  Eric D. Scheirer,et al.  Tempo and beat analysis of acoustic musical signals. , 1998, The Journal of the Acoustical Society of America.

[69]  Gary E. Wittlich,et al.  The Stratification of Musical Rhythm , 1976 .

[70]  Dirk-Jan Povel Internal representation of simple temporal patterns. , 1981 .

[71]  Grosvenor W. Cooper,et al.  The Rhythmic Structure of Music , 1971 .