Ritme and Rizumu: studies in music cognition

The words Ritme and Rizumu mean “rhythm” in Dutch and Japanese respectively. The words were chosen for the title of this thesis to allude to the distinct prosodic characteristics of different languages. In this thesis, we have investigated musical rhythm perception and production from various angles. One of the main aims was to examine the question of cross-domain influence, namely the effect of exposure to speech rhythm on music rhythm processing. We have found some cases where such an effect is apparent. Furthermore, the strength of the effect has been shown to interact with the complexity of the rhythmic structures. A more salient effect seems to emerge for rhythmic patterns that have a more complex structure and therefore require more complex mental coding. In addition to this cross-domain influence, an exposure to the rhythmic sequences measured as probability of occurrence or familiarity was examined and evaluated in a Bayesian framework. Using this framework, we have demonstrated the possibility of predicting rhythm perception from rhythm production data and priors. The method offers a new perspective on the relation between music rhythm perception and production; the rhythm perception process is adaptive to information in one’s environment. Finally, by looking at the degree of transfer of learning on rhythm production, we have shown that certain rhythmic patterns seem to be represented in a more similar way than others. Therefore we have indirectly shown that the categorical representation of rhythmic patterns is involved in the process of production;

[1]  Isabelle Peretz,et al.  Singing in the Brain: Insights from Cognitive Neuropsychology , 2004 .

[2]  B H Repp,et al.  Detecting deviations from metronomic timing in music: Effects of perceptual structure on the mental timekeeper , 1999, Perception & psychophysics.

[3]  J. Sundberg,et al.  Replicability and accuracy of pitch patterns in professional singers , 2007 .

[4]  John A. Sloboda,et al.  The role of practice in the development of performing musicians , 1996 .

[5]  Takehiko Ito,et al.  Sentence processing strategies in adult bilinguals , 1989 .

[6]  D J Povel,et al.  A theoretical framework for rhythm perception , 1984, Psychological research.

[7]  Ian Robertsonnm,et al.  Imitative problem solving: Why transfer of learning often fails to occur , 2000 .

[8]  Henkjan Honing POCO: An Environment for Analysing, Modifying and Generating Expression in Music , 1990, ICMC.

[9]  Finn V. Jensen,et al.  Bayesian Networks and Decision Graphs , 2001, Statistics for Engineering and Information Science.

[10]  H. C. Longuet-Higgins,et al.  The Rhythmic Interpretation of Monophonic Music , 1984 .

[11]  D. Kersten,et al.  Illusions, perception and Bayes , 2002, Nature Neuroscience.

[12]  C Palmer,et al.  Monitoring and planning capacities in the acquisition of music performance skills. , 1997, Canadian journal of experimental psychology = Revue canadienne de psychologie experimentale.

[13]  Peter A. van der Helm,et al.  Simplicity versus likelihood in visual perception: from surprisals to precisals. , 2000 .

[14]  D. Povel,et al.  Accents in equitone sequences , 1981, Perception & psychophysics.

[15]  Peter Roach On the distinction between 'stress-timed' and 'syllable-timed' languages , 1982 .

[16]  T. Scruggs,et al.  Acquisition and Transfer of Learning Strategies by Gifted and Nongifted Students , 1988 .

[17]  Nico Schuler Freedom and Constraints in Timing and Ornamentation (review) , 2004 .

[18]  C. Wright,et al.  Temporal rescaling of simple and complex ratios in rhythmic tapping. , 1995 .

[19]  J. Sundberg,et al.  On the anatomy of the retard: A study of timing in music , 1980 .

[20]  D. Harwood Universals in Music: A Perspective from Cognitive Psychology , 1976 .

[21]  B. Repp Categorical Perception: Issues, Methods, Findings , 1984 .

[22]  J. Jastrow THE TIME-RELATIONS OF MENTAL PHENOMENA. , 1890, Science.

[23]  P. Fraisse Perception and estimation of time. , 1984, Annual review of psychology.

[24]  A. Gabrielsson Music Performance Research at the Millennium , 2003 .

[25]  Esther Grabe,et al.  THE ACQUISITION OF RHYTHMIC PATTERNS IN ENGLISH AND FRENCH , 1999 .

[26]  G. Rizzolatti,et al.  Premotor cortex and the recognition of motor actions. , 1996, Brain research. Cognitive brain research.

[27]  Eric Clarke,et al.  Imitating and Evaluating Real and Transformed Musical Performances , 1993 .

[28]  Peter Desain,et al.  The Bayesian Way to Relate Rhythm Perception and Production , 2006 .

[29]  B. Wenk Just in time: on speech rhythms in music , 1987 .

[30]  John A. Sloboda,et al.  Expressive skill in two pianists: metrical communication in real and simulated performances , 1985 .

[31]  Peter Desain,et al.  Development of real-time visual feedback assistance in singing training: a review , 2006, J. Comput. Assist. Learn..

[32]  J. Sloboda The Musical Mind: The Cognitive Psychology of Music , 1987 .

[33]  W. L. Windsor,et al.  Expressive Timing and Dynamics in Real and Artificial Musical Performances: Using an Algorithm as an Analytical Tool , 1997 .

[34]  J. Mehler,et al.  Language discrimination by newborns: toward an understanding of the role of rhythm. , 1998, Journal of experimental psychology. Human perception and performance.

[35]  Peter Desain,et al.  A structurally guided method for the decomposition of expression in music performance. , 2006, The Journal of the Acoustical Society of America.

[36]  L. Demany,et al.  Limits of rhythm perception , 2002, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[37]  I. Peretz,et al.  Singing in the Brain: Independence of Lyrics and Tunes , 1998 .

[38]  Changing Tunes: Musical Experience and Self-Perception Amongst School and University Music Students , 2002 .

[39]  B H Repp,et al.  A microcosm of musical expression: II. Quantitative analysis of pianists' dynamics in the initial measures of Chopin's Etude in E major. , 1999, The Journal of the Acoustical Society of America.

[40]  W. L. Reed,et al.  National Anthems of the World , 1985 .

[41]  Graeme B. Wilson,et al.  Constructions of jazz: How Jazz musicians present their collaborative musical practice , 2006 .

[42]  Yukari Hirata,et al.  Computer Assisted Pronunciation Training for Native English Speakers Learning Japanese Pitch and Durational Contrasts , 2004 .

[43]  Low Ee Ling,et al.  Q uantitative Characterizations of Speech Rhythm: Syllable-Timing in Singapore English , 2000, Language and speech.

[44]  Peter A. Lachenbruch,et al.  Statistics: Probability Inference and Decision, Volume 1 , 1971 .

[45]  Simon R. Hawkins,et al.  Imitation and production of interval ratios , 1986, Perception & psychophysics.

[46]  B H Repp,et al.  Expressive timing in Schumann's "Träumerei:" an analysis of performances by graduate student pianists. , 1995, The Journal of the Acoustical Society of America.

[47]  Yoshitaka Nakajima,et al.  Time-Shrinking and Categorical Temporal Ratio Perception: Evidence for a 1:1 Temporal Category , 2006 .

[48]  R. Diehl,et al.  Speech Perception , 2004, Annual review of psychology.

[49]  David Temperley,et al.  A Bayesian Approach to Key-Finding , 2002, ICMAI.

[50]  E. Grabe,et al.  Durational variability in speech and the rhythm class hypothesis , 2005 .

[51]  H Pashler,et al.  How persuasive is a good fit? A comment on theory testing. , 2000, Psychological review.

[52]  E. Altenmüller,et al.  Hits to the left, flops to the right: different emotions during listening to music are reflected in cortical lateralisation patterns , 2002, Neuropsychologia.

[53]  R. M. Dauer Stress-timing and syllable-timing reanalyzed. , 1983 .

[54]  G. L. Collier,et al.  A Study of Timing in Two Louis Armstrong Solos , 2002 .

[55]  C. Drake,et al.  Synchronizing with Music: Intercultural Differences , 2003, Annals of the New York Academy of Sciences.

[56]  S. Trehub,et al.  Metrical Categories in Infancy and Adulthood , 2005, Psychological science.

[57]  R. Ashley Do[[n't]] Change a Hair for Me: The Art of Jazz Rubato , 2002 .

[58]  Peter Desain,et al.  The Formation of Rhythmic Categories and Metric Priming , 2003, Perception.

[59]  Marina Nespor,et al.  On the rhythm parameter in phonology , 1990 .

[60]  Carol A. Seger,et al.  Implicit learning. , 1994, Psychological bulletin.

[61]  Jeff Pressing,et al.  Cognitive complexity and the structure of musical patterns , 1999 .

[62]  F. Ramus Acoustic correlates of linguistic rhythm: Perspectives , 2002 .

[63]  Carolyn Drake Perceptual and performed accents in musical sequences. , 1991 .

[64]  B. Rosner,et al.  Categories and boundaries in speech and music* , 1974 .

[65]  R. Schmidt,et al.  Transfer of learning among motor patterns with different relative timing. , 1988 .

[66]  Peter Desain,et al.  Practice Space: A platform for real-time visual feedback in music instruction , 2006 .

[67]  Peter Essens,et al.  Perception of Temporal Patterns , 1985 .

[68]  Peter Desain,et al.  A cross-cultural study of the rhythm in English and Japanese popular music , 2004 .

[69]  D. M. Green,et al.  Signal detection theory and psychophysics , 1966 .

[70]  A. Samuel,et al.  The role of knowledge-based expectations in music perception: evidence from musical restoration. , 1990, Journal of experimental psychology. General.

[71]  Alf Gabrielsson,et al.  Performance of rhythm patterns , 1974 .

[72]  H C Longuet-Higgins,et al.  The Perception of Musical Rhythms , 1982, Perception.

[73]  B H Repp,et al.  Variations on a theme by chopin: relations between perception and production of timing in music. , 1998, Journal of experimental psychology. Human perception and performance.

[74]  B. Burns,et al.  Perceptual and motor factors in the imitation of simple temporal patterns , 1989, Psychological research.

[75]  Carol L. Krumhansl,et al.  Infants’ Perception of Phrase Structure in Music , 1990 .

[76]  C. Drake,et al.  The Quest for Universals in Temporal Processing in Music , 2001, Annals of the New York Academy of Sciences.

[77]  P. D. Eimas,et al.  Speech Perception in Infants , 1971, Science.

[78]  W. Siegel,et al.  Categorical perception of tonal intervals: Musicians can't tell sharp irotaflat , 1977 .

[79]  Henkjan Honing The Final Ritard: On Music, Motion, and Kinematic Models , 2003, Computer Music Journal.

[80]  Richard I. Ivry,et al.  Attention and Structure in Sequence Learning , 2004 .

[81]  J. Saffran,et al.  Music and Language: A Developmental Comparison , 2004 .

[82]  Ian Cross,et al.  The Andean anacrusis? Rhythmic structure and perception in Easter songs of Northern Potosí, Bolivia , 2000 .

[83]  H Eisler,et al.  Experiments on subjective duration 1968-1975: a collection of power function exponents. , 1976, Psychological bulletin.

[84]  M. Studdert-Kennedy,et al.  Theoretical notes. Motor theory of speech perception: a reply to Lane's critical review. , 1970, Psychological review.

[85]  R. Jackendoff,et al.  A Generative Theory of Tonal Music , 1985 .

[86]  S. M. Williams,et al.  The Premotor Cortex , 2001 .

[87]  Peter Desain,et al.  Rhythm Quantization for Transcription , 2000, Computer Music Journal.

[88]  P J Essens,et al.  Hierarchical organization of temporal patterns , 1986, Perception & psychophysics.

[89]  Isabelle Peretz,et al.  Processing Prosodic and Musical Patterns: A Neuropsychological Investigation , 1998, Brain and Language.

[90]  Peter Desain,et al.  Effects of Tempo on the Timing of Simple Musical Rhythms , 2002 .

[91]  Carolyn Drake,et al.  Sources of timing variations in music performance: A psychological segmentation model , 1998 .

[92]  Aniruddh D. Patel Syntactic Processing in Language and Music: Different Cognitive Operations, Similar Neural Resources? , 1998 .

[93]  G. Aschersleben,et al.  The Theory of Event Coding (TEC): a framework for perception and action planning. , 2001, The Behavioral and brain sciences.

[94]  C. Drake,et al.  Reproduction of musical rhythms by children, adult musicians, and adult nonmusicians , 1993, Perception & psychophysics.

[95]  C. Krumhansl Music as Cognition. , 1987 .

[96]  B. Repp Diversity and commonality in music performance: an analysis of timing microstructure in Schumann's "Träumerei". , 1992, The Journal of the Acoustical Society of America.

[97]  E. Clarke Generative principles in music performance. , 1988 .

[98]  Edward H. Adelson,et al.  Motion illusions as optimal percepts , 2002, Nature Neuroscience.

[99]  Geoffrey E. Hinton,et al.  The Helmholtz Machine , 1995, Neural Computation.

[100]  Caroline Palmer,et al.  Accent structures in music performance. , 1993 .

[101]  C. Krumhansl,et al.  Mental representations for musical meter. , 1990, Journal of experimental psychology. Human perception and performance.

[102]  Peter Desain,et al.  Does expressive timing in music performance scale proportionally with tempo? , 1994 .

[103]  B. Repp,et al.  Integration of melody and text in memory for songs , 1982, Cognition.

[104]  Robert Rowe,et al.  Action and Perception in Rhythm and Music , 1989 .

[105]  P. Desain,et al.  Perception and production of short western musical rhythms , 2006 .

[106]  B H Repp A microcosm of musical expression. III. Contributions of timing and dynamics to the aesthetic impression of pianists' performances of the initial measures of Chopin's Etude in E major. , 1999, The Journal of the Acoustical Society of America.

[107]  Caroline Palmer,et al.  Linguistic prosody and musical meter in song , 1992 .

[108]  Renee Timmers,et al.  Predicting the similarity between expressive performances of music from measurements of tempo and dynamics. , 2005, The Journal of the Acoustical Society of America.

[109]  David Huron,et al.  Music Information Processing Using the Humdrum Toolkit: Concepts, Examples, and Lessons , 2002, Computer Music Journal.

[110]  A. Samuel Phonemic restoration: insights from a new methodology. , 1981, Journal of experimental psychology. General.

[111]  Peter Desain,et al.  The effect of real-time visual feedback on the training of expressive performance skills , 2006 .

[112]  C. Drake,et al.  Skill acquisition in music performance: relations between planning and temporal control , 2000, Cognition.

[113]  P. Jusczyk,et al.  Clauses are perceptual units for young infants , 1987, Cognition.

[114]  T Nakamura,et al.  The communication of dynamics between musicians and listeners through musical performance. , 1989, Perception & psychophysics.

[115]  D Schön,et al.  Comparison between Language and Music , 2001, Annals of the New York Academy of Sciences.

[116]  A. Gabrielsson,et al.  Performance of musical rhythm in 3/4 and 6/8 meter , 1983 .

[117]  Peter Desain,et al.  An analysis of rhythm in japanese and english popular music , 2003 .

[118]  E. Large,et al.  The dynamics of attending: How people track time-varying events. , 1999 .

[119]  R. Woody Learning Expressivity in Music Performance: An Exploratory Study , 2000 .

[120]  B. Repp Expressive Timing in a Debussy Prelude: A Comparison of Student and Expert Pianists , 1997 .

[121]  P. Desain,et al.  Music, Mind, and Machine: Studies in Computer Music, Music Cognition, and Artificial Intelligence , 1992 .

[122]  E. Leeuwenberg,et al.  Birkhoff revisited: beauty as a function of effect and means. , 1985, The American journal of psychology.

[123]  Kengo Ohgushi,et al.  How Are the Player's Ideas Conveyed to the Audience? , 1987 .

[124]  P. Essens,et al.  Metrical and nonmetrical representations of temporal patterns , 1985, Perception & psychophysics.

[125]  B. Repp A microcosm of musical expression. I. Quantitative analysis of pianists' timing in the initial measures of Chopin's Etude in E major. , 1998, The Journal of the Acoustical Society of America.

[126]  C. Palmer Mapping musical thought to musical performance. , 1989, Journal of experimental psychology. Human perception and performance.

[127]  R. M. Dauer Phonetic and Phonological Components of Language Rhythm , 1987 .

[128]  Eric Clarke,et al.  Rhythm and Timing in Music , 1999 .

[129]  David Huron,et al.  Agogic Contrast in French and English Themes: Further Support for Patel and Daniele (2003) , 2003 .

[130]  M. Beckman,et al.  Gesture, Segment, Prosody: Prosodic structure and tempo in a sonority model of articulatory dynamics , 1992 .

[131]  Janet E. Davidson,et al.  On the nature of melody-text integration in memory for songs☆ , 1986 .

[132]  Peter J. Beek,et al.  Multifrequency coordination in bimanual tapping: Asymmetrical coupling and signs of supercriticality. , 1995 .

[133]  Robert O. Gjerdingen,et al.  The Psychology of Music , 1972 .

[134]  Anders Askenfelt,et al.  Measurement of bow motion and bow force in violin playing , 1986 .

[135]  L. H. Shaffer,et al.  Timing in Solo and Duet Piano Performances , 1984 .

[136]  Aniruddh D. Patel,et al.  An empirical comparison of rhythm in language and music , 2003, Cognition.

[137]  Jessica Maye,et al.  Infant sensitivity to distributional information can affect phonetic discrimination , 2002, Cognition.

[138]  Toshie Nakamura,et al.  The communication of dynamics between musicians and listeners through musical performance , 1987 .

[139]  Roger A. Kendall,et al.  Comparative Music Perception and Cognition , 1999 .

[140]  Robert J. Crutcher,et al.  The role of deliberate practice in the acquisition of expert performance. , 1993 .

[141]  E. Parzen On Estimation of a Probability Density Function and Mode , 1962 .

[142]  A. Gabrielsson,et al.  Methods for analyzing performance of musical rhythm , 1980 .

[143]  Lee Osterhout,et al.  Event-related potentials and syntactic anomaly: Evidence of anomaly detection during the perception of continuous speech , 1993 .

[144]  Dharmesh Patel Rhythm , 1919, The Craft of Poetry.

[145]  D J Povel,et al.  Internal representation of simple temporal patterns. , 1981, Journal of experimental psychology. Human perception and performance.

[146]  Caroline Palmer,et al.  Temporal and Motor Transfer in Music Performance , 2003 .

[147]  N. Todd A Model of Expressive Timing in Tonal Music , 1985 .

[148]  A. Friederici,et al.  Musical syntax is processed in Broca's area: an MEG study , 2001, Nature Neuroscience.

[149]  Bruno H. Repp,et al.  Relationships Between Performance Timing, Perception of Timing Perturbations, and Perceptual‐Motor Synchronisation in Two Chopin Preludes , 1999 .

[150]  Antonios K. Travlos More Practice Does Not Necessarily Enhance Transfer of Learning: Evidence and Interpretations , 1999, Perceptual and motor skills.

[151]  J G Martin,et al.  Rhythmic (hierarchical) versus serial structure in speech and other behavior. , 1972, Psychological review.

[152]  C. Drake,et al.  Tapping in Time with Mechanically and Expressively Performed Music , 2000 .

[153]  P. Desain,et al.  The relation between rhythm perception and production: towards a bayesian model , 2002 .

[154]  Andranick Tanguiane Artificial Perception and Music Recognition , 1993, Lecture Notes in Computer Science.

[155]  B H Repp,et al.  Detectability of duration and intensity increments in melody tones: A partial connection between music perception and performance , 1995, Perception & psychophysics.

[156]  Abraham Lempel,et al.  On the Complexity of Finite Sequences , 1976, IEEE Trans. Inf. Theory.

[157]  M. Coltheart,et al.  Modularity of music processing , 2003, Nature Neuroscience.

[158]  K. Alho,et al.  Lateralized automatic auditory processing of phonetic versus musical information: A PET study , 2000, Human brain mapping.

[159]  C. Krumhansl,et al.  Pitch and rhythmic patterns affecting infants' sensitivity to musical phrase structure. , 1993, Journal of experimental psychology. Human perception and performance.

[160]  Curt Sachs Rhythm and tempo , 1953 .

[161]  Peter Desain,et al.  Computational models of beat induction: the rule-based approach , 1999 .

[162]  Roger A. Kendall,et al.  The Communication of Musical Expression , 1990 .

[163]  Isabelle Peretz,et al.  Two-way interactions between music and language: Evidence from priming recognition of tune and lyrics in familiar songs , 2004, Memory & cognition.

[164]  J. Aitchinson The crosslinguistic study of sentence processing , 1993, Journal of Child Language.

[165]  Rosalee K. Meyer,et al.  Conceptual and Motor Learning in Music Performance , 2000, Psychological science.

[166]  Anders Friberg,et al.  Swing Ratios and Ensemble Timing in Jazz Performance: Evidence for a Common Rhythmic Pattern , 2002 .

[167]  B H Repp,et al.  Relational invariance of expressive microstructure across global tempo changes in music performance: An exploratory study , 1994, Psychological research.

[168]  D. Berlyne,et al.  Aesthetics and Psychobiology , 1975 .

[169]  González,et al.  Symmetric kicked self-oscillators: Iterated maps, strange attractors, and symmetry of the phase-locking Farey hierarchy. , 1985, Physical review letters.

[170]  Karl J. Friston Functional integration and inference in the brain , 2002, Progress in Neurobiology.

[171]  B. Repp Probing the cognitive representation of musical time: Structural constraints on the perception of timing perturbations , 1992, Cognition.

[172]  Hans-Henning Schulze,et al.  Categorical perception of rhythmic patterns , 1989 .

[173]  Luke Windsor,et al.  Computational Modeling of Music Cognition: Problem or Solution? , 1998 .

[174]  C. Drake Influence of age and musical experience on timing and intensity variations in reproductions of short musical rhythms , 1993 .

[175]  F. Ramus,et al.  Correlates of linguistic rhythm in the speech signal , 1999, Cognition.

[176]  C. Palmer Music performance. , 1997, Annual review of psychology.

[177]  J. Swets,et al.  A decision-making theory of visual detection. , 1954, Psychological review.

[178]  Aniruddh D. Patel,et al.  Language, music, syntax and the brain , 2003, Nature Neuroscience.