Across-Language Perspective on Speech Information Rate

This article is a crosslinguistic investigation of the hypothesis that the average information rate conveyed during speech communication results from a trade-off between average information density and speech rate. The study, based on seven languages, shows a negative correlation between density and rate, indicating the existence of several encoding strategies. However, these strategies do not necessarily lead to a constant information rate. These results are further investigated in relation to the notion of syllabic complexity.

[1]  B. Boruff,et al.  Short-term memory capacity: magic number or magic spell? , 1986, Journal of experimental psychology. Learning, memory, and cognition.

[2]  Yuen Ren Chao,et al.  Human Behavior and the Principle of Least Effort: An Introduction to Human Ecology , 1950 .

[3]  J H Greenberg.  Language universals: a research frontier. , 1969, Science.

[4]  Ian Maddieson,et al.  Patterns of sounds , 1986 .

[5]  M A Nowak,et al.  Language evolution and information theory. , 2000, Journal of theoretical biology.

[6]  Rosalind Temple,et al.  Phonetic Interpretation Papers in Laboratory Phonology VI: Acknowledgements , 2004 .

[7]  Eugene Charniak,et al.  Variation of Entropy and Parse Trees of Sentences as a Function of the Sentence Number , 2003, EMNLP.

[8]  Patrick Juola.  Assessing linguistic complexity , 2008 .

[9]  M. D’Esposito.  Working memory. , 2008, Handbook of clinical neurology.

[10]  Steven Greenberg,et al.  ON THE ORIGINS OF SPEECH INTELLIGIBILITY IN THE REAL WORLD , 1997 .

[11]  Mirjam Ernestus,et al.  Morphological predictability and acoustic duration of interfixes in Dutch compounds. , 2007, The Journal of the Acoustical Society of America.

[12]  Kaius Sinnemäki,et al.  Language complexity: typology, contact, change , 2008 .

[13]  S. Potter,et al.  Universals of Language , 1966 .

[14]  William D. Raymond,et al.  The Buckeye corpus of conversational speech: labeling conventions and a test of transcriber reliability , 2005, Speech Commun..

[15]  Gina-Anne Levow,et al.  The functional load of tone in Mandarin is as high as that of vowels , 2004, Speech Prosody 2004.

[16]  Östen Dahl,et al.  The growth and maintenance of linguistic complexity , 2004 .

[17]  Ian Maddieson,et al.  Investigating the "Hidden" Structure of Phonological Systems * , 2004 .

[18]  Pierre-Yves Oudeyer,et al.  Self-Organization in the Evolution of Speech , 2006, Oxford Studies in the Evolution of Language.

[19]  Ryan Keith Shosted,et al.  Correlating complexity: A typological approach , 2006 .

[20]  Jean Véronis,et al.  A multilingual prosodic database , 1998, ICSLP.

[21]  A. Martinet,et al.  Remarques sur le système phonologique du français , 2000 .

[22]  Katsuo Tamaoka,et al.  Frequency of occurrence for units of phonemes, morae, and syllables appearing in a lexical corpus of a Japanese newspaper , 2004, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[23]  Nikolaj Sergejevič Trubeckoj.  Grundzüge der Phonologie , 1989 .

[24]  Frank Keller,et al.  The Entropy Rate Principle as a Predictor of Processing Effort: An Evaluation against Eye-tracking Data , 2004, EMNLP.

[25]  J. Hawkins.  Efficiency and complexity in grammars , 2004 .

[26]  Steven Greenberg,et al.  Speaking in shorthand - A syllable-centric perspective for understanding pronunciation variation , 1999, Speech Commun..

[27]  Ian Maddieson.  Calculating phonological complexity , 2009 .

[28]  George Kingsley Zipf,et al.  Statistical Methods and Dynamic Philology , 1937 .

[29]  Richard Wiese,et al.  The Use of Time in Storytelling , 1983 .

[30]  Austin F. Frank,et al.  Speaking Rationally: Uniform Information Density as an Optimal Strategy for Language Production , 2008 .

[31]  Alexandra D’Arcy.  Variation and Change , 2013 .

[32]  Steven Greenberg,et al.  Incorporating information from syllable-length time scales into automatic speech recognition , 1998, Proceedings of the 1998 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP '98 (Cat. No.98CH36181).

[33]  Gang Peng.  TEMPORAL AND TONAL ASPECTS OF CHINESE SYLLABLES: A CORPUS-BASED COMPARATIVE STUDY OF MANDARIN AND CANTONESE , 2005 .

[34]  John C. Wells,et al.  Accents of English , 1982 .

[35]  A. Baddeley.  The episodic buffer: a new component of working memory? , 2000, Trends in Cognitive Sciences.

[36]  Ioana Chitoran,et al.  Approaches to phonological complexity , 2009 .

[37]  Patrick Juola.  Measuring Linguistic Complexity: The Morphological Tier , 1998, J. Quant. Linguistics.

[38]  G. Bower,et al.  THE PSYCHOLOGY OF LEARNING AND M·OTIVATION , 2001 .

[39]  P. Ladefoged.  A course in phonetics , 1975 .

[40]  M. Aylett,et al.  Language redundancy predicts syllabic duration and the spectral characteristics of vocalic syllable nuclei. , 2006, The Journal of the Acoustical Society of America.

[41]  Jacques Durand,et al.  Phonetics, phonology, and cognition , 2002 .

[42]  Mirjam Ernestus,et al.  Frequency distributions of uniphones, diphones, and triphones in spontaneous speech. , 2008, The Journal of the Acoustical Society of America.

[43]  Alice Turk,et al.  The Smooth Signal Redundancy Hypothesis: A Functional Explanation for Relationships between Redundancy, Prosodic Prominence, and Duration in Spontaneous Speech , 2004, Language and speech.

[44]  Roger Levy,et al.  Speakers optimize information density through syntactic reduction , 2006, NIPS.

[45]  Peter Trudgill,et al.  Linguistic and social typology: The Austronesian migrations and phoneme inventories , 2004 .

[46]  Shane T. Mueller,et al.  Theoretical implications of articulatory duration, phonological similarity, and phonological complexity in verbal working memory. , 2003, Journal of experimental psychology. Learning, memory, and cognition.

[47]  André Martinet,et al.  A Functional View of Language , 1963 .

[48]  André Martinet,et al.  Economie des changements phon??tiques , 1957 .

[49]  Ramon Ferrer i Cancho,et al.  Decoding least effort and scaling in signal frequency distributions , 2005 .

[50]  Gertraud Fenk-Oczlon,et al.  Crosslinguistic correlations between size of syllables , number of cases , and adposition order , 2004 .

[51]  R. Mishra.  Pierre-Yves Oudeyer Self-Organization in the Evolution of Speech , 2011, Cognitive Systems Research.

[52]  Charles F. Hockett,et al.  A mathematical theory of communication , 1948, MOCO.

[53]  Keith Johnson.  Massive reduction in conversational American English , 2004 .

[54]  Roman Jakobson,et al.  Fundamentals of Language , 1957 .

[55]  Joan L. Bybee,et al.  Frequency of Use and the Organization of Language , 2006 .

[56]  Martine Adda-Decker,et al.  Language identification using lattice-based phonotactic and syllabotactic approaches , 2006, 2006 IEEE Odyssey - The Speaker and Language Recognition Workshop.

[57]  C. E. SHANNON,et al.  A mathematical theory of communication , 1948, MOCO.

[58]  Marc Brysbaert,et al.  Lexique 2 : A new French lexical database , 2004, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[59]  A. Baddeley.  Working memory: looking back and looking forward , 2003, Nature Reviews Neuroscience.

[60]  Ka Cormier,et al.  Annual Meeting of the Linguistic Society of America , 2004 .

[61]  George Kingsley Zipf,et al.  Human behavior and the principle of least effort , 1949 .

[62]  Jan Khre,et al.  The Mathematical Theory of Information , 2012 .

[63]  J. Pennebaker,et al.  Psychological aspects of natural language. use: our words, our selves. , 2003, Annual review of psychology.

[64]  Elisabet Service,et al.  The Effect of Word Length on Immediate Serial Recall Depends on Phonological Complexity, Not Articulatory Duration , 1998 .

[65]  John Goldsmith,et al.  Probabilistic Models of Grammar: Phonology as Information Minimization , 2002 .

[66]  R. Port,et al.  Against Formal Phonology , 2005 .

[67]  S. Levinson,et al.  The myth of language universals: language diversity and its importance for cognitive science. , 2009, The Behavioral and brain sciences.

[68]  Björn Lindblom,et al.  Explaining Phonetic Variation: A Sketch of the H&H Theory , 1990 .

[69]  Claude E. Shannon,et al.  A mathematical theory of communication , 1948, MOCO.

[70]  G. Zipf.  The Psycho-Biology Of Language: AN INTRODUCTION TO DYNAMIC PHILOLOGY , 1999 .

[71]  John Goldsmith,et al.  On Information theory, entropy, and phonology in the 20th century , 2000 .

[72]  Robert D. King,et al.  Functional Load and Sound Change , 1967 .

[73]  A. Martinet,et al.  Economie des changements phonetiques: Traite de phonologie diachronique , 1957 .

[74]  M. Joos.  Review of the book [G.K. Zipf, The psychobiology of language] , 1936 .

[75]  G. Zipf,et al.  The Psycho-Biology of Language , 1936 .

[76]  Louis C. W. Pols,et al.  Information structure and efficiency in speech production , 2003, INTERSPEECH.

[77]  Ian Maddieson,et al.  Correlating phonological complexity: data and validation , 2005 .

[78]  Ricard V. Solé,et al.  Least effort and the origins of scaling in human language , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[79]  Roman Jakobson,et al.  Towards a logical description of languages in their phonemic aspects , 1953 .

[80]  J. Verhoeven,et al.  Speech Rate in a Pluricentric Language: A Comparison Between Dutch in Belgium and the Netherlands , 2004, Language and speech.

[81]  Frans Plank,et al.  The co-variation of phonology with morphology and syntax: A hopeful history , 1998 .

[82]  Cristian S. Calude.  The mathematical theory of information , 2007 .

[83]  Mary E. Beckman,et al.  Phonetic Interpretation Papers in Laboratory Phonology VI: Speech perception, well-formedness and the statistics of the lexicon , 2004 .

[84]  John Harris,et al.  Vowel reduction as information loss , 2005 .

[85]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[86]  Daphne Bavelier,et al.  Short-term memory span: insights from sign language , 2004, Nature Neuroscience.

[87]  A. Marchal,et al.  Speech production and speech modelling , 1990 .

[88]  John L. Casti,et al.  Art and Complexity , 2003 .

[89]  Geoffrey Sampson,et al.  Language complexity as an evolving variable , 2009 .

[90]  Daniel Nettle,et al.  Segmental inventory size, word length, and communicative efficiency , 1995 .

[91]  W J Levelt,et al.  Spoken word production: A theory of lexical access , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[92]  E Ahissar,et al.  Speech comprehension is correlated with temporal response patterns recorded from auditory cortex , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[93]  P. Ladefoged.  Articulatory Features for Describing Lexical Distinctions , 2007 .

[94]  Matthew L. Hall,et al.  Persistent Difference in Short-Term Memory Span Between Sign and Speech , 2006, Psychological science.

[95]  GERTRAUD FENK-OCZLON,et al.  Cognition, quantitative linguistics, and systemic typology , 1999 .

[96]  W. Twaddell,et al.  On Defining the Phoneme , 1935 .

[97]  J. Locke,et al.  Cost and complexity: selection for speech and language. , 2008, Journal of theoretical biology.

[98]  David Crystal,et al.  The Cambridge Encyclopedia of Language , 2012, Modern Language Review.

[99]  Jason M. Brenier,et al.  Predictability Effects on Durations of Content and Function Words in Conversational English , 2009 .

[100]  Edward Gibson,et al.  The Communicative Lexicon Hypothesis , 2009 .

[101]  Eric Fosler-Lussier,et al.  THE UNINVITED GUEST: INFORMATION'S ROLE IN GUIDING THE PRODUCTION OF SPONTANEOUS SPEECH , 2000 .

[102]  R. Fox,et al.  Articulation rate across dialect, age, and gender , 2009, Language Variation and Change.

[103]  R. Baayen,et al.  Mixed-effects modeling with crossed random effects for subjects and items , 2008 .

[104]  Peter Trudgill,et al.  Linguistic and Social Typology , 2008 .

[105]  Howard Giles,et al.  Speaker evaluations as a function of speech rate, accent and context , 1985 .

[106]  Willem J. M. Levelt,et al.  Effects of syllable frequency in speech production , 2006, Cognition.