Functional data analysis of prosodic effects on articulatory timing.

An application of functional data analysis (FDA) (Ramsay and Silverman, 2005, Functional Data Analysis, 2nd ed. (Springer-Verlag, New York)) for linguistic experimentation is explored. The functional time-registration method provided by FDA is shown to offer novel advantages in the investigation of articulatory timing. Traditionally, articulatory studies examining the effects of linguistic variables such as prosody on articulatory timing have relied on comparing the durations of speech intervals of interest defined by kinematic landmarks. Such measurements, however, do not preserve information on the detailed, continuous pattern of articulatory timing that unfolds during these intervals. We present an approach that allows the analysis of entire, continuous kinematic trajectories obtained in a movement tracking experiment examining the influence of a phrasal boundary on articulatory patterning. FDA time deformation functions, after alignment of test and reference (control) signals, reveal delaying of articulator movement (i.e., slowing of the internal clock rate) in the presence of a phrase boundary as the speech stream recedes from the boundary. This is a theoretically predicted pattern (Byrd and Saltzman, 2003, The elastic phrase: Modeling the dynamics of boundary-adjacent lengthening, Journal of Phonetics 31, 149-180.), which would be more difficult to validate with a traditional interval-based approach. It is concluded that the FDA time alignment method provides a useful tool for characterizing timing patterns in linguistic experimentation based on continuous kinematic trajectories.

[1]  Sungbok Lee,et al.  How far, how long: on the temporal scope of prosodic boundary effects. , 2006, The Journal of the Acoustical Society of America.

[2]  Laura L. Koenig,et al.  The use of functional data analysis to study variability in childrens speech: Further data , 2002 .

[3]  Dani Byrd,et al.  Intragestural dynamics of multiple prosodic boundaries , 1998 .

[4]  Shrikanth S. Narayanan,et al.  Phrasal signatures in articulation , 2000 .

[5]  Taehong Cho,et al.  Articulatory and acoustic studies on domain-initial strengthening in Korean , 2001, J. Phonetics.

[6]  W. L. Nelson Physical principles for economies of skilled movements , 1983, Biological Cybernetics.

[7]  S. Chiba,et al.  Dynamic programming algorithm optimization for spoken word recognition , 1978 .

[8]  Cécile Fougeron,et al.  Articulatory properties of initial segments in several prosodic constituents in French , 2001, J. Phonetics.

[9]  V L Gracco,et al.  On the registration of time and the patterning of speech movements. , 1997, Journal of speech, language, and hearing research : JSLHR.

[10]  J C Lucero,et al.  Time normalization of voice signals using functional data analysis. , 2000, The Journal of the Acoustical Society of America.

[11]  Taehong Cho,et al.  Domain-initial articulatory strengthening in four languages , 2003 .

[12]  M. Beckman,et al.  The articulatory kinematics of final lengthening. , 1991, The Journal of the Acoustical Society of America.

[13]  Dani Byrd,et al.  The elastic phrase: modeling the dynamics of boundary-adjacent lengthening , 2003, J. Phonetics.

[14]  J. Ramsay When the data are functions , 1982 .

[15]  V. Gracco,et al.  Functional data analyses of lip motion. , 1996, The Journal of the Acoustical Society of America.

[16]  Helmer Strik,et al.  A dynamic programming algorithm for time-aligning and averaging physiological signals related to speech , 1991 .

[17]  Paula,et al.  THE EXTENT OF COARTICULATION OF ENGLISH LIQUIDS: AN ACOUSTIC AND ARTICULATORY STUDY , 1999 .

[18]  Pascal Perrier,et al.  Articulation and acoustics of /i/ in preboundary position in French , 2005, J. Phonetics.

[19]  Anders Löfqvist,et al.  Measures of articulatory variability in VCV sequences , 2005 .

[20]  Carl de Boor,et al.  Smoothing and Least-Squares Approximation , 1978 .

[21]  M. Tabain Effects of prosodic boundary on /aC/ sequences: articulatory results. , 2003, The Journal of the Acoustical Society of America.