Application of concepts from cross-recurrence analysis in speech production: an overview and comparison with other nonlinear methods.

PURPOSE The aim of this article was to introduce an important tool, cross-recurrence analysis, to speech production applications by showing how it can be adapted to evaluate the similarity of multivariate patterns of articulatory motion. The method differs from classical applications of cross-recurrence analysis because no phase space reconstruction is conducted, and a cleaning algorithm removes the artifacts from the recurrence plot. The main features of the proposed approach are robustness to nonstationarity and efficient separation of amplitude variability from temporal variability. METHOD The authors tested these claims by applying their method to synthetic stimuli whose variability had been carefully controlled. The proposed method was also demonstrated in a practical application: It was used to investigate the role of biomechanical constraints in articulatory reorganization as a consequence of speeded repetition of CVCV utterances containing a labial and a coronal consonant. RESULTS Overall, the proposed approach provided more reliable results than other methods, particularly in the presence of high variability. CONCLUSION The proposed method is a useful and appropriate tool for quantifying similarity and dissimilarity in patterns of speech articulator movement, especially in such research areas as speech errors and pathologies, where unpredictable divergent behavior is expected.

[1]  E. Bradley,et al.  Recurrence plots of experimental data: To embed or not to embed? , 1998, Chaos.

[2]  Sue E Roulstone,et al.  Distinguishing groups of children with persistent speech disorder: Findings from a prospective population study , 2012, Logopedics, phoniatrics, vocology.

[3]  Björn Lindblom,et al.  Speech transforms , 1992, Speech Commun..

[4]  Susanne Fuchs,et al.  The labial coronal effect revisited , 2011 .

[5]  P. Hoole,et al.  Jaw and Order , 2007, Language and speech.

[6]  S. Tasko,et al.  Orofacial movements associated with fluent speech in persons who stutter. , 2004, Journal of speech, language, and hearing research : JSLHR.

[7]  J. Hartigan,et al.  The Dip Test of Unimodality , 1985 .

[8]  B. Silverman,et al.  Using Kernel Density Estimates to Investigate Multimodality , 1981 .

[9]  V. Gracco,et al.  Kinematic analyses of speech, orofacial nonspeech, and finger movements in stuttering and nonstuttering adults. , 2003, Journal of speech, language, and hearing research : JSLHR.

[10]  M. Small Applied Nonlinear Time Series Analysis: Applications in Physics, Physiology and Finance , 2005 .

[11]  Norbert Marwan,et al.  How to Avoid Potential Pitfalls in Recurrence Plot Based Data Analysis , 2010, Int. J. Bifurc. Chaos.

[12]  Jean-Luc Schwartz,et al.  An articulatory basis for the labial-to-coronal effect: /pata/ seems a more stable articulatory pattern than /tapa/. , 2007, The Journal of the Acoustical Society of America.

[13]  Raymond D. Kent,et al.  Maximum performance tests of speech production. , 1987, The Journal of speech and hearing disorders.

[14]  Jonathan L Preston,et al.  Speed and accuracy of rapid speech output by adolescents with residual speech sound errors including rhotics , 2009, Clinical linguistics & phonetics.

[15]  V L Gracco,et al.  On the registration of time and the patterning of speech movements. , 1997, Journal of speech, language, and hearing research : JSLHR.

[16]  Jorge C Lucero,et al.  Comparison of measures of variability of speech movement trajectories using synthetic records. , 2005, Journal of speech, language, and hearing research : JSLHR.

[17]  John P. Scholz,et al.  Motor equivalence and the uncontrolled manifold , 2008 .

[18]  Howard N. Zelaznik,et al.  Spatiotemporal stability and patterning of speech movement sequences , 2004, Experimental Brain Research.

[19]  J. Kurths,et al.  Estimation of dynamical invariants without embedding by recurrence plots. , 2004, Chaos.

[20]  L. D. De Nil,et al.  Oral Kinesthetic Deficit in Adults Who Stutter: A Target-Accuracy Study , 2006, Journal of motor behavior.

[21]  J. Zbilut,et al.  Recurrence quantification analysis as a tool for nonlinear exploration of nonstationary cardiac signals. , 2002, Medical engineering & physics.

[22]  J C Lucero,et al.  Time normalization of voice signals using functional data analysis. , 2000, The Journal of the Acoustical Society of America.

[23]  Pascal H H M van Lieshout,et al.  Speech motor control in fluent and dysfluent speech production of an individual with apraxia of speech and Broca's aphasia , 2007, Clinical linguistics & phonetics.

[24]  Norbert Marwan,et al.  Line structures in recurrence plots , 2005 .

[25]  Jürgen Kurths,et al.  Recurrence plots for the analysis of complex systems , 2009 .

[26]  Hans-Georg Müller,et al.  Functional Data Analysis , 2016 .

[27]  F. Takens Detecting strange attractors in turbulence , 1981 .

[28]  A. Smith,et al.  Kinematic correlates of speaking rate changes in stuttering and normally fluent adults. , 2000, Journal of speech, language, and hearing research : JSLHR.

[29]  R. O. Dendy,et al.  Recurrence plot statistics and the effect of embedding , 2005 .

[30]  S. Chiba,et al.  Dynamic programming algorithm optimization for spoken word recognition , 1978 .

[31]  S. P. Garcia,et al.  Multivariate phase space reconstruction by nearest neighbor embedding with different time delays. , 2005, Physical review. E, Statistical, nonlinear, and soft matter physics.

[32]  Eric Vatikiotis-Bateson,et al.  Quantifying time-varying coordination of multimodal speech signals using correlation map analysis. , 2012, The Journal of the Acoustical Society of America.

[33]  Anders Löfqvist,et al.  Studying articulatory variability using Functional Data Analysis , 2002 .

[34]  Shachar Lovett,et al.  Preface , 2012, COLT.

[35]  Eamonn J. Keogh,et al.  Derivative Dynamic Time Warping , 2001, SDM.

[36]  B. Lindblom,et al.  Variability in jaw height for segments in English and Swedish VCVs , 1994 .

[37]  J. Kelso,et al.  A qualitative dynamic analysis of reiterant speech production: phase portraits, kinematics, and dynamic modeling. , 1985, The Journal of the Acoustical Society of America.

[38]  J. Abbs,et al.  Kinematic analysis of multiple movement coordination during speech in stutterers. , 1988, Brain : a journal of neurology.

[39]  R. Krakow Physiological organization of syllables: a review , 1999 .

[40]  Norbert Marwan,et al.  Selection of recurrence threshold for signal detection , 2008 .

[41]  D. Ruelle,et al.  Recurrence Plots of Dynamical Systems , 1987 .

[42]  Leonardo Lancia,et al.  A survey of methods for the analysis of the temporal evolution of speech articulator trajectories , 2012 .

[43]  Yi Xu,et al.  In defense of lab speech , 2010, J. Phonetics.

[44]  G. Zimmermann,et al.  Stuttering: a disorder of movement. , 1980, Journal of speech and hearing research.

[45]  Wolfram Ziegler,et al.  Apraxia of speech: what the deconstruction of phonetic plans tells us about the construction of articulate language , 2010 .

[46]  D. Herbert Chaos and the changing nature of science and medicine: an introduction, Mobile, AL April 1995 , 1996 .

[47]  J. Perkell,et al.  Invariance and variability in speech processes , 1987 .

[48]  B. Murdoch,et al.  Lingual kinematics during rapid syllable repetition in Parkinson's disease. , 2012, International journal of language & communication disorders.

[49]  Azriel Rosenfeld,et al.  Sequential Operations in Digital Picture Processing , 1966, JACM.

[50]  T. Gasser,et al.  Alignment of curves by dynamic time warping , 1997 .

[51]  Arpita Bose,et al.  Speech-like and non-speech lip kinematics and coordination in aphasia. , 2012, International journal of language & communication disorders.

[52]  Anders Löfqvist,et al.  Functional data analysis of articulatory variability in VCV sequences , 2003 .

[53]  Hamayun Zafar,et al.  Deep Brain Stimulation of Caudal Zona Incerta and Subthalamic Nucleus in Patients with Parkinson's Disease: Effects on Diadochokinetic Rate , 2011, Parkinson's disease.

[54]  Anders Löfqvist,et al.  Intrasegmental timing: Laryngeal-oral coordination in voiceless consonant production , 1984, Speech Commun..

[55]  J. Yaruss,et al.  Evaluating rate, accuracy, and fluency of young children's diadochokinetic productions: a preliminary investigation. , 2002, Journal of fluency disorders.

[56]  N. Marwan,et al.  Nonlinear analysis of bivariate data with cross recurrence plots , 2002, physics/0201061.

[57]  Pascal Perrier,et al.  A critical evaluation of gestural stiffness estimations in speech production based on a linear second-order model. , 2011, Journal of speech, language, and hearing research : JSLHR.

[58]  Pascal van Lieshout,et al.  Speech motor variability in people who stutter , 2010 .

[59]  C L Webber,et al.  Dynamical assessment of physiological systems and states using recurrence plot strategies. , 1994, Journal of applied physiology.

[60]  H. Bruce Stewart,et al.  Chaos, dynamical structure, and climate variability , 2008 .

[61]  Dimitris Kugiumtzis,et al.  State Space Reconstruction for Multivariate Time Series Prediction , 2008, 0809.2220.

[62]  M. Thiel,et al.  Cross recurrence plot based synchronization of time series , 2002, physics/0201062.

[63]  P. MacNeilage,et al.  On the origin of internal structure of word forms. , 2000, Science.