Model selection for the extraction of movement primitives

A wide range of blind source separation methods have been used in motor control research for the extraction of movement primitives from EMG and kinematic data. Popular examples are principal component analysis (PCA), independent component analysis (ICA), anechoic demixing, and the time-varying synergy model (d'Avella and Tresch, 2002). However, choosing the parameters of these models, or indeed choosing the type of model, is often done in a heuristic fashion, driven by result expectations as much as by the data. We propose an objective criterion which allows to select the model type, number of primitives and the temporal smoothness prior. Our approach is based on a Laplace approximation to the posterior distribution of the parameters of a given blind source separation model, re-formulated as a Bayesian generative model. We first validate our criterion on ground truth data, showing that it performs at least as good as traditional model selection criteria [Bayesian information criterion, BIC (Schwarz, 1978) and the Akaike Information Criterion (AIC) (Akaike, 1974)]. Then, we analyze human gait data, finding that an anechoic mixture model with a temporal smoothness constraint on the sources can best account for the data.

[1]  F. Lacquaniti,et al.  Five basic muscle activation patterns account for muscle activity during human locomotion , 2004, The Journal of physiology.

[2]  Tülay Adali,et al.  Estimating the number of independent components for functional magnetic resonance imaging data , 2007, Human brain mapping.

[3]  Determination of the number of sources in blind source separation , 2005 .

[4]  Lars Omlor,et al.  Blind source separation for over-determined delayed mixtures , 2006, NIPS.

[5]  Lena H Ting,et al.  A limited set of muscle synergies for force control during a postural task. , 2005, Journal of neurophysiology.

[6]  Andrea d'Avella,et al.  Matrix factorization algorithms for the identification of muscle synergies: evaluation on simulated and experimental data sets. , 2006, Journal of neurophysiology.

[7]  J. F. Soechting,et al.  Postural Hand Synergies for Tool Use , 1998, The Journal of Neuroscience.

[8]  F. Lacquaniti,et al.  Coordination of Locomotion with Voluntary Movements in Humans , 2005, The Journal of Neuroscience.

[9]  Lei Xu,et al.  Bayesian Ying Yang learning , 2007, Scholarpedia.

[10]  H. Akaike Factor analysis and AIC , 1987 .

[11]  Lars Kai Hansen,et al.  Model Selection for Convolutive ICA with an Application to Spatiotemporal Analysis of EEG , 2007, Neural Computation.

[12]  Marc G. Genton,et al.  Classes of Kernels for Machine Learning: A Statistics Perspective , 2002, J. Mach. Learn. Res..

[13]  Yiu-Ming Cheung,et al.  An empirical method to select dominant independent components in ICA for time series analysis , 1999, IJCNN'99. International Joint Conference on Neural Networks. Proceedings (Cat. No.99CH36339).

[14]  Lars Omlor,et al.  Extraction of spatio-temporal primitives of emotional body expressions , 2006, Neurocomputing.

[15]  Daniel M. Wolpert,et al.  Making smooth moves , 2022 .

[16]  Stefano Panzeri,et al.  Quantitative evaluation of muscle synergy models: a single-trial task decoding approach , 2013, Front. Comput. Neurosci..

[17]  Corey B. Hart,et al.  Distinguishing synchronous and time-varying synergies using point process interval statistics: motor primitives in frog and rat , 2013, Front. Comput. Neurosci..

[18]  N. L. Johnson,et al.  Multivariate Analysis , 1958, Nature.

[19]  Tamar Flash,et al.  Motor primitives in vertebrates and invertebrates , 2005, Current Opinion in Neurobiology.

[20]  Terrence J. Sejnowski,et al.  An Information-Maximization Approach to Blind Separation and Blind Deconvolution , 1995, Neural Computation.

[21]  Lena H Ting,et al.  Muscle synergy organization is robust across a variety of postural perturbations. , 2006, Journal of neurophysiology.

[22]  Zucchini,et al.  An Introduction to Model Selection. , 2000, Journal of mathematical psychology.

[23]  G. Sutton,et al.  The variation of hand tremor with force in healthy subjects , 1967, The Journal of physiology.

[24]  Nasser M. Nasrabadi,et al.  Pattern Recognition and Machine Learning , 2006, Technometrics.

[25]  J. Rissanen,et al.  Modeling By Shortest Data Description* , 1978, Autom..

[26]  Hiroshi Sawada,et al.  Estimating the number of sources using independent component analysis , 2005 .

[27]  H. Zelaznik,et al.  Motor-output variability: a theory for the accuracy of rapid motor acts. , 1979, Psychological review.

[28]  H. Akaike A new look at the statistical model identification , 1974 .

[29]  Carl E. Rasmussen,et al.  Gaussian processes for machine learning , 2005, Adaptive computation and machine learning.

[30]  John D. Hunter,et al.  Matplotlib: A 2D Graphics Environment , 2007, Computing in Science & Engineering.

[31]  Martin A. Giese,et al.  Perceptual relevance of kinematic components of facial movements extracted by unsupervised learning , 2012 .

[32]  F. Reif,et al.  Fundamentals of Statistical and Thermal Physics , 1965 .

[33]  A. d’Avella,et al.  Locomotor Primitives in Newborn Babies and Their Development , 2011, Science.

[34]  T. Pozzo,et al.  Tri-dimensional and triphasic muscle organization of whole-body pointing movements , 2010, Neuroscience.

[35]  R. Cattell The Scree Test For The Number Of Factors. , 1966, Multivariate behavioral research.

[36]  Stefano Panzeri,et al.  Investigating reduction of dimensionality during single-joint elbow movements: a case study on muscle synergies , 2013, Front. Comput. Neurosci..

[37]  Lars Omlor,et al.  Anechoic Blind Source Separation Using Wigner Marginals , 2011, J. Mach. Learn. Res..

[38]  Andrea d'Avella,et al.  Modularity in the motor system: decomposition of muscle patterns as combinations of time-varying synergies , 2001, NIPS.

[39]  E. Bizzi,et al.  Central and Sensory Contributions to the Activation and Organization of Muscle Synergies during Natural Motor Behaviors , 2005, The Journal of Neuroscience.

[40]  Christian Böhm,et al.  Information-Theoretic Model Selection for Independent Components , 2010, LVA/ICA.

[41]  Thierry Pozzo,et al.  Variant and invariant features characterizing natural and reverse whole-body pointing movements , 2012, Experimental Brain Research.

[42]  Tianjian Ji,et al.  FREQUENCY AND VELOCITY OF PEOPLE WALKING , 2005 .

[43]  Michael E. Tipping,et al.  Probabilistic Principal Component Analysis , 1999 .

[44]  Lei Xu,et al.  An investigation of several typical model selection criteria for detecting the number of signals , 2011 .

[45]  G. Schwarz Estimating the Dimension of a Model , 1978 .

[46]  J. Zeman,et al.  quantitative evaluation of by , 2010 .

[47]  Lars Omlor,et al.  Lateral asymmetry of bodily emotion expression , 2008, Current Biology.

[48]  T. Kaminski The coupling between upper and lower extremity synergies during whole body reaching. , 2007, Gait & posture.

[49]  J. E. Jackson,et al.  Statistical Factor Analysis and Related Methods: Theory and Applications , 1995 .

[50]  Aapo Hyvärinen,et al.  New Approximations of Differential Entropy for Independent Component Analysis and Projection Pursuit , 1997, NIPS.

[51]  Emilio Bizzi,et al.  Combinations of muscle synergies in the construction of a natural motor behavior , 2003, Nature Neuroscience.

[52]  Claire L. Roether,et al.  Critical features for the perception of emotion from gait. , 2009, Journal of vision.

[53]  E. Bizzi,et al.  Article history: , 2005 .

[54]  R. J. van Beers,et al.  The role of execution noise in movement variability. , 2004, Journal of neurophysiology.

[55]  Aapo Hyvärinen,et al.  Fast and robust fixed-point algorithms for independent component analysis , 1999, IEEE Trans. Neural Networks.

[56]  Francesco Lacquaniti,et al.  Control of Fast-Reaching Movements by Muscle Synergy Combinations , 2006, The Journal of Neuroscience.

[57]  X. Lei,et al.  An investigation of several typical model selection criteria for detecting the number of signals , 2011 .

[58]  Radford M. Neal Pattern Recognition and Machine Learning , 2007, Technometrics.

[59]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[60]  Tom Minka,et al.  Automatic Choice of Dimensionality for PCA , 2000, NIPS.

[61]  David R. Anderson,et al.  Multimodel Inference , 2004 .

[62]  Richard M. Everson,et al.  ICA: model order selection and dynamic source models , 2001 .

[63]  Eric Jones,et al.  SciPy: Open Source Scientific Tools for Python , 2001 .

[64]  S. Qin,et al.  Selection of the Number of Principal Components: The Variance of the Reconstruction Error Criterion with a Comparison to Other Methods† , 1999 .