Towards sparse coding of natural movements for neuroprosthetics and brain-machine interfaces

The correlation structure of natural hand & finger movements suggests that their motion is controlled in a lower-dimensional space than would be possible given their mechanical nature. Yet, it is unclear whether this low dimensional embedding is relevant to how the brain represents motor actions and how we can decode it for Brain-Machine Interface applications. We collected large data set of natural hand movement kinematics and analysed it using a novel sparse coding and dictionary learning approach - Sparse Movement Decomposition (SMD), which captures the embedding of the data in terms of spatial and temporal structure. We show that our sparse codes over natural movement statistics give a more parsimonious representation than the simple correlation structure. This suggest that, like V1 neuron receptive fields can be predicted from sparse code over natural image statistics, motor control may be encoded in such a manner. We further show how our sparse coding can help understand the temporal structure of behaviour, and thus our technique may be used for behavioural fingerprinting in diagnostics and for more naturalistic neuroprosthetic control.

[1]  Carolyn R. Mason,et al.  Hand synergies during reach-to-grasp. , 2001, Journal of neurophysiology.

[2]  J. F. Soechting,et al.  Postural Hand Synergies for Tool Use , 1998, The Journal of Neuroscience.

[3]  Constantinos Gavriel,et al.  Prediction of Arm End-Point Force Using Multi-channel MMG , 2014, 2014 11th International Conference on Wearable and Implantable Body Sensor Networks.

[4]  L. Fogassi,et al.  Functional properties of grasping-related neurons in the ventral premotor area F5 of the macaque monkey. , 2006, Journal of neurophysiology.

[5]  David J. Field,et al.  Emergence of simple-cell receptive field properties by learning a sparse code for natural images , 1996, Nature.

[6]  Guillermo Sapiro,et al.  Online Learning for Matrix Factorization and Sparse Coding , 2009, J. Mach. Learn. Res..

[7]  Constantinos Gavriel,et al.  A Comparison of Day-Long Recording Stability and Muscle Force Prediction between BSN-Based Mechanomyography and Electromyography , 2014, 2014 11th International Conference on Wearable and Implantable Body Sensor Networks.

[8]  Emilio Bizzi,et al.  Combinations of muscle synergies in the construction of a natural motor behavior , 2003, Nature Neuroscience.

[9]  L. Fogassi,et al.  Functional properties of grasping-related neurons in the dorsal premotor area F2 of the macaque monkey. , 2004, Journal of neurophysiology.

[10]  A. Aldo Faisal,et al.  Real-time movement prediction for improved control of neuroprosthetic devices , 2013, 2013 6th International IEEE/EMBS Conference on Neural Engineering (NER).

[11]  E. Bizzi,et al.  Central and Sensory Contributions to the Activation and Organization of Muscle Synergies during Natural Motor Behaviors , 2005, The Journal of Neuroscience.

[12]  Michael A. Saunders,et al.  Atomic Decomposition by Basis Pursuit , 1998, SIAM J. Sci. Comput..

[13]  M. Tresch,et al.  The case for and against muscle synergies , 2022 .

[14]  A. Aldo Faisal,et al.  Unsupervised Time Series Segmentation for High-Dimensional Body Sensor Network Data Streams , 2014, 2014 11th International Conference on Wearable and Implantable Body Sensor Networks.

[15]  Konrad Paul Kording,et al.  The statistics of natural hand movements , 2008, Experimental Brain Research.

[16]  R. Tibshirani Regression Shrinkage and Selection via the Lasso , 1996 .

[17]  Y. C. Pati,et al.  Orthogonal matching pursuit: recursive function approximation with applications to wavelet decomposition , 1993, Proceedings of 27th Asilomar Conference on Signals, Systems and Computers.

[18]  Emilio Bizzi,et al.  Shared and specific muscle synergies in natural motor behaviors. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[19]  G. Rizzolatti Motor and visual-motor functions of the premotor cortex , 1988 .

[20]  Stéphane Mallat,et al.  Matching pursuits with time-frequency dictionaries , 1993, IEEE Trans. Signal Process..

[21]  David J. Field,et al.  Sparse coding with an overcomplete basis set: A strategy employed by V1? , 1997, Vision Research.

[22]  Francesco Lacquaniti,et al.  Control of Fast-Reaching Movements by Muscle Synergy Combinations , 2006, The Journal of Neuroscience.

[23]  L. Ting,et al.  Muscle synergies characterizing human postural responses. , 2007, Journal of neurophysiology.