Real-time movement prediction for improved control of neuroprosthetic devices

Replacing lost hands with prosthetic devices that offer the same functionality as natural limbs is an open challenge, as current technology is often limited to basic grasps by the low information readout. In this work, we develop a probabilistic inference-based method that allows for improved control of neuroprosthetic devices. We observe the behaviour of the undamaged limb to predict the most likely actions of lost limbs. Offline, our algorithm learns movement primitives (e.g. various types of grasps) from a database of recordings from healthy subjects performing everyday activities. Online, it performs Bayesian inference to determine the currently active movement primitive from the observed limbs and estimates the most likely movement of the missing limbs from the training data. We can demonstrate on test data that this two-stage approach yields statistically significantly higher prediction accuracy than linear regression approaches that reconstruct limb movements from their overall correlation structure.

[1]  William W. Abbott,et al.  Large-field study of ultra low-cost, non-invasive task level BMI , 2013, 2013 6th International IEEE/EMBS Conference on Neural Engineering (NER).

[2]  Jon A. Mukand,et al.  Neuronal ensemble control of prosthetic devices by a human with tetraplegia , 2006, Nature.

[3]  Emilio Bizzi,et al.  Modular organization of motor behavior in the frog's spinal cord , 1995, Trends in Neurosciences.

[4]  Nicolas Y. Masse,et al.  Reach and grasp by people with tetraplegia using a neurally controlled robotic arm , 2012, Nature.

[5]  David Elliott,et al.  In the Wild , 2010 .

[6]  Faisal Aldo Deriving motion primitives from naturalistic hand movements for neuroprosthetic control , 2012 .

[7]  Andrew S. Whitford,et al.  Cortical control of a prosthetic arm for self-feeding , 2008, Nature.

[8]  A Aldo Faisal,et al.  The structured variability of finger coordination in daily tasks , 2011, BMC Neuroscience.

[9]  J. Wolpaw,et al.  Multichannel EEG-based brain-computer communication. , 1994, Electroencephalography and clinical neurophysiology.

[10]  A. Faisal,et al.  Noise in the nervous system , 2008, Nature Reviews Neuroscience.

[11]  Constantinos Gavriel,et al.  Wireless kinematic body sensor network for low-cost neurotechnology applications “in-the-wild” , 2013, 2013 6th International IEEE/EMBS Conference on Neural Engineering (NER).

[12]  Patrick van der Smagt,et al.  Learning EMG control of a robotic hand: towards active prostheses , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[13]  Constantinos Gavriel,et al.  Robust, ultra low-cost MMG system with brain-machine-interface applications , 2013, 2013 6th International IEEE/EMBS Conference on Neural Engineering (NER).

[14]  Reza Shadmehr,et al.  Learning of action through adaptive combination of motor primitives , 2000, Nature.

[15]  W W Abbott,et al.  Ultra-low-cost 3D gaze estimation: an intuitive high information throughput compliment to direct brain–machine interfaces , 2012, Journal of neural engineering.

[16]  M. Swiontkowski Targeted Muscle Reinnervation for Real-time Myoelectric Control of Multifunction Artificial Arms , 2010 .

[17]  Robert D. Lipschutz,et al.  Targeted reinnervation for enhanced prosthetic arm function in a woman with a proximal amputation: a case study , 2007, The Lancet.

[18]  R. Roeschlein,et al.  Factors related to successful upper extremity prosthetic use , 1989, Prosthetics and orthotics international.

[19]  Jonathan R Wolpaw,et al.  Control of a two-dimensional movement signal by a noninvasive brain-computer interface in humans. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[20]  J. Davidson A survey of the satisfaction of upper limb amputees with their prostheses, their lifestyles, and their abilities. , 2002, Journal of hand therapy : official journal of the American Society of Hand Therapists.