Multi-state decoding of point-and-click control signals from motor cortical activity in a human with tetraplegia

Basic neural prosthetic control of a computer cursor has been recently demonstrated by Hochberg et al. (2006) using the BrainGate system (Cyberkinetics Neurotechnology Systems, Inc.). While these results demonstrate the feasibility of intracortically-driven prostheses for humans with paralysis, a practical cursor-based computer interface requires more precise cursor control and the ability to "click" on areas of interest. Here we present the first practical point and click device that decodes both continuous states (e.g. cursor kinematics) and discrete states (e.g. click states) from a single neural population in human motor cortex. We describe a probabilistic multi-state decoder and the necessary training paradigms that enable point and click cursor control by a human with tetraplegia using an implanted microelectrode array. We present results from multiple recording sessions and quantify the point and click performance

[1]  Jon A. Mukand,et al.  Neuronal ensemble control of prosthetic devices by a human with tetraplegia , 2006, Nature.

[2]  José Carlos Príncipe,et al.  Bimodal brain-machine interface for motor control of robotic prosthetic , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[3]  Wei Wu,et al.  Bayesian Population Decoding of Motor Cortical Activity Using a Kalman Filter , 2006, Neural Computation.

[4]  Prabhat,et al.  Inferring Attentional State and Kinematics from Motor Cortical Firing Rates , 2005, 2005 IEEE Engineering in Medicine and Biology 27th Annual Conference.

[5]  A B Schwartz,et al.  Motor cortical representation of speed and direction during reaching. , 1999, Journal of neurophysiology.

[6]  Trevor Hastie,et al.  The Elements of Statistical Learning , 2001 .

[7]  Michael J. Black,et al.  Probabilistic Inference of Hand Motion from Neural Activity in Motor Cortex , 2001, NIPS.

[8]  Kenneth E. Barner,et al.  Accuracy and frequency analysis of multitouch interfaces for individuals with Parkinsonian and essential hand tremor , 2005, Assets '05.

[9]  Sarah A. Douglas,et al.  Testing pointing device performance and user assessment with the ISO 9241, Part 9 standard , 1999, CHI '99.

[10]  Michael J. Black,et al.  Closed-loop neural control of cursor motion using a Kalman filter , 2004, The 26th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.