A Real-Time Virtual Integration Environment for Neuroprosthetics and Rehabilitation

198 INTRODUCTION Within the last decade, neural prosthetics have seen tremendous progress based on advances in neuroscience, robotics, controls, electrical engineering, and applied mathematics. Virtual and real devices can now be controlled with signals recorded from a variety of locations along the neural efferent pathway from the brain to the hand. These signals originate within and on e present a Virtual Integration Environment (VIE) for neuroprosthetic devices. The VIE is an integrated software framework for coordinating distributed engineering design efforts. It provides researchers with a means to implement and test all major components involved in developing and using a neuroprosthetic device, using both virtual and hardware-in-the-loop simulations. Data provided from neural signals in the motor cortex, nerve fibers of the peripheral nervous system, and surface or intramuscular myoelectric signals can be acquired and processed to provide realtime control of real or virtual prosthetic upper limbs. The VIE can therefore be used to visualize and monitor performance of various design approaches, evaluate neural signal analysis algorithms, simulate emerging mechatronic elements, train end users to control real or virtual neuroprosthetic devices, and configure and customize takehome devices. Here we provide a comprehensive description of the system, as well as a summary of its applications for myoelectric control and neural research at multiple academic institutions. A Real-Time Virtual Integration Environment for Neuroprosthetics and Rehabilitation

[1]  R.J. Vogelstein,et al.  Air-Guitar Hero: A real-time video game interface for training and evaluation of dexterous upper-extremity neuroprosthetic control algorithms , 2008, 2008 IEEE Biomedical Circuits and Systems Conference.

[2]  R. Jacob Vogelstein,et al.  The use of a virtual integration environment for the real-time implementation of neural decode algorithms , 2008, 2008 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[3]  Francesco Tenore,et al.  An embedded controller for a 7-degree of freedom prosthetic arm , 2008, 2008 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[4]  M. Hauschild,et al.  A Virtual Reality Environment for Designing and Fitting Neural Prosthetic Limbs , 2007, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[5]  M. Schieber,et al.  How somatotopic is the motor cortex hand area? , 1993, Science.

[6]  Robert D. Lipschutz,et al.  The use of targeted muscle reinnervation for improved myoelectric prosthesis control in a bilateral shoulder disarticulation amputee , 2004, Prosthetics and orthotics international.

[7]  M. Swiontkowski Targeted Muscle Reinnervation for Real-time Myoelectric Control of Multifunction Artificial Arms , 2010 .

[8]  Byron M. Yu,et al.  Mixture of Trajectory Models for Neural Decoding of Goal-directed Movements a Computational Model of Craving and Obsession Decoding Visual Inputs from Multiple Neurons in the Human Temporal Lobe Encoding Contribution of Individual Retinal Ganglion Cell Responses to Velocity and Acceleration , 2008 .

[9]  Justin J. Baker,et al.  Decoding individuated finger flexions with Implantable MyoElectric Sensors , 2008, 2008 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[10]  N. Birbaumer,et al.  BCI2000: a general-purpose brain-computer interface (BCI) system , 2004, IEEE Transactions on Biomedical Engineering.

[11]  Erik Scheme,et al.  A real-time virtual integration environment for the design and development of neural prosthetic systems , 2008, 2008 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[12]  Thilo Hinterberger,et al.  The Thought Translation Device: structure of a multimodal brain-computer communication system , 2003, First International IEEE EMBS Conference on Neural Engineering, 2003. Conference Proceedings..

[13]  Nitish V. Thakor,et al.  Decoding of Individuated Finger Movements Using Surface Electromyography , 2009, IEEE Transactions on Biomedical Engineering.

[14]  Hyun-Chool Shin,et al.  Asynchronous Decoding of Dexterous Finger Movements Using M1 Neurons , 2008, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[15]  Rahman Davoodi,et al.  A Software Tool for Faster Development of Complex Models of Musculoskeletal Systems and Sensorimotor Controllers in Simulink TM , 2002 .