EEG-Gesture Based Artificial Limb Movement for Rehabilitative Applications

Due to damage in parietal and/or motor cortex regions of a rehabilitative patient (subject), there can be failure while performing day-to-day basic task. Thus this chapter focuses on directing an artificial limb based on brain signals and body gesture to assist the subject. This research finds tremendous applications in rehabilitative aid for the disable persons. To concretize our goal we have developed an experimental setup, where the target subject is asked to catch a ball while his/her brain (occipital, parietal and motor cortex) signals electroencephalography (EEG) sensor and body gestures using Kinect sensor are simultaneously acquired. These two data are mapped using cascade correlation learning architecture to train Jaco robot arm to move accordingly. When a rehabilitative patient is unable to catch the ball, then in that scenario, the artificial limb is helpful for assisting the patient to catch the ball. The proposed system can be implemented not only in ball catching experiment but also in several application areas where an artificial limb needs to perform a locomotive task based on EEG and body gesture.

[1]  Guanglong Du,et al.  Markerless human-robot interface for dual robot manipulators using Kinect sensor , 2014 .

[2]  Laurent Bougrain,et al.  From the decoding of cortical activities to the control of a JACO robotic arm: a whole processing chain , 2012, ArXiv.

[3]  Amit Konar,et al.  Motor imagery, P300 and error-related EEG-based robot arm movement control for rehabilitation purpose , 2014, Medical & Biological Engineering & Computing.

[4]  Francois Routhier,et al.  Evaluation of the JACO robotic arm: Clinico-economic study for powered wheelchair users with upper-extremity disabilities , 2011, 2011 IEEE International Conference on Rehabilitation Robotics.

[5]  Sriparna Saha,et al.  A study on emotion recognition from body gestures using Kinect sensor , 2014, 2014 International Conference on Communication and Signal Processing.

[6]  Te-Won Lee.  Independent Component Analysis , 1998, Springer US.

[7]  Chenguang Yang,et al.  Human-machine interfaces based on EMG and Kinect applied to teleoperation of a mobile humanoid robot , 2012, Proceedings of the 10th World Congress on Intelligent Control and Automation.

[8]  Gernot R. Müller-Putz,et al.  Kinect-based detection of self-paced hand movements: Enhancing functional brain mapping paradigms , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[9]  Martin A. Riedmiller,et al.  A direct adaptive method for faster backpropagation learning: the RPROP algorithm , 1993, IEEE International Conference on Neural Networks.

[10]  T. Martin McGinnity,et al.  A position based visual tracking system for a 7 DOF robot manipulator using a Kinect camera , 2012, The 2012 International Joint Conference on Neural Networks (IJCNN).

[11]  Amit Konar,et al.  Interval type-2 fuzzy logic based multiclass ANFIS algorithm for real-time EEG based movement control of a robot arm , 2015, Robotics Auton. Syst..

[12]  Karan Singh,et al.  Eurographics/siggraph Symposium on Computer Animation (2003) Handrix: Animating the Human Hand , 2003 .

[13]  Christian Lebiere,et al.  The Cascade-Correlation Learning Architecture , 1989, NIPS.

[14]  Hugo Ferreira,et al.  Hybrid Brain Computer Interface Based on Gaming Technology: An Approach with Emotiv EEG and Microsoft Kinect , 2014 .

[15]  B. Yegnanarayana,et al.  Neural network classifiers for language identification using phonotactic and prosodic features , 2005, Proceedings of 2005 International Conference on Intelligent Sensing and Information Processing, 2005..

[16]  Emer Gilmartin,et al.  Multimodal conversational interaction with a humanoid robot , 2012, 2012 IEEE 3rd International Conference on Cognitive Infocommunications (CogInfoCom).

[17]  L. Somlyai,et al.  Differences between Kinect and structured lighting sensor in robot navigation , 2012, 2012 IEEE 10th International Symposium on Applied Machine Intelligence and Informatics (SAMI).

[18]  D. N. Tibarewala,et al.  EEG driven artificial limb control using state feedback PI controller , 2012, 2012 IEEE Students' Conference on Electrical, Electronics and Computer Science.

[19]  Sriparna Saha,et al.  Gesture Recognition from Indian Classical Dance Using Kinect Sensor , 2013, 2013 Fifth International Conference on Computational Intelligence, Communication Systems and Networks.

[20]  Amit Konar,et al.  EEG based artificial learning of motor coordination for visually inspired task using neural networks , 2014, 2014 International Joint Conference on Neural Networks (IJCNN).

[21]  M. Bergamasco,et al.  A New Gaze-BCI-Driven Control of an Upper Limb Exoskeleton for Rehabilitation in Real-World Tasks , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).