Evaluation of Motor Training Performance in 3D Virtual Environment via Combining Brain-computer Interface and Haptic Feedback

Brain-computer interfaces (BCIs) based on virtual reality (VR) mostly integrate visual and/or auditory feedback. Haptic feedbackwhich has the potential on improving the feasibility and operability of VR-based BCI systems is rarely explored in previous studies. In this article, we present a novel framework of BCI system based on both visual and haptic feedback, in which users can learn to manipulate the haptic device's stylus for motor training. The effects of motor training with and without haptic feedback are evaluated by detecting and analysing the changes of electroencephalogram (EEG). The preliminary experimental results indicate that haptic feedback may influence the modulation of the beta rhythms over left and right sensorimotor cortex during hand movements. This study can be easily replicated to evaluate the existing systems with haptic feedback and used to develop new applications for motor training.

[1]  Maud Marchal,et al.  Combining Brain-Computer Interfaces and Haptics: Detecting Mental Workload to Adapt Haptic Assistance , 2012, EuroHaptics.

[2]  Arnaud Delorme,et al.  EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis , 2004, Journal of Neuroscience Methods.

[3]  R. Klatzky,et al.  Haptic perception: A tutorial , 2009, Attention, perception & psychophysics.

[4]  Bin He,et al.  Brain–Computer Interfaces Using Sensorimotor Rhythms: Current State and Future Perspectives , 2014, IEEE Transactions on Biomedical Engineering.

[5]  Cynthia Breazeal,et al.  TIKL: Development of a Wearable Vibrotactile Feedback Suit for Improved Human Motor Learning , 2007, IEEE Transactions on Robotics.

[6]  M. Jeannerod,et al.  Mental imaging of motor activity in humans , 1999, Current Opinion in Neurobiology.

[7]  Hirokazu Taki,et al.  Classification of Haptic Tasks based on Electroencephalogram Frequency Analysis , 2014, KES.

[8]  Yuru Zhang,et al.  Preliminary study on haptic-stimulation based brainwave entrainment , 2013, 2013 World Haptics Conference (WHC).

[9]  Kup-Sze Choi,et al.  Improving the discrimination of hand motor imagery via virtual reality based visual guidance , 2016, Comput. Methods Programs Biomed..

[10]  J. Wolpaw,et al.  Mu and Beta Rhythm Topographies During Motor Imagery and Actual Movements , 2004, Brain Topography.

[11]  Kup-Sze Choi,et al.  Enhancing training performance for brain–computer interface with object-directed 3D visual guidance , 2015, International Journal of Computer Assisted Radiology and Surgery.

[12]  Fabio Babiloni,et al.  Quantitative Assessment of the Training Improvement in a Motor-Cognitive Task by Using EEG, ECG and EOG Signals , 2015, Brain Topography.

[13]  J R Wolpaw,et al.  Spatial filter selection for EEG-based communication. , 1997, Electroencephalography and clinical neurophysiology.

[14]  Judy M. Vance,et al.  Virtual reality for assembly methods prototyping: a review , 2011, Virtual Reality.

[15]  T. Sejnowski,et al.  Dynamic Brain Sources of Visual Evoked Responses , 2002, Science.

[16]  G. Pfurtscheller,et al.  Brain-Computer Interfaces for Communication and Control. , 2011, Communications of the ACM.