The closed-loop human eye-brain-hand to computer (EBH-C) interface for hand sensory-motor coordination based on force tablet

The mechanism of the sensory-to-motor transformation as well as motor-to-sensory transformation of human beings has attracted much attention in recent years. As no efficient device can record hand intrinsic behavior, it is difficult to get its neuro-physiological models of sensory-motor coordination. In this paper, we offer a system to acquire the kinematics and kinetics information of human hand movement through handwriting. Joined with human being, an eye-brain-hand to computer (EBH-C) interaction system is presented. In this human-in-the-loop-testing system, human beings acquire image, voice or text from computer by eyes or ears then write them down. The core part of the system, named as F-Tablet/spl trade/ is able to acquire the trajectory and three-axis forces of pen-tip directly and simultaneously. With the help of this system, we designed an experiment to evaluate the handwriting movements and forces controlling ability of different ages. Some experiment results were present. Aided with conventional analysis of electroencephalography (EEG) and magnetoencephalography (MEG), the whole procedures of information transmitting, acquired by eyes and ears, processed by brain, outputted and actuated by hand, can be recorded.

[1]  D J McFarland,et al.  Brain-computer interface research at the Wadsworth Center. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[2]  Febo Cincotti,et al.  Human Movement-Related Potentials vs Desynchronization of EEG Alpha Rhythm: A High-Resolution EEG Study , 1999, NeuroImage.

[3]  Arthur Prochazka,et al.  The man-machine analogy in robotics and neurophysiology , 2002 .

[4]  G. Pfurtscheller,et al.  EEG-based discrimination between imagination of right and left hand movement. , 1997, Electroencephalography and clinical neurophysiology.

[5]  Maja J. Matarić,et al.  Sensory-motor primitives as a basis for imitation: linking perception to action and biology to robotics , 2002 .

[6]  G Pfurtscheller,et al.  Graphical display and statistical evaluation of event-related desynchronization (ERD). , 1977, Electroencephalography and clinical neurophysiology.

[7]  B. Allison,et al.  The effects of self-movement, observation, and imagination on mu rhythms and readiness potentials (RP's): toward a brain-computer interface (BCI). , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[8]  G. Pfurtscheller,et al.  Optimal spatial filtering of single trial EEG during imagined hand movement. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[9]  Gert Pfurtscheller,et al.  Automatic differentiation of multichannel EEG signals , 2001, IEEE Transactions on Biomedical Engineering.

[10]  J. Rothwell,et al.  Knowledge of motor commands and the recruitment of human motoneurons. , 1987, Brain : a journal of neurology.

[11]  Conrad V. Kufta,et al.  Event-related desynchronization and movement-related cortical potentials on the ECoG and EEG. , 1994, Electroencephalography and clinical neurophysiology.