A human-assisting manipulator teleoperated by EMG signals and arm motions

This paper proposes a human-assisting manipulator teleoperated by electromyographic (EMG) signals and arm motions. The proposed method can realize a new master-slave manipulator system that uses no mechanical master controller. A person whose forearm has been amputated can use this manipulator as a personal assistant for desktop work. The control system consists of a hand and wrist control part and an arm control part. The hand and wrist control part selects an active joint in the manipulator's end-effector and controls it based on EMG pattern discrimination. The arm control part measures the position of the operator's wrist joint or the amputated part using a three-dimensional position sensor, and the joint angles of the manipulator's arm, except for the end-effector part, are controlled according to this position, which, in turn, corresponds to the position of the manipulator's joint. These control parts enable the operator to control the manipulator intuitively. The distinctive feature of our system is to use a novel statistical neural network for EMG pattern discrimination. The system can adapt itself to changes of the EMG patterns according to the differences among individuals, different locations of the electrodes, and time variation caused by fatigue or sweat. Our experiments have shown that the developed system could learn and estimate the operator's intended motions with a high degree of accuracy using the EMG signals, and that the manipulator could be controlled smoothly. We also confirmed that our system could assist the amputee in performing desktop work.

[1]  F. H. Adler.  Cybernetics, or Control and Communication in the Animal and the Machine. , 1949 .

[2]  F. Taylor.  Cybernetics (or control and communication in the animal and the machine). , 1949 .

[3]  L. Ljung,et al.  A Microprocessor System for Multifunctional Control of Upper-Limb Prostheses via Myoelectric Signal Identification , 1978 .

[4]  Sukhan Lee,et al.  The control of a prosthetic arm by EMG pattern recognition , 1982, 1982 21st IEEE Conference on Decision and Control.

[5]  Shawn W. O'Driscoll,et al.  Clinical application of basic research on continuous passive motion for disorders and injuries of synovial joints: A preliminary report of a feasibility study , 1986, Journal of orthopaedic research : official publication of the Orthopaedic Research Society.

[6]  Richard T. Johnson,et al.  Development of the Utah Artificial Arm , 1982, IEEE Transactions on Biomedical Engineering.

[7]  A. Willsky,et al.  Upper Extremity Limb Function Discrimination Using EMG Signal Analysis , 1983, IEEE Transactions on Biomedical Engineering.

[8]  K. Akazawa,et al.  Modulation of reflex EMG and stiffness in response to stretch of human finger muscle. , 1983, Journal of neurophysiology.

[9]  J. Houk,et al.  Nonlinear viscosity of human wrist. , 1984, Journal of neurophysiology.

[10]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[11]  Mitsuo Nagamachi,et al.  A limb-function discrimination method using EMG signals for the control of multifunctional powered prostheses , 1987, Systems and Computers in Japan.

[12]  Kenzo Akazawa,et al.  DEVELOPMENT OF CONTROL SYSTEM AND MYOELECTRIC SIGNAL PROCESSOR FOR BIO-MIMETIC PROSTHETIC HAND , 1988 .

[13]  M. Zak.  Terminal attractors for addressable memory in neural networks , 1988 .

[14]  Katsunori Shimohara,et al.  EMG pattern analysis and classification by neural network , 1989, Conference Proceedings., IEEE International Conference on Systems, Man and Cybernetics.

[15]  T. Sinkjaer,et al.  Regulation of wrist stiffness by the stretch reflex. , 1989, Journal of biomechanics.

[16]  R.J. Triolo,et al.  The theoretical development of a multichannel time-series myoprocessor for simultaneous limb function detection and muscle force estimation , 1989, IEEE Transactions on Biomedical Engineering.

[17]  Homayoon Kazerooni,et al.  Human-robot interaction via the transfer of power and information signals , 1990, IEEE Trans. Syst. Man Cybern..

[18]  C.J. Abul-Haj,et al.  Functional assessment of control systems for cybernetic elbow prostheses. I. Description of the technique , 1990, IEEE Transactions on Biomedical Engineering.

[19]  R.N. Scott,et al.  The application of neural networks to myoelectric signal analysis: a preliminary study , 1990, IEEE Transactions on Biomedical Engineering.

[20]  Hans G. C. Tråvén,et al.  A neural network approach to statistical pattern classification by 'semiparametric' estimation of probability density functions , 1991, IEEE Trans. Neural Networks.

[21]  Leonid I. Perlovsky,et al.  Maximum likelihood neural networks for sensor fusion and adaptive classification , 1991, Neural Networks.

[22]  T. Tsuji,et al.  An EMG controlled prosthetic forearm in three degrees of freedom using ultrasonic motors , 1992, 1992 14th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[23]  Toshio Tsuji,et al.  Discrimination of Forearm Motions from EMG Signals by Error Back Propagation Typed Neural Network Using Entropy , 1993 .

[24]  William A. Gruver.  Intelligent robotics in manufacturing, service, and rehabilitation: an overview , 1994, IEEE Trans. Ind. Electron..

[25]  Toshio Tsuji,et al.  Spatial characteristics of human hand impedance in multi-joint arm movements , 1994, Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS'94).

[26]  Yasuharu Koike,et al.  Estimation of Arm Posture in 3D-Space from Surface EMG Signals Using a Neural Network Model (Special Issue on Neurocomputing) , 1994 .

[27]  Peter J. Kyberd,et al.  MARCUS: a two degree of freedom hand prosthesis with hierarchical grip control , 1995 .

[28]  D. T. Lee,et al.  A study of neuromuscular-like control in rehabilitation robot , 1996, Proceedings of IEEE International Conference on Robotics and Automation.

[29]  Ian D. Walker,et al.  Myoelectric teleoperation of a complex robotic hand , 1996, IEEE Trans. Robotics Autom..

[30]  T. Tsuji.  Human Arm Impedance in Multi-Joint Movements , 1997 .

[31]  Toshio Tsuji,et al.  An EMG controlled robotic manipulator using neural networks , 1997, Proceedings 6th IEEE International Workshop on Robot and Human Communication. RO-MAN'97 SENDAI.

[32]  Toshio Tsuji,et al.  Pattern Classification of EMG Signals Using Neural Networks during a Series of Motions , 1997 .

[33]  T. Tsuji,et al.  The Relations Between the Excitability of the Stretch Reflex System and Changes in the Wrist Joint Impedance during Isometric Muscle Contraction in Human , 1998 .

[34]  Toshio Tsuji,et al.  EMG-based human-robot interface for rehabilitation aid , 1998, Proceedings. 1998 IEEE International Conference on Robotics and Automation (Cat. No.98CH36146).

[35]  W Craelius,et al.  A biomimetic controller for a multifinger prosthesis. , 1999, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[36]  Toshio Tsuji,et al.  A human supporting manipulator using neural network and its clinical application for forearm amputation , 1999, 1999 Third International Conference on Knowledge-Based Intelligent Information Engineering Systems. Proceedings (Cat. No.99TH8410).

[37]  Han-Pang Huang,et al.  Development of a myoelectric discrimination system for a multi-degree prosthetic hand , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[38]  Toshio Tsuji,et al.  A log-linearized Gaussian mixture network and its application to EEG pattern classification , 1999, IEEE Trans. Syst. Man Cybern. Part C.

[39]  Toshio Tsuji,et al.  Pattern classification of time-series EMG signals using neural networks , 2000 .

[40]  Toshio Tsuji,et al.  A Human Supporting Manipulator Based on Manual Control Using EMG Signals , 2000 .

[41]  Toshio Tsuji,et al.  Skill assistance for myoelectric control using an event-driven task model , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.