PossessedHand: a hand gesture manipulation system using electrical stimuli

Acquiring knowledge about the timing and speed of hand gestures is important to learn physical skills, such as playing musical instruments, performing arts, and making handicrafts. However, it is difficult to use devices that dynamically and mechanically control a user's hand for learning because such devices are very large, and hence, are unsuitable for daily use. In addition, since groove-type devices interfere with actions such as playing musical instruments, performing arts, and making handicrafts, users tend to avoid wearing these devices. To solve these problems, we propose PossessedHand, a device with a forearm belt, for controlling a user's hand by applying electrical stimulus to the muscles around the forearm of the user. The dimensions of PossessedHand are 10 x 7.0 x 8.0 cm, and the device is portable and suited for daily use. The electrical stimuli are generated by an electronic pulse generator and transmitted from 14 electrode pads. Our experiments confirmed that PossessedHand can control the motion of 16 joints in the hand. We propose an application of this device to help a beginner learn how to play musical instruments such as the piano and koto.

[1]  Naoki Kawakami,et al.  FlexTorque: innovative haptic interface for realistic physical interaction in virtual reality , 2009, SIGGRAPH ASIA '09.

[2]  Marian Poboroniuc,et al.  A method to test FES-based control strategies for neuroprostheses , 2008, ICIA 2008.

[3]  Thomas Brandt,et al.  Galvanic vestibular stimulation in humans: effects on otolith function in roll , 1997, Neuroscience Letters.

[4]  Emi Tamaki A robust and accurate 3d hand posture estimation method for interactive systems , 2010, TEI '10.

[5]  F B Horak,et al.  Effect of galvanic vestibular stimulation on human postural responses during support surface translations. , 1995, Journal of neurophysiology.

[6]  W. T. Ang,et al.  Functional electrical stimulation in rehabilitation engineering: a survey , 2007, i-CREATe '07.

[7]  Y. Shen,et al.  Hand rehabilitation based on augmented reality , 2009, i-CREATe.

[8]  Nozomu Hoshimiya,et al.  A method of multichannel PID control of two-degree-of-freedom wrist joint movements by functional electrical stimulation , 2003, Systems and Computers in Japan.

[9]  Erik Schulte,et al.  Comprar General Anatomy And Musculoskeletal System, Latin Nomenclature (Thieme Atlas Of Anatomy) | Michael Schuenke | 9781604063783 | GEORG THIEME , 2010 .

[10]  Toshiyuki Kondo,et al.  Lower-limb Joint Torque and Position Controls by Functional Electrical Stimulation (FES) , 2007 .

[11]  V. M. Zat︠s︡iorskiĭ,et al.  Science and practice of strength training , 1995 .

[12]  Naoki Kawakami,et al.  Proposal for tactile sense presentation that combines electrical and mechanical stimulus , 2007, Second Joint EuroHaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems (WHC'07).

[13]  Michael Recce,et al.  A virtual reality-based exercise program for stroke rehabilitation , 2000, Assets '00.

[14]  Melissa Mates,et al.  Atlas of Anatomy: General Anatomy and Musculoskeletal System , 2008, Occupational therapy in health care.

[15]  電子情報通信学会 The Transactions of the Institute of Electronics, Information and Communication Engineers , 1987 .

[16]  Yasunobu Handa,et al.  ANALYSIS OF HAND MOVEMENT INDUCED BY FUNCTIONAL ELECTRICAL STIMULATION IN TETRAPLEGIC AND HEMIPLEGIC PATIENTS , 1984 .

[17]  Jeonghun Cho,et al.  Electrical stimuli capsule for control moving direction at the small intestine , 2006 .

[18]  H Hummelsheim,et al.  The functional value of electrical muscle stimulation for the rehabilitation of the hand in stroke patients. , 1997, Scandinavian journal of rehabilitation medicine.

[19]  K Tanie,et al.  [Effects of pulse height and pulse width on the magnitude sensation of electrocutaneous stimulus (author's transl)]. , 1977, Iyo denshi to seitai kogaku. Japanese journal of medical electronics and biological engineering.

[20]  Dieter Schmalstieg,et al.  Using neuromuscular electrical stimulation for pseudo-haptic feedback , 2006, VRST '06.