Wearable tactile device using mechanical and electrical stimulation for fingertip interaction with virtual world

We developed “Finger Glove for Augmented Reality” (FinGAR), which combines electrical and mechanical stimulation to selectively stimulate skin sensory mechanoreceptors and provide tactile feedback of virtual objects. A DC motor provides high-frequency vibration and shear deformation to the whole finger, and an array of electrodes provide pressure and low-frequency vibration with high spatial resolution. FinGAR devices are attached to the thumb, index finger and middle finger. It is lightweight, simple in mechanism, easy to wear, and does not disturb the natural movements of the hand. All of these attributes are necessary for a general-purpose virtual reality system. User study was conducted to evaluate its ability to reproduce sensations of four tactile dimensions: macro roughness, friction, fine roughness and hardness. Result indicated that skin deformation and cathodic stimulation affect macro roughness and hardness, whereas high-frequency vibration and anodic stimulation affect friction and fine roughness.

[1]  Yoji Yamada,et al.  Psychophysical Dimensions of Tactile Perception of Textures , 2013, IEEE Transactions on Haptics.

[2]  F. Rattay,et al.  Modeling axon membranes for functional electrical stimulation , 1993, IEEE Transactions on Biomedical Engineering.

[3]  Hiroyuki Shinoda,et al.  A method of selective stimulation to epidermal skin receptors for realistic touch feedback , 1999, Proceedings IEEE Virtual Reality (Cat. No. 99CB36316).

[4]  Ryuta Okazaki,et al.  Vibrotactile and pseudo force presentation using motor rotational acceleration , 2016, 2016 IEEE Haptics Symposium (HAPTICS).

[5]  Koji Yatani,et al.  SemFeel: a user interface with semantic tactile feedback for mobile touch-screen devices , 2009, UIST '09.

[6]  Carter C. Collins,et al.  Tactile Television - Mechanical and Electrical Image Projection , 1970 .

[7]  A. Landi.  Human Hand Function , 2007 .

[8]  Kouta Minamizawa,et al.  Gravity grabber: wearable haptic display to present virtual mass sensation , 2007, SIGGRAPH '07.

[9]  H. Kajimoto,et al.  HamsaTouch: tactile vision substitution with smartphone and electro-tactile display , 2014, CHI Extended Abstracts.

[10]  Takashi Yoshioka,et al.  Automatic filter design for synthesis of haptic textures from recorded acceleration data , 2010, 2010 IEEE International Conference on Robotics and Automation.

[11]  Christopher J. Poletto,et al.  Elevating pain thresholds in humans using depolarizing prepulses , 2002, IEEE Transactions on Biomedical Engineering.

[12]  Shuhei Asano,et al.  Vibrotactile display approach that modifies roughness sensations of real textures , 2012, 2012 IEEE RO-MAN: The 21st IEEE International Symposium on Robot and Human Interactive Communication.

[13]  Satoshi Tadokoro,et al.  A tactile synthesis method using multiple frequency vibrations for representing virtual touch , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[14]  J. Edward Colgate,et al.  Dynamics of ultrasonic and electrostatic friction modulation for rendering texture on haptic surfaces , 2014, 2014 IEEE Haptics Symposium (HAPTICS).

[15]  Hiroyuki Kajimoto,et al.  Comparative Evaluation of Tactile Sensation by Electrical and Mechanical Stimulation , 2017, IEEE Transactions on Haptics.

[16]  K. Fujita,et al.  A New Softness Display Interface by Dynamic Fingertip Contact Area Control by Dynamic Fingertip Cont , 2001 .

[17]  Hiroyuki Kajimoto,et al.  Tactile Presentation Using Mechanical and Electrical Stimulation , 2016, AsiaHaptics.

[18]  Hiroyuki Kajimoto,et al.  Expression of 2DOF Fingertip Traction with 1DOF Lateral Skin Stretch , 2016, AsiaHaptics.

[19]  Toshi Takamori,et al.  Tactile feel display for virtual active touch , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[20]  Andreas M. Kunz,et al.  Planning redirection techniques for optimal free walking experience using model predictive control , 2014, 2014 IEEE Symposium on 3D User Interfaces (3DUI).

[21]  Gi-Hun Yang,et al.  Small and lightweight tactile display(SaLT) and its application , 2009, World Haptics 2009 - Third Joint EuroHaptics conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems.

[22]  Osamu Oshiro,et al.  Material Roughness Modulation via Electrotactile Augmentation , 2015, IEEE Transactions on Haptics.

[23]  Tae-Heon Yang,et al.  Development of a miniature pin-array tactile module using elastic and electromagnetic force for mobile devices , 2009, World Haptics 2009 - Third Joint EuroHaptics conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems.

[24]  Ryuta Okazaki,et al.  FinGAR: combination of electrical and mechanical stimulation for high-fidelity tactile presentation , 2016, SIGGRAPH Emerging Technologies.

[25]  Stefania Serafin,et al.  Establishing the Range of Perceptually Natural Visual Walking Speeds for Virtual Walking-In-Place Locomotion , 2014, IEEE Transactions on Visualization and Computer Graphics.

[26]  Stephen A. Brewster,et al.  Sensory substitution using tactile pin arrays: Human factors, technology and applications , 2006, Signal Process..

[27]  Ali Israr,et al.  TeslaTouch: electrovibration for touch surfaces , 2010, UIST.

[28]  Minoru Abe,et al.  Electrocutaneous Communication in a Guide Dog Robot (MELDOG) , 1985, IEEE Transactions on Biomedical Engineering.

[29]  Jun Rekimoto,et al.  Ambient touch: designing tactile interfaces for handheld devices , 2002, UIST '02.

[30]  K.A. Kaczmarek,et al.  Electrotactile haptic display on the fingertips: preliminary results , 1994, Proceedings of 16th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[31]  J T Rubinstein,et al.  Analytical theory for extracellular electrical stimulation of nerve with focal electrodes. I. Passive unmyelinated axon. , 1988, Biophysical journal.

[32]  J T Rubinstein,et al.  Analytical theory for extracellular electrical stimulation of nerve with focal electrodes. II. Passive myelinated axon. , 1988, Biophysical journal.

[33]  F A Saunders.  Information transmission across the skin: high-resolution tactile sensory aids for the deaf and the blind. , 1983, The International journal of neuroscience.