HyVE: Hybrid Vibro-Electrotactile Stimulation for Sensory Feedback and Substitution in Rehabilitation

Electro- or vibro-tactile stimulations were used in the past to provide sensory information in many different applications ranging from human manual control to prosthetics. The two modalities were used separately in the past, and we hypothesized that a hybrid vibro-electrotactile (HyVE) stimulation could provide two afferent streams that are independently perceived by a subject, although delivered in parallel and through the same skin location. We conducted psychophysical experiments where healthy subjects were asked to recognize the intensities of electro- and vibro-tactile stimuli during hybrid and single modality stimulations. The results demonstrated that the subjects were able to discriminate the features of the two modalities within the hybrid stimulus, and that the cross-modality interaction was limited enough to allow better transmission of discrete information (messages) using hybrid versus single modality coding. The percentages of successful recognitions (mean ± standard deviation) for nine messages were 56 ±11% and 72 ±8% for two hybrid coding schemes, compared to 29 ±7% for vibrotactile and 44 ±4% for electrotactile coding. The HyVE can be therefore an attractive solution in numerous application for providing sensory feedback in prostheses and rehabilitation, and it could be used to increase the resolution of a single variable or to simultaneously feedback two different variables.

[1]  V. Mountcastle,et al.  The sense of flutter-vibration: comparison of the human capacity with response patterns of mechanoreceptive afferents from the monkey hand. , 1968, Journal of neurophysiology.

[2]  G. Rollman,et al.  Electrocutaneous stimulation: Psychometric functions and temporal integration , 1969 .

[3]  D H Weir,et al.  Theory of manual vehicular control. , 1969, Ergonomics.

[4]  S. D. Reimers,et al.  Kinesthetic Sensing for the EMG Controlled "Boston Arm" , 1970 .

[5]  N W Heimstra,et al.  Tracking Performance with Visual, Auditory, or Electrocutaneous Displays , 1972, Human factors.

[6]  R E Prior,et al.  Electrocutaneous feedback for artificial limbs. Summary progress report. February 1, 1974, through July 31, 1975. , 1975, Bulletin of prosthetics research.

[7]  R E Prior,et al.  Supplemental sensory feedback for the VA/NU myoelectric hand. Background and preliminary designs. , 1976, Bulletin of prosthetics research.

[8]  George A. Bekey,et al.  Tactile Information Processing by Human Operators in Control Systems , 1978, IEEE Transactions on Systems, Man, and Cybernetics.

[9]  G. Shannon.  Sensory feedback for artificial limbs. , 1979, Medical progress through technology.

[10]  A. Higashiyama,et al.  The perceptual properties of electrocutaneous stimulation: Sensory quality, subjective intensity, and intensity-duration relation , 1981, Perception & psychophysics.

[11]  Frank A. Saunders,et al.  Electrocutaneous Stimulation for Sensory Communication in Rehabilitation Engineering , 1982, IEEE Transactions on Biomedical Engineering.

[12]  F A Saunders.  Information transmission across the skin: high-resolution tactile sensory aids for the deaf and the blind. , 1983, The International journal of neuroscience.

[13]  C. N. Tupper,et al.  Improved prosthesis control via high resolution electro-tactile feedback , 1989, Proceedings of the Fifteenth Annual Northeast Bioengineering Conference.

[14]  W.J. Tompkins,et al.  Electrotactile and vibrotactile displays for sensory substitution systems , 1991, IEEE Transactions on Biomedical Engineering.

[15]  B H Brown,et al.  Vibrotactile and electrotactile perception of time-varying pulse trains. , 1994, The Journal of the Acoustical Society of America.

[16]  William A. Gruver,et al.  Gripping force sensory feedback for a myoelectrically controlled forearm prosthesis , 1995, 1995 IEEE International Conference on Systems, Man and Cybernetics. Intelligent Systems for the 21st Century.

[17]  G. Gescheider.  Psychophysics: The Fundamentals , 1997 .

[18]  George A. Gescheider,et al.  Psychophysics: The Fundamentals , 1997 .

[19]  B. Rosén,et al.  Artificial Sensibility Based on the Use of Piezoresistive Sensors , 1998, Journal of hand surgery.

[20]  Lorna M. Brown,et al.  Non-visual information display using tactons , 2004, CHI EA '04.

[21]  J. V. Erp,et al.  Vibrotactile in-vehicle navigation system , 2004 .

[22]  H. Hermens,et al.  Effect of augmented feedback on motor function of the affected upper extremity in rehabilitation patients: a systematic review of randomized controlled trials. , 2005, Journal of rehabilitation medicine.

[23]  A. Kargov,et al.  Design and Evaluation of a Low-Cost Force Feedback System for Myoelectric Prosthetic Hands , 2006 .

[24]  K. Ikeda,et al.  Human ability to discriminate various parameters in afferent electrical nerve stimulation with particular reference to prostheses sensory feedback , 1977, Medical and Biological Engineering and Computing.

[25]  G. F. Shannon,et al.  A comparison of alternative means of providing sensory feedback on upper limb prostheses , 2006, Medical and biological engineering.

[26]  T. A. Rohland.  Sensory feedback for powered limb prostheses , 2006, Medical and biological engineering.

[27]  T. Beeker,et al.  Artificial touch in a hand-prosthesis , 2006, Medical and biological engineering.

[28]  R. N. Scott,et al.  Sensory-feedback system compatible with myoelectric control , 2006, Medical and Biological Engineering and Computing.

[29]  G. Shannon.  A myoelectrically-controlled prosthesis with sensory feedback , 2006, Medical and Biological Engineering and Computing.

[30]  Cynthia Breazeal,et al.  TIKL: Development of a Wearable Vibrotactile Feedback Suit for Improved Human Motor Learning , 2007, IEEE Transactions on Robotics.

[31]  Nitish V. Thakor,et al.  Testing a Prosthetic Haptic Feedback Simulator With an Interactive Force Matching Task , 2008 .

[32]  Lynette A. Jones,et al.  Tactile Displays: Guidance for Their Design and Application , 2008, Hum. Factors.

[33]  G. Lundborg,et al.  SmartHand tactile display: A new concept for providing sensory feedback in hand prostheses , 2010, Scandinavian journal of plastic and reconstructive surgery and hand surgery.

[34]  Christian Balkenius,et al.  Design and technical construction of a tactile display for sensory feedback in a hand prosthesis system , 2010, Biomedical engineering online.

[35]  Seungmoon Choi,et al.  Perceptual space and adjective rating of sinusoidal vibrations perceived via mobile device , 2010, 2010 IEEE Haptics Symposium.

[36]  S. Vijayakumar,et al.  The role of feed-forward and feedback processes for closed-loop prosthesis control , 2011, Journal of NeuroEngineering and Rehabilitation.

[37]  Peter H. Veltink,et al.  Vibro- and Electrotactile User Feedback on Hand Opening for Myoelectric Forearm Prostheses , 2012, IEEE Transactions on Biomedical Engineering.

[38]  Toshio Tsuji,et al.  The Cybernetic Rehabilitation Aid: Preliminary Results for Wrist and Elbow Motions in Healthy Subjects , 2012, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[39]  Winnie Jensen,et al.  Evaluation of sensation evoked by electrocutaneous stimulation on forearm in nondisabled subjects. , 2012, Journal of rehabilitation research and development.

[40]  Christian Cipriani,et al.  A Miniature Vibrotactile Sensory Substitution Device for Multifingered Hand Prosthetics , 2012, IEEE Transactions on Biomedical Engineering.

[41]  R. Riener,et al.  Augmented visual, auditory, haptic, and multimodal feedback in motor learning: A review , 2012, Psychonomic Bulletin & Review.

[42]  Seungmoon Choi,et al.  Vibrotactile Display: Perception, Technology, and Applications , 2013, Proceedings of the IEEE.

[43]  Christian Antfolk,et al.  Sensory feedback in upper limb prosthetics , 2013, Expert review of medical devices.

[44]  C. Antfolk,et al.  Artificial Redirection of Sensation From Prosthetic Fingers to the Phantom Hand Map on Transradial Amputees: Vibrotactile Versus Mechanotactile Sensory Feedback , 2013, IEEE Transactions on Neural Systems and Rehabilitation Engineering.