A vibrotactile display design for the feedback of external prosthesis sensory information to the amputee wearer

This thesis documents the development of a vibrotactile display to be incorporated into a powered ankle-foot prosthesis. Although existing devices have addressed the need for tactile and proprioceptive feedback in external prostheses, there has not yet been an attempt to develop and clinically evaluate a comprehensive vibrotactile display and signaling schematic for use with an active myoelectric prosthesis. The development and evaluation of two different hardware solutions are presented including an array of vibrating pancake motors embedded into the exterior of a carbon fiber prosthetic socket and an array of vibrating pancake motors embedded into a silicone socket liner. Three haptic mappings were designed based on previous work in psychophysics, haptics, and HCI. These schematics include a spatial discrimination pattern, an amplitude modulated pattern, and a gap detection pattern. To assess the effectiveness of the system, lower-limb amputees were asked to learn the three haptic mappings and use the feedback system to control a virtual ankle to a desired ankle position using a physical knob interface. Results show an overall recognition rate of 85% for all three haptic mappings and error response averages ranging from 8.2 s to 11.6 s. The high recognition rates and lack of variance between the mappings suggest that the three vibration parameters of spatial discrimination, amplitude modulation, and gap detection may be successfully used to represent different ankle parameters. However, the overall successful integration of the vibrotactile display ultimately depends on the interaction between the components of the whole prosthetic system. Thesis Advisor: Hugh Herr Title: Associate Professor of Media Arts and Sciences Table of

[1]  George A. Gescheider,et al.  Auditory and cutaneous temporal resolution of successive brief stimuli. , 1967 .

[2]  R. Seymour Prosthetics and orthotics : lower limb and spinal , 2002 .

[3]  Karen A. Moxon Brain-control interfaces for sensory and motor prosthetic devices , 2001, 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.01CH37221).

[4]  N Hogan,et al.  A review of the methods of processing EMG for use as a proportional control signal. , 1976, Biomedical engineering.

[5]  Lorna M. Brown,et al.  Feel who's talking: using tactons for mobile phone alerts , 2006, CHI Extended Abstracts.

[6]  Serge Marchand Touch, Temperature, and Pain in Health and Disease: Mechanisms and Assessments , 1995 .

[7]  Gerald E. Loeb,et al.  BION™ Implants for Therapeutic and Functional Electrical Stimulation , 2000 .

[8]  Hugh M. Herr,et al.  New horizons for orthotic and prosthetic technology: artificial muscle for ambulation , 2004, SPIE Smart Structures and Materials + Nondestructive Evaluation and Health Monitoring.

[9]  A. E. Patla,et al.  The effects of human ankle muscle vibration on posture and balance during adaptive locomotion , 2002, Experimental Brain Research.

[10]  W.J. Tompkins,et al.  Electrotactile and vibrotactile displays for sensory substitution systems , 1991, IEEE Transactions on Biomedical Engineering.

[11]  Hong Z. Tan,et al.  HUMAN FACTORS FOR THE DESIGN OF FORCE-REFLECTING HAPTIC INTERFACES , 1994 .

[12]  I. Summers Tactile Aids for the Hearing Impaired , 1992 .

[13]  Mandayam A. Srinivasan,et al.  Tangential versus normal displacements of skin: relative effectiveness for producing tactile sensations , 2002, Proceedings 10th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. HAPTICS 2002.

[14]  Q. Pei,et al.  High-speed electrically actuated elastomers with strain greater than 100% , 2000, Science.

[15]  Steven Ashley,et al.  Artificial muscles. , 2003, Scientific American.

[16]  R. T. Verrillo,et al.  Vibration Sensation in Humans , 1992 .

[17]  Grigore C. Burdea,et al.  The “Rutgers Ankle” Orthopedic Rehabilitation Interface , 1999, Dynamic Systems and Control.

[18]  Lorna M. Brown,et al.  Tactons: Structured Tactile Messages for Non-Visual Information Display , 2004, AUIC.

[19]  I. S. Mackenzie,et al.  Virtual Environments and Advanced Interface Design , 1995 .

[20]  Blake Hannaford,et al.  Evaluation Of Performance Of A Telerobot , 1992 .

[21]  Allison M. Okamura,et al.  A Magnetically-Actuated Friction Feedback Mouse , 2004 .

[22]  R. Johansson,et al.  Representation of braille characters in human nerve fibres , 2006, Experimental Brain Research.

[23]  Masaki Yoshida,et al.  Sensory feedback system for prosthetic hand by using interferential current , 2001, 2001 Conference Proceedings of the 23rd Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[24]  J. Duysens,et al.  Vibration-induced changes in EMG during human locomotion. , 2003, Journal of neurophysiology.

[25]  Hugh M. Herr,et al.  An ankle-foot emulation system for the study of human walking biomechanics , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[26]  T. Elbert,et al.  Phantom-limb pain as a perceptual correlate of cortical reorganization following arm amputation , 1995, Nature.

[27]  R.R. Riso,et al.  Chronic intraneural electrical stimulation for prosthetic sensory feedback , 2003, First International IEEE EMBS Conference on Neural Engineering, 2003. Conference Proceedings..

[28]  D. Bavelier,et al.  Cross-modal plasticity: where and how? , 2002, Nature Reviews Neuroscience.

[29]  J. Sabolich,et al.  Sense of Feel for Lower‐Limb Amputees: A Phase‐One Study , 1994 .

[30]  J M Weisenberger Sensitivity to amplitude-modulated vibrotactile signals. , 1986, The Journal of the Acoustical Society of America.

[31]  R. Poppele,et al.  Proprioception from a spinocerebellar perspective. , 2001, Physiological reviews.

[32]  K. Horch,et al.  Closed-loop control of ankle position using muscle afferent feedback with functional neuromuscular stimulation , 1996, IEEE Transactions on Biomedical Engineering.

[33]  Lorna M. Brown,et al.  A first investigation into the effectiveness of Tactons , 2005, First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. World Haptics Conference.

[34]  Karon E. MacLean,et al.  Learning and identifying haptic icons under workload , 2005, First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. World Haptics Conference.

[35]  Rachel Z. Pytel,et al.  Artificial muscle technology: physical principles and naval prospects , 2004, IEEE Journal of Oceanic Engineering.

[36]  P. Chappell,et al.  Thick-film force and slip sensors for a prosthetic hand , 2005 .

[37]  S. Bolanowski,et al.  Four channels mediate the mechanical aspects of touch. , 1988, The Journal of the Acoustical Society of America.

[38]  Judith E. Deutsch,et al.  Rehabilitation of Musculoskeletal Injuries Using the Rutgers Ankle Haptic Interface: Three Case Reports , 2001 .

[39]  E. Zehr,et al.  Regulation of Arm and Leg Movement during Human Locomotion , 2004, The Neuroscientist : a review journal bringing neurobiology, neurology and psychiatry.

[40]  F Lacquaniti,et al.  Influence of leg muscle vibration on human walking. , 2000, Journal of neurophysiology.

[41]  C M Light,et al.  Intelligent multifunction myoelectric control of hand prostheses , 2002, Journal of medical engineering & technology.

[42]  T. Sinkjaer,et al.  Cuff electrodes for long-term recording of natural sensory information , 1999, IEEE Engineering in Medicine and Biology Magazine.

[43]  Karon E. MacLean,et al.  Perceptual Design of Haptic Icons , 2003 .

[44]  Ronald Raymond Riso,et al.  Intraneural microstimulation for enhanced prosthetic control using a peripheral nerve interface , 1996, Proceedings of 18th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[45]  M. Alexander,et al.  Principles of Neural Science , 1981 .

[46]  J. Dostrovsky,et al.  Phantom sensations generated by thalamic microstimulation , 1998, Nature.

[47]  E. Mackenzie,et al.  Limb Amputation and Limb Deficiency: Epidemiology and Recent Trends in the United States , 2002, Southern medical journal.

[48]  A. Kargov,et al.  Progress in the development of a multifunctional hand prosthesis , 2004, The 26th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[49]  Kaat Desloovere,et al.  Effects of tendon vibration on the spatiotemporal characteristics of human locomotion , 2002, Experimental Brain Research.

[50]  Paul Bach-y-Rita,et al.  Tactile displays , 1995 .