Effectiveness of supplemental grasp-force feedback in the presence of vision

Previous studies have shown that supplemental grasp-force feedback can improve control for users of a hand prosthesis or neuroprosthesis under conditions where vision provides little force information. Visual cues of force are widely available in everyday use, however, and may obviate the utility of supplemental force information. The purpose of the present study was to use a video-based hand neuroprosthesis simulator to determine whether grasp-force feedback can improve control in the presence of realistic visual information. Seven able-bodied subjects used the simulator to complete a simple grasp-and-hold task while controlling and viewing pre-recorded, digitised video clips of a neuroprosthesis user's hand squeezing a compliant object. The task was performed with and without supplemental force feedback presented via electrocutaneous stimulation. Subjects had to achieve and maintain the (simulated) grasp force within a target window of variable size (±10–40% of full scale). Force feedback improved the success rate significantly for all target window sizes (8–16%, on average), and improved the success rate at all window sizes for six of the seven subjects. Overall, the improvement was equivalent functionally to a 35% increase in the window size. Feedback also allowed subjects to identify the direction of grasp errors more accurately, on average by 10–15%. In some cases, feedback improved the failure identification rate even if success rates were unchanged. It is thus concluded that supplemental grasp-force feedback can improve grasp control even with access to rich visual information from the hand and object.

[1]  R G Radwin,et al.  A conductive polymer sensor for measuring external finger forces. , 1991, Journal of biomechanics.

[2]  Jacob Cohen Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[3]  H.J. Chizeck,et al.  Feedback regulation of hand grasp opening and contact force during stimulation of paralyzed muscle , 1991, IEEE Transactions on Biomedical Engineering.

[4]  A Cliquet,et al.  A low-cost instrumented glove for monitoring forces during object manipulation. , 1997, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[5]  Follow-up study of wrist-driven flexor-hinge-splint use. , 1971 .

[6]  A. Prochazka,et al.  The bionic glove: an electrical stimulator garment that provides controlled grasp and hand opening in quadriplegia. , 1997, Archives of physical medicine and rehabilitation.

[7]  K. Kilgore,et al.  Electrode characterization for functional application to upper extremity FNS , 1990, IEEE Transactions on Biomedical Engineering.

[8]  G. Shannon Sensory feedback for artificial limbs. , 1979, Medical progress through technology.

[9]  P H Chappell,et al.  A portable system for closed loop control of the paralysed hand using functional electrical stimulation. , 1998, Medical engineering & physics.

[10]  P E Patterson,et al.  Design and evaluation of a sensory feedback system that provides grasping pressure in a myoelectric hand. , 1992, Journal of rehabilitation research and development.

[11]  P. H. Peckham,et al.  An Implanted Upper-Extremity Neuroprosthesis. Follow-up of Five Patients* , 1997, The Journal of bone and joint surgery. American volume.

[12]  M W Keith,et al.  An elbow extension neuroprosthesis for individuals with tetraplegia. , 1998, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[13]  G E Loeb,et al.  Neural signals for command control and feedback in functional neuromuscular stimulation: a review. , 1996, Journal of rehabilitation research and development.

[14]  W K Durfee,et al.  Simulator for evaluating shoulder motion as a command source for FES grasp restoration systems. , 1991, Archives of physical medicine and rehabilitation.

[15]  P H Peckham,et al.  Functional neuromuscular stimulation for combined control of elbow extension and hand grasp in C5 and C6 quadriplegics. , 1998, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[16]  J. Webster,et al.  A silicon-based tactile sensor for finger-mounted applications , 1998, IEEE Transactions on Biomedical Engineering.

[17]  R R Betz,et al.  Challenges to clinical deployment of upper limb neuroprostheses. , 1996, Journal of rehabilitation research and development.

[18]  R. Johansson,et al.  Factors influencing the force control during precision grip , 2004, Experimental Brain Research.

[19]  Nathan Rh Control strategies in FNS systems for the upper extremities. , 1993 .

[20]  K W Grant,et al.  Perceived magnitude of multiple electrocutaneous pulses , 1980, Perception & psychophysics.

[21]  A. Freehafer Tendon transfers in patients with cervical spinal cord injury. , 1991, The Journal of hand surgery.

[22]  V R Allen Follow-up study of wrist-driven flexor-hinge-splint use. , 1971, The American journal of occupational therapy : official publication of the American Occupational Therapy Association.

[23]  R.R. Riso,et al.  Cognitive feedback for use with FES upper extremity neuroprostheses , 1991, IEEE Transactions on Biomedical Engineering.

[24]  P.E. Crago,et al.  Assessment of input-output properties and control of neuroprosthetic hand grasp , 1992, IEEE Transactions on Biomedical Engineering.

[25]  Karen Milchus,et al.  Sensory Feedback for Enhancing Upper Extremity Neuromuscular Prostheses , 1991 .

[26]  K. Kilgore,et al.  Implantable functional neuromuscular stimulation in the tetraplegic hand. , 1989, The Journal of hand surgery.

[27]  W.J. Tompkins,et al.  Electrotactile and vibrotactile displays for sensory substitution systems , 1991, IEEE Transactions on Biomedical Engineering.

[28]  J Kawamura,et al.  [Sensory feedback device for the artificial arm]. , 1971, Nihon Seikeigeka Gakkai zasshi.

[29]  V R Hentz,et al.  Rehabilitation and surgical reconstruction of the upper limb in tetraplegia: an update. , 1992, The Journal of hand surgery.

[30]  S Ishikawa,et al.  Functional electrical stimulation (FES) systems for restoration of motor function of paralyzed muscles--versatile systems and a portable system. , 1992, Frontiers of medical and biological engineering : the international journal of the Japan Society of Medical Electronics and Biological Engineering.

[31]  M M Adamczyk,et al.  Input-output nonlinearities and time delays increase tracking errors in hand grasp neuroprostheses. , 1996, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[32]  R. Johansson,et al.  Influences of Cutaneous Sensory Input on the Motor Coordination During Precision Manipulation , 1984 .

[33]  John Lyman,et al.  Comparison of codes for sensory feedback using electrocutaneous tracking , 1977, Annals of Biomedical Engineering.

[34]  K. Kaczmarek Sensory Augmentation and Substitution , 1999 .

[35]  S C Jacobsen,et al.  Extended physiologic taction: design and evaluation of a proportional force feedback system. , 1989, Journal of rehabilitation research and development.

[36]  S. D. Reimers,et al.  Kinesthetic Sensing for the EMG Controlled "Boston Arm" , 1970 .

[37]  G. F. Shannon,et al.  A comparison of alternative means of providing sensory feedback on upper limb prostheses , 2006, Medical and biological engineering.

[38]  T R Scott,et al.  Tri-state myoelectric control of bilateral upper extremity neuroprostheses for tetraplegic individuals. , 1996, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.