Tactile Feedback of Object Slip Facilitates Virtual Object Manipulation

Recent advances in myoelectric prosthetic technology have enabled more complex movements and interactions with objects, but the lack of natural haptic feedback makes object manipulation difficult to perform. Our research effort aims to develop haptic feedback systems for improving user performance in object manipulation. Specifically, in this work, we explore the effectiveness of vibratory tactile feedback of slip information for grasping objects without slipping. A user interacts with a virtual environment to complete a virtual grasp and hold task using a Sensable Phantom. Force feedback simulates contact with objects, and vibratory tactile feedback alerts the user when a virtual object is slipping from the grasp. Using this task, we found that tactile feedback significantly improved a user's ability to detect and respond to slip and to recover the slipping object when visual feedback was not available. This advantage of tactile feedback is especially important in conjunction with force feedback, which tends to reduce a subject's grasping forces and therefore encourage more slips. Our results demonstrate the potential of slip feedback to improve a prosthesis user's ability to interact with objects with less visual attention, aiding in performance of everyday manipulation tasks.

[1]  J. Randall Flanagan,et al.  Coding and use of tactile signals from the fingertips in object manipulation tasks , 2009, Nature Reviews Neuroscience.

[2]  Christian Cipriani,et al.  Vibrotactile sensory substitution in multi-fingered hand prostheses: Evaluation studies , 2011, 2011 IEEE International Conference on Rehabilitation Robotics.

[3]  L. Panait,et al.  Do laparoscopic skills transfer to robotic surgery? , 2014, The Journal of surgical research.

[4]  G. Lundborg,et al.  Sensory feedback from a prosthetic hand based on air-mediated pressure from the hand to the forearm skin. , 2012, Journal of rehabilitation medicine.

[5]  Joe Langley,et al.  Finger friction: Grip and opening packaging , 2007 .

[6]  Takashi Maeno,et al.  Reflective grasp force control of humans induced by distributed vibration stimuli on finger skin with ICPF actuators , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[7]  Wenwei Yu,et al.  Psycho-physiological assessment of a prosthetic hand sensory feedback system based on an auditory display: a preliminary study , 2012, Journal of NeuroEngineering and Rehabilitation.

[8]  Marcia Kilchenman O'Malley,et al.  Tactile feedback of object slip improves performance in a grasp and hold task , 2014, 2014 IEEE Haptics Symposium (HAPTICS).

[9]  Vincent Hayward,et al.  Slip-induced vibration influences the grip reflex: a pilot study , 2013, 2013 World Haptics Conference (WHC).

[10]  Joachim Hermsdörfer,et al.  Selective deficits of grip force control during object manipulation in patients with reduced sensibility of the grasping digits , 2003, Neuroscience Research.

[11]  Silvestro Micera,et al.  On the Shared Control of an EMG-Controlled Prosthetic Hand: Analysis of User–Prosthesis Interaction , 2008, IEEE Transactions on Robotics.

[12]  D. Rubin,et al.  Statistical Analysis with Missing Data , 1988 .

[13]  Alejandro Hernández Arieta,et al.  Slip Speed Feedback for Grip Force Control , 2012, IEEE Transactions on Biomedical Engineering.

[14]  Marcia Kilchenman O'Malley,et al.  Vibrotactile feedback of pose error enhances myoelectric control of a prosthetic hand , 2013, 2013 World Haptics Conference (WHC).

[15]  Blake Hannaford,et al.  Human Interaction with Small Haptic Effects , 2005, Presence: Teleoperators & Virtual Environments.

[16]  Tsukasa Ogasawara,et al.  Grip-force control of an elastic object by vision-based slip-margin feedback during the incipient slip , 2005, IEEE Transactions on Robotics.

[17]  K. Kaczmarek Sensory Augmentation and Substitution , 1999 .

[18]  Mark R. Cutkosky,et al.  A wearable skin stretch device for haptic feedback , 2009, World Haptics 2009 - Third Joint EuroHaptics conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems.

[19]  P Praamstra,et al.  Maintaining grip: anticipatory and reactive EEG responses to load perturbations. , 2008, Journal of neurophysiology.

[20]  J R Flanagan,et al.  The Role of Internal Models in Motion Planning and Control: Evidence from Grip Force Adjustments during Movements of Hand-Held Loads , 1997, The Journal of Neuroscience.

[21]  Maiju Aikala,et al.  Finger Friction Measurements on Coated and Uncoated Printing Papers , 2010 .

[22]  Maiju Aikala,et al.  Tactile perception : Finger friction, surface roughness and perceived coarseness , 2011 .

[23]  S. Vijayakumar,et al.  The role of feed-forward and feedback processes for closed-loop prosthesis control , 2011, Journal of NeuroEngineering and Rehabilitation.

[24]  Luca Citi,et al.  Restoring Natural Sensory Feedback in Real-Time Bidirectional Hand Prostheses , 2014, Science Translational Medicine.

[25]  Tara L. McIsaac,et al.  Within-trial modulation of multi-digit forces to friction , 2011, Experimental Brain Research.

[26]  D. Atkins,et al.  Epidemiologic Overview of Individuals with Upper-Limb Loss and Their Reported Research Priorities , 1996 .

[27]  Stefan Glasauer,et al.  How predictive is grip force control in the complete absence of somatosensory feedback? , 2004, Brain : a journal of neurology.

[28]  A. Kargov,et al.  A comparison of the grip force distribution in natural hands and in prosthetic hands , 2004, Disability and rehabilitation.

[29]  C. Antfolk,et al.  Artificial Redirection of Sensation From Prosthetic Fingers to the Phantom Hand Map on Transradial Amputees: Vibrotactile Versus Mechanotactile Sensory Feedback , 2013, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[30]  S Glasauer,et al.  The effects of digital anaesthesia on predictive grip force adjustments during vertical movements of a grasped object , 2001, The European journal of neuroscience.

[31]  Nikolaos G. Tsagarakis,et al.  Exploring Teleimpedance and Tactile Feedback for Intuitive Control of the Pisa/IIT SoftHand , 2014, IEEE Transactions on Haptics.

[32]  Keehoon Kim,et al.  Haptic Feedback Enhances Grip Force Control of sEMG-Controlled Prosthetic Hands in Targeted Reinnervation Amputees , 2012, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[33]  Peter H Veltink,et al.  Hand-opening feedback for myoelectric forearm prostheses: performance in virtual grasping tasks influenced by different levels of distraction. , 2012, Journal of rehabilitation research and development.

[34]  Hasan Ayaz,et al.  Using Brain Activity to Predict Task Performance and Operator Efficiency , 2012, BICS.

[35]  Marcia Kilchenman O'Malley,et al.  Understanding the role of haptic feedback in a teleoperated/prosthetic grasp and lift task , 2013, 2013 World Haptics Conference (WHC).

[36]  E. Guglielmelli,et al.  Forearm orientation guidance with a vibrotactile feedback bracelet: On the directionality of tactile motor communication , 2008, 2008 2nd IEEE RAS & EMBS International Conference on Biomedical Robotics and Biomechatronics.

[37]  Y. Benjamini,et al.  Controlling the false discovery rate: a practical and powerful approach to multiple testing , 1995 .

[38]  Jenny Dankelman,et al.  The Effect of Augmented Feedback on Grasp Force in Laparoscopic Grasp Control , 2010, IEEE Transactions on Haptics.