Effects of Grip-Force, Contact, and Acceleration Feedback on a Teleoperated Pick-and-Place Task

The multifaceted human sense of touch is fundamental to direct manipulation, but technical challenges prevent most teleoperation systems from providing even a single modality of haptic feedback, such as force feedback. This paper postulates that ungrounded grip-force, fingertip-contact-and-pressure, and high-frequency acceleration haptic feedback will improve human performance of a teleoperated pick-and-place task. Thirty subjects used a teleoperation system consisting of a haptic device worn on the subject's right hand, a remote PR2 humanoid robot, and a Vicon motion capture system to move an object to a target location. Each subject completed the pick-and-place task 10 times under each of the eight haptic conditions obtained by turning on and off grip-force feedback, contact feedback, and acceleration feedback. To understand how object stiffness affects the utility of the feedback, half of the subjects completed the task with a flexible plastic cup, and the others used a rigid plastic block. The results indicate that the addition of grip-force feedback with gain switching enables subjects to hold both the flexible and rigid objects more stably, and it also allowed subjects who manipulated the rigid block to hold the object more delicately and to better control the motion of the remote robot's hand. Contact feedback improved the ability of subjects who manipulated the flexible cup to move the robot's arm in space, but it deteriorated this ability for subjects who manipulated the rigid block. Contact feedback also caused subjects to hold the flexible cup less stably, but the rigid block more securely. Finally, adding acceleration feedback slightly improved the subject's performance when setting the object down, as originally hypothesized; interestingly, it also allowed subjects to feel vibrations produced by the robot's motion, causing them to be more careful when completing the task. This study supports the utility of grip-force and high-frequency acceleration feedback in teleoperation systems and motivates further improvements to fingertip-contact-and-pressure feedback.

[1]  Katherine J. Kuchenbecker,et al.  A wearable device for controlling a robot gripper with fingertip contact, pressure, vibrotactile, and grip force feedback , 2014, 2014 IEEE Haptics Symposium (HAPTICS).

[2]  David W. L. Wang,et al.  A gain-switching control scheme for position-error-based force-reflecting teleoperation , 2002, Proceedings 10th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. HAPTICS 2002.

[3]  A. Gordon,et al.  Contribution of tactile information to accuracy in pointing movements , 2001, Experimental Brain Research.

[4]  Claudio Pacchierotti,et al.  Two Finger Grasping Simulation with Cutaneous and Kinesthetic Force Feedback , 2012, EuroHaptics.

[5]  K. J. Kuchenbecker,et al.  Surgeons and non-surgeons prefer haptic feedback of instrument vibrations during robotic surgery , 2015, Surgical Endoscopy.

[6]  Mark R. Cutkosky,et al.  Feedback Strategies for Telemanipulation with Shared Control of Object Handling Forces , 2005, Presence: Teleoperators & Virtual Environments.

[7]  Blake Hannaford,et al.  Performance evaluation of a six-axis generalized force-reflecting teleoperator , 1991, IEEE Trans. Syst. Man Cybern..

[8]  Katherine J. Kuchenbecker,et al.  Spectral Subtraction of Robot Motion Noise for Improved Event Detection in Tactile Acceleration Signals , 2012, EuroHaptics.

[9]  Joseph M. Romano,et al.  Dimensional Reduction of High-Frequency Accelerations for Haptic Rendering , 2010, EuroHaptics.

[10]  Antonio Frisoli,et al.  Design of a novel finger haptic interface for contact and orientation display , 2010, 2010 IEEE Haptics Symposium.

[11]  Robert D. Howe,et al.  Tactile Display of Vibratory Information in Teleoperation and Virtual Environments , 1995, Presence: Teleoperators & Virtual Environments.

[12]  John Kenneth Salisbury,et al.  Enabling multi-finger, multi-hand virtualized grasping , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[13]  Frans C T van der Helm,et al.  Sensory Weighting of Force and Position Feedback in Human Motor Control Tasks , 2009, The Journal of Neuroscience.

[14]  Frans C. T. van der Helm,et al.  The Impact of Haptic Feedback Quality on the Performance of Teleoperated Assembly Tasks , 2013, IEEE Transactions on Haptics.

[15]  J Houk,et al.  Responses of Golgi tendon organs to forces applied to muscle tendon. , 1967, Journal of neurophysiology.

[16]  Sachin Chitta,et al.  Human-Inspired Robotic Grasp Control With Tactile Sensing , 2011, IEEE Transactions on Robotics.

[17]  Mark R. Cutkosky,et al.  Haptic display of contact location , 2004, 12th International Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, 2004. HAPTICS '04. Proceedings..

[18]  Allison M. Okamura,et al.  Effects of Gripping and Translational Forces on Teleoperation , 2005, Multi-point Interaction with Real and Virtual Objects.

[19]  Pavel Zahorik,et al.  Presence as Being-in-the-World , 1998, Presence.

[20]  Peter J Beek,et al.  Exploratory movements determine cue weighting in haptic length perception of handheld rods. , 2010, Journal of neurophysiology.

[21]  Ivan Toni,et al.  Tactile input of the hand and the control of reaching to grasp movements , 1997, Experimental Brain Research.

[22]  Catherine E. Lewis,et al.  Tactile Feedback Induces Reduced Grasping Force in Robot-Assisted Surgery , 2009, IEEE Transactions on Haptics.

[23]  Claudio Pacchierotti,et al.  A three DoFs wearable tactile display for exploration and manipulation of virtual objects , 2012, 2012 IEEE Haptics Symposium (HAPTICS).

[24]  Katherine J. Kuchenbecker,et al.  Tool Contact Acceleration Feedback for Telerobotic Surgery , 2011, IEEE Transactions on Haptics.

[25]  John Kenneth Salisbury,et al.  Preliminary design of a whole-arm manipulation system (WAMS) , 1988, Proceedings. 1988 IEEE International Conference on Robotics and Automation.

[26]  Antonio Frisoli,et al.  The contribution of cutaneous and kinesthetic sensory modalities in haptic perception of orientation , 2011, Brain Research Bulletin.

[27]  J. Randall Flanagan,et al.  Coding and use of tactile signals from the fingertips in object manipulation tasks , 2009, Nature Reviews Neuroscience.

[28]  Katherine J. Kuchenbecker,et al.  Improving contact realism through event-based haptic feedback , 2006, IEEE Transactions on Visualization and Computer Graphics.

[29]  Andrew M. Gordon,et al.  Tactile feedback contributes to consistency of finger movements during typing , 2004, Experimental Brain Research.

[30]  N. Strominger,et al.  Discriminative General Senses, Crude Touch, and Proprioception , 2012 .

[31]  Michael J. Singer,et al.  Measuring Presence in Virtual Environments: A Presence Questionnaire , 1998, Presence.

[32]  Yosuke Kurihara,et al.  Virtual Robotization of the Human Body via Data-Driven Vibrotactile Feedback , 2013, Advances in Computer Entertainment.

[33]  Joseph M. Romano,et al.  High frequency acceleration feedback significantly increases the realism of haptically rendered textured surfaces , 2010, 2010 IEEE Haptics Symposium.

[34]  Mark R. Cutkosky,et al.  Perception of Curvature and Object Motion Via Contact Location Feedback , 2003, ISRR.

[35]  Göran A. V. Christiansson.  An Experimental Study of Haptic Feedback in a Teleoperated Assembly Task , 2008, J. Comput. Inf. Sci. Eng..

[36]  '. B.Vallbo.  Properties of cutaneous mechanoreceptors in the human hand-related to touch sensation , 1999 .

[37]  Wijnand A. IJsselsteijn,et al.  Embodiment and telepresence: Toward a comprehensive theoretical framework , 2012, Interact. Comput..