Three-Dimensional Skin Deformation as Force Substitution: Wearable Device Design and Performance During Haptic Exploration of Virtual Environments

Virtual reality systems would benefit from a compelling force sensory substitute when workspace or stability limitations prevent the use of kinesthetic force feedback systems. We present a wearable fingertip haptic device with the ability to make and break contact in addition to rendering both shear and normal skin deformation to the fingerpad. A delta mechanism with novel bias spring and tether actuator relocation method enables the use of high-end motors and encoders, allowing precise device control: 10 Hz bandwidth and 0.255 mm RMS tracking error were achieved during testing. In the first of two experiments, participants determined the orientation of a stiff region in a surrounding compliant virtual surface with an average angular error of 7.6 degree, similar to that found in previous studies using traditional force feedback. In the second experiment, we evaluated participants’ ability to interpret differences in friction. The Just Noticeable Difference (JND) of surface friction coefficient discrimination using our skin deformation device was 0.20, corresponding with a reference friction coefficient of 0.5. While higher than that found using kinesthetic feedback, this demonstrates that users can perceive differences in surface friction without world-grounded kinesthetic forces. These experiments show that three DoF skin deformation enables both stiffness and friction discrimination capability in the absence of kinesthetic force feedback.

[1]  R. Klatzky,et al.  Hand movements: A window into haptic object recognition , 1987, Cognitive Psychology.

[2]  John Kenneth Salisbury,et al.  A constraint-based god-object method for haptic display , 1995, Proceedings 1995 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human Robot Interaction and Cooperative Robots.

[3]  A. M. Smith,et al.  Friction, not texture, dictates grip forces used during object manipulation. , 1996, Journal of neurophysiology.

[4]  D. Beebe,et al.  A microfabricated electrostatic haptic display for persons with visual impairments. , 1998, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[5]  A. Mak,et al.  In vivo friction properties of human skin , 1999, Prosthetics and orthotics international.

[6]  Kenneth O. Johnson,et al.  The roles and functions of cutaneous mechanoreceptors , 2001, Current Opinion in Neurobiology.

[7]  F A Wichmann,et al.  Ning for Helpful Comments and Suggestions. This Paper Benefited Con- Siderably from Conscientious Peer Review, and We Thank Our Reviewers the Psychometric Function: I. Fitting, Sampling, and Goodness of Fit , 2001 .

[8]  R. Johansson,et al.  Encoding of Direction of Fingertip Forces by Human Tactile Afferents , 2001, The Journal of Neuroscience.

[9]  W. Harwin,et al.  Improved Haptic Rendering for Multi-Finger Manipulation Using Friction Cone based God-Objects , 2002 .

[10]  Mark R. Cutkosky,et al.  Friction modeling and display in haptic applications involving user performance , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[11]  Martin Buss,et al.  First evaluation of a novel tactile display exerting shear force via lateral displacement , 2005, TAP.

[12]  François Conti,et al.  CHAI: An Open-Source Library for the Rapid Development of Haptic Scenes , 2005 .

[13]  Caroline G. L. Cao,et al.  Vibrotactile force feedback system for minimally invasive surgical procedures , 2006, 2006 IEEE International Conference on Systems, Man and Cybernetics.

[14]  Katherine J. Kuchenbecker,et al.  Improving contact realism through event-based haptic feedback , 2006, IEEE Transactions on Visualization and Computer Graphics.

[15]  M. López,et al.  Delta robot: Inverse, direct, and intermediate Jacobians , 2006 .

[16]  Christopher R. Wagner,et al.  The Benefit of Force Feedback in Surgery: Examination of Blunt Dissection , 2007, PRESENCE: Teleoperators and Virtual Environments.

[17]  J. Edward Colgate,et al.  T-PaD: Tactile Pattern Display through Variable Friction Reduction , 2007, Second Joint EuroHaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems (WHC'07).

[18]  Lynette A. Jones,et al.  Tactile Displays: Guidance for Their Design and Application , 2008, Hum. Factors.

[19]  Allison M. Okamura,et al.  Effects of haptic and graphical force feedback on teleoperated palpation , 2009, 2009 IEEE International Conference on Robotics and Automation.

[20]  William R. Provancher,et al.  Fingerpad Skin Stretch Increases the Perception of Virtual Friction , 2009, IEEE Transactions on Haptics.

[21]  William R. Provancher,et al.  Design of a Fingertip-Mounted Tactile Display with Tangential Skin Displacement Feedback , 2010, IEEE Transactions on Haptics.

[22]  William R. Provancher,et al.  Perception of Direction for Applied Tangential Skin Displacement: Effects of Speed, Displacement, and Repetition , 2010, IEEE Transactions on Haptics.

[23]  Charles A. Stewart,et al.  Improved Tactile Shear Feedback: Tactor Design and an Aperture-Based Restraint , 2011, IEEE Transactions on Haptics.

[24]  Katherine J. Kuchenbecker,et al.  Tool Contact Acceleration Feedback for Telerobotic Surgery , 2011, IEEE Transactions on Haptics.

[25]  Claudio Pacchierotti,et al.  Cutaneous Force Feedback as a Sensory Subtraction Technique in Haptics , 2011, IEEE Transactions on Haptics.

[26]  Claudio Pacchierotti,et al.  Towards Wearability in Fingertip Haptics: A 3-DoF Wearable Device for Cutaneous Force Feedback , 2013, IEEE Transactions on Haptics.

[27]  William R. Provancher,et al.  Haptic matching of directional force and skin stretch feedback cues , 2013, 2013 World Haptics Conference (WHC).

[28]  Allison M. Okamura,et al.  Sensory substitution via cutaneous skin stretch feedback , 2013, 2013 IEEE International Conference on Robotics and Automation.

[29]  Allison M. Okamura,et al.  Augmentation Of Stiffness Perception With a 1-Degree-of-Freedom Skin Stretch Device , 2014, IEEE Transactions on Human-Machine Systems.

[30]  Kazuhiko Terashima,et al.  LinkTouch: A wearable haptic device with five-bar linkage mechanism for presentation of two-DOF force feedback at the fingerpad , 2014, HAPTICS.

[31]  Claudio Pacchierotti,et al.  Improving Transparency in Teleoperation by Means of Cutaneous Tactile Force Feedback , 2014, TAP.

[32]  Francesco Chinello,et al.  Soft finger tactile rendering for wearable haptics , 2015, 2015 IEEE World Haptics Conference (WHC).

[33]  Allison M. Okamura,et al.  Sensory Substitution and Augmentation Using 3-Degree-of-Freedom Skin Deformation Feedback , 2015, IEEE Transactions on Haptics.

[34]  Allison M. Okamura,et al.  Tactor-Induced Skin Stretch as a Sensory Substitution Method in Teleoperated Palpation , 2015, IEEE Transactions on Human-Machine Systems.

[35]  Claudio Pacchierotti,et al.  Cutaneous haptic feedback to ensure the stability of robotic teleoperation systems , 2015, Int. J. Robotics Res..

[36]  Claudio Pacchierotti,et al.  Data-driven comparison of four cutaneous displays for pinching palpation in robotic surgery , 2016, 2016 IEEE Haptics Symposium (HAPTICS).

[37]  Claudio Pacchierotti,et al.  Cutaneous Feedback of Fingertip Deformation and Vibration for Palpation in Robotic Surgery , 2016, IEEE Transactions on Biomedical Engineering.

[38]  Antonio Frisoli,et al.  A 3-RSR Haptic Wearable Device for Rendering Fingertip Contact Forces , 2017, IEEE Transactions on Haptics.