A Modular Wearable Finger Interface for Cutaneous and Kinesthetic Interaction: Control and Evaluation

In this paper, we present a novel modular wearable interface for haptic interaction and robotic teleoperation. It is composed of a 3-degree-of-freedom (3-DoF) fingertip cutaneous device and a 1-DoF finger kinesthetic exoskeleton, which can be either used together as a single device or separately as two different devices. The 3-DoF fingertip device is composed of a static body and a mobile platform. The mobile platform is capable of making and breaking contact with the finger pulp and reangle to replicate contacts with arbitrarily oriented surfaces. The 1-DoF finger exoskeleton provides kinesthetic force to the proximal and distal interphalangeal finger articulations using one servo motor grounded on the proximal phalanx. This paper presents the wearable device as well as three different position, force, and compliance control schemes, together with their evaluations. We also present three human subjects experiments, enrolling a total of 40 different participants: the first experiment considered a curvature discrimination task, the second one a robot-assisted palpation task, and the third one an immersive experience in virtual reality. Results show that providing cutaneous and kinesthetic feedback through our device significantly improve the performance of all the considered tasks. Moreover, although cutaneous-only feedback shows promising performance, adding kinesthetic feedback improves most metrics. Finally, subjects rank our device as highly wearable, comfortable, and effective.

[1]  Claudio Pacchierotti,et al.  A soft robotic supernumerary finger and a wearable cutaneous finger interface to compensate the missing grasping capabilities in chronic stroke patients , 2017, 2017 IEEE World Haptics Conference (WHC).

[2]  Xavier de Tinguy,et al.  Enhancing the Stiffness Perception of Tangible Objects in Mixed Reality Using Wearable Haptics , 2018, 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR).

[3]  Mario Cortese,et al.  A Powered Finger–Thumb Wearable Hand Exoskeleton With Self-Aligning Joint Axes , 2015, IEEE/ASME Transactions on Mechatronics.

[4]  Antonio Frisoli,et al.  Design of an Underactuated Hand Exoskeleton with Joint Estimation , 2017 .

[5]  Jon Rigelsford,et al.  Modelling and Control of Robot Manipulators , 2000 .

[6]  Vincent Hayward,et al.  Local Surface Orientation Dominates Haptic Curvature Discrimination , 2009, IEEE Transactions on Haptics.

[7]  Claudio Pacchierotti,et al.  Cutaneous haptic feedback to ensure the stability of robotic teleoperation systems , 2015, Int. J. Robotics Res..

[8]  Claudio Pacchierotti,et al.  A three DoFs wearable tactile display for exploration and manipulation of virtual objects , 2012, 2012 IEEE Haptics Symposium (HAPTICS).

[9]  Claudio Pacchierotti,et al.  Cutaneous Feedback of Fingertip Deformation and Vibration for Palpation in Robotic Surgery , 2016, IEEE Transactions on Biomedical Engineering.

[10]  Claudio Pacchierotti,et al.  Wearable haptics and hand tracking via an RGB-D camera for immersive tactile experiences , 2014, SIGGRAPH '14.

[11]  Claudio Pacchierotti,et al.  A Three Revolute-Revolute-Spherical Wearable Fingertip Cutaneous Device for Stiffness Rendering , 2018, IEEE Transactions on Haptics.

[12]  Kouta Minamizawa,et al.  Gravity grabber: wearable haptic display to present virtual mass sensation , 2007, SIGGRAPH '07.

[13]  S. Roccella,et al.  Bio-inspired sensorization of a biomechatronic robot hand for the grasp-and-lift task , 2008, Brain Research Bulletin.

[14]  Takahiro Nozaki,et al.  Design and Evaluation of a Remote Actuated Finger Exoskeleton Using Motion-Copying System for Tendon Rehabilitation , 2018, IEEE Transactions on Industrial Informatics.

[15]  L. W. Tsai,et al.  Robot Analysis: The Mechanics of Serial and Parallel Ma-nipulators , 1999 .

[16]  Allison M Okamura,et al.  Evaluation of Skin Deformation Tactile Feedback for Teleoperated Surgical Tasks , 2019, IEEE Transactions on Haptics.

[17]  Allison M. Okamura,et al.  The Touch Thimble: Providing Fingertip Contact Feedback During Point-Force Haptic Interaction , 2008, 2008 Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems.

[18]  Antonio Frisoli,et al.  A Fingertip Haptic Display for Improving Curvature Discrimination , 2008, PRESENCE: Teleoperators and Virtual Environments.

[19]  Blake Hannaford,et al.  Stable teleoperation with time-domain passivity control , 2002, IEEE Transactions on Robotics and Automation.

[20]  Claudio Pacchierotti,et al.  Sensory Subtraction in Robot-Assisted Surgery: Fingertip Skin Deformation Feedback to Ensure Safety and Improve Transparency in Bimanual Haptic Interaction , 2014, IEEE Transactions on Biomedical Engineering.

[21]  Weiliang Xu,et al.  Toward Whole-Hand Kinesthetic Feedback: A Survey of Force Feedback Gloves , 2019, IEEE Transactions on Haptics.

[22]  Claudio Pacchierotti,et al.  Towards Wearability in Fingertip Haptics: A 3-DoF Wearable Device for Cutaneous Force Feedback , 2013, IEEE Transactions on Haptics.

[23]  Claudio Pacchierotti,et al.  Combining Wearable Finger Haptics and Augmented Reality: User Evaluation Using an External Camera and the Microsoft HoloLens , 2018, IEEE Robotics and Automation Letters.

[24]  Claudio Pacchierotti,et al.  Touch the virtual reality: using the leap motion controller for hand tracking and wearable tactile devices for immersive haptic rendering , 2015, SIGGRAPH Posters.

[25]  Stefano Stramigioli,et al.  Bilateral Telemanipulation With Time Delays: A Two-Layer Approach Combining Passivity and Transparency , 2011, IEEE Transactions on Robotics.

[26]  Claudio Pacchierotti,et al.  Steering and Control of Miniaturized Untethered Soft Magnetic Grippers With Haptic Assistance , 2018, IEEE Transactions on Automation Science and Engineering.

[27]  H Stanislaw,et al.  Calculation of signal detection theory measures , 1999, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[28]  S. Torp-Pedersen,et al.  Prostate Cancer: Comparison of Transrectal US and Digital Rectal Examination for Screening , 1988, Radiology.

[29]  Maud Marchal,et al.  HapTip: Displaying Haptic Shear Forces at the Fingertips for Multi-Finger Interaction in Virtual Environments , 2016, Front. ICT.

[30]  Blake Hannaford,et al.  Assessment of Tissue Damage due to Mechanical Stresses , 2006, The First IEEE/RAS-EMBS International Conference on Biomedical Robotics and Biomechatronics, 2006. BioRob 2006..

[31]  Oussama Khatib,et al.  Haptic interaction in virtual environments , 1997, Proceedings of the 1997 IEEE/RSJ International Conference on Intelligent Robot and Systems. Innovative Robotics for Real-World Applications. IROS '97.

[32]  G. Gescheider Psychophysics: The Fundamentals , 1997 .

[33]  Vincent Hayward,et al.  Wearable Haptic Systems for the Fingertip and the Hand: Taxonomy, Review, and Perspectives , 2017, IEEE Transactions on Haptics.