Evaluation of Wearable Haptic Systems for the Fingers in Augmented Reality Applications

Although Augmented Reality (AR) has been around for almost five decades, only recently we have witnessed AR systems and applications entering in our everyday life. Representative examples of this technological revolution are the smartphone games “Pokémon GO” and “Ingress” or the Google Translate real-time sign interpretation app. Even if AR applications are already quite compelling and widespread, users are still not able to physically interact with the computer-generated reality. In this respect, wearable haptics can provide the compelling illusion of touching the superimposed virtual objects without constraining the motion or the workspace of the user. In this paper, we present the experimental evaluation of two wearable haptic interfaces for the fingers in three AR scenarios, enrolling 38 participants. In the first experiment, subjects were requested to write on a virtual board using a real chalk. The haptic devices provided the interaction forces between the chalk and the board. In the second experiment, subjects were asked to pick and place virtual and real objects. The haptic devices provided the interaction forces due to the weight of the virtual objects. In the third experiment, subjects were asked to balance a virtual sphere on a real cardboard. The haptic devices provided the interaction forces due to the weight of the virtual sphere rolling on the cardboard. Providing haptic feedback through the considered wearable device significantly improved the performance of all the considered tasks. Moreover, subjects significantly preferred conditions providing wearable haptic feedback.

[1]  Claudio Pacchierotti,et al.  Cutaneous haptic feedback to ensure the stability of robotic teleoperation systems , 2015, Int. J. Robotics Res..

[2]  Sean Follmer,et al.  Wolverine: A wearable haptic interface for grasping in virtual reality , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[3]  Ivan E. Sutherland,et al.  A head-mounted three dimensional display , 1968, AFIPS Fall Joint Computing Conference.

[4]  Antonio Frisoli,et al.  Design of a cutaneous fingertip display for improving haptic exploration of virtual objects , 2010, 19th International Symposium in Robot and Human Interactive Communication.

[5]  Maud Marchal,et al.  HapTip: Displaying Haptic Shear Forces at the Fingertips for Multi-Finger Interaction in Virtual Environments , 2016, Front. ICT.

[6]  Nick Bryan-Kinns,et al.  Mood Glove: A haptic wearable prototype system to enhance mood music in film , 2016, Entertain. Comput..

[7]  Eyal Ofek,et al.  NormalTouch and TextureTouch: High-fidelity 3D Haptic Shape Rendering on Handheld Virtual Reality Controllers , 2016, UIST.

[8]  Jumpei Arata,et al.  Design and Characterization of a Lightweight and Fully Portable Remote Actuation System for Use With a Hand Exoskeleton , 2016, IEEE Robotics and Automation Letters.

[9]  Mel Slater,et al.  Touching the void: exploring virtual objects through a vibrotactile glove , 2012 .

[10]  Claudio Pacchierotti,et al.  Sensory Subtraction in Robot-Assisted Surgery: Fingertip Skin Deformation Feedback to Ensure Safety and Improve Transparency in Bimanual Haptic Interaction , 2014, IEEE Transactions on Biomedical Engineering.

[11]  Shinichi Hirai,et al.  Development of a soft-fingertip and its modeling based on force distribution , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[12]  Claudio Pacchierotti,et al.  Towards Wearability in Fingertip Haptics: A 3-DoF Wearable Device for Cutaneous Force Feedback , 2013, IEEE Transactions on Haptics.

[13]  Claudio Pacchierotti,et al.  Cutaneous Haptic Feedback in Robotic Teleoperation , 2015, Springer Series on Touch and Haptic Systems.

[14]  Claudio Pacchierotti,et al.  Wearable haptics and hand tracking via an RGB-D camera for immersive tactile experiences , 2014, SIGGRAPH '14.

[15]  Stefan Marks,et al.  An Intuitive Tangible Game Controller , 2014, IE.

[16]  Claudio Pacchierotti,et al.  Cutaneous Force Feedback as a Sensory Subtraction Technique in Haptics , 2011, IEEE Transactions on Haptics.

[17]  Daniel C. Asmar,et al.  A Haptic Glove as a Tactile-Vision Sensory Substitution for Wayfinding , 2003 .

[18]  Antonio Frisoli,et al.  A 3-RSR Haptic Wearable Device for Rendering Fingertip Contact Forces , 2017, IEEE Transactions on Haptics.

[19]  Kouta Minamizawa,et al.  Gravity grabber: wearable haptic display to present virtual mass sensation , 2007, SIGGRAPH '07.

[20]  Kouta Minamizawa,et al.  A Wearable Haptic Display to Present the Gravity Sensation - Preliminary Observations and Device Design , 2007, Second Joint EuroHaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems (WHC'07).

[21]  Hyoukryeol Choi,et al.  Development of Soft-Actuator-Based Wearable Tactile Display , 2008, IEEE Transactions on Robotics.

[22]  Daniele Mazzei,et al.  Wearable Wireless Tactile Display for Virtual Interactions with Soft Bodies , 2014, Front. Bioeng. Biotechnol..

[23]  Domenico Prattichizzo,et al.  Shape and weight rendering for haptic Augmented Reality , 2010, 19th International Symposium in Robot and Human Interactive Communication.

[24]  Antonio Frisoli,et al.  A wearable fingertip haptic device with 3 DoF asymmetric 3-RSR kinematics , 2015, 2015 IEEE World Haptics Conference (WHC).

[25]  John Kenneth Salisbury,et al.  A constraint-based god-object method for haptic display , 1995, Proceedings 1995 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human Robot Interaction and Cooperative Robots.

[26]  Claudio Pacchierotti,et al.  The hRing: A wearable haptic device to avoid occlusions in hand tracking , 2016, 2016 IEEE Haptics Symposium (HAPTICS).

[27]  Lauren Hayes,et al.  Vibrotactile Feedback-Assisted Performance , 2011, NIME.

[28]  Jumpei Arata,et al.  A new hand exoskeleton device for rehabilitation using a three-layered sliding spring mechanism , 2013, 2013 IEEE International Conference on Robotics and Automation.

[29]  Walter D. Potter,et al.  Vibrotactile Glove guidance for semi-autonomous wheelchair operations , 2008, ACM-SE 46.

[30]  Allison M. Okamura,et al.  Three-Dimensional Skin Deformation as Force Substitution: Wearable Device Design and Performance During Haptic Exploration of Virtual Environments , 2017, IEEE Transactions on Haptics.

[31]  Antonio Frisoli,et al.  A new wearable fingertip haptic interface for the rendering of virtual shapes and surface features , 2016, 2016 IEEE Haptics Symposium (HAPTICS).

[32]  Claudio Pacchierotti,et al.  Design and development of a 3RRS wearable fingertip cutaneous device , 2015, 2015 IEEE International Conference on Advanced Intelligent Mechatronics (AIM).

[33]  Vincent Hayward,et al.  Wearable Haptic Systems for the Fingertip and the Hand: Taxonomy, Review, and Perspectives , 2017, IEEE Transactions on Haptics.

[34]  Andreas Hein,et al.  conTACT - A Vibrotactile Display for Computer Aided Surgery , 2007, Second Joint EuroHaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems (WHC'07).