DesktopGlove: A multi-finger force feedback interface separating degrees of freedom between hands

In virtual environments, interacting directly with our hands and fingers greatly contributes to immersion, especially when force feedback is provided for simulating the touch of virtual objects. Yet, common haptic interfaces are unfit for multi-finger manipulation and only costly and cumbersome grounded exoskeletons do provide all the efforts expected from object manipulation. To make multi-finger haptic interaction more accessible, we propose to combine two affordable haptic interfaces into a bimanual setup named DesktopGlove. With this approach, each hand is in charge of different components of object manipulation: one commands the global motion of a virtual hand while the other controls its fingers for grasping. In addition, each hand is subjected to forces that relate to its own degrees of freedom so that users perceive a variety of haptic effects through both of them. Our results show that (1) users are able to integrate the separated degrees of freedom of DesktopGlove to efficiently control a virtual hand in a posing task, (2) DesktopGlove shows overall better performance than a traditional data glove and is preferred by users, and (3) users considered the separated haptic feedback realistic and accurate for manipulating objects in virtual environments.

[1]  Blake Hannaford,et al.  High fidelity multi finger haptic display , 2005, First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. World Haptics Conference.

[2]  Naoki Kawakami,et al.  An Encounter-Type Multi-Fingered Master Hand Using Circuitous Joints , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[3]  Ravin Balakrishnan,et al.  Exploring bimanual camera control and object manipulation in 3D graphics interfaces , 1999, CHI '99.

[4]  Makoto Sato,et al.  4 + 4 Fingers Manipulating Virtual Objects in Mixed-Reality Environment , 2002, Presence: Teleoperators & Virtual Environments.

[5]  Frederick P. Brooks,et al.  Moving objects in space: exploiting proprioception in virtual-environment interaction , 1997, SIGGRAPH.

[6]  Paul Kabbash,et al.  Human performance using computer input devices in the preferred and non-preferred hands , 1993, INTERCHI.

[7]  Florian Gosselin,et al.  Design of a wearable haptic interface for precise finger interactions in large virtual environments , 2005, First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. World Haptics Conference.

[8]  Claudio Pacchierotti,et al.  Two Finger Grasping Simulation with Cutaneous and Kinesthetic Force Feedback , 2012, EuroHaptics.

[9]  David Zeltzer,et al.  A survey of glove-based input , 1994, IEEE Computer Graphics and Applications.

[10]  J.B.F. van Erp,et al.  Multi-finger haptic interaction within the MIAMM project , 2002 .

[11]  Patrick Olivier,et al.  Digits: freehand 3D interactions anywhere using a wrist-worn gloveless sensor , 2012, UIST.

[12]  William Buxton,et al.  Pen + touch = new tools , 2010, UIST.

[13]  James M. Hennessey,et al.  Comparing single- and two-handed 3D input for a 3D object assembly task , 1998, CHI Conference Summary.

[14]  Grigore C. Burdea,et al.  The Rutgers Master II-ND force feedback glove , 2002, Proceedings 10th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. HAPTICS 2002.

[15]  Thomas H. Massie,et al.  The PHANToM Haptic Interface: A Device for Probing Virtual Objects , 1994 .

[16]  Laurent Grisoni,et al.  The effect of DOF separation in 3D manipulation tasks with multi-touch displays , 2010, VRST '10.

[17]  Maud Marchal,et al.  THING: Introducing a Tablet-based Interaction Technique for Controlling 3D Hand Models , 2015, CHI.

[18]  Christophe Chaillou,et al.  The DigiHaptic , a New Three Degrees of Freedom Multi-finger Haptic Device , 2003 .

[19]  Daniel J. Wigdor,et al.  Combining and measuring the benefits of bimanual pen and direct-touch interaction on horizontal interfaces , 2008, AVI '08.

[20]  Christophe Chaillou,et al.  Does DOF Separation on Elastic Devices Improve User 3D Steering Task Performance? , 2004, APCHI.

[21]  Antonis A. Argyros,et al.  Efficient model-based 3D tracking of hand articulations using Kinect , 2011, BMVC.

[22]  Dominique Bechmann,et al.  Influence of degrees of freedom's manipulation on performances during orientation tasks in virtual reality environments , 2009, VRST '09.

[23]  David J. Sturman,et al.  Computer Puppetry , 1998, IEEE Computer Graphics and Applications.

[24]  M. Ferre,et al.  Multi-finger grasps in a dynamic environment , 2013 .

[25]  Karin Coninx,et al.  Multisensory interaction metaphors with haptics and proprioception in virtual environments , 2004, NordiCHI '04.

[26]  Christoph W. Borst,et al.  A Spring Model for Whole-Hand Virtual Grasping , 2006, Presence: Teleoperators & Virtual Environments.

[27]  W. Buxton,et al.  A study in two-handed input , 1986, CHI '86.

[28]  Ken Hinckley,et al.  A survey of design issues in spatial input , 1994, UIST '94.

[29]  Jorge Barrio,et al.  MasterFinger: Multi-finger Haptic Interface for Collaborative Environments , 2008, EuroHaptics.

[30]  Antonio Frisoli,et al.  The Museum of Pure Form: touching real statues in an immersive virtual museum , 2004, VAST.

[31]  Dennis Proffitt,et al.  Two-handed virtual manipulation , 1998, TCHI.

[32]  Vincent Hayward,et al.  FREEDOM-7: A High Fidelity Seven Axis Haptic Device with Application to Surgical Training , 1997, ISER.

[33]  Joaquim A. Jorge,et al.  Mockup builder: direct 3D modeling on and above the surface in a continuous interaction space , 2012, Graphics Interface.

[34]  Y. Guiard.  Asymmetric division of labor in human skilled bimanual action: the kinematic chain as a model. , 1987, Journal of motor behavior.

[35]  Robert J. K. Jacob,et al.  Integrality and separability of input devices , 1994, TCHI.

[36]  Saeid Nahavandi,et al.  Extending Haptic Device Capability for 3D Virtual Grasping , 2008, EuroHaptics.

[37]  Christophe Chaillou,et al.  Effects of DOF separation on elastic devices for the navigation in 3D virtual environments with force feedback , 2005, First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. World Haptics Conference.

[38]  Jovan Popović,et al.  Real-time hand-tracking with a color glove , 2009, SIGGRAPH 2009.

[39]  Takashi Maeno,et al.  Development of a mouse-shaped haptic device with multiple finger inputs , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).