Toward Whole-Hand Kinesthetic Feedback: A Survey of Force Feedback Gloves

Force feedback gloves have found many applications in fields such as teleoperation and virtual reality. In order to enhance the immersive feeling of interaction with remote or virtual environments, glove-like haptic devices are used, which enable users to touch and manipulate virtual objects in a more intuitive and direct way via the dexterous manipulation and sensitive perception capabilities of human hands. In this survey, we aim to identify the gaps between existing force feedback gloves and the desired ones that can provide robust and realistic sensation of the interaction with diverse virtual environments. By examining existing force feedback gloves, the pros and cons of existing design solutions to the major sub-systems including sensing, actuation, control, transmission and structure are discussed. Future research topics are put forward with design challenges being elaborated. Innovative design solutions are needed to enable the utility of wearable haptic gloves in the upcoming virtual reality era.

[1]  Makoto Sato,et al.  Development of string-based multi-finger haptic interface SPIDAR-MF , 2013, 2013 23rd International Conference on Artificial Reality and Telexistence (ICAT).

[2]  J. Edward Colgate,et al.  Passivity of a class of sampled-data systems: Application to haptic interfaces , 1997, J. Field Robotics.

[3]  Nitish V. Thakor,et al.  Soft haptics using soft actuator and soft sensor , 2016, 2016 6th IEEE International Conference on Biomedical Robotics and Biomechatronics (BioRob).

[4]  Igor Zubrycki,et al.  Novel haptic glove-based interface using jamming principle , 2015, 2015 10th International Workshop on Robot Motion and Control (RoMoCo).

[5]  Dongseok Ryu,et al.  Wearable haptic glove using micro hydraulic system for control of construction robot system with VR environment , 2008, 2008 IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems.

[6]  Honghai Liu,et al.  Exploring Human Hand Capabilities Into Embedded Multifingered Object Manipulation , 2011, IEEE Transactions on Industrial Informatics.

[7]  Stephen A. Mascaro,et al.  Estimation of Fingertip Force Direction With Computer Vision , 2009, IEEE Transactions on Robotics.

[8]  H. Mckellop,et al.  Functional range of motion of the joints of the hand. , 1990, The Journal of hand surgery.

[9]  Jean Ponce,et al.  On computing three-finger force-closure grasps of polygonal objects , 1991, Fifth International Conference on Advanced Robotics 'Robots in Unstructured Environments.

[10]  Antonio Frisoli,et al.  A 3-RSR Haptic Wearable Device for Rendering Fingertip Contact Forces , 2017, IEEE Transactions on Haptics.

[11]  Antonio Frisoli,et al.  Design and kinematic optimization of a novel underactuated robotic hand exoskeleton , 2017, ArXiv.

[12]  K. Koyanagi,et al.  Development of Passive Force Display Glove System and Its Improved Mechanism , 2007, 2007 International Conference on Mechatronics and Automation.

[13]  Tsuneo Yoshikawa,et al.  Designing an Encountered-type Haptic Display for Multiple Fingertip Contacts Based on the Observation of Human Grasping Behaviors , 2004, 12th International Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, 2004. HAPTICS '04. Proceedings..

[14]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[15]  H. Ide,et al.  Effect of skin temperature on vibrotactile sensitivity , 1985, Medical and Biological Engineering and Computing.

[16]  Li Jiang.  Portable haptic feedback for training and rehabilitation , 2009 .

[17]  Jumpei Arata,et al.  A new hand exoskeleton device for rehabilitation using a three-layered sliding spring mechanism , 2013, 2013 IEEE International Conference on Robotics and Automation.

[18]  Darwin G. Caldwell,et al.  Human hand compatible underactuated exoskeleton robotic system , 2014 .

[19]  J. Edward Colgate,et al.  Passivity of a class of sampled-data systems: Application to haptic interfaces , 1997 .

[20]  Yi Sun,et al.  A Fully Fabric-Based Bidirectional Soft Robotic Glove for Assistance and Rehabilitation of Hand Impaired Patients , 2017, IEEE Robotics and Automation Letters.

[21]  Y. J. Nam,et al.  Smart glove: hand master using magnetorheological fluid actuators , 2007, ICMIT: Mechatronics and Information Technology.

[22]  Gesche Joost,et al.  Mobile Lorm Glove: introducing a communication device for deaf-blind people , 2012, TEI.

[23]  Ian Oakley,et al.  A tactile glove design and authoring system for immersive multimedia , 2010 .

[24]  Takashi Maeno,et al.  Contact Force and Finger Angles Estimation for Touch Panel by Detecting Transmitted Light on Fingernail , 2012, EuroHaptics.

[25]  J. Blake,et al.  Haptic Glove With MR Brakes for Virtual Reality , 2009, IEEE/ASME Transactions on Mechatronics.

[26]  E. B. Brokaw,et al.  Hand Spring Operated Movement Enhancer (HandSOME): A Portable, Passive Hand Exoskeleton for Stroke Rehabilitation , 2011, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[27]  Pilwon Hur,et al.  A Portable Sensory Augmentation Device for Balance Rehabilitation Using Fingertip Skin Stretch Feedback , 2017, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[28]  Naoki Kawakami,et al.  An Encounter-Type Multi-Fingered Master Hand Using Circuitous Joints , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[29]  Satoshi Kinoshita,et al.  Wearable contact force sensor system based on fingerpad deformation , 2011, 2011 IEEE World Haptics Conference.

[30]  Ali Israr,et al.  TeslaTouch: electrovibration for touch surfaces , 2010, UIST.

[31]  M. Ferrarin,et al.  Multi-finger coordination in healthy subjects and stroke patients: a mathematical modelling approach , 2011, Journal of NeuroEngineering and Rehabilitation.

[32]  Nikolaus Correll,et al.  Materials that couple sensing, actuation, computation, and communication , 2015, Science.

[33]  Karl Iagnemma,et al.  A Novel Layer Jamming Mechanism With Tunable Stiffness Capability for Minimally Invasive Surgery , 2013, IEEE Transactions on Robotics.

[34]  José Pascual Molina,et al.  Identifying Virtual 3D Geometric Shapes with a Vibrotactile Glove , 2016, IEEE Computer Graphics and Applications.

[35]  Matteo Bianchi,et al.  On the use of postural synergies to improve human hand pose reconstruction , 2012, 2012 IEEE Haptics Symposium (HAPTICS).

[36]  Sungchul Kang,et al.  Micro hydraulic system using slim artificial muscles for a wearable haptic glove , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[37]  Mircea Nicolescu,et al.  Vision-based hand pose estimation: A review , 2007, Comput. Vis. Image Underst..

[38]  Nikolaos G. Tsagarakis,et al.  HEXOTRAC: A highly under-actuated hand exoskeleton for finger tracking and force feedback , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[39]  Kyu-Jin Cho,et al.  Jointless structure and under-actuation mechanism for compact hand exoskeleton , 2011, 2011 IEEE International Conference on Rehabilitation Robotics.

[40]  Pinhas Ben-Tzvi,et al.  Design and Optimization of a Five-Finger Haptic Glove Mechanism , 2015 .

[41]  Ravi Balasubramanian,et al.  The Human Hand as an Inspiration for Robot Hand Development , 2014, Springer Tracts in Advanced Robotics.

[42]  Joonbum Bae,et al.  A Force-Controllable Compact Actuator Module for a Wearable Hand Exoskeleton , 2014 .

[43]  Pinhas Ben-Tzvi,et al.  Sensing and Force-Feedback Exoskeleton (SAFE) Robotic Glove , 2015, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[44]  Vincent Hayward,et al.  Wearable Haptic Systems for the Fingertip and the Hand: Taxonomy, Review, and Perspectives , 2017, IEEE Transactions on Haptics.

[45]  KooIg Mo,et al.  Development of Soft-Actuator-Based Wearable Tactile Display , 2008 .

[46]  Antonio Frisoli,et al.  An EMG-Controlled Robotic Hand Exoskeleton for Bilateral Rehabilitation , 2015, IEEE Transactions on Haptics.

[47]  Paul H. Chappell,et al.  Validation and Application of a Computational Model for Wrist and Hand Movements Using Surface Markers , 2008, IEEE Transactions on Biomedical Engineering.

[48]  Ryuichiro Yamane,et al.  Smart mouse: 5-DOF haptic hand master using magneto-rheological fluid actuators , 2009 .

[49]  Robert J. Wood,et al.  Soft robotic glove for combined assistance and at-home rehabilitation , 2015, Robotics Auton. Syst..

[50]  Joonbum Bae,et al.  Development of a dual-cable hand exoskeleton system for virtual reality , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[51]  Antonio Frisoli,et al.  Kinematic Design of a Two Contact Points Haptic Interface for the Thumb and Index Fingers of the Hand , 2007 .

[52]  William R. Provancher,et al.  Planar Hand Motion Guidance Using Fingertip Skin-Stretch Feedback , 2014, IEEE Transactions on Haptics.

[53]  Paolo Dario,et al.  A Survey of Glove-Based Systems and Their Applications , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[54]  B. Buchholz,et al.  Anthropometric data for describing the kinematics of the human hand. , 1992, Ergonomics.

[55]  Michela Borghetti,et al.  Sensorized Glove for Measuring Hand Finger Flexion for Rehabilitation Purposes , 2013, IEEE Transactions on Instrumentation and Measurement.

[56]  Junji Furusho,et al.  Development of VR-STEF system with force display glove system , 2005, ICAT '05.

[57]  Yifei Zhang,et al.  Dexmo: An Inexpensive and Lightweight Mechanical Exoskeleton for Motion Capture and Force Feedback in VR , 2016, CHI.

[58]  Hyoukryeol Choi,et al.  Development of Soft-Actuator-Based Wearable Tactile Display , 2008, IEEE Transactions on Robotics.

[59]  Grigore C. Burdea,et al.  The Rutgers Master II-new design force-feedback glove , 2002 .

[60]  Yutaka Tanaka,et al.  WEARABLE HAPTIC DISPLAY FOR IMMERSIVE VIRTUAL ENVIRONMENT , 2002 .

[61]  Kyle B. Reed,et al.  Perceived Cooling Using Asymmetrically-Applied Hot and Cold Stimuli , 2017, IEEE Transactions on Haptics.

[62]  S. Lederman,et al.  Human Hand Function , 2006 .

[63]  Kouta Minamizawa,et al.  Haptic telexistence , 2007, SIGGRAPH Posters.

[64]  S. Gandevia,et al.  Proprioceptive signals contribute to the sense of body ownership , 2011, The Journal of physiology.

[65]  Jian Song,et al.  Co-actuation: Achieve High Stiffness and Low Inertia in Force Feedback Device , 2016, EuroHaptics.

[66]  Haruhisa Kawasaki,et al.  Five-fingered haptic interface robot: HIRO III , 2009, World Haptics 2009 - Third Joint EuroHaptics conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems.

[67]  Mark R. Cutkosky,et al.  On grasp choice, grasp models, and the design of hands for manufacturing tasks , 1989, IEEE Trans. Robotics Autom..

[68]  Andreas M. Kunz,et al.  Dielectric Elastomer Spring Roll Actuators for a Portable Force Feedback Device , 2006, 2006 14th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems.

[69]  Makoto Sato,et al.  Two-Handed Multi-Fingers String-Based Haptic Interface Device , 2001 .

[70]  Lapo Governi,et al.  Development and experimental testing of a portable hand exoskeleton , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[71]  Yashraj S. Narang,et al.  Mechanically Versatile Soft Machines through Laminar Jamming , 2018 .

[72]  Sean Follmer,et al.  Wolverine: A wearable haptic interface for grasping in virtual reality , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[73]  Massimo Bergamasco,et al.  Mechanical design of a novel Hand Exoskeleton for accurate force displaying , 2009, 2009 IEEE International Conference on Robotics and Automation.

[74]  Nicolas Roussel,et al.  STIMTAC: a tactile input device with programmable friction , 2011, UIST '11 Adjunct.

[75]  Yili Fu,et al.  Design and development of a hand rehabilitation robot for patient-cooperative therapy following stroke , 2011, 2011 IEEE International Conference on Mechatronics and Automation.

[76]  Hideki Hashimoto,et al.  Development of 20 DOF glove type haptic interface device-Sensor Glove II , 1997, Proceedings of IEEE/ASME International Conference on Advanced Intelligent Mechatronics.

[77]  Wei Xiong,et al.  Design of a new type of pneumatic force feedback data glove , 2011, Proceedings of 2011 International Conference on Fluid Power and Mechatronics.

[78]  David J. Fleet,et al.  Model-Based 3D Hand Pose Estimation from Monocular Video , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[79]  D. Rus,et al.  Design, fabrication and control of soft robots , 2015, Nature.

[80]  M. Cates,et al.  Jamming, Force Chains, and Fragile Matter , 1998, cond-mat/9803197.

[81]  Ivan E. Sutherland,et al.  The Ultimate Display , 1965 .

[82]  Ross T. Smith,et al.  Wearable jamming mitten for virtual environment haptics , 2014, SEMWEB.

[83]  Danica Kragic,et al.  The GRASP Taxonomy of Human Grasp Types , 2016, IEEE Transactions on Human-Machine Systems.

[84]  S.H. Winter,et al.  Use of Magnetorheological Fluid in a Force Feedback Glove , 2007, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[85]  Ming C. Lin,et al.  Haptic Rendering : Foundations, Algorithms, and Applications , 2008 .

[86]  Brian Byunghyun Kang,et al.  Development of a polymer-based tendon-driven wearable robotic hand , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[87]  Peter Korondi,et al.  Vibro-tactile feedback for VR systems , 2009, 2009 2nd Conference on Human System Interactions.

[88]  Cagatay Basdogan,et al.  Haptics in virtual environments: taxonomy, research status, and challenges , 1997, Comput. Graph..

[89]  Michael A. Saliba,et al.  A force feedback glove based on Magnetorheological Fluid: Preliminary design issues , 2010, Melecon 2010 - 2010 15th IEEE Mediterranean Electrotechnical Conference.

[90]  Walter D. Potter,et al.  Vibrotactile Glove guidance for semi-autonomous wheelchair operations , 2008, ACM-SE 46.

[91]  Francesco Giovacchini,et al.  Mechatronic Design and Characterization of the Index Finger Module of a Hand Exoskeleton for Post-Stroke Rehabilitation , 2012, IEEE/ASME Transactions on Mechatronics.

[92]  Blake Hannaford,et al.  Haptic characteristics of some activities of daily living , 2010, 2010 IEEE Haptics Symposium.

[93]  John Kenneth Salisbury,et al.  Haptic rendering: programming touch interaction with virtual objects , 1995, I3D '95.

[94]  Akio Yamamoto,et al.  Electrostatic Tactile Display with Thin Film Slider and Its Application to Tactile Telepresentation Systems , 2006, IEEE Trans. Vis. Comput. Graph..

[95]  Pinhas Ben-Tzvi,et al.  RML Glove—An Exoskeleton Glove Mechanism With Haptics Feedback , 2015, IEEE/ASME Transactions on Mechatronics.

[96]  Ja Choon Koo,et al.  Design analysis and fabrication of arrayed tactile display based on dielectric elastomer actuator , 2014 .

[97]  Blake Hannaford,et al.  Stable haptic interaction with virtual environments , 1999, IEEE Trans. Robotics Autom..

[98]  Osamu Oshiro,et al.  Haptic Glove Using Compression-Induced Friction Torque , 2013 .

[99]  Lynette A. Jones,et al.  Warm or Cool, Large or Small? The Challenge of Thermal Displays , 2008, IEEE Transactions on Haptics.

[100]  J. Edward Colgate,et al.  Factors affecting the Z-Width of a haptic display , 1994, Proceedings of the 1994 IEEE International Conference on Robotics and Automation.

[101]  Zhongsheng Sun,et al.  Design of a bidirectional force feedback dataglove based on pneumatic artificial muscles , 2009, 2009 International Conference on Mechatronics and Automation.

[102]  Philippe Fuchs,et al.  Design of a 2-finger hand skeleton for VR grasping simulation , 2003 .

[103]  Takashi Nakagawa,et al.  Force Display for Presentation of Rigidity of Virtual Objects , 1992, J. Robotics Mechatronics.

[104]  Darwin G. Caldwell,et al.  Four-fingered lightweight exoskeleton robotic device accommodating different hand sizes , 2015 .

[105]  Mark R. Cutkosky,et al.  Rotational Skin Stretch Feedback: A Wearable Haptic Display for Motion , 2010, IEEE Transactions on Haptics.

[106]  Takashi Maeno,et al.  Multi-fingered exoskeleton haptic device using passive force feedback for dexterous teleoperation , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[107]  Kotaro Tadano,et al.  Development of grip amplified glove using bi-articular mechanism with pneumatic artificial rubber muscle , 2010, 2010 IEEE International Conference on Robotics and Automation.

[108]  Olivier Lambercy,et al.  Design of a thumb exoskeleton for hand rehabilitation , 2013 .

[109]  Maud Marchal,et al.  Aggregate Constraints for Virtual Manipulation with Soft Fingers , 2015, IEEE Transactions on Visualization and Computer Graphics.

[110]  J. Edward Colgate,et al.  T-PaD: Tactile Pattern Display through Variable Friction Reduction , 2007, Second Joint EuroHaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems (WHC'07).

[111]  Claudio Pacchierotti,et al.  Towards Wearability in Fingertip Haptics: A 3-DoF Wearable Device for Cutaneous Force Feedback , 2013, IEEE Transactions on Haptics.