Sensing and Force-Feedback Exoskeleton (SAFE) Robotic Glove

This paper presents the design, implementation and experimental validation of a novel robotic haptic exoskeleton device to measure the user's hand motion and assist hand motion while remaining portable and lightweight. The device consists of a five-finger mechanism actuated with miniature DC motors through antagonistically routed cables at each finger, which act as both active and passive force actuators. The SAFE Glove is a wireless and self-contained mechatronic system that mounts over the dorsum of a bare hand and provides haptic force feedback to each finger. The glove is adaptable to a wide variety of finger sizes without constraining the range of motion. This makes it possible to accurately and comfortably track the complex motion of the finger and thumb joints associated with common movements of hand functions, including grip and release patterns. The glove can be wirelessly linked to a computer for displaying and recording the hand status through 3D Graphical User Interface (GUI) in real-time. The experimental results demonstrate that the SAFE Glove is capable of reliably modeling hand kinematics, measuring finger motion and assisting hand grasping motion. Simulation and experimental results show the potential of the proposed system in rehabilitation therapy and virtual reality applications.

[1]  E. Mackin,et al.  Examination of the hand & upper limb , 1998 .

[2]  Paolo Dario,et al.  A Survey of Glove-Based Systems and Their Applications , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[3]  Mircea Nicolescu,et al.  A Review on Vision-Based Full DOF Hand Motion Estimation , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[4]  Pinhas Ben-Tzvi,et al.  RML Glove—An Exoskeleton Glove Mechanism With Haptics Feedback , 2015, IEEE/ASME Transactions on Mechatronics.

[5]  Hong Liu,et al.  An exoskeleton master hand for controlling DLR/HIT hand , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[6]  L. Paredes-Madrid,et al.  Dataglove-based interface for impedance control of manipulators in cooperative human?robot environments , 2013 .

[7]  B. Buchholz,et al.  Anthropometric data for describing the kinematics of the human hand. , 1992, Ergonomics.

[8]  Michela Borghetti,et al.  Sensorized Glove for Measuring Hand Finger Flexion for Rehabilitation Purposes , 2013, IEEE Transactions on Instrumentation and Measurement.

[9]  Mark R. Cutkosky,et al.  Using Haptic Feedback to Improve Grasp Force Control in Multiple Sclerosis Patients , 2009, IEEE Transactions on Robotics.

[10]  Robert A. Chase,et al.  Atlas of Hand Anatomy and Clinical Implications , 2003 .

[11]  T. Milner,et al.  HandCARE: A Cable-Actuated Rehabilitation System to Train Hand Function After Stroke , 2008, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[12]  John T. McConville,et al.  Sampling and Data Gathering Strategies for Future USAF Anthropometry , 1976 .

[13]  Francesco Giovacchini,et al.  Mechatronic Design and Characterization of the Index Finger Module of a Hand Exoskeleton for Post-Stroke Rehabilitation , 2012, IEEE/ASME Transactions on Mechatronics.

[14]  S Stefan Lichiardopol,et al.  A Survey on Teleoperation , 2007 .

[15]  S. Gandevia,et al.  Proprioceptive signals contribute to the sense of body ownership , 2011, The Journal of physiology.

[16]  Pinhas Ben-Tzvi,et al.  Experimental validation and field performance metrics of a hybrid mobile robot mechanism , 2010, J. Field Robotics.

[17]  S.H. Winter,et al.  Use of Magnetorheological Fluid in a Force Feedback Glove , 2007, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[18]  Grigore C. Burdea,et al.  The Rutgers Master II-new design force-feedback glove , 2002 .

[19]  Andrew A. Goldenberg,et al.  Design and Analysis of a Hybrid Mobile Robot Mechanism With Compounded Locomotion and Manipulation Capability , 2008 .

[20]  Honghai Liu,et al.  Exploring Human Hand Capabilities Into Embedded Multifingered Object Manipulation , 2011, IEEE Transactions on Industrial Informatics.

[21]  Steve Rothberg,et al.  Evaluation of thin, flexible sensors for time-resolved grip force measurement , 2007 .

[22]  Frans C. T. van der Helm,et al.  Self-Aligning Exoskeleton Axes Through Decoupling of Joint Rotations and Translations , 2009, IEEE Transactions on Robotics.

[23]  Pinhas Ben-Tzvi,et al.  Design and Optimization of a Five-Finger Haptic Glove Mechanism , 2015 .

[24]  Grigore C. Burdea,et al.  Virtual reality simulation modeling for a haptic glove , 1999, Proceedings Computer Animation 1999.

[25]  M. Chen,et al.  An intention driven hand functions task training robotic system , 2010, 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology.

[26]  Takashi Maeno,et al.  Contact Force and Finger Angles Estimation for Touch Panel by Detecting Transmitted Light on Fingernail , 2012, EuroHaptics.

[27]  J. Blake,et al.  Haptic Glove With MR Brakes for Virtual Reality , 2009, IEEE/ASME Transactions on Mechatronics.

[28]  Haruhisa Kawasaki,et al.  Development of a Hand-Assist Robot With Multi-Degrees-of-Freedom for Rehabilitation Therapy , 2012, IEEE/ASME Transactions on Mechatronics.

[29]  Peter I. Corke,et al.  Robotics, Vision and Control - Fundamental Algorithms in MATLAB® , 2011, Springer Tracts in Advanced Robotics.

[30]  Anne M. R. Agur,et al.  Grant's Atlas of Anatomy, 10th Edition , 1999 .

[31]  Takashi Maeno,et al.  Development of an Ultrasonic Clutch , 2003 .

[32]  A. Buryanov,et al.  Proportions of Hand Segments , 2010 .

[33]  J. Muscolino Kinesiology : The Skeletal System and Muscle Function , 2006 .

[34]  G. Burdea,et al.  Telerehabilitation Using the Rutgers Master II Glove Following Carpal Tunnel Release Surgery: Proof-of-Concept , 2007, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[35]  Wataru Fukui,et al.  Two-Fingered Haptic Device for Robot Hand Teleoperation , 2011, J. Robotics.

[36]  M. Ferrarin,et al.  Multi-finger coordination in healthy subjects and stroke patients: a mathematical modelling approach , 2011, Journal of NeuroEngineering and Rehabilitation.

[37]  Sheldon R. Simon,et al.  Orthopaedic basic science : biology and biomechanics of the musculoskeletal system , 2000 .

[38]  Satoshi Kinoshita,et al.  Wearable contact force sensor system based on fingerpad deformation , 2011, 2011 IEEE World Haptics Conference.

[39]  Andris Freivalds,et al.  Biomechanics of the Upper Limbs: Mechanics, Modelling and Musculoskeletal Injuries , 2004 .

[40]  Takashi Maeno,et al.  Development of an ultrasonic clutch , 2003, IEEE Symposium on Ultrasonics, 2003.

[41]  Paul H. Chappell,et al.  Validation and Application of a Computational Model for Wrist and Hand Movements Using Surface Markers , 2008, IEEE Transactions on Biomedical Engineering.

[42]  Oussama Khatib,et al.  A Haptic Teleoperation Approach Based on Contact Force Control , 2006, Int. J. Robotics Res..

[43]  A Murgia,et al.  A gait analysis approach to the study of upper limb kinematics using activities of daily living. , 2005 .

[44]  Robert V Kenyon,et al.  A Pneumatic Glove and Immersive Virtual Reality Environment for Hand Rehabilitative Training After Stroke , 2010, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[45]  Robert J. Anderson Advanced dexterous manipulation for IED defeat : report on the feasibility of using the ShadowHand for remote operations. , 2011 .

[46]  Mircea Nicolescu,et al.  Vision-based hand pose estimation: A review , 2007, Comput. Vis. Image Underst..

[47]  Nicola J. Ferrier,et al.  Design and Control of a Force-Reflecting Haptic Interface for Teleoperational Grasping , 2002 .

[48]  Haruhisa Kawasaki,et al.  A finger skill transfer system using a multi-fingered haptic interface robot and a hand motion image , 2013, Robotica.

[49]  Zhi-Hong Mao,et al.  Information Capacity of the Thumb and the Index Finger in Communication , 2009, IEEE Transactions on Biomedical Engineering.

[50]  P. Helliwell,et al.  Biomechanics of the Upper Limbs: Mechanics, Modeling, and Musculoskeletal Injuries , 2007 .

[51]  A. Landi Human Hand Function , 2007 .

[52]  Jumpei Arata,et al.  A new hand exoskeleton device for rehabilitation using a three-layered sliding spring mechanism , 2013, 2013 IEEE International Conference on Robotics and Automation.

[53]  David G. Kirkpatrick,et al.  On the shape of a set of points in the plane , 1983, IEEE Trans. Inf. Theory.

[54]  H. Cotta [On the physiology of joints]. , 1966, Langenbecks Archiv fur Chirurgie.

[55]  Andrew A. Goldenberg,et al.  Articulated hybrid mobile robot mechanism with compounded mobility and manipulation and on-board wireless sensor/actuator control interfaces , 2010 .

[56]  David J. Fleet,et al.  Model-Based 3D Hand Pose Estimation from Monocular Video , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[57]  Anne M.R. Agur,et al.  Grant's Atlas of Anatomy , 1943 .

[58]  Stephen A. Mascaro,et al.  Estimation of Fingertip Force Direction With Computer Vision , 2009, IEEE Transactions on Robotics.

[59]  Vitor F. Pamplona,et al.  The Image-Based Data Glove , 2008 .

[60]  Matteo Bianchi,et al.  On the use of postural synergies to improve human hand pose reconstruction , 2012, 2012 IEEE Haptics Symposium (HAPTICS).

[61]  Pinhas Ben-Tzvi,et al.  Modeling Human Hand and Sensing Hand Motions With the Five-Fingered Haptic Glove Mechanism , 2014 .