HIRO: Multi-fingered Haptic Interface Robot and Its Medical Application Systems

This chapter presents the design and characteristics of a five-fingered haptic interface robot named HIRO and its medical application systems. The aim of the development of HIRO is to provide a high-precision three-directional force at the five human fingertips. HIRO consists of a 15-degrees-of-freedom (DOF) haptic hand, a 6-DOF interface arm, and a control system. The haptic interface can be used in a large workspace and can provide multipoint contact between the user and a virtual environment. Three medical application systems using HIRO, a hand rehabilitation support system, a medical training system using plural devices, and a breast palpation training system, are introduced. Furthermore, a hand haptic interface for an advanced palpation training system, which consists of a multi-fingered haptic interface for fingertips and 1-dimensional force display for finger pads, is presented. These systems show the great potential of HIRO.

[1]  D Stredney,et al.  A haptic interface for virtual simulation of endoscopic surgery. , 1996, Studies in health technology and informatics.

[2]  Haruhisa Kawasaki,et al.  FPGA-Based Control for the Wire-Saving of Five-Fingered Haptic Interface , 2008, EuroHaptics.

[3]  Grigore C. Burdea,et al.  The Rutgers Master II-new design force-feedback glove , 2002 .

[4]  Haruhisa Kawasaki,et al.  Development of a Hand-Assist Robot With Multi-Degrees-of-Freedom for Rehabilitation Therapy , 2012, IEEE/ASME Transactions on Mechatronics.

[5]  H. Kawasaki,et al.  Development of a Hand Motion Assist Robot for Rehabilitation Therapy by Patient Self-Motion Control , 2007, 2007 IEEE 10th International Conference on Rehabilitation Robotics.

[6]  T. Milner,et al.  HandCARE: A Cable-Actuated Rehabilitation System to Train Hand Function After Stroke , 2008, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[7]  Imre Cikajlo,et al.  Universal Haptic Drive: A Robot for Arm and Wrist Rehabilitation , 2010, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[8]  Takashi Maeno,et al.  Development of a mouse-shaped haptic device with multiple finger inputs , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[9]  Hyoukryeol Choi,et al.  Development of Soft-Actuator-Based Wearable Tactile Display , 2008, IEEE Transactions on Robotics.

[10]  Makoto Sato,et al.  Wearable haptic device to present contact sensation based on cutaneous sensation using thin wire , 2009, Advances in Computer Entertainment Technology.

[11]  Haruhisa Kawasaki,et al.  Design and Control of Five-Fingered Haptic Interface Opposite to Human Hand , 2007, IEEE Transactions on Robotics.

[12]  Eric Rogers,et al.  Upper limb rehabilitation of stroke participants using electrical stimulation: Changes in tracking and EMG timing , 2009, 2009 IEEE International Conference on Rehabilitation Robotics.

[13]  Grigore C. Burdea,et al.  Human performance using virtual reality tumor palpation simulation , 1997, Comput. Graph..

[14]  H. Kawasaki,et al.  Estimation of finger joint angles from sEMG using a recurrent neural network with time-delayed input vectors , 2009, 2009 IEEE International Conference on Rehabilitation Robotics.

[15]  Robert V Kenyon,et al.  A Pneumatic Glove and Immersive Virtual Reality Environment for Hand Rehabilitative Training After Stroke , 2010, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[16]  Hans Zwart,et al.  Preprints of the 16th IFAC World Congress , 2005 .

[17]  Herve Delingette,et al.  Real-Time Elastic Deformations of Soft Tissues for Surgery Simulation , 1999, IEEE Trans. Vis. Comput. Graph..

[18]  Robert J. Webster,et al.  Design Considerations for Robotic Needle Steering , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[19]  Saeid Nahavandi,et al.  Extending Haptic Device Capability for 3D Virtual Grasping , 2008, EuroHaptics.

[20]  Tsuneo Yoshikawa,et al.  Design and path planning of an encountered-type haptic display for multiple fingertip contacts based on the observation of human grasping behavior , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[21]  M.K. O'Malley,et al.  Design of a haptic arm exoskeleton for training and rehabilitation , 2006, IEEE/ASME Transactions on Mechatronics.

[22]  H. F. Machiel Van der Loos,et al.  Robotic stroke therapy assistant , 2003, Robotica.

[23]  Takahiro Kumano,et al.  Development of a Haptic Device for Multi Fingers by Macro-Micro Structure , 2002 .

[24]  Haruhisa Kawasaki,et al.  Finger pad force display for hand haptic interface , 2010, 2010 IEEE International Conference on Automation Science and Engineering.

[25]  Haruhisa Kawasaki,et al.  Multi-Fingered Haptic Interface Robot Handling Plural Tool Devices , 2007, Second Joint EuroHaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems (WHC'07).

[26]  村山 淳,et al.  World Haptics 2005 , 2005 .

[27]  Yu Sun,et al.  3-D force control on the human fingerpad using a magnetic levitation device for fingernail imaging calibration , 2009, World Haptics 2009 - Third Joint EuroHaptics conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems.

[28]  Robert D. Howe,et al.  Remote palpation technology , 1995 .

[29]  Haruhisa Kawasaki,et al.  Medical training simulation for palpation of subsurface tumor using HIRO , 2005, First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. World Haptics Conference.

[30]  Haruhisa Kawasaki,et al.  Development of a tweezers-type device for a multi-fingered haptic interface robot , 2011, 2011 IEEE/SICE International Symposium on System Integration (SII).

[31]  Costas S. Tzafestas,et al.  Pilot Evaluation Study of a Virtual Paracentesis Simulator for Skill Training and Assessment: The Beneficial Effect of Haptic Display , 2008, PRESENCE: Teleoperators and Virtual Environments.

[32]  Nadia Magnenat-Thalmann,et al.  Haptics in virtual reality and multimedia , 2006, IEEE MultiMedia.

[33]  Haruhisa Kawasaki,et al.  Force Feedback Glove for Manipulation of Virtual Objects , 1993, J. Robotics Mechatronics.

[34]  Haruhisa Kawasaki,et al.  Five-fingered haptic interface robot: HIRO III , 2009, World Haptics 2009 - Third Joint EuroHaptics conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems.

[35]  Makoto Sato,et al.  Two-Handed Multi-Fingers String-Based Haptic Interface Device , 2001 .

[36]  Grigore C. Burdea,et al.  Force and Touch Feedback for Virtual Reality , 1996 .

[37]  Toshio Tsuji,et al.  A Hybrid Motion Classification Approach for EMG-Based Human–Robot Interfaces Using Bayesian and Neural Networks , 2009, IEEE Transactions on Robotics.

[38]  Manuel Ferre.  Haptics: Perception, Devices and Scenarios, 6th International Conference, EuroHaptics 2008, Madrid, Spain, June 10-13, 2008, Proceedings , 2008, EuroHaptics.

[39]  Huosheng Hu,et al.  Myoelectric control systems - A survey , 2007, Biomed. Signal Process. Control..

[40]  Jorge Barrio,et al.  MasterFinger: Multi-finger Haptic Interface for Collaborative Environments , 2008, EuroHaptics.

[41]  Naoki Kawakami,et al.  An Encounter-Type Multi-Fingered Master Hand Using Circuitous Joints , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[42]  T Saito,et al.  Virtual reality in surgical education. , 1995, Computers in biology and medicine.

[43]  Haruhisa Kawasaki,et al.  Finger Rehabilitation Support System Using a Multifingered Haptic Interface Controlled by a Surface Electromyogram , 2011, J. Robotics.

[44]  C. Carignan,et al.  Design of an arm exoskeleton with scapula motion for shoulder rehabilitation , 2005, ICAR '05. Proceedings., 12th International Conference on Advanced Robotics, 2005..

[45]  Haruhisa Kawasaki,et al.  Medical palpation of deformable tissue using physics-based model for haptic interface robot (HIRO) , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[46]  K. Tong,et al.  A randomized controlled trial on the recovery process of wrist rehabilitation assisted by Electromyography (EMG)-Driven robot for chronic stroke , 2009, 2009 IEEE International Conference on Rehabilitation Robotics.

[47]  Haruhisa Kawasaki,et al.  Development of a Surgical Knife Device for a Multi-fingered Haptic Interface Robot , 2011 .

[48]  Tsuneo Yoshikawa,et al.  Development and Control of Touch and Force Display Devices for Haptic Interface , 2000 .

[49]  Robert J. Webster,et al.  The haptic scissors: cutting in virtual environments , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[50]  H. Kawasaki,et al.  Development of a hand haptic interface and its basic experimental evaluation , 2012, 2012 International Symposium on Innovations in Intelligent Systems and Applications.

[51]  R. Johansson,et al.  Tactile sensibility in the human hand: relative and absolute densities of four types of mechanoreceptive units in glabrous skin. , 1979, The Journal of physiology.

[52]  J. Shaw,et al.  Health care in the information age. , 2000, Managed care.

[53]  Massimo Bergamasco,et al.  Mechanical design of a novel Hand Exoskeleton for accurate force displaying , 2009, 2009 IEEE International Conference on Robotics and Automation.