Multipoint Haptic Guidance for Micrograsping Systems

The ability to perform accurate micromanipulation offers wide-reaching benefits and is of increasing interest to researchers. Recent research into microgripper, microtweezer, and microforcep systems contributes toward accurate micrograsping and manipulation. Despite these efforts, achieving adequate operator control remains a distinct research challenge. Haptic interfaces interact with the human's haptic modality and offer the ability to enhance the operator's controllability of micromanipulation systems. Our previous work introduced single-point haptic guidance to assist the operator during intracellular microinjection. This paper extends the approach to propose multipoint haptic guidance for micrograsping tasks. Accurate micrograsping is valuable in many applications, including microassembly and biomanipulation. A multipoint haptic gripper facilitates haptic interaction, and haptic guidance assists the operator in controlling systems suitable for micrograsping. Force fields are used to guide the operator to suitable grasp points on micrometer-sized objects and consist of attractive and repulsive forces. The ability of the force field to effectively assist the operator in grasping the cell is evaluated using a virtual environment. Evaluation results demonstrate the ability of the approach to significantly reduce participants' average grasping error.

[1]  Yu Sun,et al.  A Fully Automated Robotic System for Microinjection of Zebrafish Embryos , 2007, PloS one.

[2]  Nigel W. John,et al.  The Role of Haptics in Medical Training Simulators: A Survey of the State of the Art , 2011, IEEE Transactions on Haptics.

[3]  Robert W. Lindeman,et al.  Haptic-assisted guidance system for navigating volumetric data sets , 2005, First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. World Haptics Conference.

[4]  Rafael Aracil,et al.  Multifinger haptic interface for bimanual manipulation of virtual objects , 2009, 2009 IEEE International Workshop on Haptic Audio visual Environments and Games.

[5]  Dean Chang Haptics: Gaming's New Sensation , 2002, Computer.

[6]  Manfred H. Jericho,et al.  Micro-electro-mechanical systems microtweezers for the manipulation of bacteria and small particles , 2004 .

[7]  Bijan Shirinzadeh,et al.  Towards fully-automated micrograsping for microassembly , 2008, 2008 10th International Conference on Control, Automation, Robotics and Vision.

[8]  Jing Ren,et al.  Dynamic 3-D Virtual Fixtures for Minimally Invasive Beating Heart Procedures , 2008, IEEE Transactions on Medical Imaging.

[9]  Ben Horan,et al.  Haptic Microrobotic Cell Injection System , 2014, IEEE Systems Journal.

[10]  Ben Horan,et al.  Enabling multi-point haptic grasping in virtual environments , 2011, 2011 IEEE Symposium on 3D User Interfaces (3DUI).

[11]  Olfa Mosbahi,et al.  A Component-Based Approach for the Development of Automated Systems , 2011, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[12]  Ben Horan,et al.  Virtual haptic cell model for operator training , 2011, ICM 2011.

[13]  Haruhisa Kawasaki,et al.  Design and Control of Five-Fingered Haptic Interface Opposite to Human Hand , 2007, IEEE Transactions on Robotics.

[14]  Norman A. Fleck,et al.  Comparison of microtweezers based on three lateral thermal actuator configurations , 2005 .

[15]  Masakatsu G. Fujie,et al.  Development of exchangeable microforceps for a micromanipulator system , 2001, Adv. Robotics.

[16]  Allison M. Okamura,et al.  The Effect of Visual and Haptic Feedback on Manual and Teleoperated Needle Insertion , 2002, MICCAI.

[17]  Ben Horan,et al.  Towards Haptic Microrobotic Intracellular Injection , 2009 .

[18]  Enrique Baeyens,et al.  Comparative analysis of collision-free path-planning methods for multi-manipulator systems , 2006, Robotica.

[19]  François Conti,et al.  CHAI: An Open-Source Library for the Rapid Development of Haptic Scenes , 2005 .

[20]  Xinyu Liu,et al.  High-Throughput Automated Injection of Individual Biological Cells , 2009, IEEE Transactions on Automation Science and Engineering.

[21]  F. Kishino,et al.  HAPTIC AND VISUAL FEEDBACK FOR MANIPULATION AID IN A VIRTUAL ENVIRONMENT , 1996 .

[22]  Yu Sun,et al.  Nanonewton force-controlled manipulation of biological cells using a monolithic MEMS microgripper with two-axis force feedback , 2008 .

[23]  Ahmed A. Ramadan,et al.  Developmental Process of a Chopstick-Like Hybrid-Structure Two-Fingered Micromanipulator Hand for 3-D Manipulation of Microscopic Objects , 2009, IEEE Transactions on Industrial Electronics.

[24]  Jee-Hwan Ryu,et al.  A User Study of a Mobile Robot Teleoperation , 2007 .

[25]  Yu Sun,et al.  Mechanical characterization of polymeric microcapsules using a force-feedback MEMS microgripper , 2008, 2008 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[26]  René van Paassen,et al.  Artificial Force Field for Haptic Feedback in UAV Teleoperation , 2009, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[27]  Gregory D. Hager,et al.  Vision-assisted control for manipulation using virtual fixtures , 2001, IEEE Transactions on Robotics.

[28]  Haruhisa Kawasaki,et al.  Five-Fingered Haptic Interface Robot: HIRO III , 2009, IEEE Transactions on Haptics.

[29]  Deok-Ho Kim,et al.  Dexterous teleoperation for micro parts handling based on haptic/visual interface , 2001, MHS2001. Proceedings of 2001 International Symposium on Micromechatronics and Human Science (Cat. No.01TH8583).

[30]  Jing Ren,et al.  A Potential Field Model Using Generalized Sigmoid Functions , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[31]  Greg R. Luecke,et al.  Haptic Interactions Using Virtual Manipulator Coupling With Applications to Underactuated Systems , 2011, IEEE Transactions on Robotics.

[32]  Ben Horan,et al.  Haptic guidance for microrobotic intracellular injection , 2010, 2010 3rd IEEE RAS & EMBS International Conference on Biomedical Robotics and Biomechatronics.

[33]  Yuru Zhang,et al.  Stroke-based modeling and haptic skill display for Chinese calligraphy simulation system , 2006, Virtual Reality.

[34]  Mehdi Ammi,et al.  Robotic Assisted Micromanipulation System using Virtual Fixtures and Metaphors , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[35]  Jaydev P Desai,et al.  Engineering approaches to biomanipulation. , 2007, Annual review of biomedical engineering.

[36]  Karin Coninx,et al.  Multisensory interaction metaphors with haptics and proprioception in virtual environments , 2004, NordiCHI '04.

[37]  Mehrdad Hosseini Zadeh,et al.  Perception-based lossy haptic compression considerations for velocity-based interactions , 2007, Multimedia Systems.

[38]  Allison M. Okamura,et al.  Design considerations and human-machine performance of moving virtual fixtures , 2009, 2009 IEEE International Conference on Robotics and Automation.

[39]  Yoshio Yamamoto,et al.  Tool development for force-feedback micro manipulation system , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[40]  Wei Tech Ang,et al.  Effect of Grip Force and Training in Unstable Dynamics on Micromanipulation Accuracy , 2011, IEEE Transactions on Haptics.

[41]  Daniel E. Hastings,et al.  A Logical Approach to Real Options Identification With Application to UAV Systems , 2012, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[42]  John Kenneth Salisbury,et al.  Simulating human fingers: a soft finger proxy model and algorithm , 2004, 12th International Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, 2004. HAPTICS '04. Proceedings..