Vision-based magnetic actuator positioning for wireless control of microrobots

Abstract This work is concerned with targeted drug delivery inside the human body using magnetic microrobots. It proposes a vision-based magnetic platform for guiding microrobots in both open-loop/closed-loop schemes. The open-loop scheme can be used for example in the case of the inner ear, where the microrobots cannot be localized in real time. On the other hand, for more accuracy, closed-loop scheme can be used for organs as the human eye since microrobots can be localized using a vision sensor. For both schemes, the platform is designed to compensate for human body movements. It is composed of a new magnetic actuator mounted on a robot end-effector and a hybrid vision system. The latter consists of a camera and two microscopes, while the newly proposed magnetic actuator is built using four permanent magnets. The proposed actuator has been designed to create a local maximum of the magnetic field magnitude in a planar workspace. This results in a convergence point for magnetic microrobots that are in its influence zone, making possible open-loop control with a satisfactory accuracy. The procedures for calibrating each component of the proposed platform are described and validated. Finally, several experiments have been carried out to validate the modeling part and to show the feasibility of the concept. The obtained experimental results show that using such platform, the microrobots guiding can be achieved in open-loop under reasonable perturbations and in closed-loop with an accuracy of 200  μ m .

[1]  Jan-Michael Frahm,et al.  Simple calibration of non-overlapping cameras with a mirror , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[2]  Antoine Ferreira,et al.  Endovascular navigation of a ferromagnetic microrobot using MRI-based predictive control , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[3]  M EQUEN,et al.  Magnetic removal of foreign bodies from the esophagus, stomach and duodenum. , 1957, A.M.A. archives of otolaryngology.

[4]  Roger Y. Tsai,et al.  Calibrating a Cartesian Robot with Eye-on-Hand Configuration Independent of Eye-to-Hand Relationship , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  K. Higuchi,et al.  In vivo trial of a driving system for a self-propelling capsule endoscope using a magnetic field (with video). , 2010, Gastrointestinal endoscopy.

[6]  P. Dario,et al.  Design, Fabrication, and Testing of a Capsule With Hybrid Locomotion for Gastrointestinal Tract Exploration , 2010, IEEE/ASME Transactions on Mechatronics.

[7]  C. Bárcena,et al.  APPLICATIONS OF MAGNETIC NANOPARTICLES IN BIOMEDICINE , 2003 .

[8]  Antoine Ferreira,et al.  Control of a magnetic microrobot navigating in microfluidic arterial bifurcations through pulsatile and viscous flow , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[9]  H TILLANDER,et al.  Magnetic guidance of a catheter with articulated steel tip. , 1951, Acta radiologica.

[10]  F. Carpi,et al.  Stereotaxis Niobe® magnetic navigation system for endocardial catheter ablation and gastrointestinal capsule endoscopy , 2009, Expert review of medical devices.

[11]  A Menciassi,et al.  A magnetic internal mechanism for precise orientation of the camera in wireless endoluminal applications. , 2010, Endoscopy.

[12]  Nobuhiko Hata,et al.  Swimming capsule endoscope using static and RF magnetic field of MRI for propulsion , 2008, 2008 IEEE International Conference on Robotics and Automation.

[13]  P. Dario,et al.  Robotic versus manual control in magnetic steering of an endoscopic capsule. , 2009, Endoscopy.

[14]  Jorge J. Moré,et al.  The Levenberg-Marquardt algo-rithm: Implementation and theory , 1977 .

[15]  William C. Broaddus,et al.  MAGNETIC MANIPULATION INSTRUMENTATION FOR MEDICAL PHYSICS RESEARCH , 1994 .

[16]  Okuhata,et al.  Delivery of diagnostic agents for magnetic resonance imaging. , 1999, Advanced drug delivery reviews.

[17]  W. Sardha Wijesoma,et al.  Eye-to-Hand Coordination for Vision-Guided Robot Control Applications , 1993, Int. J. Robotics Res..

[18]  Jake J. Abbott,et al.  5-DOF Manipulation of an Untethered Magnetic Device in Fluid using a Single Permanent Magnet , 2014, Robotics: Science and Systems.

[19]  Shyam B. Yodh,et al.  Superconducting magnet system for intravascular navigation , 1969 .

[20]  Paolo Dario,et al.  A Novel Magnetic Actuation System for Miniature Swimming Robots , 2011, IEEE Transactions on Robotics.

[21]  Jake J. Abbott,et al.  Generating Rotating Magnetic Fields With a Single Permanent Magnet for Propulsion of Untethered Magnetic Devices in a Lumen , 2014, IEEE Transactions on Robotics.

[22]  K. I. Arai,et al.  ブタ腸内におけるカプセル内視鏡用磁気アクチュエータの駆動(生体磁気・医療応用) , 2005 .

[23]  Michel Dhome,et al.  Fast calibration of embedded non-overlapping cameras , 2011, 2011 IEEE International Conference on Robotics and Automation.

[24]  Romain Ravaud,et al.  Magnetic Field Produced by a Parallelepipedic Magnet of Various and Uniform Polarization , 2009 .