Navigation of a rolling microrobot in cluttered environments for automated crystal harvesting

In this paper, we present a holistic system for automating the motion of a rolling microrobot for protein crystal harvesting. The RodBot, which was introduced in previous work, is able to perform noncontact manipulation of microscopic objects such as fragile crystals by trapping them in an induced vortex fluid flow. Here, we are concerned with navigating the RodBot autonomously in a liquid environment containing obstacles such as crystals. A literature review shows existing approaches to untethered microrobot control are limited and cluttered environments are often not considered. We demonstrate real-time tracking of the RodBot and surrounding obstacles, kinematic obstacle-free path planning, and nonholonomic path following. The system was evaluated in qualitative and quantitative experiments, shows satisfactory performance, and presents itself as a first step towards fully automated crystal harvesting.

[1]  Bradley J. Nelson,et al.  Robust Electromagnetic Control of Microrobots Under Force and Localization Uncertainties , 2014, IEEE Transactions on Automation Science and Engineering.

[2]  Ron Pelrine,et al.  Diamagnetically levitated robots: An approach to massively parallel robotic systems with unusual motion properties , 2012, 2012 IEEE International Conference on Robotics and Automation.

[3]  Éric Marchand,et al.  CAD Model-based Tracking and 3D Visual-based Control for MEMS Microassembly , 2010, Int. J. Robotics Res..

[4]  Islam S. M. Khalil,et al.  The Control of Self-Propelled Microjets Inside a Microchannel With Time-Varying Flow Rates , 2014, IEEE Transactions on Robotics.

[5]  Satyandra K. Gupta,et al.  Research in Automated Planning and Control for Micromanipulation , 2013, IEEE Transactions on Automation Science and Engineering.

[6]  Antonio M. Pascoal,et al.  Adaptive, non-singular path-following control of dynamic wheeled robots , 2003, 42nd IEEE International Conference on Decision and Control (IEEE Cat. No.03CH37475).

[7]  Ana Luísa Carvalho,et al.  X-ray crystallography in drug discovery. , 2009, Methods in molecular biology.

[8]  Sandro Erni,et al.  MiniMag: A Hemispherical Electromagnetic System for 5-DOF Wireless Micromanipulation , 2010, ISER.

[9]  Hsi-Wen Tung,et al.  Non-contact Manipulation for Automated Protein Crystal Harvesting using a Rolling Microrobot , 2014 .

[10]  A. Ferreira,et al.  Untethered microrobot control in fluidic environment using magnetic gradients , 2012, 2012 International Symposium on Optomechatronic Technologies (ISOT 2012).

[11]  David J. Cappelleri,et al.  Caging micromanipulation for automated microassembly , 2011, 2011 IEEE International Conference on Robotics and Automation.

[12]  Lixin Dong,et al.  Artificial bacterial flagella: Fabrication and magnetic control , 2009 .

[13]  Leon Abelmann,et al.  Closed-loop control of magnetotactic bacteria , 2013, Int. J. Robotics Res..

[14]  C. Riviere,et al.  Characteristics of hand motion of eye surgeons , 1997, Proceedings of the 19th Annual International Conference of the IEEE Engineering in Medicine and Biology Society. 'Magnificent Milestones and Emerging Opportunities in Medical Engineering' (Cat. No.97CH36136).

[15]  Sebastian Thrun,et al.  Search-based planning for large dynamic environments , 2005 .

[16]  Li Zhang,et al.  Bio-inspired magnetic swimming microrobots for biomedical applications. , 2013, Nanoscale.

[17]  Pyung Hun Chang,et al.  Electromagnetic Steering of a Magnetic Cylindrical Microrobot Using Optical Feedback Closed-Loop Control , 2014 .

[18]  Ming C. Wu,et al.  Massively parallel manipulation of single cells and microparticles using optical images , 2005, Nature.

[19]  Antoine Ferreira,et al.  Adaptive Controller and Observer for a Magnetic Microrobot , 2013, IEEE Transactions on Robotics.

[20]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Keiichi Abe,et al.  Topological structural analysis of digitized binary images by border following , 1985, Comput. Vis. Graph. Image Process..

[22]  Antoine Ferreira,et al.  Endovascular navigation of a ferromagnetic microrobot using MRI-based predictive control , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[23]  Serhat Yesilyurt,et al.  Navigation of mini swimmers in channel networks with magnetic fields , 2013, 2013 IEEE International Conference on Robotics and Automation.

[24]  Metin Sitti,et al.  Micro-Scale Mobile Robotics , 2013, Found. Trends Robotics.

[25]  Emilio Frazzoli,et al.  Sampling-based algorithms for optimal motion planning , 2011, Int. J. Robotics Res..

[26]  Tao Ju,et al.  Apply RRT-based path planning to robotic manipulation of biological cells with optical tweezer , 2011, 2011 IEEE International Conference on Mechatronics and Automation.

[27]  Metin Sitti,et al.  Towards Hybrid Swimming Microrobots: Bacteria Assisted Propulsion of Polystyrene Beads , 2006, 2006 International Conference of the IEEE Engineering in Medicine and Biology Society.

[28]  Jake J. Abbott,et al.  Modeling Magnetic Torque and Force for Controlled Manipulation of Soft-Magnetic Bodies , 2007, IEEE Transactions on Robotics.