A fast and precise micropipette positioning system based on continuous camera-robot recalibration and visual servoing

Micro-biomanipulations rely on fine motion control and precise tool positioning for the execution of delicate operations on biological structures. Appropriate control is typically enabled by the use of micromanipulators; however, manual execution of biomanipulations is difficult, requiring extensive operator training (up to one year) and meticulous work under fatiguing conditions. Automation can be an alternative to improve such operations. In this case, challenges such as interface design, system integration, acquisition of feedback data, and the design of control systems have to be dealt with. This paper concentrates in the later challenge and proposes a new strategy for fast and precise control of the micromanipulation robot. Here, problems related to tool position drift are dealt with using continuous system recalibration. In addition, speed limitations imposed by the vision system are eliminated by the definition of a guaranteed region of interest (gROI) for micropipette localizations. The final system combines the use of mapping functions and visual servoing to achieve a 60% speedup in positioning speed and an 85% reduction in the pipette positioning error. The design and evaluation of this new positioning system is described here, including detail explanations of its modules and their interconnections.

[1]  M. Sitti,et al.  Two-dimensional vision-based autonomous microparticle manipulation using a nanoprobe , 2006 .

[2]  Charles R. Phillips,et al.  Digital control system analysis and design , 1985, IEEE Transactions on Systems, Man, and Cybernetics.

[3]  H. Hashimoto,et al.  Two-dimensional fine particle positioning under an optical microscope using a piezoresistive cantilever as a manipulator , 2000 .

[4]  Nikolai Dechev,et al.  Development of a five degree-of-freedom biomanipulator for autonomous single cell electroporation , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[5]  Darwin G. Caldwell,et al.  Interface Design for MicroBiomanipulation and Teleoperation , 2009, 2009 Second International Conferences on Advances in Computer-Human Interactions.

[6]  Byungkyu Kim,et al.  Mechanical force response of single living cells using a microrobotic system , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[7]  B. Nelson,et al.  Calibration of a parametric model of an optical microscope , 1999 .

[8]  Edward Grant,et al.  From teleoperated to automatic blastocyst microinjections: Designing a new system from expert-controlled operations , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[9]  Wei Zhao,et al.  A micro visual servo system for biological cell manipulation: overview and new developments , 2002, 7th International Conference on Control, Automation, Robotics and Vision, 2002. ICARCV 2002..

[10]  Russell H. Taylor,et al.  Distributed Modular Computer-Integrated Surgical Robotic Systems: Implementation Using Modular Software and Networked Systems , 2000, MICCAI.

[11]  Bradley J. Nelson,et al.  Biological Cell Injection Using an Autonomous MicroRobotic System , 2002, Int. J. Robotics Res..

[12]  Xinyu Liu,et al.  High-Throughput Automated Injection of Individual Biological Cells , 2009, IEEE Transactions on Automation Science and Engineering.

[13]  Mehdi Ammi,et al.  Flexible Microscope Calibration using Virtual Pattern for 3-D Telemicromanipulation , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[14]  E. Dubois,et al.  Digital picture processing , 1985, Proceedings of the IEEE.

[15]  Roger Y. Tsai,et al.  A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses , 1987, IEEE J. Robotics Autom..

[16]  Edward Grant,et al.  Speeding Up Video Processing for Blastocyst Microinjection , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[17]  Zhengyou Zhang,et al.  Flexible camera calibration by viewing a plane from unknown orientations , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[18]  J. Y. Zhu,et al.  A Precise Visual Control Method for Micromanipulator , 2004 .