Contact Detection in Microrobotic Manipulation

This paper presents a computer vision-based method for visually detecting the contact between an end-effector and a target surface under an optical microscope during microrobotic manipulation. Without using proximity or force/touch sensors, this method provides a submicrometer detection accuracy and possesses robustness. Fundamentally, after the establishment of contact in the world frame, further vertical motion of the end-effector (flexible or stiff) induces horizontal motion in the image plane. Contact between a micropipette tip and a glass slide in the scenario of microrobotic cell manipulation is used as an example to elaborate on the detection method. Experimental results demonstrate that the computer vision-based method is capable of achieving contact detection between the micropipette and the glass slide surface with an accuracy of 0.2 μm. Furthermore, 1000 experimental trials reveal that the presented method is robust to variations in illumination intensity, microscopy magnification, and microrobot motion speed.

[1]  Fumihito Arai,et al.  Parallel beam micro sensor/actuator unit using PZT thin films and its application examples , 1998, Proceedings. 1998 IEEE International Conference on Robotics and Automation (Cat. No.98CH36146).

[2]  Bradley J. Nelson,et al.  Biological Cell Injection Using an Autonomous MicroRobotic System , 2002, Int. J. Robotics Res..

[3]  Bradley J Nelson,et al.  Autofocusing in computer microscopy: Selecting the optimal focus algorithm , 2004, Microscopy research and technique.

[4]  Young Shik Moon,et al.  An efficient method of estimating edge locations with subpixel accuracy in noisy images , 1999, Proceedings of IEEE. IEEE Region 10 Conference. TENCON 99. 'Multimedia Technology for Asia-Pacific Information Infrastructure' (Cat. No.99CH37030).

[5]  G. Trummer,et al.  Next-Generation Proximity and Position Sensors , 2004 .

[6]  Fumihito Arai,et al.  Novel touch sensor with piezoelectric thin film for microbial separation , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[7]  M. Kurosawa,et al.  A rod-shaped vibro touch sensor using PZT thin film , 1998, Proceedings MEMS 98. IEEE. Eleventh Annual International Workshop on Micro Electro Mechanical Systems. An Investigation of Micro Structures, Sensors, Actuators, Machines and Systems (Cat. No.98CH36176.

[8]  Peter J. Huber,et al.  Robust Statistics , 2005, Wiley Series in Probability and Statistics.

[9]  Hakho Lee,et al.  Micromanipulation of biological systems with microelectromagnets , 2004, IEEE Transactions on Magnetics.

[10]  H. Hashimoto,et al.  Two-dimensional fine particle positioning under an optical microscope using a piezoresistive cantilever as a manipulator , 2000 .

[11]  R. M. Westervelt,et al.  Microelectromagnets for the manipulation of biological systems , 2004, q-bio/0402024.

[12]  Y. F. Li.  A Sensor-Based Robot Transition Control Strategy , 1996, Int. J. Robotics Res..

[13]  Muralidhara Subbarao,et al.  Selecting the Optimal Focus Measure for Autofocusing and Depth-From-Focus , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Aristides A. G. Requicha,et al.  Direct and controlled manipulation of nanometer-sized particles using the non-contact atomic force microscope , 1998 .

[15]  Yantao Shen,et al.  A novel PVDF microforce/force rate sensor for practical applications in micromanipulation , 2004 .

[16]  L. Samuelson,et al.  Controlled manipulation of nanoparticles with an atomic force microscope , 1995 .

[17]  Spyros G. Tzafestas,et al.  Analysis and design of a new piezoresistive tactile sensor system for robotic applications , 1994, J. Intell. Robotic Syst..

[18]  Han Haitjema,et al.  A silicon-etched probe for 3-D coordinate measurements with an uncertainty below 0.1 μm , 2001, IEEE Trans. Instrum. Meas..

[19]  A W Smeulders,et al.  Robust autofocusing in microscopy. , 2000, Cytometry.