Real-time rigid-body visual tracking in a scanning electron microscope

Robotics continues to provide researchers with an increasing ability to interact with objects at the nano scale. As micro- and nanorobotic technologies mature, more interest is given to computer-assisted or automated approaches to manipulation at these scales. Although actuators are currently available that enable displacements resolutions in the subnanometer range, improvements in feedback technologies have not kept pace. Thus, many actuators that are capable of performing nanometer displacements are limited in automated tasks by the lack of suitable feedback mechanisms. This paper proposes the use of a rigid-model-based method for end effector tracking in a scanning electron microscope to aid in enabling more precise automated manipulations and measurements. These models allow the system to leverage domain-specific knowledge to increase performance in a challenging tracking environment.

[1]  Golub Gene H. Et.Al.  Matrix Computations, 3rd Edition , 2007 .

[2]  Bradley J. Nelson,et al.  Vision-based force measurement , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Bradley J. Nelson,et al.  A CAD model based tracking system for visually guided microassembly , 2005, Robotica.

[4]  Richard M. Murray,et al.  A Mathematical Introduction to Robotic Manipulation , 1994 .

[5]  Josef Kittler,et al.  A survey of the hough transform , 1988, Comput. Vis. Graph. Image Process..

[6]  Éric Marchand,et al.  Real-time Hybrid Tracking using Edge and Texture Information , 2007, Int. J. Robotics Res..

[7]  Sergej Fatikow,et al.  Real-time object tracking for the robot-based nanohandling in a scanning electron microscope , 2006 .

[8]  Pradeep K. Khosla,et al.  Force and vision resolvability for assimilating disparate sensory feedback , 1996, IEEE Trans. Robotics Autom..

[9]  Jitendra Malik,et al.  Tracking people with twists and exponential maps , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[10]  Sergej Fatikow,et al.  Microrobot System for Automatic Nanohandling Inside a Scanning Electron Microscope , 2007 .

[11]  Roberto Cipolla,et al.  Real-Time Visual Tracking of Complex Structures , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Cordelia Schmid,et al.  A Comparison of Affine Region Detectors , 2005, International Journal of Computer Vision.

[13]  David C Joy,et al.  Is SEM Noise Gaussian? , 2003, Microscopy and Microanalysis.

[14]  Li Zhang,et al.  Anomalous coiling of SiGe/Si and SiGe/Si/Cr helical nanobelts. , 2006, Nano letters.

[15]  Sergej Fatikow,et al.  Visual servoing of a mobile microrobot inside a scanning electron microscope , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[16]  Olivier Faugeras,et al.  Three-Dimensional Computer Vision , 1993 .

[17]  Gene H. Golub,et al.  Matrix computations (3rd ed.) , 1996 .

[18]  Patrick Bouthemy,et al.  A 2D-3D model-based approach to real-time visual tracking , 2001, Image Vis. Comput..

[19]  Michael A. Sutton,et al.  Metrology in a scanning electron microscope: theoretical developments and experimental validation , 2006 .

[20]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[21]  Dannelle P. Sierra,et al.  A review of research in the field of nanorobotics. , 2005 .