Embedded 3D vision system for automated micro-assembly

Machine vision plays an important role in automated assembly. However, present vision systems are not adequate for robot control in an assembly environment where individual components have sizes in the range of 1 to 100 micrometers, since current systems do not provide sufficient resolution in the whole workspace when they are fixed, and they are too bulky to be brought close enough to the components. A small-size 3D vision system is expected to provide two decisive advantages: high accuracy and high flexibility. The presented work aims to develop a 3D vision sensor easily embedded in a micro-assembly robot. The paper starts by a screening of 3D sensing methods, performed in order to identify the best candidates for miniaturization, and that results in the selection of the multifocus principle (which elegantly avoids the depth of field problem encountered for example in stereo vision). Here, depth is measured by determination of sharpness maxima in a stack of images acquired at different elevations. Then, it presents a preliminary system configuration, that delivers images of a 1300×1000 micrometers field of view with lateral resolution better than 5 micrometers and vertical resolution better than 20 micrometers. Finally, future steps in development of a real-time embedded multifocus sensor are presented, with a discussion of the most critical tradeoffs.

[1]  Ralph L. Hollis,et al.  Miniature Factories for Precision Assembly , 1998 .

[2]  Sergej Fatikow,et al.  A Flexible Microrobot-Based Microassembly Station , 2000, J. Intell. Robotic Syst..

[3]  Paul S. Schenker,et al.  Sensor Fusion and Distributed Robotic Agents , 1996 .

[4]  Jerome Carlier,et al.  Distributed microscopy: toward a 3D computer-graphic-based multiuser microscopic manipulation, imaging, and measurement system , 1996, Other Conferences.

[5]  Carnegie MellonUniversity Miniature Factories for Precision Assembly , 1998 .

[6]  Jacques Jacot,et al.  Three-dimensional vision using structured light applied to quality control in production line , 2004, SPIE Photonics Europe.

[7]  Peter Lawrence,et al.  An Investigation of Methods for Determining Depth from Focus , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Deok-Ho Kim,et al.  Dexterous teleoperation for micro parts handling based on haptic/visual interface , 2001, MHS2001. Proceedings of 2001 International Symposium on Micromechatronics and Human Science (Cat. No.01TH8583).

[9]  Quan Zhou,et al.  Three-dimensional position control of a parallel micromanipulator using visual servoing , 2000, SPIE Optics East.

[10]  Ruikang K. Wang,et al.  Theory, developments and applications of optical coherence tomography , 2005 .

[11]  Antoine Ferreira,et al.  Automation of a Teleoperated Microassembly Desktop Station Supervised by Virtual Reality , 2002 .

[12]  EnsJohn,et al.  An Investigation of Methods for Determining Depth from Focus , 1993 .

[13]  Gaudenz Danuser Stereo Light Microscope Calibration for 3D Submicron Vision , 1996 .

[14]  Takashi Miyoshi,et al.  High-precision on-machine 3D shape measurement using hypersurface calibration method , 2004, SPIE Optics East.

[15]  Juergen Hesselbach,et al.  Assembly of a miniature linear actuator using vision feedback , 2000, SPIE Optics East.