Automatic microassembly system assisted by vision servoing and virtual reality

We proposed an automated micromanipulation workcell for visually servoed teleoperated microassembly assisted by virtual reality techniques. It is composed of two micromanipulators equipped with microtools operating under a light microscope. Visual servoing techniques are applied for efficient and reliable position/force feedback during microassembly tasks. First, a pushing-based micromanipulation strategy for the microobject to follow a planned trajectory is proposed under vision based-position control. Then, we present the cooperation control strategy of the microhandling operation under vision-based force control integrating a sensor fusion framework approach. A guiding-system based on virtual microworld exactly reconstructed from the CAD-CAM databases of the real environment being considered is presented for the imprecisely calibrated microworld. Finally, a planned scenario is executed and experimental results of microassembly tasks performed on millimeter-sized components are provided.

[1]  Tsuneo Yoshikawa,et al.  Tracking control for an object in pushing operation , 1997, J. Field Robotics.

[2]  Jacques Jacot,et al.  Microvision system (MVS): a 3D computer graphic-based microrobot telemanipulation and position feedback by vision , 1995, Other Conferences.

[3]  Carl de Boor,et al.  A Practical Guide to Splines , 1978, Applied Mathematical Sciences.

[4]  Fumihito Arai,et al.  Three-dimensional bio-micromanipulation under the microscope , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[5]  Yu Zhou,et al.  Fusing force and vision feedback for micromanipulation , 1998, Proceedings. 1998 IEEE International Conference on Robotics and Automation (Cat. No.98CH36146).

[6]  Bradley J. Nelson,et al.  A flexible experimental workcell for efficient and reliable wafer-level 3D micro-assembly , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[7]  Joseph Alex,et al.  A VIRTUAL REALITY TELEOPERATOR INTERFACE FOR ASSEMBLY OF HYBRID MEMS PROTOTYPES , 1998 .

[8]  Antoine Ferreira,et al.  Cooperative Micro Object Handling by Dual Micromanipulators under Vision Control , 2000 .

[9]  Antoine Ferreira.  Design of a flexible conveyer microrobot with electromagnetic field-based friction drive control for microfactory stations , 2000 .

[10]  M. Rodriguez,et al.  A task-oriented teleoperation system for assembly in the microworld , 1997, 1997 8th International Conference on Advanced Robotics. Proceedings. ICAR'97.

[11]  T. Fukuda,et al.  Integrated microendeffector for micromanipulation , 1998 .

[12]  Ronald S. Fearing,et al.  Automating microassembly with ortho-tweezers and force sensing , 2001, Proceedings 2001 IEEE/RSJ International Conference on Intelligent Robots and Systems. Expanding the Societal Role of Robotics in the the Next Millennium (Cat. No.01CH37180).

[13]  S. FATIKOW,et al.  Assembly planning and plan decomposition in an automated microrobot-based microassembly desktop station , 1998, J. Intell. Manuf..

[14]  Yassine Haddab,et al.  Development of a teleoperated micromanipulation system with visual and haptic feedback , 2001, Optics East.

[15]  Ronald S. Fearing,et al.  Alignment of microparts using force-controlled pushing , 1998, Other Conferences.

[16]  Shigeoki Hirai,et al.  Combination of vision servoing techniques and VR-based simulation for semi-autonomous microassembly workstation , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[17]  Antoine Ferreira.  Strategies of human-robot interaction for automatic microassembly , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[18]  A. L.,et al.  The Principles of Mechanics presented in a New Form , 1900, Nature.