Networked human/robot cooperative environment for tele-assembly of MEMS devices

The objective of this paper is to develop a networked cooperative environment to achieve human/robot cooperation for reliable and dependable remote microassembly. At a microscale, surface adhesion forces, such as van der Waals, surface tension and electrostatic forces, become stronger than the downward gravitational force. For a reliable and dependable tele-microassembly, it is absolutely necessary to allow close monitoring of the magnitude and direction of those micro-forces interacting with microdevices during the assembly process. In this paper, based on integrating an in situ polyvinylidene fluoride piezoelectric micro-force sensing tool with a resolution in the range of μN, and using event-synchronization for the feedback of assembly video and micro-force, the developed networked human/robot cooperative platform can greatly advance applications in tele-microassembly. As a result, the reliable and dependable human/robot cooperative assembly operations can be achieved and extended to the single or multiple remote work-cells through a local area network or the Internet. This platform has been used successfully to perform a remote assembly of surface MEMS structures with the event-synchronized micro-force/visual feedback via the Internet between USA and Hong Kong.

[1]  Silvestro Micera,et al.  Towards a force-controlled microgripper for assembling biomedical microdevices , 2000 .

[2]  Wen J. Li,et al.  High sensitivity 2-D force sensor for assembly of surface MEMS devices , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[3]  Imad H. Elhajj,et al.  Transparency and synchronization in supermedia enhanced Internet-based teleoperation , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[4]  Wan Kyun Chung,et al.  Obtaining passivity of micro-teleoperation handling a small inertia object , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[5]  Yantao Shen,et al.  MODELING AND CONTROL OF A FLEXIBLE SENSOR STRUCTURE IN MICROASSEMBLY , 2005 .

[6]  H. Mehmet Uras,et al.  A magnetostrictive force sensor , 1994 .

[7]  Ronald S. Fearing,et al.  Alignment of microparts using force-controlled pushing , 1998, Other Conferences.

[8]  Hyunjae Kang,et al.  Development of a piezoelectric polymer-based sensorized microgripper for microassembly and micromanipulation , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[9]  Hideki Hashimoto,et al.  Improvement of response isotropy of haptic interface for tele-micromanipulation systems , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[10]  Yu Zhou,et al.  Fusing force and vision feedback for micromanipulation , 1998, Proceedings. 1998 IEEE International Conference on Robotics and Automation (Cat. No.98CH36146).

[11]  Victor M. Bright,et al.  Automated assembly of flip-up micromirrors , 1998 .

[12]  T. H. Hyde,et al.  Mechanics of engineering materials , 1997 .

[13]  Bradley J. Nelson,et al.  Modeling microassembly tasks with interactive forces , 2001, Proceedings of the 2001 IEEE International Symposium on Assembly and Task Planning (ISATP2001). Assembly and Disassembly in the Twenty-first Century. (Cat. No.01TH8560).

[14]  Katsunari Shibata,et al.  Human control characteristics in bilateral micro-teleoperation system , 2000, 2000 26th Annual Conference of the IEEE Industrial Electronics Society. IECON 2000. 2000 IEEE International Conference on Industrial Electronics, Control and Instrumentation. 21st Century Technologies.

[15]  Moussa Boukhnifer,et al.  Scaled teleoperation controller design for micromanipulation over Internet , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[16]  Antoine Ferreira Strategies of human-robot interaction for automatic microassembly , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[17]  Blake Hannaford,et al.  Force-reflection and shared compliant control in operating telemanipulators with time delay , 1992, IEEE Trans. Robotics Autom..

[18]  Yoshio Yamamoto,et al.  Tool development for force-feedback micro manipulation system , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[19]  Imad H. Elhajj,et al.  Haptic information in Internet-based teleoperation , 2001 .

[20]  Ning Xi,et al.  Event—Based Planning and Control for Robotic Systems: Theory and Implementation , 1998 .

[21]  Steven McCanne,et al.  vic: a flexible framework for packet video , 1995, MULTIMEDIA '95.

[22]  Yu Zhou,et al.  Sensor-based microassembly of hybrid MEMS devices , 1998 .

[23]  William R. Hamel,et al.  Control strategies for teleoperated Internet assembly , 2001 .

[24]  M. S. Rodgers,et al.  Single-step assembly of complex 3-D microstructures , 2000, Proceedings IEEE Thirteenth Annual International Conference on Micro Electro Mechanical Systems (Cat. No.00CH36308).

[25]  Ning Xi,et al.  Real-time control of Internet based teleoperation with force reflection , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[26]  Yantao Shen,et al.  Force-guided assembly of micro mirrors , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[27]  Akihito Sano,et al.  Human-centered scaling in micro-teleoperation , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[28]  Mark W. Spong,et al.  Bilateral control of teleoperators with time delay , 1988, Proceedings of the 1988 IEEE International Conference on Systems, Man, and Cybernetics.

[29]  M. Rodriguez,et al.  A task-oriented teleoperation system for assembly in the microworld , 1997, 1997 8th International Conference on Advanced Robotics. Proceedings. ICAR'97.

[30]  Ronald S. Fearing,et al.  Survey of sticking effects for micro parts handling , 1995, Proceedings 1995 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human Robot Interaction and Cooperative Robots.

[31]  S. Koelemijer Chollet,et al.  Cost effective micro-system assembly automation , 1999, 1999 7th IEEE International Conference on Emerging Technologies and Factory Automation. Proceedings ETFA '99 (Cat. No.99TH8467).

[32]  Ning Xi,et al.  Force regulation and contact transition control , 1996 .