Vision-Guided Robot Manipulation Predictive Control for Automating Manufacturing

Increasing demands of flexible automating manufacturing processes made robots with vision systems to be frequently used due to their ability to adapt to new environments and various conditions. This paper presents a visual servoing system for real time picking and placing of dynamic objects. The system is integrated into a manufacturing cell and its structure consists in a CCD camera with SIFT detector, an image based predictive controller and a robot manipulator. Using a Service Oriented Architecture (SOA), the visual servoing system is implemented and different experimental testing of the vision-guided robot predictive control architecture is conducted.

[1]  Z. Li,et al.  Switching control of image based visual servoing with laser pointer in robotic assembly systems , 2007, 2007 IEEE International Conference on Systems, Man and Cybernetics.

[2]  Gunnar Bolmsjö,et al.  Extending an industrial robot controller: implementation and applications of a fast open sensor interface , 2005, IEEE Robotics & Automation Magazine.

[3]  C. Lazar,et al.  Visual Servoing of Robot Manipulators Using Model-based Predictive Control , 2009, 2009 7th IEEE International Conference on Industrial Informatics.

[4]  Jing-Bing Zhang,et al.  Service-oriented architecture and technologies for automating integration of manufacturing systems and services , 2005, 2005 IEEE Conference on Emerging Technologies and Factory Automation.

[5]  Hakan Bilen,et al.  Developing robust vision modules for microsystems applications , 2010, Machine Vision and Applications.

[6]  Jacques Gangloff,et al.  High-speed visual servoing of a 6-d.o.f. manipulator using multivariable predictive control , 2003, Adv. Robotics.

[7]  Benedetto Allotta,et al.  3D Motion Planning for Image-Based Visual Servoing Tasks , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[8]  Wu Deng,et al.  Flexible Application System Integration Based on Agent-Enabled SOA in the Industrial Field , 2009, 2009 Second International Symposium on Electronic Commerce and Security.

[9]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[10]  C. Lazar,et al.  Robotic visual servoing system based on SIFT features , 2012, 2012 16th International Conference on System Theory, Control and Computing (ICSTCC).

[11]  François Chaumette,et al.  Visual servo control. I. Basic approaches , 2006, IEEE Robotics & Automation Magazine.

[12]  Hiroshi Fujimoto.  Visual servoing of 6 DOF manipulator by multirate control with depth identification , 2003, 42nd IEEE International Conference on Decision and Control (IEEE Cat. No.03CH37475).

[13]  Zheng Li,et al.  Switching Control of Image-Based Visual Servoing With Laser Pointer in Robotic Manufacturing Systems , 2009, IEEE Transactions on Industrial Electronics.

[14]  Corneliu Lazar,et al.  Predictive Control Architecture for Visual Servoing of Robot Manipulators , 2011 .

[15]  Paulo Leitão,et al.  Injecting Service-Orientation into Multi-Agent Systems in Industrial Automation , 2010, ICAISC.