Vision System for Robotic Handling of Randomly Placed Objects

Abstract This paper presents the development of a method for the calculation of coordinates of a part's features in a world reference frame (WRF), using images acquired from a camera. The method is used to identify multiple, randomly placed, similar objects from the consumer goods industry. The geometry and the intensity differences among multiple points are used for the identification, due to the objects’ complicated geometry and the non-discrete characteristics. All the general (e.g. orientation) and special (e.g. visible side) purpose features are identified. It was implemented within a software tool using MATLAB and tested in the case of shaver handles’ feeding.

[1]  Peter I. Corke,et al.  A tutorial on visual servo control , 1996, IEEE Trans. Robotics Autom..

[2]  François Chaumette,et al.  Visual servo control. II. Advanced approaches [Tutorial] , 2007, IEEE Robotics & Automation Magazine.

[3]  Vincenzo Lippiello,et al.  An open architecture for sensory feedback control of a dual-arm industrial robotic cell , 2007, Ind. Robot.

[4]  Jun Zhou,et al.  Coordination control of dual-arm modular robot based on position feedback using Optotrak3020 , 2011, Ind. Robot.

[5]  Nikolaos Papanikolopoulos,et al.  Detection and tracking for robotic visual servoing systems , 1997 .

[6]  B. Nickolay,et al.  Image based 3D surveillance for flexible man-robot-cooperation , 2005 .

[7]  Tamim Asfour,et al.  Visual servoing for dual arm motions on a humanoid robot , 2009, 2009 9th IEEE-RAS International Conference on Humanoid Robots.

[8]  Hideki Hashimoto,et al.  Image-based visual servoing control of a SCARA type dual-arm robot , 2000, ISIE'2000. Proceedings of the 2000 IEEE International Symposium on Industrial Electronics (Cat. No.00TH8543).

[9]  François Chaumette,et al.  Visual servo control. I. Basic approaches , 2006, IEEE Robotics & Automation Magazine.

[10]  E. Zereik,et al.  Autonomous dual-arm mobile manipulator crew assistant for surface operations: Force/vision-guided grasping , 2009, 2009 4th International Conference on Recent Advances in Space Technologies.

[11]  Chien Chern Cheah,et al.  Neural Network Control of Multifingered Robot Hands Using Visual Feedback , 2009, IEEE Transactions on Neural Networks.

[12]  Shigeki Sugano,et al.  Design of human symbiotic robot TWENDY-ONE , 2009, 2009 IEEE International Conference on Robotics and Automation.

[13]  Rafael Kelly,et al.  Stable visual servoing of camera-in-hand robotic systems , 2000 .

[14]  Alexander Verl,et al.  Cooperation of human and machines in assembly lines , 2009 .

[15]  Danica Kragic,et al.  Dual arm manipulation - A survey , 2012, Robotics Auton. Syst..

[16]  Danica Kragic,et al.  Survey on Visual Servoing for Manipulation , 2002 .

[17]  Fei-Yue Wang,et al.  A Robotic Vision System for Object Identification and Manipulation Using Synergetic Pattern Recognition , 1993 .

[18]  Gunther Reinhart,et al.  Automatic programming of robot-mounted 3D optical scanning devices to easily measure parts in high-variant assembly , 2009 .

[19]  B. Siciliano,et al.  An experimental setup for visual servoing applications on an industrial robotic cell , 2005, Proceedings, 2005 IEEE/ASME International Conference on Advanced Intelligent Mechatronics..

[20]  Hideki Hashimoto,et al.  A study on feature-based visual servoing control of robot system by utilizing redundant feature , 2001, ISIE 2001.

[21]  S. Hutchinson,et al.  Visual Servo Control Part II : Advanced Approaches , 2007 .