Conveyor Visual Tracking using Robot Vision

Robot conveyor tracking is a task in which a robot follows and obtains objects on a conveyor belt. Prior to obtaining an object from an automation line, a robot needs information about the object, such as its position, orientation, velocity, size, etc. Compared to ultrasonic sensors and infrared ray sensors, vision sensors can provide more information about the object on the conveyor belts. Generally, an object tracking system has several steps: obtaining an image, recognizing objects, and extracting information for object position and orientation. The object tracking process for a conveyor system should be fast enough to support a real-time environment. In this article we describe a robotic tracking system that uses vision information extracted from sequential image frames. For fast extraction of vision information we applied a difference image technique which carries out a subtraction operation between two sequential frames with a small time interval. This simple method is useful for obtaining information about an image when there are minimal background effects caused by the conveyor system. In this article we present some results of some experiments using an integrated robot conveyor, vision system, and robot user interface software.

[1]  Ren C. Luo,et al.  An adaptive robotic tracking system using optical flow , 1988, Proceedings. 1988 IEEE International Conference on Robotics and Automation.

[2]  Markus Peura,et al.  The Self-Organizing Map of Trees , 1998, Neural Processing Letters.

[3]  Metin Sitti,et al.  Visual tracking for moving multiple objects: an integration of vision and control , 1995, 1995 Proceedings of the IEEE International Symposium on Industrial Electronics.

[4]  Okyay Kaynak,et al.  Vision-controlled robotic tracking and acquisition , 1994, Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS'94).

[5]  M. H. Chowdhury,et al.  Image thresholding techniques , 1995, IEEE Pacific Rim Conference on Communications, Computers, and Signal Processing. Proceedings.

[6]  Takeo Kanade,et al.  Visual tracking of a moving target by a camera mounted on a robot: a combination of control and vision , 1993, IEEE Trans. Robotics Autom..

[7]  S. J. Steiner,et al.  An experimental visual feedback control system for tracking applications using a robotic manipulator , 1998, IECON '98. Proceedings of the 24th Annual Conference of the IEEE Industrial Electronics Society (Cat. No.98CH36200).

[8]  R. Safaric,et al.  Telerobot control via Internet , 1999, ISIE '99. Proceedings of the IEEE International Symposium on Industrial Electronics (Cat. No.99TH8465).

[9]  U. Zimmermann,et al.  Detection and handling of moving objects , 1998, IECON '98. Proceedings of the 24th Annual Conference of the IEEE Industrial Electronics Society (Cat. No.98CH36200).

[10]  Pradeep K. Khosla,et al.  Feature based robotic visual tracking of 3-D translational motion , 1991, [1991] Proceedings of the 30th IEEE Conference on Decision and Control.