Client-server control architecture for a vision-based pick-and-place robot

This article presents the software development for a vision-based pick-and-place robot to provide the computational intelligence required for its operation. It follows a client-server control architecture and aims to expand the applications of simply PC-based mechatronics systems to achieve distributed and flexible control through the introduction of a multi-featured and application-suited control unit in the form of a microcontroller as a client to the PC-based server. The system includes a five degree-of-freedom pick-and-place robot whereby a vision system is incorporated in its workspace to identify workpieces with respect to their shape and color. On user specification of the class of workpiece to be manipulated through a graphical user interface, the robot performs the manipulation. A personal computer, operating under the Windows platform, carries out all vision related processing and motion planning for the robot. On request, relevant motion information is communicated through the parallel port of the computer to peripheral interface controller (PIC) microcontroller, which interfaces with the sensing and actuation devices for robot control. The development of the system sees the integration of a number of technologies to achieve a customized control unit including: a vision system, actuation and sensing devices for precise motions, personal computer, microcontroller, and enhanced parallel port. In addition, a layered approach towards software development enables reusability, maintainability, and testability of the system through data abstraction.

[1]  Godfrey C. Onwubolu,et al.  Development of a vision-based pick-and-place robot , 2006 .

[2]  Rafael C. González,et al.  Digital image processing using MATLAB , 2006 .

[3]  N. Otsu A threshold selection method from gray level histograms , 1979 .

[4]  Dong Hwan Kim,et al.  Mechanism and control of a jumping robot , 2007, 2007 International Conference on Control, Automation and Systems.

[5]  M. O. Berger,et al.  Client-server-based mobile robot control , 1998 .

[6]  G. Awcock,et al.  Applied Image Processing , 1995 .

[7]  Roneel V. Sharan A vision-based pick-and-place robot , 2006 .

[8]  Godfrey C. Onwubolu,et al.  Development of a PC-based computer numerical control drilling machine , 2002 .

[9]  Godfrey C. Onwubolu,et al.  Mechatronics : principles and applications , 2005 .

[10]  Godfrey C. Onwubolu,et al.  Three tiered web-based manufacturing system-Part 1: System development , 2007 .

[11]  Anil K. Jain Fundamentals of Digital Image Processing , 2018, Control of Color Imaging Systems.

[12]  Russell H. Taylor,et al.  Distributed Modular Computer-Integrated Surgical Robotic Systems: Architecture for Intelligent Object Distribution , 2000, MICCAI.

[13]  M. O. Berger,et al.  A modular, layered client-server control architecture for autonomous mobile robots , 1997, ISIE '97 Proceeding of the IEEE International Symposium on Industrial Electronics.

[14]  Jian Gao,et al.  Vision Based Intelligent Control for Mobile Robot , 2006, 2006 6th World Congress on Intelligent Control and Automation.

[15]  Rafael C. González,et al.  Local Determination of a Moving Contrast Edge , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Constantinos Mavroidis,et al.  PC-based control of robotic and mechatronic systems under MS-Windows NT workstation , 2001 .