Visual Servoing Tracking Control of a Ball and Plate System: Design, Implementation and Experimental Validation

This paper presents the design, implementation and validation of real-time visual servoing tracking control for a ball and plate system. The position of the ball is measured with a machine vision system. The image processing algorithms of the machine vision system are pipelined and implemented on a field programmable gate array (FPGA) device to meet real-time constraints. A detailed dynamic model of the system is derived for the simulation study. By neglecting the high-order coupling terms, the ball and plate system model is simplified into two decoupled ball and beam systems, and an approximate input-output feedback linearization approach is then used to design the controller for trajectory tracking. The designed control law is implemented on a digital signal processor (DSP). The validity of the performance of the developed control system is investigated through simulation and experimental studies. Experimental results show that the designed system functions well with reasonable agreement with simulations.

[1]  Marco A. Moreno-Armendáriz,et al.  Indirect hierarchical FCMAC control for the ball and plate system , 2010, Neurocomputing.

[2]  P. Kokotovic,et al.  Nonlinear control via approximate input-output linearization: the ball and beam example , 1992 .

[3]  Unai Bidarte,et al.  Hardware implementation of optical flow constraint equation using FPGAs , 2005, Comput. Vis. Image Underst..

[4]  Yoshiaki Shirai,et al.  Three-Dimensional Computer Vision , 1987, Symbolic Computation.

[5]  Phillip Thomas Yip.  Symbol-Based Control of a Ball-on-Plate Mechanical System , 2004 .

[6]  Riccardo Marino,et al.  Nonlinear control design: geometric, adaptive and robust , 1995 .

[7]  S. Shankar Sastry,et al.  An Invitation to 3-D Vision , 2004 .

[8]  Anthony M. Bloch,et al.  Nonlinear Dynamical Control Systems (H. Nijmeijer and A. J. van der Schaft) , 1991, SIAM Review.

[9]  Peter I. Corke,et al.  A tutorial on visual servo control , 1996, IEEE Trans. Robotics Autom..

[10]  M. Moarref,et al.  Mechatronic design and position control of a novel ball and plate system , 2008, 2008 16th Mediterranean Conference on Control and Automation.

[11]  A. Isidori.  Nonlinear Control Systems , 1985 .

[12]  Ahmad B. Rad,et al.  An online learning fuzzy controller , 2003, IEEE Trans. Ind. Electron..

[13]  César Torres-Huitzil,et al.  Real-time image processing with a compact FPGA-based systolic architecture , 2004, Real Time Imaging.

[14]  D. Yuan,et al.  Modelling and control scheme of the ball-plate trajectory-tracking pneumatic system with a touch screen and a rotary cylinder , 2010 .

[15]  L Adolfo.  Design and Implementation of a Visual Fuzzy Control in FPGA for the Ball and Plate System , 2010 .

[16]  Joan Batlle,et al.  A New FPGA/DSP-Based Parallel Architecture for Real-Time Image Processing , 2002, Real Time Imaging.

[17]  Marco A. Moreno-Armendáriz,et al.  Design and Implementation of a Visual Fuzzy Control in FPGA for the Ball and Plate System , 2010, 2010 International Conference on Reconfigurable Computing and FPGAs.

[18]  Jong Hyeon Park,et al.  Robust visual servoing for motion control of the ball on a plate , 2003 .

[19]  A. Krener.  Approximate linearization by state feedback and coordinate change , 1984 .

[20]  Kevin C. Craig,et al.  Mechatronic design of a ball-on-plate balancing system , 2002 .

[21]  Olivier Faugeras,et al.  Three-Dimensional Computer Vision , 1993 .

[22]  Vadim I. Utkin,et al.  Sliding mode control in electromechanical systems , 1999 .

[23]  Yantao Tian,et al.  Ball and plate control system based on sliding mode control with uncertain items observe compensation , 2009, 2009 IEEE International Conference on Intelligent Computing and Intelligent Systems.

[24]  Javier Díaz,et al.  FPGA-based real-time optical-flow system , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[25]  Naiyao Zhang,et al.  Trajectory planning and tracking of ball and plate system using hierarchical fuzzy control scheme , 2004, Fuzzy Sets Syst..