Mobile Robot Control Based on 2D Visual Servoing: A New Approach Combining Neural Network With Variable Structure and Flatness Theory

This paper focuses on the 2D visual servo-control of a mobile robot using a neural network (NN) with variable structure. The interaction matrix relating camera movement and changes in visual characteristics requires an estimation phase to determine its parameters as well as a camera calibration phase. It is common in applications related to mobile robotics that the robot model contains uncertainties generated by the sliding phenomenon. We suggest online identification, using NN to avoid this problem. The RBF NN is used to estimate the block formed by the interaction matrix and the reverse robot. Since the number of variables to be estimated is large, this can lead to the use of an excessive number of RBFs. We propose to use a single point of the scene which is sufficient to solve the problem. This problem reduction is possible thanks to flatness theory which allows to reduce the number of NN inputs from 8 inputs (4 image points) -generally used in the literature- to 2 (one image point) only. In order to further reduce the complexity of the proposed algorithm, the number of neurons for each layer and for each iteration is optimized. We use a neural network with variable structure to reach this objective. The very encouraging results obtained validate the proposed approach.

[1]  Laxmidhar Behera,et al.  Visual servoing of redundant manipulator with Jacobian matrix estimation using self-organizing map , 2010, Robotics Auton. Syst..

[2]  Nagarajan Sukavanam,et al.  Neural Network Based Controller for Visual Servoing of Robotic Hand Eye System , 2007, Eng. Lett..

[3]  Rs Roel Pieters,et al.  Visual Servo Control , 2012 .

[4]  Pan Qie UNCALIBRATED 2D ROBOTIC VISUAL TRACKING BASED ON ARTIFICIAL NEURAL NETWORK , 2001 .

[5]  J. Lévine Analysis and Control of Nonlinear Systems: A Flatness-based Approach , 2009 .

[6]  Chien Chern Cheah,et al.  Neural Network Control of Multifingered Robot Hands Using Visual Feedback , 2009, IEEE Transactions on Neural Networks.

[7]  Quang-Cuong Pham,et al.  Siamese Convolutional Neural Network for Sub-millimeter-accurate Camera Pose Estimation and Visual Servoing , 2019, 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[8]  Zheng Li,et al.  An Accelerated Recurrent Neural Network for Visual Servo Control of a Robotic Flexible Endoscope With Joint Limit Constraint , 2020, IEEE Transactions on Industrial Electronics.

[9]  Vladan Papić,et al.  Adaptive Neural Network (ANN) for Visual Servoing: the Mimetic Approach , 2007 .

[10]  R. Safaric,et al.  Uncalibrated visual servo control with neural network , 2008, 2008 10th IEEE International Workshop on Advanced Motion Control.

[11]  François Chaumette,et al.  Visual servo control. II. Advanced approaches [Tutorial] , 2007, IEEE Robotics & Automation Magazine.

[12]  Pham Thuong Cat,et al.  Robust neural control of robot-camera visual tracking , 2009, 2009 IEEE International Conference on Control and Automation.

[13]  Peter I. Corke,et al.  A tutorial on visual servo control , 1996, IEEE Trans. Robotics Autom..

[14]  Ying Bai,et al.  Improving Position Accuracy of Robot Manipulators Using Neural Networks , 2005, 2005 IEEE Instrumentationand Measurement Technology Conference Proceedings.

[15]  John Cortés-Romero,et al.  Trajectory Tracking Control of a Mobile Robot Through a Flatness-Based Exact Feedforward Linearization Scheme , 2015 .

[16]  Hassen Mekki,et al.  Variable Structure Neural Networks for Adaptive Robust Control Using Evolutionary Artificial Potential Fields , 2013 .

[17]  Xu Min,et al.  Robot manipulation using image-based visual servoing control with robust state estimation , 2018, 2018 Chinese Control And Decision Conference (CCDC).

[18]  Zheng Li,et al.  An Accelerated Finite-Time Convergent Neural Network for Visual Servoing of a Flexible Surgical Endoscope With Physical and RCM Constraints , 2020, IEEE Transactions on Neural Networks and Learning Systems.

[19]  François Chaumette,et al.  Visual servo control. I. Basic approaches , 2006, IEEE Robotics & Automation Magazine.