Fuzzy membership function based neural networks with applications to the visual servoing of robot manipulators

It is shown that there exists a nonlinear mapping which transforms image features and their changes to the desired camera motion without measuring of the relative distance between the camera and the object. This nonlinear mapping can eliminate several difficulties occurring in computing the inverse of the feature Jacobian as in the usual feature-based visual feedback control methods. Instead of analytically deriving the closed form of this mapping, a fuzzy membership function (FMF) based neural network incorporating a fuzzy-neural interpolating network is proposed to approximate the nonlinear mapping, where the structure of the FMF network is similar to that of radial basis function neural network which is known to be very effective in the function approximation. Several FMF networks are trained to be capable of tracking a moving object in the whole workspace along the line of sight. For an effective implementation of the proposed FMF network, an image feature selection process is investigated, and the required fuzzy membership functions are designed. Finally, several numerical examples are presented to show the validity of the proposed visual servoing method. >

[1]  G. G. Stokes.  "J." , 1890, The New Yale Book of Quotations.

[2]  D. B. Gennery,et al.  The sensing and perception subsystem of the NASA research telerobot , 1987 .

[3]  F. Harashima,et al.  Self-Organizing Visual Servo System based on Neural Networks , 1991, 1991 American Control Conference.

[4]  L X Wang,et al.  Fuzzy basis functions, universal approximation, and orthogonal least-squares learning , 1992, IEEE Trans. Neural Networks.

[5]  Lee E. Weiss,et al.  Dynamic sensor-based control of robots with visual feedback , 1987, IEEE Journal on Robotics and Automation.

[6]  P. Werbos,et al.  Beyond Regression : "New Tools for Prediction and Analysis in the Behavioral Sciences , 1974 .

[7]  Hideki Hashimoto,et al.  Visual servo control of robotic manipulators based on artificial neural network , 1989, 15th Annual Conference of IEEE Industrial Electronics Society.

[8]  Terence D. Sanger,et al.  A tree-structured adaptive network for function approximation in high-dimensional spaces , 1991, IEEE Trans. Neural Networks.

[9]  Lee E. Weiss,et al.  Image-Based Visual Servo Control Of Robots , 1983, Optics & Photonics.

[10]  W. Thomas Miller,et al.  Sensor-based control of robotic manipulators using a general learning algorithm , 1987, IEEE J. Robotics Autom..

[11]  Fritz B. Prinz,et al.  An Algorithm for Seam Tracking Applications , 1985 .

[12]  Lee E. Weiss,et al.  Adaptive Visual Servo Control of Robots , 1983 .

[13]  W. Thomas Miller,et al.  Real-time application of neural networks for sensor-based control of robots with vision , 1989, IEEE Trans. Syst. Man Cybern..

[14]  Il Hong Suh,et al.  Visual servoing by a fuzzy reasoning method , 1991, Proceedings IROS '91:IEEE/RSJ International Workshop on Intelligent Robots and Systems '91.

[15]  T Poggio,et al.  Regularization Algorithms for Learning That Are Equivalent to Multilayer Networks , 1990, Science.

[16]  Shang-Liang Chen,et al.  Orthogonal least squares learning algorithm for radial basis function networks , 1991, IEEE Trans. Neural Networks.

[17]  J. D. Powell,et al.  Radial basis function approximations to polynomials , 1989 .

[18]  Helge J. Ritter,et al.  Three-dimensional neural net for learning visuomotor coordination of a robot arm , 1990, IEEE Trans. Neural Networks.

[19]  C. S. George Lee,et al.  Weighted selection of image features for resolved rate visual feedback control , 1991, IEEE Trans. Robotics Autom..

[20]  J. Y. S. Luh,et al.  Resolved-acceleration control of mechanical manipulators , 1980 .

[21]  Hideki Hashimoto,et al.  Self-organizing visual servo system based on neural networks , 1992 .

[22]  Michio Takahashi,et al.  Unpositioned Workpieces Handling Robot with Visual and Force Sensors , 1987, IEEE Transactions on Industrial Electronics.