Dynamic Neural Networks for Model-Free Control and Identification

Neural networks have been used to solve a broad diversity of problems on different scientific and technological disciplines. Particularly, control and identification of uncertain systems have received attention since many years ago by the natural interest to solve problem such as automatic regulation or tracking of systems having a high degree of vagueness on their formal mathematical description. On the other hand, artificial modeling of uncertain systems (where the pair output-input is the only available information) has been exploited by many years with remarkable results. Within automatic control and identification theory, neural networks must be designed using a dynamic structure. Therefore, the so-called dynamic neural network scheme has emerged as a relevant and interesting field. Dynamic neural networks have used recurrent and differential forms to represent the uncertainties of nonlinear models. This couple of representations has permitted to use the well-developed mathematical machinery of control theory within the neural network framework. The purpose of this special issue is to give an insight on novel results regarding neural networks having either recurrent or differential models. This issue has encouraged application of such type of neural networks on adaptive control designs or/and no parametric modeling of uncertain systems. The contributions of this issue reflect the well-known fact that neural networks traditionally cover a broad variety of the thoroughness of techniques deployed for new analysis and learning methods of neural networks. Based on the recommendation of the guest editors, a number of authors were invited to submit their most recent and unpublished contributions on the aforementioned topics. Finally, five papers were accepted for publication. So, the paper of P. K. Kim and S. Jung titled " Experimental studies of neural network control for one-wheel mobile robot " presents development and control of a disc-typed one-wheel mobile robot, called GYROBO. Several models of the one-wheel mobile robot are designed, developed, and controlled. The current version of GYROBO is successfully balanced and controlled to follow the straight line. GYROBO has three actuators to balance and move. Two actuators are used for balancing control by virtue of gyroeffect and one actuator for driving movements. Since the space is limited and weight balance is an important factor for the successful balancing control, careful mechanical design is considered. To compensate for uncertainties in robot dynamics , a neural network is added to the nonmodel-based PD-controlled system. The reference compensation technique (RCT) is used for the neural network controller …

[1]  Yangsheng Xu,et al.  Analysis of actuation and dynamic balancing for a single-wheel robot , 1998, Proceedings. 1998 IEEE/RSJ International Conference on Intelligent Robots and Systems. Innovations in Theory, Practice and Applications (Cat. No.98CH36190).

[2]  Floriberto Ortiz-Rodríguez,et al.  A method for online pattern recognition of abnormal eye movements , 2011, Neural Computing and Applications.

[3]  Neil E. Cotter,et al.  The Stone-Weierstrass theorem and its application to neural networks , 1990, IEEE Trans. Neural Networks.

[4]  Christopher G. Atkeson,et al.  Estimation of Inertial Parameters of Manipulator Loads and Links , 1986 .

[5]  Kok Kiong Tan,et al.  Adaptive robust control for servo manipulators , 2003, Neural Computing & Applications.

[6]  Dimitrios I. Fotiadis,et al.  Artificial neural networks for solving ordinary and partial differential equations , 1997, IEEE Trans. Neural Networks.

[7]  Risto Miikkulainen,et al.  Learning Dynamic Obstacle Avoidance for a Robot Arm Using Neuroevolution , 2009, Neural Processing Letters.

[8]  Marios M. Polycarpou,et al.  High-order neural network structures for identification of dynamical systems , 1995, IEEE Trans. Neural Networks.

[9]  Duy Nguyen-Tuong,et al.  Learning Robot Dynamics for Computed Torque Control Using Local Gaussian Processes Regression , 2008, 2008 ECSIS Symposium on Learning and Adaptive Behaviors for Robotic Systems (LAB-RS).

[10]  Alexander S. Poznyak,et al.  Nonlinear adaptive trajectory tracking using dynamic neural networks , 1999, IEEE Trans. Neural Networks.

[11]  R. Johansson,et al.  Predictive mechanisms and object representations used in object manipulation , 2009 .

[12]  Luis Arturo Soriano,et al.  An asymptotic stable proportional derivative control with sliding mode gravity compensation and with a high gain observer for robotic arms , 2010 .

[13]  D M Wolpert,et al.  Multiple paired forward and inverse models for motor control , 1998, Neural Networks.

[14]  M. Spong,et al.  Robot Modeling and Control , 2005 .

[15]  Patrick van der Smagt Cerebellar Control of Robot Arms , 1998, Connect. Sci..

[16]  Chih-Min Lin,et al.  RCMAC Hybrid Control for MIMO Uncertain Nonlinear Systems Using Sliding-Mode Technology , 2007, IEEE Transactions on Neural Networks.

[17]  Eiji Nakano,et al.  Solving function distribution and behavior design problem for cooperative object handling by multiple mobile robots , 2003, IEEE Trans. Syst. Man Cybern. Part A.

[18]  Bassam Daya A Multilayer Perceptrons Model for the Stability of a Bipedal Robot , 1999 .

[19]  Mitsuo Kawato,et al.  Internal models for motor control and trajectory planning , 1999, Current Opinion in Neurobiology.

[20]  Louis L. Whitcomb,et al.  Adaptive force control of position/velocity controlled robots: theory and experiment , 2001, Proceedings 2001 IEEE/RSJ International Conference on Intelligent Robots and Systems. Expanding the Societal Role of Robotics in the the Next Millennium (Cat. No.01CH37180).

[21]  Yan-Jun Liu,et al.  Adaptive fuzzy control for a class of uncertain nonaffine nonlinear systems , 2007, Inf. Sci..

[22]  A. Tayebi,et al.  Robust Iterative Learning Control Design: Application to a Robot Manipulator , 2008, IEEE/ASME Transactions on Mechatronics.

[23]  Silvia Tolu,et al.  Bio-inspired Control Model for Object Manipulation by Humanoid Robots , 2007, IWANN.

[24]  Stefan Schaal,et al.  Statistical Learning for Humanoid Robots , 2002, Auton. Robots.

[25]  Rong-Jong Wai,et al.  Design of Dynamic Petri Recurrent Fuzzy Neural Network and Its Application to Path-Tracking Control of Nonholonomic Mobile Robot , 2009, IEEE Transactions on Industrial Electronics.

[26]  Long Cheng,et al.  A Recurrent Neural Network for Hierarchical Control of Interconnected Dynamic Systems , 2007, IEEE Transactions on Neural Networks.

[27]  Carlos Aguilar,et al.  Optimal control based in a mathematical model applied to robotic arms , 2011 .

[28]  Seul Jung,et al.  Experimental studies of balancing control for a disc-typed mobile robot using a neural controller: GYROBO , 2010, 2010 IEEE International Symposium on Intelligent Control.

[29]  Robert J. Schilling,et al.  Fundamentals of robotics - analysis and control , 1990 .

[30]  Aníbal Ollero,et al.  Mobile robot path planning for fine-grained and smooth path spcification , 1995, J. Field Robotics.

[31]  Eduardo Ros,et al.  A real-time spiking cerebellum model for learning robot control , 2008, Biosyst..

[32]  Sheng Chen,et al.  Regularized orthogonal least squares algorithm for constructing radial basis function networks , 1996 .

[33]  N. McClamroch,et al.  Stabilization and asymptotic path tracking of a rolling disk , 1995, Proceedings of 1995 34th IEEE Conference on Decision and Control.

[34]  Plamen P. Angelov,et al.  Fuzzily Connected Multimodel Systems Evolving Autonomously From Data Streams , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[35]  Alexander S. Poznyak,et al.  Indirect adaptive control via parallel dynamic neural networks , 1999 .

[36]  Kumpati S. Narendra,et al.  Identification and control of dynamical systems using neural networks , 1990, IEEE Trans. Neural Networks.

[37]  N. Phan-Thien,et al.  Neural-network-based approximations for solving partial differential equations , 1994 .

[38]  John J. Craig,et al.  Hybrid position/force control of manipulators , 1981 .

[39]  Plamen P. Angelov,et al.  Simpl_eTS: a simplified method for learning evolving Takagi-Sugeno fuzzy models , 2005, The 14th IEEE International Conference on Fuzzy Systems, 2005. FUZZ '05..

[40]  Stefan Schaal,et al.  Incremental Online Learning in High Dimensions , 2005, Neural Computation.

[41]  Eduardo Ros,et al.  Cerebellarlike Corrective Model Inference Engine for Manipulation Tasks , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[42]  Seul Jung,et al.  Control Experiment of a Wheel-Driven Mobile Inverted Pendulum Using Neural Network , 2008, IEEE Transactions on Control Systems Technology.

[43]  Panos J. Antsaklis,et al.  Neural networks for control systems , 1990, IEEE Trans. Neural Networks.

[44]  Yangsheng Xu,et al.  Stabilization and path following of a single wheel robot , 2004, IEEE/ASME Transactions on Mechatronics.

[45]  Duy Nguyen-Tuong,et al.  Computed torque control with nonparametric regression models , 2008, 2008 American Control Conference.

[46]  Aria Alasty,et al.  Equations of Motion of a Single-Wheel Robot in a Rough Terrain , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[47]  Jian-Xin Xu,et al.  Adaptive robust iterative learning control with dead zone scheme , 2000, Autom..

[48]  Friedrich M. Wahl,et al.  On-line rigid object recognition and pose estimation based on inertial parameters , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[49]  S. Schaal,et al.  Computational motor control in humans and robots , 2005, Current Opinion in Neurobiology.

[50]  Maarten Steinbuch,et al.  Adaptive Iterative Learning Control for High Precision Motion Systems , 2008, IEEE Transactions on Control Systems Technology.

[51]  Denis Hamad,et al.  Control of a robot manipulator and pendubot system using artificial neural networks , 2005, Robotica.

[52]  Qunjing Wang,et al.  Global Robust Stabilizing Control for a Dynamic Neural Network System , 2009, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[53]  Wan Kyun Chung,et al.  Parallel Force/Position Controls for Robot Manipulators with Uncertain Kinematics , 2005, Int. J. Robotics Autom..

[54]  Wen Yu,et al.  Robust Visual Servoing of Robot Manipulators with Neuro Compensation , 2005, J. Frankl. Inst..

[55]  Hyo-Sung Ahn,et al.  Special issue on “iterative learning control” , 2011 .

[56]  J. Z. Zhu,et al.  The finite element method , 1977 .

[57]  José de Jesús Rubio,et al.  Backpropagation to train an evolving radial basis function neural network , 2010, Evol. Syst..

[58]  Konrad Reif,et al.  Multilayer neural networks for solving a class of partial differential equations , 2000, Neural Networks.

[59]  Frank L. Lewis,et al.  Identification of nonlinear dynamical systems using multilayered neural networks , 1996, Autom..

[60]  Guoping Liu,et al.  Variable neural networks for adaptive control of nonlinear systems , 1999, IEEE Trans. Syst. Man Cybern. Part C.

[61]  Chein-I Chang,et al.  Robust radial basis function neural networks , 1999, IEEE Trans. Syst. Man Cybern. Part B.

[62]  Silvia Tolu,et al.  Adaptive cerebellar Spiking Model Embedded in the Control Loop: Context Switching and Robustness against noise , 2011, Int. J. Neural Syst..

[63]  A.G. Alleyne,et al.  A survey of iterative learning control , 2006, IEEE Control Systems.

[64]  Peter J. Gawthrop,et al.  Neural networks for control systems - A survey , 1992, Autom..

[65]  Jeen-Shing Wang,et al.  A fully automated recurrent neural network for unknown dynamic system identification and control , 2006, IEEE Transactions on Circuits and Systems I: Regular Papers.

[66]  Chiang-Ju Chien,et al.  A Combined Adaptive Law for Fuzzy Iterative Learning Control of Nonlinear Systems With Varying Control Tasks , 2008, IEEE Transactions on Fuzzy Systems.

[67]  Eduardo Ros,et al.  Cerebellar Input Configuration Toward Object Model Abstraction in Manipulation Tasks , 2011, IEEE Transactions on Neural Networks.

[68]  Li-Chen Fu,et al.  An Iterative Learning Control of Nonlinear Systems Using Neural Network Design , 2002 .

[69]  R. C. Miall,et al.  Motor control, biological and theoretical , 1998 .

[70]  Zhen Zhu,et al.  Integrated ADAMS+MATLAB environment for design of an autonomous single wheel robot , 2009, 2009 35th Annual Conference of IEEE Industrial Electronics.

[71]  Chih-Min Lin,et al.  Wavelet Adaptive Backstepping Control for a Class of Nonlinear Systems , 2006, IEEE Transactions on Neural Networks.

[72]  Jing Xu,et al.  Observer based learning control for a class of nonlinear systems with time-varying parametric uncertainties , 2004, IEEE Trans. Autom. Control..

[73]  Daniel K. Wedding,et al.  Flexible link control using multiple forward paths, multiple RBF neural networks in a direct control application , 2000, Smc 2000 conference proceedings. 2000 ieee international conference on systems, man and cybernetics. 'cybernetics evolving to systems, humans, organizations, and their complex interactions' (cat. no.0.

[74]  Yangsheng Xu,et al.  Dynamic model of a gyroscopic wheel , 1998, Proceedings. 1998 IEEE International Conference on Robotics and Automation (Cat. No.98CH36146).

[75]  Frank L. Lewis,et al.  Multilayer neural-net robot controller with guaranteed tracking performance , 1996, IEEE Trans. Neural Networks.

[76]  Mitsuo Kawato,et al.  MOSAIC Model for Sensorimotor Learning and Control , 2001, Neural Computation.

[77]  Kevin L. Moore,et al.  Iterative Learning Control: Brief Survey and Categorization , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[78]  V. Lumelsky,et al.  Sensitive skin , 2000, IEEE Sensors Journal.

[79]  Yangsheng Xu,et al.  Dynamic Mobility with Single-Wheel Configuration , 1999, Int. J. Robotics Res..

[80]  Umashankar Nagarajan,et al.  Trajectory planning and control of an underactuated dynamically stable single spherical wheeled mobile robot , 2009, 2009 IEEE International Conference on Robotics and Automation.

[81]  Norma Alias,et al.  A Case Study: 2D Vs 3D Partial Differential Equation toward Tumour Cell Visualisation on Multi-Core Parallel Computing Atmosphere , 2010 .

[82]  D. T. Lee,et al.  An output recurrent fuzzy neural network based iterative learning control for nonlinear systems , 2008, 2008 IEEE International Conference on Fuzzy Systems (IEEE World Congress on Computational Intelligence).

[83]  J. Rubinstein,et al.  An Introduction to Partial Differential Equations , 2005 .

[84]  Salim Labiod,et al.  Adaptive fuzzy control of a class of SISO nonaffine nonlinear systems , 2007, Fuzzy Sets Syst..

[85]  Ching-Hung Lee,et al.  A Dynamic Fuzzy Neural System Design via Hybridization of EM and PSO Algorithms , 2010 .

[86]  John Hallam,et al.  Combining Regression Trees and Radial Basis Function Networks , 2000, Int. J. Neural Syst..

[87]  Stefan Schaal,et al.  Local Dimensionality Reduction for Non-Parametric Regression , 2009, Neural Processing Letters.

[88]  Bernard Delyon,et al.  Accuracy analysis for wavelet approximations , 1995, IEEE Trans. Neural Networks.

[89]  Shaocheng Tong,et al.  Adaptive Fuzzy Output Tracking Control of MIMO Nonlinear Uncertain Systems , 2007, IEEE Transactions on Fuzzy Systems.

[90]  Simon Haykin,et al.  Neural Networks: A Comprehensive Foundation , 1998 .

[91]  Umashankar Nagarajan,et al.  State transition, balancing, station keeping, and yaw control for a dynamically stable single spherical wheel mobile robot , 2009, 2009 IEEE International Conference on Robotics and Automation.

[92]  Xiaoou Li,et al.  PD control of robot with velocity estimation and uncertainties compensation , 2001, Proceedings of the 40th IEEE Conference on Decision and Control (Cat. No.01CH37228).

[93]  W. T. Thach,et al.  Simple spike activity predicts occurrence of complex spikes in cerebellar Purkinje cells , 1998, Nature Neuroscience.

[94]  M. Krabbes,et al.  Modelling of robot dynamics based on a multi-dimensional RBF-like neural network , 1999, Proceedings 1999 International Conference on Information Intelligence and Systems (Cat. No.PR00446).

[95]  Masao Ito Mechanisms of motor learning in the cerebellum 1 1 Published on the World Wide Web on 24 November 2000. , 2000, Brain Research.

[96]  Yih-Guang Leu,et al.  Observer-based direct adaptive fuzzy-neural control for nonaffine nonlinear systems , 2005, IEEE Trans. Neural Networks.

[97]  Chiang-Ju Chien,et al.  A sampled-data iterative learning control using fuzzy network design , 2000 .

[98]  M. Corless,et al.  Continuous state feedback guaranteeing uniform ultimate boundedness for uncertain dynamic systems , 1981 .

[99]  M.H. Hassoun,et al.  Fundamentals of Artificial Neural Networks , 1996, Proceedings of the IEEE.

[100]  Nam Mai-Duy,et al.  Numerical solution of differential equations using multiquadric radial basis function networks , 2001, Neural Networks.

[101]  Seonghee Jeong,et al.  Wheeled inverted pendulum type assistant robot: design concept and mobile control , 2008, Intell. Serv. Robotics.

[102]  Qunjing Wang,et al.  Further Development of Input-to-State Stabilizing Control for Dynamic Neural Network Systems , 2008, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[103]  Zhihong Man,et al.  An RBF neural network-based adaptive control for SISO linearisable nonlinear systems , 2005, Neural Computing & Applications.

[104]  Kwang Y. Lee,et al.  Diagonal recurrent neural networks for dynamic systems control , 1995, IEEE Trans. Neural Networks.

[105]  John S. Bay,et al.  A fully autonomous active sensor-based exploration concept for shape-sensing robots , 1991, IEEE Trans. Syst. Man Cybern..

[106]  Ralph L. Hollis,et al.  A dynamically stable single-wheeled mobile robot with inverse mouse-ball drive , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[107]  Jin S. Lee,et al.  Adaptive fuzzy learning control for a class of nonlinear dynamic systems , 2000 .

[108]  M. Garwicz,et al.  Anatomical and physiological foundations of cerebellar information processing , 2005, Nature Reviews Neuroscience.

[109]  A. Tornambè,et al.  High-gain observers in the state and estimation of robots having elastic joints , 1989 .

[110]  Jang-Hyun Park,et al.  Direct adaptive controller for nonaffine nonlinear systems using self-structuring neural networks , 2005, IEEE Transactions on Neural Networks.

[111]  Abdullah Al Mamun,et al.  Line Tracking of the Gyrobot - a Gyroscopically Stabilized Single-Wheeled Robot , 2006, 2006 IEEE International Conference on Robotics and Biomimetics.

[112]  John J. Craig Zhu,et al.  Introduction to robotics mechanics and control , 1991 .

[113]  Marc Toussaint,et al.  Learning Multiple Models of Non-linear Dynamics for Control Under Varying Contexts , 2006, ICANN.

[114]  Sethu Vijayakumar,et al.  Load estimation and control using learned dynamics models , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[115]  Seul Jung,et al.  Robust control of a mobile inverted pendulum robot using a RBF neural network controller , 2009, 2008 IEEE International Conference on Robotics and Biomimetics.

[116]  Masao Ito Control of mental activities by internal models in the cerebellum , 2008, Nature Reviews Neuroscience.

[117]  Manolis A. Christodoulou,et al.  Adaptive control of unknown plants using dynamical neural networks , 1994, IEEE Trans. Syst. Man Cybern..

[118]  T. Maneewarn,et al.  Dynamic modeling of a one-wheel robot by using Kane's method , 2002, 2002 IEEE International Conference on Industrial Technology, 2002. IEEE ICIT '02..

[119]  George Cybenko,et al.  Approximation by superpositions of a sigmoidal function , 1992, Math. Control. Signals Syst..

[120]  Alexander S. Poznyak,et al.  Differential Neural Networks for Robust Nonlinear Control: Identification, State Estimation and Trajectory Tracking , 2001 .

[121]  Daniel Sbarbaro,et al.  Neural Networks for Nonlinear Internal Model Control , 1991 .

[122]  Alexander S. Poznyak,et al.  Neural numerical modeling for uncertain distributed parameter systems , 2009, 2009 International Joint Conference on Neural Networks.

[123]  Ling Xu,et al.  Cerebellar dynamic state estimation for a biomorphic robot arm , 2005, 2005 IEEE International Conference on Systems, Man and Cybernetics.

[124]  Paramasivan Saratchandran,et al.  Sequential Adaptive Fuzzy Inference System (SAFIS) for nonlinear system identification and prediction , 2006, Fuzzy Sets Syst..

[125]  M T Turvey,et al.  Role of the inertia tensor in haptically perceiving where an object is grasped. , 1994, Journal of experimental psychology. Human perception and performance.

[126]  Christiaan J. J. Paredis,et al.  Control of the Gyrover. A single-wheel gyroscopically stabilized robot , 1999, Proceedings 1999 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human and Environment Friendly Robots with High Intelligence and Emotional Quotients (Cat. No.99CH36289).