An application of Lyapunov stability analysis to improve the performance of NARMAX models

Previously we presented a novel approach to program a robot controller based on system identification and robot training techniques. The proposed method works in two stages: first, the programmer demonstrates the desired behaviour to the robot by driving it manually in the target environment. During this run, the sensory perception and the desired velocity commands of the robot are logged. Having thus obtained training data we model the relationship between sensory readings and the motor commands of the robot using ARMAX/NARMAX models and system identification techniques. These produce linear or non-linear polynomials which can be formally analysed, as well as used in place of ''traditional robot'' control code. In this paper we focus our attention on how the mathematical analysis of NARMAX models can be used to understand the robot's control actions, to formulate hypotheses and to improve the robot's behaviour. One main objective behind this approach is to avoid trial-and-error refinement of robot code. Instead, we seek to obtain a reliable design process, where program design decisions are based on the mathematical analysis of the model describing how the robot interacts with its environment to achieve the desired behaviour. We demonstrate this procedure through the analysis of a particular task in mobile robotics: door traversal.

[1]  Noel E. Sharkey,et al.  Learning from Innate Behaviors: A Quantitative Evaluation of Neural Network Controllers , 1998, Auton. Robots.

[2]  Alan F. Murray,et al.  Synaptic Rewiring for Topographic Map Formation , 2008, ICANN.

[3]  Sridhar Mahadevan,et al.  Robot Learning , 1993 .

[4]  Sheng Chen,et al.  Representations of non-linear systems: the NARMAX model , 1989 .

[5]  Derrick H. Nguyen,et al.  Neural networks for self-learning control systems , 1990 .

[6]  Sheng Chen,et al.  Practical identification of NARMAX models using radial basis functions , 1990 .

[7]  Antonio Bicchi,et al.  Closed loop steering of unicycle like vehicles via Lyapunov techniques , 1995, IEEE Robotics Autom. Mag..

[8]  Stephen A. Billings,et al.  Visual task identification and characterization using polynomial models , 2007, Robotics Auton. Syst..

[9]  Liang Zhao,et al.  Stereo- and neural network-based pedestrian detection , 1999, Proceedings 199 IEEE/IEEJ/JSAI International Conference on Intelligent Transportation Systems (Cat. No.99TH8383).

[10]  Naresh K. Sinha,et al.  Modern Control Systems , 1981, IEEE Transactions on Systems, Man, and Cybernetics.

[11]  Theocharis Kyriacou,et al.  Task Characterisation and Cross-Platform Programming Through System Identification , 2005 .

[12]  Ulrich Nehmzow Mobile Robotics: A Practical Introduction , 2003 .

[13]  S. Billings,et al.  Correlation based model validity tests for non-linear models , 1986 .

[14]  Guido Bugmann,et al.  Training Personal Robots Using Natural Language Instruction , 2001, IEEE Intell. Syst..

[15]  Stephen A. Billings,et al.  The Determination of Multivariable Nonlinear Models for Dynamic Systems Using neural Networks , 1996 .

[16]  Ulrich Nehmzow,et al.  Applications of Robot Training: Clearing, Cleaning, Surveillance , 1995 .

[17]  Dean A. Pomerleau,et al.  Knowledge-Based Training of Artificial Neural Networks for Autonomous Robot Driving , 1993 .

[18]  Stephen A. Billings,et al.  Robot training using system identification , 2008, Robotics Auton. Syst..

[19]  S. Billings,et al.  Orthogonal parameter estimation algorithm for non-linear stochastic systems , 1988 .

[20]  Theocharis Kyriacou,et al.  ROBOT PROGRAMMING THROUGH A COMBINATION OF MANUAL TRAINING AND SYSTEM IDENTIFICATION , 2005 .

[21]  Derrick H. Nguyen,et al.  Truck backer-upper: an example of self-learning in neural networks , 1990, Defense, Security, and Sensing.

[22]  Cornelius T. Leondes,et al.  Neural network systems techniques and applications , 1998 .

[24]  Yiannis Demiris,et al.  Learning Forward Models for Robots , 2005, IJCAI.

[25]  Aude Billard,et al.  Learning to Communicate Through Imitation in Autonomous Robots , 1997, ICANN.

[26]  O. L. R. Jacobs,et al.  Trends and progress in system identification , 1982, Autom..