On-line robot adaptation to environmental change

Robots performing tasks constantly encounter changing environmental conditions. These changes in the environment vary from the dramatic, such as rearrangement of furniture, to the subtle, such as a burnt out light bulb or a different carpeting. We do not recognize many of these changes, especially subtle changes, but robots do. These changes often lead to the failure of robots. In this thesis, we develop an algorithm for detecting these changes. Traditional sensor models do not capture all of the dependencies in the sensor data and are not capable of detecting all types of signal changes while maintaining a strong probabilistic foundation. This thesis corrects these shortcomings. We show how detecting the current conditions in which the robot is operating can lead to increased performance and lower failure rates. The methods in this thesis are tested on real tasks performed by a real robot, namely a Sony AIBO robot.

[1]  Howie Choset,et al.  A Context-Based State Estimation Technique for Hybrid Systems , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[2]  Peter G. Ifju,et al.  Sky/ground modeling for autonomous MAV flight , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[3]  Robert P. W. Duin,et al.  On the Choice of Smoothing Parameters for Parzen Estimators of Probability Density Functions , 1976, IEEE Transactions on Computers.

[4]  Atsushi Nakazawa,et al.  Matching and blending human motions temporal scaleable dynamic programming , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[5]  Brett Browning,et al.  Learning to Prevent Failure States for a Dynamically Balancing Robot , 2005, AAAI.

[6]  Stephen Marsland,et al.  On-Line Novelty Detection through self-organisation with application to inspection robotics , 2001 .

[7]  Raffaella Mattone.  The growing neural map: An on-line competitive clustering algorithm , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[8]  Remi Driancourt,et al.  A general segmentation mechanism from biological inspiration , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[9]  Tomomasa Sato,et al.  Human behavior logging support system utilizing pose/position sensors and behavior target sensors , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[10]  Manuela M. Veloso,et al.  Sensor resetting localization for poorly modelled mobile robots , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[11]  Chiman Kwan,et al.  A novel approach to fault diagnostics and prognostics , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[12]  Masafumi Hashimoto,et al.  Sensor fault detection and identification in dead-reckoning system of mobile robot: interacting multiple model approach , 2001, Proceedings 2001 IEEE/RSJ International Conference on Intelligent Robots and Systems. Expanding the Societal Role of Robotics in the the Next Millennium (Cat. No.01CH37180).

[13]  Lars Niklasson,et al.  Time series segmentation using an adaptive resource allocating vector quantization network based on change detection , 2000, Proceedings of the IEEE-INNS-ENNS International Joint Conference on Neural Networks. IJCNN 2000. Neural Computing: New Challenges and Perspectives for the New Millennium.

[14]  Michèle Basseville,et al.  Detection of abrupt changes: theory and application , 1993 .

[15]  Manuela M. Veloso,et al.  The CMTrio-98 Sony-Legged Robot Team , 1998, RoboCup.

[16]  Yoshihiko Nakamura,et al.  Keyframe compression and decompression for time series data based on the continuous hidden Markov model , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[17]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[18]  Charles Poynton.  Poynton's Color FAQ , 2004 .

[19]  Wolfram Burgard,et al.  Monte Carlo Localization with Mixture Proposal Distribution , 2000, AAAI/IAAI.

[20]  Ashok N. Srivastava,et al.  Nonlinear gated experts for time series: discovering regimes and avoiding overfitting , 1995, Int. J. Neural Syst..

[21]  Geoffrey E. Hinton,et al.  Switching State-Space Models , 1996 .

[22]  Simon Lacroix,et al.  Using multiple disparity hypotheses for improved indoor stereo , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[23]  Toshiro Noritsugu,et al.  A mode switching estimator for visual servoing , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[24]  Ronald C. Arkin,et al.  Selection of behavioral parameters: integration of discontinuous switching via case-based reasoning with continuous adaptation via learning momentum , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[25]  Michael C. Mozer,et al.  A Unified Gradient-Descent/Clustering Architecture for Finite State Machine Induction , 1993, NIPS.

[26]  Manuela Veloso,et al.  Learning from accelerometer data on a legged robot , 2004 .

[27]  Masafumi Hashimoto,et al.  A multi-model based fault detection and diagnosis of internal sensors for mobile robot , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[28]  Han-Pang Huang,et al.  EMG classification for prehensile postures using cascaded architecture of neural networks with self-organizing maps , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[29]  Michael C. Horsch,et al.  Dynamic Bayesian networks , 1990 .

[30]  W. Burgard,et al.  Markov Localization for Mobile Robots in Dynamic Environments , 1999, J. Artif. Intell. Res..

[31]  Stuart J. Russell,et al.  Dynamic bayesian networks: representation, inference and learning , 2002 .

[32]  Peter Stone,et al.  Towards Illumination Invariance in the Legged League , 2005, RoboCup.

[33]  Manuela M. Veloso,et al.  CM-Pack'01: Fast Legged Robot Walking, Robust Localization, and Team Behaviors , 2001, RoboCup.

[34]  Manuela M. Veloso,et al.  CMPack: a complete software system for autonomous legged soccer robots , 2001, AGENTS '01.

[35]  Wolfram Burgard,et al.  Monte Carlo localization for mobile robots , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[36]  Wolfram Burgard,et al.  Monte Carlo Localization: Efficient Position Estimation for Mobile Robots , 1999, AAAI/IAAI.

[37]  Takayuki Koizumi,et al.  Manipulation of a robot by EMG signals using linear multiple regression model , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[38]  Andrew W. Moore,et al.  Learning to recognize time series: combining ARMA models with memory-based learning , 1997, Proceedings 1997 IEEE International Symposium on Computational Intelligence in Robotics and Automation CIRA'97. 'Towards New Computational Principles for Robotics and Automation'.

[39]  Koninklijke Nederlandse Akademie van Wetenschappen,et al.  Indagationes mathematicae. New series : proceedings of the Koninklijke Nederlandse Akademie van Wetenschappen , 1990 .

[40]  Yangsheng Xu,et al.  Modeling human actions from learning , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[41]  P. Hall.  On Kullback-Leibler loss and density estimation , 1987 .

[42]  Minoru Asada,et al.  Automatic extraction of abstract actions from humanoid motion data , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[43]  Manuela M. Veloso,et al.  Fast Parametric Transitions for Smooth Quadrupedal Motion , 2001, RoboCup.

[44]  Masamichi Shimosaka,et al.  Informative motion extractor for action recognition with kernel feature alignment , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[45]  Jun Tani,et al.  Model-based learning for mobile robot navigation from the dynamical systems perspective , 1996, IEEE Trans. Syst. Man Cybern. Part B.

[46]  Avrim Blum,et al.  The Bottleneck , 2021, Monopsony Capitalism.

[47]  Wolfram Burgard,et al.  Learning motion patterns of persons for mobile service robots , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[48]  Manuela M. Veloso,et al.  Vision-Servoed Localization and Behavior-Based Planning for an Autonomous Quadruped Legged Robot , 2000, AIPS.

[49]  Yan Huang,et al.  ARGMode - Activity Recognition using Graphical Models , 2003, 2003 Conference on Computer Vision and Pattern Recognition Workshop.

[50]  Peng Chen,et al.  Intelligent diagnosis method of multi-fault state for plant machinery using wavelet analysis, genetic programming and possibility theory , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[51]  Manuela M. Veloso,et al.  A Modular Hierarchical Behavior-Based Architecture , 2001, RoboCup.

[52]  Ronald C. Arkin,et al.  Spatio-temporal case-based reasoning for behavioral selection , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[53]  Hiroaki Kitano,et al.  Vision, Strategy, and Localization Using the Sony Robots at RoboCup-98 , 2000, AI Mag..

[54]  Maja J. Mataric,et al.  Detecting regime changes with a mobile robot using multiple models , 2001, Proceedings 2001 IEEE/RSJ International Conference on Intelligent Robots and Systems. Expanding the Societal Role of Robotics in the the Next Millennium (Cat. No.01CH37180).

[55]  Luigi Villani,et al.  Fault diagnosis for AUVs using support vector machines , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[56]  J. Kohlmorgen,et al.  An on-line method for segmentation and identification of non-stationary time series , 2001, Neural Networks for Signal Processing XI: Proceedings of the 2001 IEEE Signal Processing Society Workshop (IEEE Cat. No.01TH8584).

[57]  Stefano Nolfi,et al.  Extracting Regularities in Space and Time Through a Cascade of Prediction Networks: The Case of a Mobile Robot Navigating in a Structured Environment , 1999, Connect. Sci..

[58]  William D. Penny,et al.  Dynamic Models for Nonstationary Signal Segmentation , 1999, Comput. Biomed. Res..

[59]  Refractor.  Vision , 2000, The Lancet.

[60]  Steven Lemm,et al.  A Dynamic HMM for On-line Segmentation of Sequential Data , 2001, NIPS.

[61]  Ronald C. Arkin,et al.  Learning behavioral parameterization using spatio-temporal case-based reasoning , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[62]  Dieter Fox,et al.  An experimental comparison of localization methods continued , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[63]  Osama Masoud,et al.  Online motion classification using support vector machines , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[64]  Manuela M. Veloso,et al.  Fast and inexpensive color image segmentation for interactive robots , 2000, Proceedings. 2000 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2000) (Cat. No.00CH37113).

[65]  Roland Siegwart,et al.  Environmental modeling with fingerprint sequences for topological global localization , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[66]  William T. B. Uther,et al.  Vision , Strategy , and Localization Using the Sony Legged Robots at RoboCup-98 , 2000 .

[67]  Takeo Kanade,et al.  People detection and tracking in high resolution panoramic video mosaic , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[68]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.