Techniques for knowledge acquisition in dynamically changing environments

Intelligent agents often have the same or similar tasks and sometimes they cooperate to solve a given problem. These agents typically know how to observe their local environment and how to react on certain observations, for instance, and this knowledge may be represented in form of rules. However, many environments are dynamic in the sense that from time to time novel rules are required or old rules become obsolete. In this article we propose and investigate new techniques for knowledge acquisition by novelty detection and reaction as well as obsoleteness detection and reaction that an agent may use for self-adaptation to new situations. For that purpose we consider classifiers based on probabilistic rules. Premises of new rules are learned autonomously while conclusions are either obtained from human experts or from other agents which have learned appropriate rules in the past. By means of knowledge exchange, agents will efficiently be enabled to cope with situations they were not confronted with before. This kind of collaborative intelligence follows the human archetype: Humans are able to learn from each other by communicating learned rules. We demonstrate some properties of the knowledge acquisition techniques using artificial data as well as data from the field of intrusion detection.

[1]  Christopher M. Bishop,et al.  Pattern Recognition and Machine Learning (Information Science and Statistics) , 2006 .

[2]  Emily Kimbrough.  So near and yet so far , 1955 .

[3]  Seppo J. Ovaska,et al.  So near and yet so far: New insight into properties of some well-known classifier paradigms , 2010, Inf. Sci..

[4]  Alexander Hofmann,et al.  On the versatility of radial basis function neural networks: A case study in the field of intrusion detection , 2010, Inf. Sci..

[5]  David G. Stork,et al.  Pattern Classification , 1973 .

[6]  David A. Clifton,et al.  A Framework for Novelty Detection in Jet Engine Vibration Data , 2007 .

[7]  Hyoungjoo Lee,et al.  On-line novelty detection using the Kalman filter and extreme value theory , 2008, 2008 19th International Conference on Pattern Recognition.

[8]  Shigeo Abe DrEng.  Pattern Classification , 2001, Springer London.

[9]  Michal Pechoucek,et al.  Collaborative Learning with Logic-Based Models , 2007, Adaptive Agents and Multi-Agents Systems.

[10]  Justus H. Piater,et al.  Online Learning of Gaussian Mixture Models - a Two-Level Approach , 2008, VISAPP.

[11]  B. Sick,et al.  A framework for large-scale simulation of collaborative intrusion detection systems , 2008, 2008 IEEE Conference on Soft Computing in Industrial Applications.

[12]  Christian Müller-Schloer,et al.  Quantitative Emergence , 2006, 2006 IEEE Mountain Workshop on Adaptive and Learning Systems.

[13]  Alexander Hofmann,et al.  Online Intrusion Alert Aggregation with Generative Data Stream Modeling , 2011, IEEE Transactions on Dependable and Secure Computing.

[14]  Alexander Hofmann,et al.  Fast and Efficient Training of RBF Networks , 2003, ICANN.

[15]  Radford M. Neal.  Pattern Recognition and Machine Learning , 2007, Technometrics.

[16]  Rolf P. Wrtz.  Organic Computing - Understanding Complex Systems , 2008 .

[17]  S. Roberts.  Novelty detection using extreme value statistics , 1999 .

[18]  Marco Vannucci,et al.  Outlier Detection Methods for Industrial Applications , 2008, ICRA 2008.

[19]  Bernhard Sick,et al.  Learning by teaching versus learning by doing: Knowledge exchange in organic agent systems , 2009, 2009 IEEE Symposium on Intelligent Agents.

[20]  Philip S. Yu,et al.  A Framework for Clustering Evolving Data Streams , 2003, VLDB.

[21]  Martin Lauer,et al.  A Mixture Approach to Novelty Detection Using Training Data with Outliers , 2001, ECML.

[22]  B. Sick,et al.  Knowledge fusion using Dempster-Shafer theory and the imprecise Dirichlet model , 2008, 2008 IEEE Conference on Soft Computing in Industrial Applications.

[23]  Jim Austin,et al.  Neural networks for novelty detection in airframe strain data , 2000, Proceedings of the IEEE-INNS-ENNS International Joint Conference on Neural Networks. IJCNN 2000. Neural Computing: New Challenges and Perspectives for the New Millennium.

[24]  Bernhard Sick,et al.  Functional Knowledge Exchange Within an Intelligent Distributed System , 2007, ARCS.

[25]  Sameer Singh,et al.  Novelty detection: a review - part 2: : neural network based approaches , 2003, Signal Process..

[26]  A. Zell,et al.  Novelty Detection and Online Learning for Vibration-based Terrain Classification , 2022 .

[27]  D. Pollard.  A User's Guide to Measure Theoretic Probability by David Pollard , 2001 .

[28]  Graham J. Williams,et al.  On-Line Unsupervised Outlier Detection Using Finite Mixtures with Discounting Learning Algorithms , 2000, KDD '00.

[29]  Hongbin Wang,et al.  Highly efficient incremental estimation of Gaussian mixture models for online data stream clustering , 2005, SPIE Defense + Commercial Sensing.

[30]  Bernhard Sick,et al.  Training of radial basis function classifiers with resilient propagation and variational Bayesian inference , 2009, 2009 International Joint Conference on Neural Networks.

[31]  Stefania Costantini,et al.  Learning by Knowledge Exchange in Logical Agents , 2005, WOA.

[32]  Aoying Zhou,et al.  Distributed Data Stream Clustering: A Fast EM-based Approach , 2007, 2007 IEEE 23rd International Conference on Data Engineering.

[33]  Rolf P. Würtz,et al.  Organic Computing , 2004, Informatik-Spektrum.

[34]  Sameer Singh,et al.  Novelty detection: a review - part 1: statistical approaches , 2003, Signal Process..

[35]  David Pollard,et al.  A User's Guide to Measure Theoretic Probability by David Pollard , 2001 .

[36]  Nasser M. Nasrabadi,et al.  Pattern Recognition and Machine Learning , 2006, Technometrics.

[37]  W. Eric L. Grimson,et al.  Adaptive background mixture models for real-time tracking , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).