OBSERVER: A Probabilistic Learning System for Ordered Events

Given a sequence of observed events which are ordered with respect to time or positions and are described by the coexistence of several discrete-valued attributes that are assumed to be generated by a random process, the inductive prediction problem is to find the probabilistic patterns that characterize the random process, thereby, allowing future events to be predicted. This paper presents a probabilistic inference technique for solving such a problem. Based on it, a learning program called the OBSERVER has been implemented. The OBSERVER can learn, inductively and without supervision, even if some observed events could be erroneous, occasionally missing, or subject to certain degrees of uncertainty. It is able to reveal the patterns and regularities inherent in a sequence of observed events and can not only specify, in a clearly defined way, the happenings in the past but also gain insight for prediction. The proposed technique can be applied to solve different problems in artificial intelligence (AI) and pattern recognition (PR) where decisions concerning the future have to be made.

[1]  H. Simon,et al.  Empirical tests of a theory of human acquisition of concepts for sequential patterns , 1973 .

[2]  Andrew K. C. Wong,et al.  Synthesizing Statistical Knowledge from Incomplete Mixed-Mode Data , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Staffan Persson,et al.  Some sequence extrapolating programs : a study of representation and modeling in inquiring systems , 1968 .

[4]  Steven A. Vere,et al.  Relational Production Systems , 1977, Artificial Intelligence.

[5]  H A SIMON,et al.  HUMAN ACQUISITION OF CONCEPTS FOR SEQUENTIAL PATTERNS. , 1963, Psychological review.

[6]  Andrew K. C. Wong,et al.  Typicality, Diversity, and Feature Pattern of an Ensemble , 1975, IEEE Transactions on Computers.

[7]  Andrew K. C. Wong,et al.  Synthesizing Knowledge: A Cluster Analysis Approach Using Event Covering , 1986, IEEE Transactions on Systems, Man, and Cybernetics.

[8]  Andrew K. C. Wong,et al.  An event-covering method for effective probabilistic inference , 1987, Pattern Recognit..

[9]  Ryszard S. Michalski,et al.  Qualitative Prediction: The SPARC/G Methodology for Inductively Describing and Predicting Discrete Processes , 1986 .

[10]  Thomas G. Dietterich,et al.  Discovering Patterns in Sequences of Events , 1985, Artif. Intell..

[11]  Steven A. Vere,et al.  Induction of Relational Productions in the Presence of Background Information , 1977, IJCAI.

[12]  Richard L. Grimsdale,et al.  Experiments in machine learning and thinking , 1959, IFIP Congress.