Identification of Discrete Event Systems Using the Compound Recurrent Neural Network: Extracting DEVS from Trained Network

The authors consider identifying an unknown discrete event system (DES) as recognition of characteristic functions of a discrete event systems specification (DEVS) model that validly represents the system. Such identification consists of two major steps: behavior learning using a specially designed neural network and extraction of a DEVS model from the learned neural network. This paper presents a method for extracting a DEVS model from one such neural network called CRNN (compound recurrent neural network), which is trained using observed input/output events of an unknown DES. The DES to be identified is restricted to a subclass of DES in which any unknown state can be determined by a finite number of input/output sequences. Identification experiments were performed with three types of unknown DESs, the result of which verified the validity of the proposed model extraction method.

[1]  C. Lee Giles,et al.  Extraction, Insertion and Refinement of Symbolic Rules in Dynamically Driven Recurrent Neural Networks , 1993 .

[2]  Claude Baron,et al.  Improved functional identification using genetic simulation , 2000 .

[3]  Raymond L. Watrous,et al.  Induction of Finite-State Languages Using Second-Order Recurrent Networks , 1992, Neural Computation.

[4]  C. Lee Giles,et al.  Experimental Comparison of the Effect of Order in Recurrent Neural Networks , 1993, Int. J. Pattern Recognit. Artif. Intell..

[5]  송해상,et al.  (A) DEVS framework for analysis and design of discrete event systems control = DEVS 형식론에 기반한 이산사건 시스템 제어의 해석 및 설계 , 2000 .

[6]  C. Lee Giles,et al.  Learning a class of large finite state machines with a recurrent neural network , 1995, Neural Networks.

[7]  Hava T. Siegelmann,et al.  Computational capabilities of recurrent NARX neural networks , 1997, IEEE Trans. Syst. Man Cybern. Part B.

[8]  W. Wonham,et al.  Supervisory control of timed discrete-event systems , 1994, IEEE Trans. Autom. Control..

[9]  Les E. Atlas,et al.  Recurrent neural networks and robust time series prediction , 1994, IEEE Trans. Neural Networks.

[10]  P J Webros.  BACKPROPAGATION THROUGH TIME: WHAT IT DOES AND HOW TO DO IT , 1990 .

[11]  O. L. R. Jacobs,et al.  Trends and progress in system identification , 1982, Autom..

[12]  C. Leake.  Synchronization and Linearity: An Algebra for Discrete Event Systems , 1994 .

[13]  Jeffrey D. Ullman,et al.  Introduction to Automata Theory, Languages and Computation , 1979 .

[14]  Kumpati S. Narendra,et al.  Identification and control of dynamical systems using neural networks , 1990, IEEE Trans. Neural Networks.

[15]  J. Taylor,et al.  Switching and finite automata theory, 2nd ed. , 1980, Proceedings of the IEEE.

[16]  Carl H. Smith,et al.  Inductive Inference: Theory and Methods , 1983, CSUR.

[17]  Bernard P. Zeigler,et al.  Multifacetted Modelling and Discrete Event Simulation , 1984 .

[18]  C. Lee Giles,et al.  Learning and Extracting Finite State Automata with Second-Order Recurrent Neural Networks , 1992, Neural Computation.