Modeling a Student's Behavior in a Tutorial-Like System Using Learning Automata

This paper presents a new philosophy to model the behavior of a student in a tutorial- like system using learning automata (LAs). The model of the student in our system is inferred using a higher level LA, referred to as a meta-LA , which attempts to characterize the learning model of the students (or student simulators), while the latter use the tutorial-like system. The meta-LA , in turn, uses LAs as a learning mechanism to try to determine if the student in question is a fast, normal, or slow learner. The ultimate long-term goal of the exercise is the following: if the tutorial- like system can understand how the student perceives and processes knowledge, it will be able to customize the way by which it communicates the knowledge to the student to attain an optimal teaching strategy. The proposed meta-LA scheme has been tested for numerous environments, including the established benchmarks, and the results obtained are remarkable. Indeed, to the best of our knowledge, this is the first published result that infers the learning model of an LA when it is externally treated as a black box, whose outputs are the only observable quantities. Additionally, our paper represents a new class of multiautomata systems, where the meta-LA synchronously communicates with the students, also modeled using LAs. The meta-LA's environment ¿observes¿ the progress of the student LA, and the response of the latter to the meta-LA actions is based on these observations. This paper also discusses the learning system implications of such a meta-LA.

[1]  Kumpati S. Narendra,et al.  Learning automata - an introduction , 1989 .

[2]  B. John Oommen,et al.  Using learning automata to model a student-classroom interaction in a tutorial-like system , 2007, 2007 IEEE International Conference on Systems, Man and Cybernetics.

[3]  Q. H. Wu,et al.  Stochastic Optimal Control of Active Vehicle Suspensions Using Learning Automata , 1993 .

[4]  Norio Baba,et al.  An application of the stochastic automaton to the investment game , 1980 .

[5]  Cem Unsal,et al.  Multiple Stochastic Learning Automata for Vehicle Path Control in an Automated Highway System , 1999 .

[6]  Georgios I. Papadimitriou,et al.  On the use of stochastic estimator learning automata for dynamic channel allocation in broadcast networks , 2000, Proceedings of the 2000 Congress on Evolutionary Computation. CEC00 (Cat. No.00TH8512).

[7]  M. L. Tsetlin,et al.  Automaton theory and modeling of biological systems , 1973 .

[8]  Kumpati S. Narendra,et al.  Learning Automata - A Survey , 1974, IEEE Trans. Syst. Man Cybern..

[9]  Kaddour Najim,et al.  Learning automata with continuous inputs and their application for multimodal functions optimization , 1996, Int. J. Syst. Sci..

[10]  Georgios I. Papadimitriou,et al.  Learning automata-based receiver conflict avoidance algorithms for WDM broadcast-and-select star networks , 1996, TNET.

[11]  P. Mars,et al.  Games of stochastic learning automata and adaptive signal processing , 1993, IEEE Trans. Syst. Man Cybern..

[12]  Kumpati S. Narendra,et al.  Application of Learning Automata to Telephone Traffic Routing and Control , 1977, IEEE Transactions on Systems, Man, and Cybernetics.

[13]  Radboud Winkels,et al.  What's in an ITS? A Functional Decomposition , 1992 .

[14]  Joseph E. Beck.  Learning to Teach with a Reinforcement Learning Agent , 1998, AAAI/IAAI.

[15]  Timothy Gordon,et al.  Continuous learning automata and adaptive digital filter design , 1998 .

[16]  G.I. Papadimitriou,et al.  Self-adaptive TDMA protocols for WDM star networks: a learning-automata-based approach , 1999, IEEE Photonics Technology Letters.

[17]  P. S. Sastry,et al.  Varieties of learning automata: an overview , 2002, IEEE Trans. Syst. Man Cybern. Part B.

[18]  B. John Oommen,et al.  The asymptotic optimality of discretized linear reward-inaction learning automata , 1984, IEEE Transactions on Systems, Man, and Cybernetics.

[19]  B. John Oommen,et al.  Deterministic Learning Automata Solutions to the Equipartitioning Problem , 1988, IEEE Trans. Computers.

[20]  Georgios I. Papadimitriou,et al.  Learning-automata-based MAC protocols for photonic LANs , 2000, Proceedings IEEE International Conference on Networks 2000 (ICON 2000). Networking Trends and Challenges in the New Millennium.

[21]  Henry Wu.  Stochastic Optimal Control Of Vehicle Suspension Systems Using Learning Automata , 1993 .

[22]  B. John Oommen,et al.  Discretized pursuit learning automata , 1990, IEEE Trans. Syst. Man Cybern..

[23]  Kaddour Najim,et al.  Learning automata and stochastic optimization , 1997 .

[24]  Mohammad S. Obaidat,et al.  Guest editorial learning automata: theory, paradigms, and applications , 2002, IEEE Trans. Syst. Man Cybern. Part B.

[25]  Franciszek Seredynski,et al.  Distributed scheduling using simple learning machines , 1998, Eur. J. Oper. Res..

[26]  Kaddour Najim,et al.  Learning Automata: Theory and Applications , 1994 .

[27]  Naoki Abe,et al.  On the computational complexity of approximating distributions by probabilistic automata , 1990, Machine Learning.

[28]  B. John Oommen,et al.  Learning Automata Based Intelligent Tutorial-like System , 2009, KES.

[29]  B.J. Oommen,et al.  Ε-optimal Discretized Linear Reward-penalty Learning Automata , 1988, IEEE Trans. Syst. Man Cybern..

[30]  B. John Oommen,et al.  Generalized pursuit learning schemes: new families of continuous and discretized learning automata , 2002, IEEE Trans. Syst. Man Cybern. Part B.

[31]  B. John Oommen,et al.  Continuous Learning Automata Solutions to the Capacity Assignment Problem , 2000, IEEE Trans. Computers.

[32]  M. Thathachar,et al.  Networks of Learning Automata: Techniques for Online Stochastic Optimization , 2003 .

[33]  Kumpati S. Narendra,et al.  On the Behavior of a Learning Automaton in a Changing Environment with Application to Telephone Traffic Routing , 1980, IEEE Transactions on Systems, Man, and Cybernetics.

[34]  B. John Oommen,et al.  Graph Partitioning Using Learning Automata , 1996, IEEE Trans. Computers.

[35]  Kumpati S. Narendra,et al.  Learning automata approach to hierarchical multiobjective analysis , 1991, IEEE Trans. Syst. Man Cybern..

[36]  B. John Oommen,et al.  Stochastic Automata Solutions to the Object Partitioning Problem , 1991, Comput. J..

[37]  M. A. L. Thathachar,et al.  Learning Automata for Pattern Classification , 2004 .

[38]  Kenneth Basye,et al.  Inferring Finite Automata with Stochastic Output Functions and an Application to Map Learning , 2004, Machine Learning.

[39]  Petros Nicopolitidis,et al.  Self-adaptive polling protocols for wireless LANs: a learning-automata-based approach , 2001, ICECS 2001. 8th IEEE International Conference on Electronics, Circuits and Systems (Cat. No.01EX483).

[40]  E. Fischetti,et al.  From computer-aided instruction to intelligent tutoring systems , 1990 .

[41]  B. John Oommen,et al.  String taxonomy using learning automata , 1997, IEEE Trans. Syst. Man Cybern. Part B.

[42]  John Self,et al.  The defining characteristics of intelligent tutoring systems research: ITSs care, precisely , 1998 .

[43]  Raymond J. Mooney,et al.  Refinement-based student modeling and automated bug library construction , 1996 .

[44]  Hamid Beigy,et al.  Adaptation of parameters of BP algorithm using learning automata , 2000, Proceedings. Vol.1. Sixth Brazilian Symposium on Neural Networks.

[45]  B. John Oommen,et al.  Discretized estimator learning automata , 1992, IEEE Trans. Syst. Man Cybern..

[46]  Q. H. Wu.  Learning coordinated control of power systems using interconnected learning automata , 1995 .

[47]  Athena Vakali,et al.  Designing a learning-automata-based controller for client/server systems: a methodology , 2000, Proceedings 12th IEEE Internationals Conference on Tools with Artificial Intelligence. ICTAI 2000.

[48]  S. Lakshmivarahan,et al.  A learning approach to the two person decentralized team problem with incomplete information , 1981 .

[49]  B. John Oommen,et al.  Absorbing and Ergodic Discretized Two-Action Learning Automata , 1986, IEEE Trans. Syst. Man Cybern..

[50]  M. A. L. THATHACHAR,et al.  A new approach to the design of reinforcement schemes for learning automata , 1985, IEEE Transactions on Systems, Man, and Cybernetics.

[51]  Mohammad Reza Meybodi.  Learning automata and its application to priority assignment in a queueing system with unknown characteristics , 1983 .

[52]  S. Lakshmivarahan,et al.  Learning Algorithms Theory and Applications , 1981 .

[53]  Matt C. Best,et al.  On-line PID tuning for engine idle-speed control using continuous action reinforcement learning automata , 2000 .

[54]  B. John Oommen,et al.  Continuous and discretized pursuit learning schemes: various algorithms and their comparison , 2001, IEEE Trans. Syst. Man Cybern. Part B.