A job scheduling approach based on a learning automaton for a distributed computing system

A stochastic learning automaton model based on relative reward strength is proposed for solving the job scheduling problem in distributed computing systems. The scheduling approach belongs to the category of distributed algorithms. An automaton scheduler is used for each local host in the computer network to make the decision whether to accept the incoming job or transfer it to another server. The learning scheme proposed makes use of the most recent reward to each action provided by the environment. This feature means that the automaton has the capability to handle a class of uncertainty such as workload variation or incomplete system state information. Simulation results demonstrate that the performance of the proposed scheduling approach is not degraded in the case of a change in workload and is better than the approaches of Fixed Scheduling Discipline and Joining the Shortest Queue under incomplete system information.

[1]  Shmuel Katz,et al.  Cooperative Distributed Algorithms for Dynamic Cycle Prevention , 1987, IEEE Transactions on Software Engineering.

[2]  B.J. Oommen,et al.  Ε-optimal Discretized Linear Reward-penalty Learning Automata , 1988, IEEE Trans. Syst. Man Cybern..

[3]  L. Mason,et al.  An optimal learning algorithm for S-model environments , 1973 .

[4]  Ravi Mirchandaney,et al.  Using Stochastic Learning Automata for Job Scheduling in Distributed Processing Systems , 1986, J. Parallel Distributed Comput..

[5]  Kumpati S. Narendra,et al.  The use of learning algorithms in telephone traffic routing - A methodology , 1983, Autom..

[6]  Hany H. Ammar Performance models of parallel and distributed processing systems (abstract) , 1986, CSC '86.

[7]  B. Chandrasekaran,et al.  Stochastic Automata Games , 1969, IEEE Trans. Syst. Sci. Cybern..

[8]  Kumpati S. Narendra,et al.  Application of Learning Automata to Telephone Traffic Routing and Control , 1977, IEEE Transactions on Systems, Man, and Cybernetics.

[9]  Maged Dessouky,et al.  A case study in parallel unrelated machine scheduling: A heuristic approach , 1987 .

[10]  Flavio Bonomi,et al.  On Job Assignment for a Parallel System of Processor Sharing Queues , 1990, IEEE Trans. Computers.

[11]  RAHUL SIMHA,et al.  Relative reward strength algorithms for learning automata , 1989, IEEE Trans. Syst. Man Cybern..

[12]  MITSUO SATO,et al.  Learning control of finite Markov chains with an explicit trade-off between estimation and control , 1988, IEEE Trans. Syst. Man Cybern..

[13]  Robert M. Glorioso Engineering Intelligent Systems , 1980 .

[14]  M. A. L. THATHACHAR,et al.  A new approach to the design of reinforcement schemes for learning automata , 1985, IEEE Transactions on Systems, Man, and Cybernetics.

[15]  Kumpati S. Narendra,et al.  Learning Automata - A Survey , 1974, IEEE Trans. Syst. Man Cybern..