Optimal dispatching control for elevator systems during uppeak traffic

In this paper we develop optimal dispatching controllers for elevator systems during uppeak traffic. An uppeak traffic period arises when the bulk of the passenger traffic is moving from the first door up into the building (e.g., the start of a business day in an office building). The cars deliver the passengers and then return empty to the first floor to pick up more passengers. We show that the structure of the optimal dispatching policy minimizing the discounted or average passenger waiting time is a threshold-based policy. That is, the optimal policy is to dispatch an available car from the first floor when the number of passengers inside the car reaches or exceeds a threshold that depends on several factors including the passenger arrival rate, elevator performance capabilities, and the number of elevators available at the first floor. Since most elevator systems have sensors to determine the car locations and the number of passengers in each car, such a threshold policy is easily implemented. Our analysis is based on a Markov decision problem formulation with a batch service queueing model consisting of a single queue served by multiple finite-capacity bulk servers. We use dynamic programming techniques to obtain the structure of the optimal control policy and to derive some of its important properties. Several numerical examples are included to illustrate our results and to compare the optimal threshold policy to some known ad hoc approaches. Finally, since many transportation systems can be modeled as multiserver batch service queueing systems, we expect our results to be useful in controlling those systems as well.

[1]  R. Serfozo,et al.  Optimal control of batch service queues , 1973, Advances in Applied Probability.

[2]  M. Yadin,et al.  Optimal control of elevators , 1977 .

[3]  Bruce A. Powell,et al.  Real time simulation of elevators , 1978, WSC '78.

[4]  C. J. Harris,et al.  Multi-car lift system analysis and design , 1979 .

[5]  Jan Telgen,et al.  Stochastic Dynamic Programming , 2016 .

[6]  George R. Strakosch,et al.  Vertical Transportation: Elevators and Escalators , 1983 .

[7]  G. C. Barney,et al.  Elevator traffic analysis, design and control , 1985 .

[8]  Guy Pujolle,et al.  Introduction to queueing networks , 1987 .

[9]  Dimitri P. Bertsekas,et al.  Dynamic Programming: Deterministic and Stochastic Models , 1987 .

[10]  J. Ben Atkinson,et al.  An Introduction to Queueing Networks , 1988 .

[11]  J. Gaspard Deterministic and Stochastic Models , 1991 .

[12]  S. Tsuji,et al.  Application of the expert system to elevator group-supervisory control , 1989, [1989] Proceedings. The Fifth Conference on Artificial Intelligence Applications.

[13]  C. Watkins Learning from delayed rewards , 1989 .

[14]  N. Kameli,et al.  Intelligent elevator dispatching systems , 1989 .

[15]  Xi-Ren Cao,et al.  Perturbation analysis of discrete event dynamic systems , 1991 .

[16]  James Alan Lewis,et al.  A dynamic load balancing approach to the control of multi-server polling systems with applications to elevator system dispatching , 1992 .

[17]  Marja-Liisa Siikonen,et al.  Elevator Traffic Simulation , 1993, Simul..

[18]  Edwin K. P. Chong,et al.  Discrete event systems: Modeling and performance analysis , 1994, Discret. Event Dyn. Syst..

[19]  Andrew G. Barto,et al.  Improving Elevator Performance Using Reinforcement Learning , 1995, NIPS.

[20]  Hyung Lee-Kwang,et al.  A fuzzy approach to elevator group control system , 1995, IEEE Trans. Syst. Man Cybern..

[21]  Christos G. Cassandras,et al.  Application of Q-learning to elevator dispatcidng , 1996 .

[22]  Christos G. Cassandras,et al.  Optimal control of polling models for transportation applications , 1996 .