Approximate dynamic programming techniques for skill-based routing in call centers*

We consider the problem of dynamic multi-skill routing in call centers. Calls from different customer classes are offered to the call center according to a Poisson process. The agents are grouped into pools according to their heterogeneous skill sets that determine the calls that they can handle. Each pool of agents serves calls with independent exponentially distributed service times. Arriving calls that cannot be served directly are placed in a buffer that is dedicated to the customer class. We obtain nearly optimal dynamic routing policies that are scalable with the problem instance and can be computed online. The algorithm is based on approximate dynamic programming techniques. In particular, we perform one-step policy improvement using a polynomial approximation to relative value functions. We compare the performance of this method with decomposition techniques. Numerical experiments demonstrate that our method outperforms leading routing policies and has close to optimal performance.

[1]  Itay Gurvich,et al.  Service-Level Differentiation in Call Centers with Fully Flexible Servers , 2008, Manag. Sci..

[2]  Robert A. Shumsky Approximation and Analysis of a Queueing System with Flexible and Specialized Servers , 1999 .

[3]  Sandjai Bhulai Markov Decision Processes , 2002 .

[4]  G. M. Jenkins,et al.  Stochastic Service Systems. , 1964 .

[5]  Ger Koole,et al.  Approximating multi-skill blocking systems by HyperExponential Decomposition , 2006, Perform. Evaluation.

[6]  Martin L. Puterman,et al.  Markov Decision Processes: Discrete Stochastic Dynamic Programming , 1994 .

[7]  Ren Asmussen,et al.  Fitting Phase-type Distributions via the EM Algorithm , 1996 .

[8]  Sandjai Bhulai Dynamic routing policies for multiskill call centers , 2009 .

[9]  G. Koole,et al.  Routing heuristics for multi-skill call centers , 2003, Proceedings of the 2003 Winter Simulation Conference, 2003..

[10]  Avishai Mandelbaum,et al.  Telephone Call Centers: Tutorial, Review, and Research Prospects , 2003, Manuf. Serv. Oper. Manag..

[11]  Noah Gans,et al.  A Call-Routing Problem with Service-Level Constraints , 2003, Oper. Res..

[12]  Avishai Mandelbaum,et al.  Queueing Models of Call Centers: An Introduction , 2002, Ann. Oper. Res..

[13]  Sandjai Bhulai,et al.  A queueing model for call blending in call centers , 2003, IEEE Trans. Autom. Control..

[14]  G. Koole,et al.  An Overview of Routing and Staffing Algorithms in Multi-Skill Customer Contact Centers , 2006 .

[15]  Antonis Economou,et al.  q-SERIES IN MARKOV CHAINS WITH BINOMIAL TRANSITIONS , 2008, Probability in the Engineering and Informational Sciences.

[16]  Ward Whitt,et al.  A Staffing Algorithm for Call Centers with Skill-Based Routing , 2005, Manuf. Serv. Oper. Manag..

[17]  D. McDonald,et al.  Analysis of Communication Networks: Call Centres, Traffic and Performance , 2000 .