Evaluating multiple performance measures across several dimensions at a multi-facility outpatient center

Over the past several decades healthcare delivery systems have received increased pressure to become more efficient from both a managerial and patient perspective. Many researchers have turned to simulation to analyze the complex systems that exist within hospitals, but surprisingly few have published guidelines on how to analyze models with multiple performance measures. Moreover, the published literature has failed to address ways of analyzing performance along more than one dimension, such as performance by day of the week, patient type, facility, time period, or some combination of these attributes. Despite this void in the literature, understanding performance along these dimensions is critical to understanding the root of operational problems in almost any daily clinic operation. This paper addresses the problem of multiple responses in simulation experiments of outpatient clinics by developing a stratification framework and an evaluation construct by which managers can compare several operationally different outpatient systems across multiple performance measure dimensions. This approach is applied to a discrete-event simulation model of a real-life, large-scale oncology center to evaluate its operational performance as improvement initiatives affecting scheduling practices, process flow, and resource levels are changed. Our results show a reduction in patient wait time and resource overtime across multiple patient classes, facilities, and days of the week. This research has already proven to be successful as certain recommendations have been implemented and have improved the system-wide performance at the oncology center.

[1]  Norman T. J. Bailey,et al.  A Note on Equalising the Mean Waiting Times of Successive Customers in a Finite Queue , 1955 .

[2]  A. Soriano,et al.  Comparison of Two Scheduling Systems , 1966, Oper. Res..

[3]  Edward R. Clayton,et al.  A Goal Programming Approach to the Optimization of Multi response Simulation Models , 1982 .

[4]  Douglas C. Montgomery,et al.  Multiple response surface methods in computer simulation , 1977 .

[5]  M. Pike,et al.  Appointment Systems in Out-patients?? Clinics and the Effect of Patients?? Unpunctuality , 1964 .

[6]  G. V. Sarma,et al.  Out-patient Queues at the Ibn-Rochd Health Centre , 1991 .

[7]  Mark W. Isken,et al.  Simulating outpatient obstetrical clinics , 1999, WSC '99.

[8]  Loren Paul Rees,et al.  Solving Multiple Response Simulation Models Using Modified Response Surface Methodology Within A Lexicographic Goal Programming Framework , 1985 .

[9]  Stephen D. Roberts,et al.  Applications of computer simulation in health care , 1978, WSC '78.

[10]  José A. Sepúlveda,et al.  Multi-objective simulation optimization for a cancer treatment center , 2001, Proceeding of the 2001 Winter Simulation Conference (Cat. No.01CH37304).

[11]  R. Fetter,et al.  Patients' waiting time and doctors' idle time in the outpatient setting. , 1966, Health services research.

[12]  L. LeBlanc,et al.  Modeling emergency department operations using advanced computer simulation systems. , 1989, Annals of emergency medicine.

[13]  Salah E. Elmaghraby,et al.  An empirical and theoretical study of outpatient scheduling problems employing simulation and genetic algorithm methodologies , 2004 .

[14]  S. Jacobson,et al.  Evaluating the Design of a Family Practice Healthcare Clinic Using Discrete-Event Simulation , 2002, Health care management science.

[15]  James J. Swain,et al.  Mathematical programming and the optimization of computer simulations , 1979 .

[16]  Brian Lehaney,et al.  A case of an intervention in an outpatients department , 1999, J. Oper. Res. Soc..

[17]  A. Wilt,et al.  Health care case study: simulating staffing needs and work flow in an outpatient diagnostic center , 1989 .

[18]  Emre A. Veral,et al.  Designing appointment scheduling systems for ambulatory care services , 2006, Health care management science.

[19]  S Vemuri,et al.  Simulated analysis of patient waiting time in an outpatient pharmacy. , 1984, American journal of hospital pharmacy.

[20]  Brant E. Fries,et al.  Determination of Optimal Variable-Sized Multiple-Block Appointment Systems , 1981, Oper. Res..

[21]  N. Bailey A Study of Queues and Appointment Systems in Hospital Out‐Patient Departments, with Special Reference to Waiting‐Times , 1952 .

[22]  Sheldon Howard Jacobson,et al.  Application of discrete-event simulation in health care clinics: A survey , 1999, J. Oper. Res. Soc..

[23]  Hon-Shiang Lau,et al.  Minimizing total cost in scheduling outpatient appointments , 1992 .

[24]  Edward J. Rising,et al.  A Systems Analysis of a University-Health-Service Outpatient Clinic , 1973, Oper. Res..

[25]  R. Hall Patient flow : reducing delay in healthcare delivery , 2006 .

[26]  Linda Weiser Friedman,et al.  The analysis of multiple response simulation output data: Experiments of comparison , 1986, Comput. Oper. Res..