A service analytic approach to studying patient no-shows

Patients who fail to show up for an appointment are a major challenge to medical providers. Understanding no-shows and predicting them are keys to developing a proactive strategy in healthcare operations. In this study, we propose a data analytics framework to explore the underlying factors of no-shows via various machine learning models to predict whether a patient is a no-show. The analytics results reveal key patterns in no-show patients. We also propose a methodology to integrate the prediction model with a Bayesian inference system to create an overbooking decision support tool that allows variable overbooking rates in different time windows.

[1]  Ramesh Sharda,et al.  Predicting box-office success of motion pictures with neural networks , 2006 .

[2]  Amir Ahmadi-Javid,et al.  Outpatient appointment systems in healthcare: A review of optimization studies , 2017, Eur. J. Oper. Res..

[3]  Ron Kohavi,et al.  A Study of Cross-Validation and Bootstrap for Accuracy Estimation and Model Selection , 1995, IJCAI.

[4]  M. M. Malik,et al.  Data mining and predictive analytics applications for the delivery of healthcare services: a systematic literature review , 2016, Annals of Operations Research.

[5]  Audrey Paulman,et al.  Why We Don’t Come: Patient Perceptions on No-Shows , 2004, The Annals of Family Medicine.

[6]  Michael J. Pazzani,et al.  Reducing Misclassification Costs , 1994, ICML.

[7]  Vidyadhar G. Kulkarni,et al.  Appointment Scheduling Under Patient No-Shows and Service Interruptions , 2012, Manuf. Serv. Oper. Manag..

[8]  Dursun Delen,et al.  Analysis of cancer data: a data mining approach , 2009, Expert Syst. J. Knowl. Eng..

[9]  Michele Samorani,et al.  Outpatient Appointment Scheduling Given Individual Day-Dependent No-Show Predictions , 2013 .

[10]  Andreas Graefe,et al.  Combining Forecasts: An Application to Elections , 2013 .

[11]  Nan Liu,et al.  Appointment Scheduling Under Patient Preference and No-Show Behavior , 2014, Oper. Res..

[12]  Chelliah Sriskandarajah,et al.  Outpatient Appointment Scheduling Under Patient Heterogeneity and Patient No-Shows , 2015 .

[13]  Jose C. Principe,et al.  Neural and adaptive systems : fundamentals through simulations , 2000 .

[14]  Nitesh V. Chawla,et al.  Data Mining for Imbalanced Datasets: An Overview , 2005, The Data Mining and Knowledge Discovery Handbook.

[15]  Paul R. Harper,et al.  Reduced outpatient waiting times with improved appointment scheduling: a simulation modelling approach , 2003, OR Spectr..

[16]  Karolina J. Glowacka,et al.  A hybrid data mining/simulation approach for modelling outpatient no-shows in clinic scheduling , 2009, J. Oper. Res. Soc..

[17]  C. Kistler,et al.  Getting patients in the door: medical appointment reminder preferences , 2016, Patient preference and adherence.

[18]  Nan Liu.  Optimal choice for appointment scheduling window under patient no-show behavior , 2016 .

[19]  Soo-Yeol Kim.  Predicting hospitality financial distress with ensemble models: the case of US hotels, restaurants, and amusement and recreation , 2018 .

[20]  Ana S. Camanho,et al.  Predicting direct marketing response in banking: comparison of class imbalance methods , 2017 .

[21]  David L. Olson,et al.  A support vector machine (SVM) approach to imbalanced datasets of customer responses: comparison with other customer response models , 2012, Service Business.

[22]  Andrew P. Bradley,et al.  The use of the area under the ROC curve in the evaluation of machine learning algorithms , 1997, Pattern Recognit..

[23]  M. Wieland,et al.  Missed appointments in resident continuity clinic: patient characteristics and health care outcomes. , 2011, Journal of graduate medical education.

[24]  André Berchtold,et al.  Missed appointments in an outpatient clinic for adolescents, an approach to predict the risk of missing. , 2008, The Journal of adolescent health : official publication of the Society for Adolescent Medicine.

[25]  Refael Hassin,et al.  Scheduling Arrivals to Queues: A Single-Server Model with No-Shows , 2008, Manag. Sci..

[26]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[27]  Xin Yao,et al.  MWMOTE--Majority Weighted Minority Oversampling Technique for Imbalanced Data Set Learning , 2014 .

[28]  Tony R. Martinez,et al.  Distribution-balanced stratified cross-validation for accuracy estimation , 2000, J. Exp. Theor. Artif. Intell..

[29]  A. Sharafkhaneh,et al.  Prevalence, predictors and economic consequences of no-shows , 2015, BMC Health Services Research.

[30]  Alan C. Wilson,et al.  The effectiveness of outpatient appointment reminder systems in reducing no-show rates. , 2010, The American journal of medicine.

[31]  J. Gaspoz,et al.  Reduction of missed appointments at an urban primary care clinic: a randomised controlled study , 2010, BMC family practice.

[32]  Michael R Kramer,et al.  A Profile of Patients Who Fail to Keep Appointments in a Veterans Affairs Primary Care Clinic. , 2016, WMJ : official publication of the State Medical Society of Wisconsin.

[33]  Jerrold H. May,et al.  Large-Scale No-Show Patterns and Distributions for Clinic Operational Research , 2016, Healthcare.

[34]  Haibo He,et al.  ADASYN: Adaptive synthetic sampling approach for imbalanced learning , 2008, 2008 IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence).

[35]  Ben Torsney,et al.  SMS Reminders in the UK National Health Service: An Evaluation of Its Impact on "No-Shows" at Hospital Out-Patient Clinics , 2006, Health care management review.

[36]  Missed appointments at public hospitals in Riyadh, Saudi Arabia. , 2002, Saudi medical journal.

[37]  Erkam Güresen,et al.  Developing an early warning system to predict currency crises , 2014, Eur. J. Oper. Res..

[38]  Y. Huang,et al.  Dynamic overbooking scheduling system to improve patient access , 2012, J. Oper. Res. Soc..

[39]  Vojislav Kecman,et al.  Learning and Soft Computing: Support Vector Machines, Neural Networks, and Fuzzy Logic Models , 2001 .

[40]  Alexander L. Wolf,et al.  A conceptual basis for feature engineering , 1999, J. Syst. Softw..

[41]  Raquel Florez-Lopez,et al.  Modelling of insurers’ rating determinants. An application of machine learning techniques and statistical models , 2007 .

[42]  Herbert Moskowitz,et al.  Modeling and optimizing a vendor managed replenishment system using machine learning and genetic algorithms , 2007, Eur. J. Oper. Res..

[43]  Dimitris Kanellopoulos,et al.  Handling imbalanced datasets: A review , 2006 .

[44]  Mehmet Bayram Yildirim,et al.  Predicting pediatric clinic no-shows: a decision analytic framework using elastic net and Bayesian belief network , 2018, Ann. Oper. Res..

[45]  Nan Liu,et al.  Panel Size and Overbooking Decisions for Appointment-Based Services under Patient No-Shows , 2014 .

[46]  Hongnian Yu,et al.  A combination selection algorithm on forecasting , 2014, Eur. J. Oper. Res..

[47]  Y. Huang,et al.  Effective cancellation policy to reduce the negative impact of patient no-show , 2014, J. Oper. Res. Soc..

[48]  D. Shepard,et al.  Mailed versus telephoned appointment reminders to reduce broken appointments in a hospital outpatient department. , 1976, Medical care.

[49]  Fabio H. Nieto,et al.  A note on linear combination of predictors , 2000 .

[50]  Kum Khiong Yang,et al.  A universal appointment rule in the presence of no-shows and walk-ins , 2012 .

[51]  Nitesh V. Chawla,et al.  SMOTE: Synthetic Minority Over-sampling Technique , 2002, J. Artif. Intell. Res..

[52]  S. N. Sivanandam,et al.  Introduction to Data Mining and its Applications , 2006, Studies in Computational Intelligence.

[53]  R. Clemen.  Combining forecasts: A review and annotated bibliography , 1989 .

[54]  Yen-Chun Chou,et al.  A predictive investigation of first-time customer retention in online reservation services , 2018 .

[55]  V. Pesata,et al.  A descriptive study of missed appointments: families' perceptions of barriers to care. , 1999, Journal of pediatric health care : official publication of National Association of Pediatric Nurse Associates & Practitioners.

[56]  Gongping Yang,et al.  On the Class Imbalance Problem , 2008, 2008 Fourth International Conference on Natural Computation.

[57]  V Allgar,et al.  Missed appointments in general practice: retrospective data analysis from four practices. , 2001, The British journal of general practice : the journal of the Royal College of General Practitioners.

[58]  R A Deyo,et al.  Dropouts and broken appointments. A literature review and agenda for future research. , 1980, Medical care.

[59]  Jerrold H. May,et al.  Evaluating and Tuning Predictive Data Mining Models Using Receiver Operating Characteristic Curves , 2004, J. Manag. Inf. Syst..

[60]  Michael Pinedo,et al.  Appointment scheduling with no-shows and overbooking , 2014 .

[61]  Yu-Li Huang,et al.  A cost-effective urgent care policy to improve patient access in a dynamic scheduled clinic setting , 2014, J. Oper. Res. Soc..

[62]  Richard D Neal,et al.  Reasons for and consequences of missed appointments in general practice in the UK: questionnaire survey and prospective review of medical records , 2005, BMC family practice.

[63]  Joanne K. Daggy,et al.  Using no-show modeling to improve clinic performance , 2010, Health Informatics J..

[64]  Herbert Moskowitz,et al.  An empirical investigation into factors affecting patient cancellations and no-shows at outpatient clinics , 2014, Decis. Support Syst..

[65]  Nan Liu,et al.  Dynamic Scheduling of Outpatient Appointments Under Patient No-Shows and Cancellations , 2010, Manuf. Serv. Oper. Manag..

[66]  Sotiris B. Kotsiantis,et al.  Supervised Machine Learning: A Review of Classification Techniques , 2007, Informatica.